Instructor: Alexey Grigorev
Note: You don't have to rent an instance in the cloud. You can follow the same instructions for setting up your local environment.
Code:
Recommended development environment: Linux
wget https://repo.anaconda.com/archive/Anaconda3-2022.05-Linux-x86_64.shsudo apt updatesudo apt install docker.io4.1 Install docker-compose in a separate directory
mkdir soft
cd soft4.2 To get the latest release of Docker Compose, go to https://github.com/docker/compose and download the release for your OS.
wget https://github.com/docker/compose/releases/download/v2.5.0/docker-compose-linux-x86_64 -O docker-compose4.3 Make it executable
chmod +x docker-compose4.4 Add to path
nano .bashrcIn .bashrc, add:
export PATH="${HOME}/soft:${PATH}"Run
source .bashrcsudo groupadd docker
sudo usermod -aG docker $USERdocker run hello-worldNote: The NYC taxi data is now in parquet format, not CSV. Here's a video that explains how to read parquet data.
Links:
Links:
More information here: homework.md
Did you take notes? Add them here:
- Environment Setup, Ayoub
- Week 1 Notes: Intro & Environment Setup
- Send a PR, add your notes above this line