Deep Learning Tutorial 2019 installations
Instructions
Participants MUST complete the 3 following instructions before the tutorial kick off date:
- Installations
- Download resources
- Configurations
Installations
There are 2 options:
- Using personal computer (alternative)
- Using Google Colab (preferred choice)
NB: Colab is the preference for this tutorial (at least after Tutorial 2) due to the need of a powerful GPU.
Nevertheless, participants are encouraged to do the installations on their personal computers in the case of unavailability/downtime of Google Colab for all users at the same time.
Using personal computer
A. Download and install Anaconda
- Download and install Anaconda depending on your OS from https://www.anaconda.com/distribution/#download-section (choose Python 3.6 version)
B. Create virtual environment
We will use the name `dsai` for this purpose (if you choose a different name, endeavour to be consistent):
- conda create --name dsai
- source activate dsai
C. Install packages
Install PyTorch and Tensorflow packages. Depending on your system, you can install either the cpu or gpu version. Do not install both:
- conda install pytorch torchvision cpuonly -c pytorch # for cpu; if you don't have gpu
- conda install -c aaronzs tensorflow=1.10
Or;
- conda install pytorch torchvision cudatoolkit=9.2 -c pytorch # for gpu with cuda 9.2
- conda install -c aaronzs tensorflow-gpu=1.10
Install python libraries:
- conda install numpy matplotlib
- pip install torchsummary
- conda install -c anaconda scipy==1.1.0
- conda install -c conda-forge opencv tqdm keras
- conda install -c anaconda pillow
- conda install -c anaconda scikit-learn
- conda install -c anaconda scikit-image
- pip install comet_ml
For editor, install either jupyter notebook or jupyter lab:
- conda install -c anaconda jupyter
Or;
- conda install -c conda-forge jupyterlab
For visualization: install any web browser (e.g.: Google chrome, Mozilla Firefox, Microsoft Edge, Apple Safari, etc.,)
Downloads
There are 3 resources to download:
- Codes
- Models
- Dataset
A. Codes
- wget --content-disposition "https://seafile.unistra.fr/f/edda24980da54200af52/?dl=1"
- unzip dsai_dl_tutorial.zip
- cd dsai_dl_tutorial
B. Models
Navigate to the model directory and run the download.sh bash file::
- cd models
- chmod +x download.sh
- ./download.sh
C. Dataset
Navigate to the dataset directory and run the download.sh bash file::
- cd ../datasets
- chmod +x download.sh
- ./download.sh
D. Slides
Download the presentation slides::
- wget --content-disposition "https://seafile.unistra.fr/d/9e379d8b3a3949f6b2bb/"
Using Google Colab (alternative)
Colab is the preference for this tutorial (at least after Tutorial 2) due to the need of a powerful GPU
- Please make sure you have a working Gmail account with atleast 3GB of free space on your Google Drive.
- Download this zip folder
- Follow instructions A,B & C above to download the models and datasets.
- Unzip and upload both downloads and models to your Google drive.
- Note the path and update it on the notebook according to instructions provided by the instructor on the tutorial day.
Configurations
Run check_packages.py to see any missing package. See the output and install any missing packages:
- python check_packages.py
Run either jupyter notebook or jupyter lab to view/run the tutorial notebooks
- jupyter notebook
Or,
- jupyter lab
If you completed up to this step, you are ready!
Check that your tutorial organisation is in this hierarchical order:
├── 01_introduction_to_dl_concepts
│ └── README.md
├── 02_a_primer_on_python
│ └── README.md
├── 03_introduction_to_pytorch
│ ├── p01_pytorch-tensors.ipynb => Introduction to PyTorch tensors + autograd.
│ ├── p02_pytorch_dataloaders.ipynb => Introduction to PyTorch dataloaders.
│ ├── p03_pytorch_model_training.ipynb => Training a state-of-the-art model in PyTorch.
│ ├── p05_extra_pytorch_mnist_training.ipynb => A bonus program to train a a simple CNN on the mnist dataset.
│ ├── p05_extra_pytorch_mnist_inference_live.py => Bonus program to use the model trained above for live inference on the webcam stream.
│ └── utils
│ ├── hicoDataset.py => Custom data-loader class for hico-Det dataset
├── 04_introduction_to_tensorflow
│ └── README.md
├── 05_a_dl_application
│ └── ckpt => Training weight and summary repository
│ └── model => DL model classes
│ └── output => Collection of outputs
│ └── inference*.ipynb
│ └── finetune*.ipynb
│ └── README.md
├── 06_generating_images_with_gans
│ ├── README.md
│ ├── Part A - GAN_image_generation.ipynb => Using GANs to generate images from noise.
│ └── Part B - GAN_syle_transfer.ipynb => Using GANs to transfer image style from one image to another.