Deep Learning Tutorial 2019 installations

Instructions

---

Participants MUST complete the 3 following instructions before the tutorial kick off date:

• Installations
• Download resources
• Configurations

---

Installations

---

There are 2 options:

1. Using personal computer
2. Using Google Colab (alternative)

Using personal computer

A. Download and install Anaconda

1. Download and install Anaconda depending on your OS from https://www.anaconda.com/distribution/#download-section (chhose Python 3.7 version)

B. Create virtual environment

We will use the name `dsai` for thi purpose (if you choose a different name, endeavour to be consistent):

1. conda create --name dsai
2. source activate dsai

C. Install packages

Install PyTorch and Tensorflow packages. Depending on your system, you can install either the cpu or gpu version. Do not install both:

1. conda install pytorch torchvision cpuonly -c pytorch # for cpu; if you don't have gpu
2. conda install -c aaronzs tensorflow=1.10

Or;

1. conda install pytorch torchvision cudatoolkit=9.2 -c pytorch # for gpu with cuda 9.2
2. conda install -c aaronzs tensorflow-gpu=1.10

Install python libraries:

1. conda install numpy matplotlib
2. pip install torchsummary
3. conda install -c anaconda scipy==1.1.0
4. conda install -c conda-forge opencv tqdm keras
5. conda install -c anaconda opencv3
6. conda install -c anaconda matplotlib
7. conda install -c anaconda pillow
8. conda install -c anaconda scikit-learn
9. conda install -c anaconda scikit-image
10. conda install -c anaconda argparse

For editor, install either jupyter notebook or jupyter lab:

• conda install -c anaconda jupyter

Or;

• conda install -c conda-forge jupyterlab

Using Google Colab (alternative)

Colab is the preference for this tutorial (at least after Tutorial 2) due to the need of a powerful GPU Navigate to the dataset directory and run the download.sh bash file::

• We will share google drive link shortly containing notebooks which you can directly open in the colab.
• You must have a working Google account.
• You must have at least 3GB free space on your Google Drive.
• Further instructions will communicated on the D-day.

---

For visualization: install any web browser (e.g.: Google chrome, Mozilla Firefox, Microsoft Edge, Apple Safari, etc.,)

Downloads

---

There are 3 resources to download:

• Codes
• Models
• Dataset

---

A. Codes

clone the git repository::

1. wget --content-disposition "link to be updated"
2. unzip code-repo-dsai
3. cd code-repo-dsai

B. Models

Navigate to the model directory and run the download.sh bash file::

1. cd models
2. chmod +x download.sh
3. ./download.sh

B. Dataset

Navigate to the dataset directory and run the download.sh bash file::

1. cd ../dataset
2. chmod +x download.sh
3. ./download.sh

Configurations

---

Ensure every installation is completed successfully and every resources downloaded to their appropriate directory:: Execute check_packages.sh to see any missing package:

1. cd ..
2. chmod +x check_packages.sh
3. ./check_packages.sh

Or run:

1. python check_packages.py

See the output of the bash file to install missing packages.

Run either jupyter notebook or jupyter lab to view/run the tutorial notebooks

• jupyter notebook

Or,

• jupyter lab

If you completed up to this step, you are ready!

Check that your tutorial organisation is in this hierarchical order:

├── 01_introduction_to_dl_concepts
│   └── README.md
├── 02_a_primer_on_python
│   └── README.md
├── 03_introduction_to_pytorch
│   ├── p01_pytorch-tensors.ipynb => Introduction to PyTorch tensors + autograd.
│   ├── p02_pytorch_dataloaders.ipynb => Introduction to PyTorch dataloaders.
│   ├── p03_pytorch_model_training.ipynb => Training a state-of-the-art model in PyTorch.
│   ├── p05_extra_pytorch_mnist_training.ipynb => A bonus program to train a a simple CNN on the mnist dataset.
│   ├── p05_extra_pytorch_mnist_inference_live.py => Bonus program to use the model trained above for live inference on the webcam stream.
│   └── utils
│   ├── hicoDataset.py => Custom data-loader class for hico-Det dataset
├── 04_introduction_to_tensorflow
│   └── README.md
├── 05_a_dl_application
│   └── ckpt => Weight management class
│   └── dataset => Dataset management class
│   └── model => DL model classes
│   └── output => Collection of outputs
│   └── inference*.ipynb
│   └── finetune*.ipynb
│   └── README.md
├── 06_generating_images_with_gans
│   ├── README.md
│   ├── Part A - GAN_image_generation.ipynb => Using GANs to generate images from noise.
│   └── Part B - GAN_syle_transfer.ipynb => Using GANs to transfer image style from one image to another.