Prerequisites
Books
- Deep Learning, Vol. 1: From Basics to Practice (2018) by Andrew Glassner (website, @Twitter)
- Deep Learning, Vol. 2: From Basics to Practice (2018) by Andrew Glassner (website, @Twitter)
- Deep Learning (2016) by Ian Goodfellow, Yoshua Bengio, Aaron Courville (website)
See Also
- Arto's Deep Learning bookshelf
- Artificial Neural Networks and Deep Learning community bookshelf.
Courses
People
- Geoffrey Hinton, University of Toronto (home page)
- Yann LeCun, Director of AI Research at Facebook (home page)
- Yoshua Bengio, Université de Montréal (home page)
Software
Frameworks
- TensorFlow (C++, Python) and Keras
- PyTorch (Python)
- Torch7 (Lua)
Hardware
GPUs
- Recommended: NVIDIA GTX 1080 Ti, GTX 1080, GTX 1070
- On a small budget: NVIDIA GTX 1060 (6 GB)
- On a tiny budget: NVIDIA GTX 1050 Ti (4 GB)
Sources:
- http://timdettmers.com/2017/04/09/which-gpu-for-deep-learning/
- https://www.oreilly.com/learning/build-a-super-fast-deep-learning-machine-for-under-1000
- https://jeffxtang.github.io/deep/learning,/hardware,/gpu,/performance/2017/02/14/deep-learning-machine.html
- https://medium.com/towards-data-science/build-a-deep-learning-rig-for-800-4434e21a424f
- https://www.servethehome.com/nvidia-deep-learning-ai-gpu-value-comparison-q2-2017/
- https://www.servethehome.com/deeplearning02-sub-800-ai-machine-learning-cuda-starter-build/
Unsorted
- https://keras.io
- http://deeplearning.net/software/theano/
- https://github.com/vahidk/EffectiveTensorflow
- https://github.com/torch/nn/tree/master/lib/THNN
- https://discuss.pytorch.org/t/torch-autograd-vs-pytorch-autograd/1671/5
- https://discuss.pytorch.org/t/roadmap-for-torch-and-pytorch/38/2
- https://github.com/tensorflow/models
- https://github.com/pytorch/examples
- https://github.com/pytorch/tutorials
- http://pytorch.org/tutorials/
- http://pytorch.org/docs/master/torchvision/models.html
- https://github.com/opencv/opencv/wiki/Deep-Learning-in-OpenCV
Resources
Graphics
- https://twitter.com/AndrewGlassner/status/976212991627575296
- https://twitter.com/AndrewGlassner/status/966822004153176064
- https://github.com/blueberrymusic/DeepLearningBook-Resources
- https://github.com/blueberrymusic/DeepLearningBookFigures-Thumbnails
- https://github.com/blueberrymusic/DeepLearningBookFigures-Volume1
- https://github.com/blueberrymusic/DeepLearningBookFigures-Volume2