Fully Convolutional Networks for Semantic Segmentation (arxiv, video, caffemodel, example, presentation, solved issue)

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs (arxiv, DeepLab bitbucket, github, pretrained models, UCLA page)

Conditional Random Fields as Recurrent Neural Networks (arxiv, project, demo, github)

Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation (arxiv)

Constrained Convolutional Neural Networks for Weakly Supervised Segmentation (arxiv)

BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation (arxiv)

Videos

1. Deep Learning and Neural Networks with Kevin Duh: course page
2. NY Course by Yann LeCun: 2014 version, 2015 version
3. NIPS 2015 Deep Learning Tutorial by Yann LeCun and Yoshua Bengio (slides)(YouTube)
4. ICML 2013 Deep Learning Tutorial by Yann Lecun (slides)
5. Geoffery Hinton’s cousera course on Neural Networks for Machine Learning
6. Stanford 231n Class: Convolutional Neural Networks for Visual Recognition (YouTube2016, YouTube2017, github, syllabus, subreddit, project, final reports, twitter)
7. Large Scale Visual Recognition Challenge 2014, arxiv paper
8. GTC Deep Learning Link
9. Hugo Larochelle Neural Networks class, slides
10. My youtube playlist
11. Yaser Abu-Mostafa’s Learning from Data course (youtube playlist)
12. Stanford CS224n: Deep Learning for Natural Language Processing (Christopher Manning): homepage, youtube 2017 playlist, reddit
13. Stanford CS224d: Deep Learning for Natural Language Processing: syllabus, youtube playlist, reddit, longer playlist
14. Neural Networks for Machine Perception: vimeo
15. Deep Learning for NLP (without magic): page, better page, video1, video2, youtube playlist
16. Introduction to Deep Learning with Python: video, slides, code
17. Machine Learning course with emphasis on Deep Learning by Nando de Freitas (youtube playlist), course page, torch practicals
18. NIPS 2013 Deep Learning for Computer Vision Tutorial – Rob Fergus: video, slides
19. Tensorflow Udacity mooc
20. Oxford Deep NLP Course 2017 (github)
21. Berkeley Deep Reinforcement Learning (homepage, reddit, youtube)
22. MIT Deep Learning – Lex Fridman (homepage, github, youtube, twitter)

Links

1. Deeplearning.net
2. NVidia’s Deep Learning portal
3. My flipboard page

AMIs, Docker images & Install Howtos

1. AWS Deep Learning AMI
2. Stanford 231n AWS AMI:  image is cs231n_caffe_torch7_keras_lasagne_v2, AMI ID: ami-125b2c72, Caffe, Torch7, Theano, Keras and Lasagne are pre-installed. Python bindings of caffe are available. It has CUDA 7.5 and CuDNN v3.
3. AMI for AWS EC2 (g2.2xlarge): ubuntu14.04-mkl-cuda-dl (ami-03e67874) in Ireland Region: page,  Installed stuffs: Intel MKL, CUDA 7.0, cuDNN v2, theano, pylearn2, CXXNET, Caffe, cuda-convnet2, OverFeat, nnForge, Graphlab Create (GPU), etc.
4. Chef cookbook for installing the Caffe deep learning framework
5. Public EC2 AMI with Torch and Caffe deep learning toolkits (ami-027a4e6a): page
6. Install Theano on AWS (ami-b141a2f5 with CUDA 7): page
7. Running Caffe on AWS Instance via Docker: page, docs, image
8. CVPR 2015 ITorch Tutorial (ami-b36981d8): github, cheatsheet
9. Torch/iTorch/Ubuntu 14.04 Docker image: docker pull kaixhin/torch
10. Torch/iTorch/CUDA 7/Ubuntu 14.04 Docker image: docker pull kaixhin/cuda-torch
11. AMI containing Caffe, Python, Cuda 7, CuDNN, and all dependencies. Its id is ami-763a311e (disk min 8G,system is 4.6G), howto
12. My Dockerfiles at GitHub

Examples and Tutorials

1. IPython Caffe Classification
2. IPython Detection, arxiv paper, rcnn github, selective search
3. Machine Learning with Torch 7
4. Deep Learning Tutorials with Theano/Python, CNN, github
5. Torch tutorials, tutorial&demos from Clement Fabaret
6. Brewing Imagenet with Caffe
7. Training an Object Classifier in Torch-7 on multiple GPUs over ImageNet
8. Stanford Deep Learning Matlab based Tutorial (github, data)
9. DIY Deep Learning for Vision: A Hands on tutorial with Caffe (google doc)
10. Tutorial on Deep Learning for Vision CVPR 2014: page
11. Pylearn2 tutorials: convolutional network, getthedata
12. Pylearn2 quickstart, docs
13. So you wanna try deep learning? post from SnippyHollow
14. Object Detection ipython nb from SnippyHollow
15. Filter Visualization ipython nb from SnippyHollow
16. Specifics on CNN and DBN
17. CVPR 2015 Caffe Tutorial
18. Deep Learning on Amazon EC2 GPU with Python and nolearn
19. How to build and run your first deep learning network (video, behind paywall)
20. Tensorflow examples
21. Illia Polosukhin’s Getting Started with Tensorflow – Part 1, Part 2, Part 3
22. CNTK Tutorial at NIPS 2015
23. CNTK: LSTM, Github Tutorials
24. CNTK Introduction and Book

People

1. Geoffery Hinton: Homepage, Reddit AMA (11/10/2014)
2. Yann LeCun: Homepage, NYU Research Page, Reddit AMA (5/15/2014)
3. Yoshua Bengio: Homepage, Reddit AMA (2/27/2014)
4. Clement Fabaret: Scene Parsing (paper), github, code page
5. Andrej Karpathy: Homepage, twitter, github, blog
6. Michael I Jordan: Homepage, Reddit AMA (9/10/2014)
7. Andrew Ng: Homepage, Reddit AMA (4/15/2015)
8. Jurden Schmidhuber: Homepage, Reddit AMA (3/4/2015)
9. Nando de Freitas: Homepage, YouTube, Reddit AMA (12/26/2015)

Datasets

1. ImageNet
2. MNIST (Wikipedia), database
3. Kaggle datasets
4. Kitti Vision Benchmark Suite
5. Ford Campus Vision and Lidar Dataset
6. PCL Lidar Datasets
7. Pylearn2 list

Frameworks and Libraries

1. Caffe: homepage, github, google group
2. Torch: homepage, cheatsheet, github, google group
3. Theano: homepage, google group
4. Tensorflow: homepage, github, google group, skflow
5. CNTK: homepage, github, docs
6. CuDNN: homepage
7. PaddlePaddle: homepage, github, docs
8. fbcunn: github
9. pylearn2: github, docs
10. cuda-convnet2: github, matlab
11. nnForge: homepage
12. Deep Learning software links
13. Torch vs. Theano post
14. Overfeat: page, github, paper, slides, google group
15. Keras: github, docs, google group
16. Deeplearning4j: page, github
17. Lasagne: docs, github

Topics

1. Scene Understanding (CVPR 2013, Lecun) (slides), Scene Parsing (paper)
2. Overfeat: Integrated Recognition, Localization and Detection using Convolutional Networks (arxiv)
3. Parsing Natural Scenes and Natural Language with Recursive Neural Networks: page, ICML 2011 paper

Reddit

1. Machine Learning Reddit page
2. Computer Vision Reddit page
3. Reddit: Neural Networks: new, relevant
4. Reddit: Deep Learning: new, relevant

Books

1. Learning Deep Architectures for AI, Bengio (pdf)
2. Neural Nets and Deep Learning (html, github)
3. Deep Learning, Bengio, Goodfellow, Courville (html, MIT Press, Amazon)
4. Neural Nets and Learning Machines, Haykin, 2008 (Amazon)

Papers

1. ImageNet Classification with Deep Convolutional Neural Networks, Alex Krizhevsky, Ilya Sutskever, Geoffrey E Hinton, NIPS 2012 (paper)
2. Why does unsupervised pre-training help deep learning? (paper)
3. Hinton06 – Autoencoders (paper)
4. Deep Learning using Linear Support Vector machines (paper)

Companies

1. Kaggle: homepage
2. Microsoft Deep Learning Technology Center

Conferences

1. ICML
2. PAMITC Sponsored Conferences
3. NIPS