Deep Learning Resources

Videos

  1. Deep Learning and Neural Networks with Kevin Duh: course page
  2. NY Course by Yann LeCun: 2014 version, 2015 version
  3. NIPS 2015 Deep Learning Tutorial by Yann LeCun and Yoshua Bengio (slides)(YouTube)
  4. ICML 2013 Deep Learning Tutorial by Yann Lecun (slides)
  5. Geoffery Hinton’s cousera course on Neural Networks for Machine Learning
  6. Stanford 231n Class: Convolutional Neural Networks for Visual Recognition (YouTube2016, YouTube2017github, syllabus, subreddit, projectfinal reports, twitter)
  7. Large Scale Visual Recognition Challenge 2014, arxiv paper
  8. GTC Deep Learning Link
  9. Hugo Larochelle Neural Networks class, slides
  10. My youtube playlist
  11. Yaser Abu-Mostafa’s Learning from Data course (youtube playlist)
  12. Stanford CS224n: Deep Learning for Natural Language Processing (Christopher Manning): homepage, youtube 2017 playlist, reddit
  13. Stanford CS224d: Deep Learning for Natural Language Processing: syllabus, youtube playlist, reddit, longer playlist
  14. Neural Networks for Machine Perception: vimeo
  15. Deep Learning for NLP (without magic): page, better page, video1, video2, youtube playlist
  16. Introduction to Deep Learning with Python: video, slides, code
  17. Machine Learning course with emphasis on Deep Learning by Nando de Freitas (youtube playlist), course page, torch practicals
  18. NIPS 2013 Deep Learning for Computer Vision Tutorial – Rob Fergus: video, slides
  19. Tensorflow Udacity mooc
  20. Oxford Deep NLP Course 2017 (github)
  21. Berkeley Deep Reinforcement Learning (homepage, reddit, youtube)
  22. MIT Deep Learning – Lex Fridman (homepage, github, youtube, twitter)

Links

  1. Deeplearning.net
  2. NVidia’s Deep Learning portal
  3. My flipboard page

AMIs, Docker images & Install Howtos

  1. AWS Deep Learning AMI
  2. Stanford 231n AWS AMI:  image is cs231n_caffe_torch7_keras_lasagne_v2, AMI ID: ami-125b2c72, Caffe, Torch7, Theano, Keras and Lasagne are pre-installed. Python bindings of caffe are available. It has CUDA 7.5 and CuDNN v3.
  3. AMI for AWS EC2 (g2.2xlarge): ubuntu14.04-mkl-cuda-dl (ami-03e67874) in Ireland Region: page,  Installed stuffs: Intel MKL, CUDA 7.0, cuDNN v2, theano, pylearn2, CXXNET, Caffe, cuda-convnet2, OverFeat, nnForge, Graphlab Create (GPU), etc.
  4. Chef cookbook for installing the Caffe deep learning framework
  5. Public EC2 AMI with Torch and Caffe deep learning toolkits (ami-027a4e6a): page
  6. Install Theano on AWS (ami-b141a2f5 with CUDA 7): page
  7. Running Caffe on AWS Instance via Docker: page, docs, image
  8. CVPR 2015 ITorch Tutorial (ami-b36981d8): githubcheatsheet
  9. Torch/iTorch/Ubuntu 14.04 Docker image: docker pull kaixhin/torch
  10. Torch/iTorch/CUDA 7/Ubuntu 14.04 Docker image: docker pull kaixhin/cuda-torch
  11. AMI containing Caffe, Python, Cuda 7, CuDNN, and all dependencies. Its id is ami-763a311e (disk min 8G,system is 4.6G), howto
  12. My Dockerfiles at GitHub

Examples and Tutorials

  1. IPython Caffe Classification
  2. IPython Detection, arxiv paper, rcnn github, selective search
  3. Machine Learning with Torch 7
  4. Deep Learning Tutorials with Theano/Python, CNN, github
  5. Torch tutorials, tutorial&demos from Clement Fabaret
  6. Brewing Imagenet with Caffe
  7. Training an Object Classifier in Torch-7 on multiple GPUs over ImageNet
  8. Stanford Deep Learning Matlab based Tutorial (github, data)
  9. DIY Deep Learning for Vision: A Hands on tutorial with Caffe (google doc)
  10. Tutorial on Deep Learning for Vision CVPR 2014: page
  11. Pylearn2 tutorials: convolutional network, getthedata
  12. Pylearn2 quickstart, docs
  13. So you wanna try deep learning? post from SnippyHollow
  14. Object Detection ipython nb from SnippyHollow
  15. Filter Visualization ipython nb from SnippyHollow
  16. Specifics on CNN and DBN
  17. CVPR 2015 Caffe Tutorial
  18. Deep Learning on Amazon EC2 GPU with Python and nolearn
  19. How to build and run your first deep learning network (video, behind paywall)
  20. Tensorflow examples
  21. Illia Polosukhin’s Getting Started with Tensorflow – Part 1, Part 2, Part 3
  22. CNTK Tutorial at NIPS 2015
  23. CNTK: LSTM, Github Tutorials
  24. CNTK Introduction and Book

People

  1. Geoffery Hinton: Homepage, Reddit AMA (11/10/2014)
  2. Yann LeCun: Homepage, NYU Research Page, Reddit AMA (5/15/2014)
  3. Yoshua Bengio: Homepage, Reddit AMA (2/27/2014)
  4. Clement Fabaret: Scene Parsing (paper), github, code page
  5. Andrej Karpathy: Homepagetwitter, github, blog
  6. Michael I Jordan: Homepage, Reddit AMA (9/10/2014)
  7. Andrew Ng: Homepage, Reddit AMA (4/15/2015)
  8. Jurden Schmidhuber: Homepage, Reddit AMA (3/4/2015)
  9. Nando de Freitas: Homepage, YouTube, Reddit AMA (12/26/2015)

Datasets

  1. ImageNet
  2. MNIST (Wikipedia), database
  3. Kaggle datasets
  4. Kitti Vision Benchmark Suite
  5. Ford Campus Vision and Lidar Dataset
  6. PCL Lidar Datasets
  7. Pylearn2 list

Frameworks and Libraries

  1. Caffe: homepage, github, google group
  2. Torch: homepage, cheatsheet, github, google group
  3. Theano: homepage, google group
  4. Tensorflow: homepage, github, google group, skflow
  5. CNTK: homepage, github, docs
  6. CuDNN: homepage
  7. PaddlePaddle: homepage, github, docs
  8. fbcunn: github
  9. pylearn2: github, docs
  10. cuda-convnet2: github, matlab
  11. nnForge: homepage
  12. Deep Learning software links
  13. Torch vs. Theano post
  14. Overfeat: page, github, paper, slidesgoogle group
  15. Keras: github, docs, google group
  16. Deeplearning4j: page, github
  17. Lasagne: docs, github

Topics

  1. Scene Understanding (CVPR 2013, Lecun) (slides), Scene Parsing (paper)
  2. Overfeat: Integrated Recognition, Localization and Detection using Convolutional Networks (arxiv)
  3. Parsing Natural Scenes and Natural Language with Recursive Neural Networks: page, ICML 2011 paper

Reddit

  1. Machine Learning Reddit page
  2. Computer Vision Reddit page
  3. Reddit: Neural Networks: new, relevant
  4. Reddit: Deep Learning: new, relevant

Books

  1. Learning Deep Architectures for AI, Bengio (pdf)
  2. Neural Nets and Deep Learning (html, github)
  3. Deep Learning, Bengio, Goodfellow, Courville (html, MIT Press, Amazon)
  4. Neural Nets and Learning Machines, Haykin, 2008 (Amazon)

Papers

  1. ImageNet Classification with Deep Convolutional Neural Networks, Alex Krizhevsky, Ilya Sutskever, Geoffrey E Hinton, NIPS 2012 (paper)
  2. Why does unsupervised pre-training help deep learning? (paper)
  3. Hinton06 – Autoencoders (paper)
  4. Deep Learning using Linear Support Vector machines (paper)

Companies

  1. Kaggle: homepage
  2. Microsoft Deep Learning Technology Center

Conferences

  1. ICML
  2. PAMITC Sponsored Conferences
  3. NIPS

Spanish TV Kids Shows, Movies, Games, and Videos for Immersion

I have been trying to learn Spanish lately and have been using a lot of Spanish kids shows for immersion.  I started with Plaza Sesamo and a little bit of Elmo’s World and have watched all the shows listed below.  Enjoy!

Good Spanish kids shows with Spanish Subtitles that match the Spanish Dialogue

  1. Plaza Sesamo – Hulu Plus, UniMas, VmeTV
  2. El Mundo de Elmo – Hulu Plus
  3. Tomas y sus amigos – VmeTV
  4. Bob El Constructor – VmeTV
  5. Spongebob Season 1 – Hulu Plus
  6. Fairly Odd Parents Season 1 – Hulu Plus
  7. TMNT Season 1 – Hulu Plus
  8. Reino Animal – UniMas
  9. Star Wars Clone Wars – Netflix
  10. Pokemon Indigo League – Netflix
  11. Hulu Programas para Niños

Good Spanish kids shows – Spanish Subtitles don’t match dialogue or no subtitles

  1. Spongebob Squarepants 2nd Season and 3rd Season – Amazon DVD
  2. Avatar: The Last Airbender Book OneBook Two, (not 3) – Amazon DVD
  3. The Legend of Korra Book One, Book Two, Book Three, (not 4) – Amazon Blu-ray or DVD
  4. Pac Man and the Ghostly Adventures – Netflix, DisneyXD SAP
  5. Ultimate Spiderman – DisneyXD SAP
  6. Star vs. the Forces of Evil – DisneyXD SAP
  7. Phineas and Ferb  – DisneyXD SAP
  8. Clone Wars – Netflix
  9. Veggie Tales – Netflix
  10. Lots of Disney Movies on Netflix

Good Steam games that can be switched to Spanish spoken dialog w/ Spanish subtitles

  1. Alien: Isolation (YouTube Playlist) (Steam, Amazon)
  2. Assassin’s Creed 2 (youtube playlist) (Steam, Amazon)
  3. Assassin’s Creed 3 (youtube playlist(Steam, Amazon)
  4. Assassin’s Creed 4 (Black Flag) (Steam, Amazon)
  5. Assassin’s Creed Unity (Steam, Amazon)
  6. Assassin’s Creed Syndicate (Steam, Amazon)
  7. Borderlands (youtube playlist(Steam, Amazon)
  8. Borderlands 2 (Steam, Amazon)
  9. Batman: Arkham Asylum (youtube playlist) (Steam, Amazon)
  10. Batman: Arkham City (Steam, Amazon)
  11. Batman: Arkham Origins (Steam, Amazon)
  12. Batman: Arkham Knight (Steam, Amazon)
  13. Bioshock 2 (Steam, Amazon)
  14. Bioshock Infinite (youtube playlist) (Steam, Amazon)
  15. Civilization V (Steam, Amazon)
  16. The Darkness 2 (Steam, Amazon)
  17. Darksiders 2: Deathinitve Edition (Steam, Amazon)
  18. Dead Rising 3 (Steam, Amazon)
  19. Dead Space (Steam, Amazon)
  20. Deus Ex: Human Revolution (Director’s Cut) (Steam, Amazon)
  21. Doom (2016) (Steam, Amazon)
  22. Duke Nukem Forever (ok, maybe not a good game) (Steam, Amazon)
  23. Expeditions: Conquistador (Steam, Amazon)
  24. Fable Anniversary (Steam, Amazon)
  25. Fallout 3 (Steam, Amazon)
  26. Fallout: New Vegas (Steam, Amazon)
  27. Fallout 4 (Steam, Amazon)
  28. Far Cry 4 (Steam, Amazon)
  29. Icewind Dale: Enhanced Edition (Steam, Amazon)
  30. Injustice: Gods Among Us Ultimate Edition (Steam, Amazon)
  31. Just Cause 3 (youtube playlist) (Steam, Amazon)
  32. Lego Batman 3 (Steam, Amazon)
  33. Lego Marvel Super Heroes (Steam, Amazon)
  34. Lego Pirates of the Caribbean (Steam, Amazon)
  35. Lego The Hobbit (Steam, Amazon)
  36. Resident Evil 6 (Steam, Amazon)
  37. Resident Evil Revelations (youtube playlist) (Steam, Amazon)
  38. Resident Evil Revelations 2 (Steam, Amazon)
  39. Skyrim (youtube playlist) (Steam, Amazon)
  40. Skyrim Special Edition (Steam, Amazon)
  41. Thief (2014) (youtube playlist) (Steam, Amazon)
  42. Total War: Shogun 2 (Steam, Amazon)
  43. Total War: Shogun 2 – Fall of the Samurai (Steam, Amazon)
  44. Trine 1,2,3 (Steam, Amazon)
  45. Unepic (Steam, Amazon)
  46. Tomb Raider (2013) (youtube playlist) (Steam, Amazon)
  47. Rise of the Tomb Raider (Steam, Amazon)

Good Steam games: Spanish spoken dialog w/ No Spanish subtitles

  1. Age of Empires 2, 3
  2. Age of Mythology
  3. Assassin’s Creed (youtube playlist)
  4. Half-Life 2
  5. Bulletstorm
  6. Dead Space 2
  7. Dishonored
  8. Fear 3
  9. Farcry 3, Farcry 3 – Blood Dragon
  10. Grid 2
  11. Grid Autosport
  12. Guardians of Middle Earth
  13. Hitman: Contracts
  14. Hitman Absolution
  15. Just Cause 2
  16. Left 4 Dead 1,2
  17. Lord of the Rings: War in the North
  18. Mirror’s Edge
  19. Mortal Kombat Komplete Edition
  20. Portal 1,2
  21. Scribblenauts Unmasked
  22. Sonic All-Stars Racing Transformed
  23. Stacking
  24. Splinter Cell Blacklist
  25. Viking: Battle for Asgard
  26. Wolfenstein: The New Order

Good Steam games that can be switched to English spoken dialog w/ Spanish subtitles

  1. Oblivion GOTY (Original, not Deluxe)
  2. Dragon Age: Origins – Ultimate Edition
  3. Bastion
  4. Dead Island
  5. Deus Ex: The Fall
  6. Final Fantasy 13
  7. Final Fantasy 13-2
  8. GTA 3
  9. GTA 4
  10. GTA: Episodes from Liberty City
  11. GTA 5
  12. Baldur’s Gate: Enhanced Edition
  13. LA Noire
  14. Mass Effect 1,2
  15. Max Payne 3
  16. Resident Evil 4, 5
  17. Saint’s Row 4
  18. Shadowgate (2014)
  19. Sleeping Dogs
  20. South Park: The Stick of Truth
  21. Knights of the Old Republic 2 (French&German Audio Too)
  22. Styx
  23. Witcher 2, 3
  24. Yaiba: Ninja Gaiden Z

Good Nintendo Games

  1. Dragon Quest VII 3DS (youtube playlist) – Get the game!
  2. Dragon Quest VIII 3DS (youtube playlist) – Get the game!
  3. Dragon Quest 4,5,6,9 DS
  4. Pokémon Red Gameboy/3DS Virtual Console (youtube playlist) – Get the game!
  5. Pokémon Sun 3DS (youtube playlist) – Get the game!
  6. Fantasy Life – 3DS
  7. Animal Crossing New Leaf – 3DS
  8. Bravely Default – 3DS
  9. Bravely Second: End Layer – 3DS (youtube playlist) – Get the game!
  10. Yokai Watch – 3DS (youtube playlist) Get the game!
  11. Yokai Watch 2: Fleshy Souls – 3DS (youtube playlist) – Get the game!
  12. My Spanish Coach – DS
  13. Assassin’s Creed 4 (Black Flag) – WiiU
  14. Puzzle Quest 2, Galactrix – DS
  15. Mario Kart – DS. Mario Kart 7- 3DS
  16. Final Fantasy 4 – DS
  17. Clubhouse Games – DS
  18. Mario & Luigi: Bowser’s Inside Story – DS
  19. Mario & Luigi Dream Team – 3DS
  20. Sonic Rush, Sonic Rush Adventure – DS
  21. USA Today Crossword Challenge – DS
  22. Golden Sun Dark Dawn – DS
  23. Final Fantasy Tactics A2: Grimoire of the Rift – DS
  24. Yoshi’s New Island – 3DS (youtube playlist) – Get the game!
  25. All DS, 3DS, WiiU, Switch Zelda games
    1. Breath of the Wild (Switch) (youtube playlist) – Get the Game!
    2. Spirit Tracks DS (youtube playlist) – Get the game!
    3. Phantom Hourglass DS
    4. Ocarina of Time 3D – 3DS
    5. Majora’s Mask 3D – 3DS
    6. Link Between Two Worlds – 3DS
    7. Tri Force Heroes – 3DS
    8. Windwaker HD – WiiU
    9. Twilight Princess HD – WiiU
    10. Breath of the Wild – WiiU, Switch

Ok Spanish shows with Spanish Subtitles that match the Dialogue

  1. CyberChase – VmeTV, Hulu Plus
  2. Angelina Ballerina – VmeTV

Spanish Duolingo

Spanish Duolingo wikia

IPad/Android Games/Apps

  1. Duolingo
  2. Anki
  3. Mindsnacks Spanish (youtube playlist)