Track Awesome Deep Learning Updates Weekly

A curated list of awesome Deep Learning tutorials, projects and communities.

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · 😺 ChristosChristofidis/awesome-deep-learning · ⭐ 20K · 🏷️ Computer Science

[ Daily / Weekly / Overview ]

Nov 14 - Nov 20, 2022

Table of Contents / Books

• Deep Learning with R, Second Edition - by François Chollet with Tomasz Kalinowski and J. J. Allaire

• Regularization in Deep Learning - by Liu Peng

• Jax in Action - by Grigory Sapunov

Table of Contents / Videos and Lectures

• Understand what is Deep Learning

Researchers / Tools

• DVC - DVC is built to make ML models shareable and reproducible. It is designed to handle large files, data sets, machine learning models, and metrics as well as code.

• CML - CML helps you bring your favorite DevOps tools to machine learning.

• MLEM - MLEM is a tool to easily package, deploy and serve Machine Learning models. It seamlessly supports a variety of scenarios like real-time serving and batch processing.

May 02 - May 08, 2022

Table of Contents / Books

• Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow by Aurélien Géron | Oct 15, 2019

Table of Contents / Courses

• Deep Learning A.I.Shelf

Table of Contents / Papers

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

• DeepFaceDrawing: Deep Generation of Face Images from Sketches

Researchers / Datasets

• SANAD: Single-Label Arabic News Articles Dataset for Automatic Text Categorization - SANAD Dataset is a large collection of Arabic news articles that can be used in different Arabic NLP tasks such as Text Classification and Word Embedding. The articles were collected using Python scripts written specifically for three popular news websites: AlKhaleej, AlArabiya and Akhbarona.

• Referit3D - Two large-scale and complementary visio-linguistic datasets (aka Nr3D and Sr3D) for identifying fine-grained 3D objects in ScanNet scenes. Nr3D contains 41.5K natural, free-form utterances, and Sr3d contains 83.5K template-based utterances.

• SQuAD - Stanford released ~100,000 English QA pairs and ~50,000 unanswerable questions

• FQuAD - ~25,000 French QA pairs released by Illuin Technology

• GermanQuAD and GermanDPR - deepset released ~14,000 German QA pairs

• SberQuAD (⭐1) - Sberbank released ~90,000 Russian QA pairs

• ArtEmis - Contains 450K affective annotations of emotional responses and linguistic explanations for 80,000 artworks of WikiArt.

Researchers / Frameworks

• haystack: an open-source neural search framework

• Maze (⭐218) - Application-oriented deep reinforcement learning framework addressing real-world decision problems.

• InsNet - A neural network library for building instance-dependent NLP models with padding-free dynamic batching (⭐61)

Apr 25 - May 01, 2022

Researchers / Tools

• Nebullvm (⭐1.5k) - Easy-to-use library to boost deep learning inference leveraging multiple deep learning compilers.

• Netron (⭐20k) - Visualizer for deep learning and machine learning models

Mar 14 - Mar 20, 2022

Researchers / Frameworks

• Colossal-AI - An Integrated Large-scale Model Training System with Efficient Parallelization Techniques (⭐6.5k)

Mar 07 - Mar 13, 2022

Table of Contents / Books

• Engineering Deep Learning Platforms - by Chi Wang and Donald Szeto

Jan 31 - Feb 06, 2022

Researchers / Websites

• all AI news

Jan 10 - Jan 16, 2022

Table of Contents / Courses

• Yann LeCun’s Deep Learning Course at CDS - DS-GA 1008 · SPRING 2021

• Neural Networks and Deep Learning - COMP9444 19T3

Table of Contents / Papers

• VOLO: Vision Outlooker for Visual Recognition

• ViT: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Dec 13 - Dec 19, 2021

Table of Contents / Books

• Evolutionary Deep Learning - by Micheal Lanham

Table of Contents / Videos and Lectures

• What is Neural Structured Learning by Andrew Ferlitsch

• Deep Learning Design Patterns by Andrew Ferlitsch

• Architecture of a Modern CNN: the design pattern approach by Andrew Ferlitsch

• Metaparameters in a CNN by Andrew Ferlitsch

• Multi-task CNN: a real-world example by Andrew Ferlitsch

• A friendly introduction to deep reinforcement learning by Luis Serrano

• What are GANs and how do they work? by Edward Raff

• Coding a basic WGAN in PyTorch by Edward Raff

• Training a Reinforcement Learning Agent by Miguel Morales

Nov 01 - Nov 07, 2021

Researchers / Miscellaneous

• Awesome Drug Interactions, Synergy, and Polypharmacy Prediction (⭐73)

Oct 25 - Oct 31, 2021

Table of Contents / Books

• Deep Learning Patterns and Practices - by Andrew Ferlitsch

• Inside Deep Learning - by Edward Raff

• Deep Learning with Python, Second Edition - by François Chollet

Sep 20 - Sep 26, 2021

Researchers / Datasets

• LLVIP (⭐373) - 15488 visible-infrared paired images (30976 images) for low-light vision research, Project_Page

• MSDA (⭐188) - Over over 5 million images from 5 different domains for multi-source ocr/text recognition DA research, Project_Page

Sep 13 - Sep 19, 2021

Table of Contents / Books

• Deep Learning for Natural Language Processing - by Stephan Raaijmakers

Aug 30 - Sep 05, 2021

Researchers / Tools

• Neptune - Lightweight tool for experiment tracking and results visualization.

Aug 02 - Aug 08, 2021

Researchers / Tools

• Visual Studio Tools for AI - Develop, debug and deploy deep learning and AI solutions

Apr 12 - Apr 18, 2021

Table of Contents / Tutorials

• Keras Tutorial: Content Based Image Retrieval Using a Convolutional Denoising Autoencoder

Researchers / Websites

• stat.ucla.edu

Mar 29 - Apr 04, 2021

Researchers / Tools

• hub (⭐5k) - Fastest unstructured dataset management for TensorFlow/PyTorch by activeloop.ai. Stream & version-control data. Converts large data into single numpy-like array on the cloud, accessible on any machine.

Feb 01 - Feb 07, 2021

Table of Contents / Books

• Grokking Deep Learning for Computer Vision

Dec 07 - Dec 13, 2020

Table of Contents / Tutorials

• Named Entity Recognition using Reformers (⭐5)

• Deep N-Gram Models on Shakespeare’s works (⭐5)

• Wide Residual Networks (⭐5)

• Fashion MNIST using Flax

• Fake News Classification (with streamlit deployment) (⭐8)

• Regression Analysis for Primary Biliary Cirrhosis (⭐1)

• Cross Matching Methods for Astronomical Catalogs (⭐2)

• Named Entity Recognition using BiDirectional LSTMs

• Image Recognition App using Tflite and Flutter (⭐5)

Researchers / Websites

• The Epic Code

Researchers / Frameworks

• Trax — Deep Learning with Clear Code and Speed (⭐7.2k)

• Flax - a neural network ecosystem for JAX that is designed for flexibility (⭐3.7k)

• QuickVision (⭐50)

Nov 30 - Dec 06, 2020

Table of Contents / Courses

• Intro to Deep Learning with PyTorch - A great introductory course on Deep Learning by Udacity and Facebook AI

• Deep Learning by Kaggle - Kaggle's free course on Deep Learning

Researchers / Tools

• DAGsHub - Community platform for Open Source ML – Manage experiments, data & models and create collaborative ML projects easily.

Nov 09 - Nov 15, 2020

Table of Contents / Tutorials

• Semi-Supervised Deep Learning with GANs for Melanoma Detection

Nov 02 - Nov 08, 2020

Researchers / Miscellaneous

• AI Expert Roadmap (⭐23k) - Roadmap to becoming an Artificial Intelligence Expert

Oct 26 - Nov 01, 2020

Researchers / Frameworks

• lightly - A computer vision framework for self-supervised learning (⭐1.9k)

Oct 19 - Oct 25, 2020

Table of Contents / Books

• TensorFlow 2.0 in Action - by Thushan Ganegedara

Oct 05 - Oct 11, 2020

Table of Contents / Courses

• AWS Machine Learning Machine Learning and Deep Learning Courses from Amazon's Machine Learning university

Researchers / Tutorials

• Andrej Karpathy

Sep 28 - Oct 04, 2020

Table of Contents / Books

• Math and Architectures of Deep Learning - by Krishnendu Chaudhury

Table of Contents / Videos and Lectures

• Machine Learning CS 229 : End part focuses on deep learning By Andrew Ng

Researchers / Websites

• ahmedbesbes.com

• CatalyzeX: Machine Learning Hub for Builders and Makers

Researchers / Tools

• Determined (⭐1.9k) - Deep learning training platform with integrated support for distributed training, hyperparameter tuning, smart GPU scheduling, experiment tracking, and a model registry.

Aug 10 - Aug 16, 2020

Researchers / Tools

• CatalyzeX - Browser extension (Chrome and Firefox) that automatically finds and links to code implementations for ML papers anywhere online: Google, Twitter, Arxiv, Scholar, etc.

Jul 27 - Aug 02, 2020

Table of Contents / Videos and Lectures

• Medical Imaging with Deep Learning Tutorial: This tutorial is styled as a graduate lecture about medical imaging with deep learning. This will cover the background of popular medical image domains (chest X-ray and histology) as well as methods to tackle multi-modality/view, segmentation, and counting tasks.

Researchers / Websites

• AI Hub - supported by AAAI, NeurIPS

Jul 20 - Jul 26, 2020

Researchers / Frameworks

• PyTorch Geometric Temporal - Representation learning on dynamic graphs (⭐3.7k)

Jul 06 - Jul 12, 2020

Table of Contents / Videos and Lectures

• Deepmind x UCL Deeplearning: 2020 version

• Deepmind x UCL Reinforcement Learning: Deep Reinforcement Learning

• CMU 11-785 Intro to Deep learning Spring 2020 Course: 11-785, Intro to Deep Learning by Bhiksha Raj

Jun 15 - Jun 21, 2020

Table of Contents / Books

• Practical Deep Learning for Cloud, Mobile, and Edge - A book for optimization techniques during production.

Table of Contents / Courses

• Deep Learning Online Course list at Classpert List of Deep Learning online courses (some are free) from Classpert Online Course Search

Table of Contents / Papers

• FaceNet: A Unified Embedding for Face Recognition and Clustering

• Siamese Neural Networks for One-shot Image Recognition

• Unsupervised Translation of Programming Languages

• Matching Networks for One Shot Learning

Jun 01 - Jun 07, 2020

Researchers / Datasets

• MIT Vision Texture - Image archive (100+ images) (Formats: ppm)

Researchers / Miscellaneous

• CNN Explainer

Mar 23 - Mar 29, 2020

Researchers / Websites

• AI Summer

Mar 09 - Mar 15, 2020

Table of Contents / Tutorials

• The Illustrated Self-Supervised Learning

• Visual Paper Summary: ALBERT (A Lite BERT)

Researchers / Websites

• amitness.com

Researchers / Datasets

• Biometric Systems Lab - University of Bologna

Researchers / Miscellaneous

• toolbox: Curated list of ML libraries

Mar 02 - Mar 08, 2020

Researchers / Frameworks

• Hopsworks - A Feature Store for ML and Data-Intensive AI (⭐812)

• Feast - A Feature Store for ML for GCP by Gojek/Google (⭐3.7k)

Feb 24 - Mar 01, 2020

Table of Contents / Papers

• Generative Adversarial Nets

• Fast R-CNN

Feb 03 - Feb 09, 2020

Table of Contents / Books

• Dive into Deep Learning - numpy based interactive Deep Learning book

Table of Contents / Courses

• Machine Learning for Mere Mortals video course by Nick Chase

• Machine Learning Crash Course with TensorFlow APIs -Google AI

• Deep Learning from the Foundations Jeremy Howard - Fast.ai

• Deep Reinforcement Learning (nanodegree) - Udacity a 3-6 month Udacity nanodegree, spanning multiple courses (2018)

• Grokking Deep Learning in Motion by Beau Carnes (2018)

• Face Detection with Computer Vision and Deep Learning by Hakan Cebeci

Table of Contents / Videos and Lectures

• Deep Learning with R in Motion: a live video course that teaches how to apply deep learning to text and images using the powerful Keras library and its R language interface.

Table of Contents / Tutorials

• Hardware for AI: Understanding computer hardware & build your own computer (⭐2)

Researchers / Websites

• Programming Community Curated Resources

• Machine Learning Mastery blog

• ML Compiled

• A Beginner's Guide To Understanding Convolutional Neural Networks

Researchers / Frameworks

• Catalyst: High-level utils for PyTorch DL & RL research. It was developed with a focus on reproducibility, fast experimentation and code/ideas reusing (⭐3k)

• garage - A toolkit for reproducible reinforcement learning research (⭐1.6k)

• Detecto - Train and run object detection models with 5-10 lines of code (⭐566)

• Karate Club - An unsupervised machine learning library for graph structured data (⭐1.8k)

• Synapses - A lightweight library for neural networks that runs anywhere (⭐65)

• TensorForce - A TensorFlow library for applied reinforcement learning (⭐3.2k)

Researchers / Tools

• ML Workspace (⭐2.8k) - All-in-one web-based IDE for machine learning and data science.

• dowel (⭐26) - A little logger for machine learning research. Log any object to the console, CSVs, TensorBoard, text log files, and more with just one call to logger.log()

Researchers / Miscellaneous

• Microsoft Recommenders (⭐14k) contains examples, utilities and best practices for building recommendation systems. Implementations of several state-of-the-art algorithms are provided for self-study and customization in your own applications.

• The Unreasonable Effectiveness of Recurrent Neural Networks - Andrej Karpathy blog post about using RNN for generating text.

• Ladder Network (⭐101) - Keras Implementation of Ladder Network for Semi-Supervised Learning

Jan 27 - Feb 02, 2020

Table of Contents / Courses

• Deep Learning - UC Berkeley | STAT-157 by Alex Smola and Mu Li (2019)

Dec 16 - Dec 22, 2019

Researchers / Datasets

• National Design Repository - Over 55,000 3D CAD and solid models of (mostly) mechanical/machined engineering designs. (Formats: gif,vrml,wrl,stp,sat)

Nov 25 - Dec 01, 2019

Researchers / Frameworks

• MXnet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning framework (⭐20k)

Nov 04 - Nov 10, 2019

Table of Contents / Courses

• Deep Learning Specialization - Coursera - Breaking into AI with the best course from Andrew NG.

Sep 02 - Sep 08, 2019

Researchers / Conferences

• MAIS - Montreal AI Symposium

Researchers / Frameworks

• Neuraxle - A general-purpose ML pipelining framework (⭐549)

Jul 29 - Aug 04, 2019

Researchers / Miscellaneous

• YOLO: Practical Implementation using Python

• AlphaGo - A replication of DeepMind's 2016 Nature publication, "Mastering the game of Go with deep neural networks and tree search"

• Machine Learning for Software Engineers (⭐26k)

• Machine Learning is Fun!

• Siraj Raval's Deep Learning tutorials

• Dockerface (⭐182) - Easy to install and use deep learning Faster R-CNN face detection for images and video in a docker container.

• Awesome Deep Learning Music (⭐2.4k) - Curated list of articles related to deep learning scientific research applied to music

• Awesome Graph Embedding (⭐4.5k) - Curated list of articles related to deep learning scientific research on graph structured data at the graph level.

• Awesome Network Embedding (⭐2.4k) - Curated list of articles related to deep learning scientific research on graph structured data at the node level.

Jul 08 - Jul 14, 2019

Table of Contents / Courses

• MIT Intro to Deep Learning 7 day bootcamp - A seven day bootcamp designed in MIT to introduce deep learning methods and applications (2019)

• Deep Blueberry: Deep Learning - A free five-weekend plan to self-learners to learn the basics of deep-learning architectures like CNNs, LSTMs, RNNs, VAEs, GANs, DQN, A3C and more (2019)

• Spinning Up in Deep Reinforcement Learning - A free deep reinforcement learning course by OpenAI (2019)

Jun 10 - Jun 16, 2019

Researchers / Tools

• TensorWatch (⭐3.3k) - Debugging and visualization for deep learning

Mar 11 - Mar 17, 2019

Table of Contents / Courses

• AI for Everyone by Andrew Ng (2019)

Mar 04 - Mar 10, 2019

Researchers / Datasets

• Univerity of Minnesota Vision Lab

Feb 25 - Mar 03, 2019

Table of Contents / Books

• An introduction to genetic algorithms

Nov 26 - Dec 02, 2018

Table of Contents / Videos and Lectures

• Deep Learning Crash Course By Oliver Zeigermann

Oct 22 - Oct 28, 2018

Table of Contents / Tutorials

• Understanding deep Convolutional Neural Networks with a practical use-case in Tensorflow and Keras

• Overview and benchmark of traditional and deep learning models in text classification

Researchers / Tutorials

• Merve Ayyüce Kızrak

Sep 24 - Sep 30, 2018

Researchers / Frameworks

• albumentations - A fast and framework agnostic image augmentation library (⭐11k)

Researchers / Tools

• Jupyter Notebook - Web-based notebook environment for interactive computing

• TensorBoard (⭐6k) - TensorFlow's Visualization Toolkit

Researchers / Miscellaneous

• Torch7 Cheat sheet (⭐8.8k)

Sep 17 - Sep 23, 2018

Researchers / Frameworks

• TVM - End to End Deep Learning Compiler Stack for CPUs, GPUs and specialized accelerators

Jun 11 - Jun 17, 2018

Table of Contents / Books

• Artificial intelligence and machine learning: Topic wise explanation

Mar 19 - Mar 25, 2018

Table of Contents / Papers

• Efficient BackProp

Mar 05 - Mar 11, 2018

Table of Contents / Books

• Deep Learning by Microsoft Research (2013)

Table of Contents / Videos and Lectures

• Making Sense of the World with Deep Learning By Adam Coates

• Demystifying Unsupervised Feature Learning By Adam Coates

• Deep Learning: Intelligence from Big Data by Steve Jurvetson (and panel) at VLAB in Stanford.

Table of Contents / Papers

• Image-to-Image Translation with Conditional Adversarial Networks

• Berkeley AI Research (BAIR) Laboratory

Researchers / Datasets

• Content-based image retrieval database - 11 sets of color images for testing algorithms for content-based retrieval. Most sets have a description file with names of objects in each image. (Formats: jpg)

• INRIA's Syntim stereo databases - 34 calibrated color stereo pairs (Formats: gif)

• Image Analysis Laboratory

• JAFFE Facial Expression Image Database - The JAFFE database consists of 213 images of Japanese female subjects posing 6 basic facial expressions as well as a neutral pose. Ratings on emotion adjectives are also available, free of charge, for research purposes. (Formats: TIFF Grayscale images.)

• JISCT Stereo Evaluation - 44 image pairs. These data have been used in an evaluation of stereo analysis, as described in the April 1993 ARPA Image Understanding Workshop paper ``The JISCT Stereo Evaluation'' by R.C.Bolles, H.H.Baker, and M.J.Hannah, 263--274 (Formats: SSI)

• MIT face images and more - hundreds of images (Formats: homebrew)

• NIST Fingerprint data - compressed multipart uuencoded tar file

• Geometric & Intelligent Computing Laboratory

• OSU/SAMPL Database: Range Images, 3D Models, Stills, Motion Sequences - Over 1000 range images, 3D object models, still images and motion sequences (Formats: gif, ppm, vrml, homebrew)

• Vision Research Group

• ftp://ftp.limsi.fr/pub/quenot/opflow/testdata/piv/ - Real and synthetic image sequences used for testing a Particle Image Velocimetry application. These images may be used for the test of optical flow and image matching algorithms. (Formats: pgm (raw))

• LIMSI-CNRS/CHM/IMM/vision

• Photometric 3D Surface Texture Database - This is the first 3D texture database which provides both full real surface rotations and registered photometric stereo data (30 textures, 1680 images). (Formats: TIFF)

• Department Image Understanding

• Centre for Vision, Speech and Signal Processing

• IAKS/KOGS

• U Oulu wood and knots database - Includes classifications - 1000+ color images (Formats: ppm)

• UCID - an Uncompressed Colour Image Database - a benchmark database for image retrieval with predefined ground truth. (Formats: tiff)

• Yale Face Database B - 5760 single light source images of 10 subjects each seen under 576 viewing conditions (9 poses x 64 illumination conditions). (Formats: PGM)

• Fashion-MNIST (⭐10k) - MNIST like fashion product dataset consisting of a training set of 60,000 examples and a test set of 10,000 examples. Each example is a 28x28 grayscale image, associated with a label from 10 classes.

Feb 12 - Feb 18, 2018

Researchers / Datasets

• FakeNewsCorpus (⭐335) - Contains about 10 million news articles classified using opensources.co types

Feb 05 - Feb 11, 2018

Researchers / Frameworks

• Coach - Reinforcement Learning Coach by Intel® AI Lab (⭐2.2k)

Jan 22 - Jan 28, 2018

Table of Contents / Videos and Lectures

• Deep Learning Crash Course: a series of mini-lectures by Leo Isikdogan on YouTube (2018)

Dec 18 - Dec 24, 2017

Table of Contents / Books

• Deep Learning by Yoshua Bengio, Ian Goodfellow and Aaron Courville (05/07/2015)

Table of Contents / Courses

• Designing, Visualizing and Understanding Deep Neural Networks-UC Berkeley

• UVA Deep Learning Course MSc in Artificial Intelligence for the University of Amsterdam.

• MIT 6.S094: Deep Learning for Self-Driving Cars

• MIT 6.S191: Introduction to Deep Learning

• Berkeley CS 294: Deep Reinforcement Learning

• Keras in Motion video course

• Practical Deep Learning For Coders by Jeremy Howard - Fast.ai

• Introduction to Deep Learning by Prof. Bhiksha Raj (2017)

Table of Contents / Tutorials

• Deep Learning with Python

• Grokking Deep Learning

• Deep Learning for Search

• Pytorch Tutorial by Yunjey Choi (⭐25k)

Researchers / Frameworks

• Caffe2 - A New Lightweight, Modular, and Scalable Deep Learning Framework (⭐8.4k)

• deeplearn.js - Hardware-accelerated deep learning and linear algebra (NumPy) library for the web (⭐8.5k)

Dec 04 - Dec 10, 2017

Researchers / Conferences

• CVPR - IEEE Conference on Computer Vision and Pattern Recognition

• AAMAS - International Joint Conference on Autonomous Agents and Multiagent Systems

• IJCAI - International Joint Conference on Artificial Intelligence

• ICML - International Conference on Machine Learning

• ECML - European Conference on Machine Learning

• KDD - Knowledge Discovery and Data Mining

• NIPS - Neural Information Processing Systems

• O'Reilly AI Conference - O'Reilly Artificial Intelligence Conference

• ICDM - International Conference on Data Mining

• ICCV - International Conference on Computer Vision

• AAAI - Association for the Advancement of Artificial Intelligence

Oct 30 - Nov 05, 2017

Table of Contents / Papers

• Dynamic Routing Between Capsules

• Matrix Capsules With Em Routing

Oct 16 - Oct 22, 2017

Table of Contents / Courses

• Convolutional Neural Networks for Visual Recognition - Stanford by Fei-Fei Li, Andrej Karpathy (2017)

Researchers / Frameworks

• Serpent.AI - Game agent framework: Use any video game as a deep learning sandbox (⭐6.4k)

Oct 09 - Oct 15, 2017

Researchers / Websites

• Guide to Machine Learning

• Deep Learning for Beginners

Sep 04 - Sep 10, 2017

Researchers / Datasets

• Visual Object Classes Challenge 2012 (VOC2012) - VOC2012 dataset containing 12k images with 20 annotated classes for object detection and segmentation.

• Large-scale Fashion (DeepFashion) Database - Contains over 800,000 diverse fashion images. Each image in this dataset is labeled with 50 categories, 1,000 descriptive attributes, bounding box and clothing landmarks

Aug 21 - Aug 27, 2017

Table of Contents / Papers

• Google - Sequence to Sequence Learning with Neural Networks

Aug 14 - Aug 20, 2017

Researchers / Frameworks

• CNTK - Microsoft Cognitive Toolkit (⭐17k)

Jul 24 - Jul 30, 2017

Table of Contents / Papers

• Residual Learning

• MobileNets by Google

• Cross Audio-Visual Recognition in the Wild Using Deep Learning

Jul 17 - Jul 23, 2017

Researchers / Tutorials

• Youzhi (Will) Zou

• Fei-Fei Li

• Ian Goodfellow

• Robert Laganière

Jul 10 - Jul 16, 2017

Table of Contents / Courses

• Graduate Summer School: Deep Learning, Feature Learning by Geoffrey Hinton, Yoshua Bengio, Yann LeCun, Andrew Ng, Nando de Freitas and several others @ IPAM, UCLA (2012)

Table of Contents / Papers

• Geoff Hinton's reading list (all papers)

Table of Contents / Tutorials

• The Best Machine Learning Tutorials On The Web (⭐440)

Researchers / Frameworks

• nolearn - wrappers and abstractions around existing neural network libraries, most notably Lasagne (⭐948)

• Sonnet - a library for constructing neural networks by Google's DeepMind (⭐9.4k)

• PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration (⭐60k)

Researchers / Miscellaneous

• Misc from MIT's 'Advanced Natural Language Processing' course

• Reproducing the results of "Playing Atari with Deep Reinforcement Learning" by DeepMind (⭐651)

Jun 19 - Jun 25, 2017

Table of Contents / Tutorials

• TensorFlow-World (⭐4.5k)

Apr 03 - Apr 09, 2017

Researchers / Datasets

• Digital Embryos - Digital embryos are novel objects which may be used to develop and test object recognition systems. They have an organic appearance. (Formats: various formats are available on request)

Mar 06 - Mar 12, 2017

Table of Contents / Videos and Lectures

• NIPS 2016 lecture and workshop videos - NIPS 2016

Feb 27 - Mar 05, 2017

Table of Contents / Papers

• Neural Networks for Named Entity Recognition zip

Researchers / Tutorials

• Derek Rose

• Itamar Arel

• Misha Denil

• Robert Coop

• Tom Karnowski

Researchers / Websites

• Machine Learning is Fun! Adam Geitgey's Blog

Researchers / Datasets

• Flickr Data 100 Million Yahoo dataset

Feb 20 - Feb 26, 2017

Researchers / Datasets

• The AR Face Database - Contains over 4,000 color images corresponding to 126 people's faces (70 men and 56 women). Frontal views with variations in facial expressions, illumination, and occlusions. (Formats: RAW (RGB 24-bit))

Feb 06 - Feb 12, 2017

Table of Contents / Tutorials

• Using convolutional neural nets to detect facial keypoints tutorial

Researchers / Frameworks

• Lasagne - a lightweight library to build and train neural networks in Theano (⭐3.8k)

Dec 12 - Dec 18, 2016

Table of Contents / Tutorials

• Classification on raw time series in TensorFlow with a LSTM RNN (⭐3.1k)

Dec 05 - Dec 11, 2016

Table of Contents / Tutorials

• Torch7 Tutorials (⭐125)

Researchers / Frameworks

• NeuPy - Theano based Python library for ANN and Deep Learning

Oct 24 - Oct 30, 2016

Researchers / Datasets

• YouTube-8M Dataset - YouTube-8M is a large-scale labeled video dataset that consists of 8 million YouTube video IDs and associated labels from a diverse vocabulary of 4800 visual entities.

• Open Images dataset (⭐4.1k) - Open Images is a dataset of ~9 million URLs to images that have been annotated with labels spanning over 6000 categories.

Aug 29 - Sep 04, 2016

Researchers / Frameworks

• Paddle - PArallel Distributed Deep LEarning by Baidu (⭐19k)

Aug 22 - Aug 28, 2016

Table of Contents / Videos and Lectures

• Introduction to Artificial Neural Networks and Deep Learning by Leo Isikdogan at Motorola Mobility HQ

Aug 15 - Aug 21, 2016

Table of Contents / Courses

• Deep Learning Course by Yann LeCun (2016)

Aug 08 - Aug 14, 2016

Researchers / Datasets

• CIFAR-10 and CIFAR-100

Researchers / Frameworks

• Knet.jl (⭐1.4k)

Jul 04 - Jul 10, 2016

Researchers / Datasets

• UMass Vision Image Archive - Large image database with aerial, space, stereo, medical images and more. (Formats: homebrew)

Jun 20 - Jun 26, 2016

Table of Contents / Courses

• Statistical Machine Learning - CMU by Prof. Larry Wasserman

Table of Contents / Papers

• Batch Normalization

Researchers / Frameworks

• Torchnet - Torch based Deep Learning Library (⭐994)

May 23 - May 29, 2016

Researchers / Frameworks

• mlpack - A scalable Machine Learning library

May 16 - May 22, 2016

Researchers / Tutorials

• Adam Coates

• David Reichert

• Justin A. Blanco

• Ludovic Arnold

• Patrick Nguyen

• Rob Fergus

• Tomáš Mikolov

• Yotaro Kubo

Researchers / Datasets

• DeepMind QA Corpus (⭐1.3k) - Textual QA corpus from CNN and DailyMail. More than 300K documents in total. Paper for reference.

May 09 - May 15, 2016

Table of Contents / Courses

• Deep Learning - Udacity/Google by Vincent Vanhoucke and Arpan Chakraborty (2016)

• Deep Learning - UWaterloo by Prof. Ali Ghodsi at University of Waterloo (2015)

Researchers / Frameworks

• DSSTNE - Amazon's library for building Deep Learning models (⭐4.4k)

• SyntaxNet - Google's syntactic parser - A TensorFlow dependency library (⭐75k)

Apr 25 - May 01, 2016

Researchers / Frameworks

• Apache SINGA - A General Distributed Deep Learning Platform

Feb 01 - Feb 07, 2016

Table of Contents / Courses

• Deep Learning for Natural Language Processing - Stanford

• Neural Networks - usherbrooke

• Machine Learning - Oxford (2014-2015)

• Deep Learning - Nvidia (2015)

Table of Contents / Tutorials

• More TensorFlow tutorials (⭐5.6k)

Jan 25 - Jan 31, 2016

Table of Contents / Papers

• Mastering the Game of Go with Deep Neural Networks and Tree Search

Jan 11 - Jan 17, 2016

Table of Contents / Tutorials

• Keras and Lasagne Deep Learning Tutorials (⭐423)

Nov 30 - Dec 06, 2015

Researchers / Frameworks

• Veles - Samsung Distributed machine learning platform (⭐898)

• Marvin - A Minimalist GPU-only N-Dimensional ConvNets Framework (⭐416)

Nov 23 - Nov 29, 2015

Table of Contents / Tutorials

• TensorFlow Python Notebooks (⭐42k)

Researchers / Frameworks

• Scikit Flow - Simplified interface for TensorFlow (mimicking Scikit Learn) (⭐3.2k)

Researchers / Miscellaneous

• Proof of concept for loading Caffe models in TensorFlow (⭐2.8k)

• YOLO: Real-Time Object Detection

Nov 16 - Nov 22, 2015

Table of Contents / Tutorials

• TensorFlow tutorials (⭐5.9k)

Researchers / Frameworks

• Tensorflow - Open source software library for numerical computation using data flow graphs (⭐169k)

• DMTK - Microsoft Distributed Machine Learning Tookit (⭐2.8k)

Researchers / Miscellaneous

• Emotion Recognition API Demo - Microsoft

Nov 02 - Nov 08, 2015

Researchers / Frameworks

• Brainstorm - Fast, flexible and fun neural networks. (⭐1.3k)

Oct 19 - Oct 25, 2015

Table of Contents / Videos and Lectures

• A beginners Guide to Deep Neural Networks By Natalie Hammel and Lorraine Yurshansky

Researchers / Miscellaneous

• Face recognition with Google's FaceNet deep neural network. (⭐15k)

• Basic digit recognition neural network (⭐96)

Oct 05 - Oct 11, 2015

Researchers / Miscellaneous

• Memory Networks Implementations - Facebook (⭐1.8k)

Sep 14 - Sep 20, 2015

Researchers / Frameworks

• Minerva - a fast and flexible tool for deep learning on multi-GPU (⭐680)

Aug 24 - Aug 30, 2015

Researchers / Tutorials

• Aaron Courville

• Abdel-rahman Mohamed

• Alex Acero

• Alex Krizhevsky

• Alexander Ilin

• Amos Storkey

• Andrew M. Saxe

• Andrew Ng

• Andrew W. Senior

• Andriy Mnih

• Ayse Naz Erkan

• Benjamin Schrauwen

• Bernardete Ribeiro

• Bo David Chen

• Boureau Y-Lan

• Brian Kingsbury

• Christopher Manning

• Clement Farabet

• Dan Claudiu Cireșan

• Dong Yu

• Drausin Wulsin

• Erik M. Schmidt

• Eugenio Culurciello

• Frank Seide

• Galen Andrew

• Geoffrey Hinton

• George Dahl

• Graham Taylor

• Grégoire Montavon

• Guido Francisco Montúfar

• Guillaume Desjardins

• Hannes Schulz

• Hélène Paugam-Moisy

• Honglak Lee

• Hugo Larochelle

• Ilya Sutskever

• James Martens

• Jason Morton

• Jason Weston

• Jeff Dean

• Jiquan Mgiam

• Joseph Turian

• Joshua Matthew Susskind

• Jürgen Schmidhuber

• Koray Kavukcuoglu

• KyungHyun Cho

• Li Deng

• Lucas Theis

• Marc'Aurelio Ranzato

• Martin Längkvist

• Mohammad Norouzi

• Nando de Freitas

• Navdeep Jaitly

• Nicolas Le Roux

• Nitish Srivastava

• Noel Lopes

• Oriol Vinyals

• Pascal Vincent

• Pedro Domingos

• Peggy Series

• Pierre Sermanet

• Piotr Mirowski

• Quoc V. Le

• Reinhold Scherer

• Richard Socher

• Robert Gens

• Roger Grosse

• Ronan Collobert

• Ruslan Salakhutdinov

• Sebastian Gerwinn

• Stéphane Mallat

• Sven Behnke

• Tapani Raiko

• Tara Sainath

• Tijmen Tieleman

• Ueli Meier

• Vincent Vanhoucke

• Volodymyr Mnih

• Yann LeCun

• Yichuan Tang

• Yoshua Bengio

Aug 10 - Aug 16, 2015

Table of Contents / Books

• Deep Learning Tutorial by LISA lab, University of Montreal (Jan 6 2015)

• neuraltalk (⭐5.3k) by Andrej Karpathy : numpy-based RNN/LSTM implementation

• Artificial Intelligence: A Modern Approach

• Deep Learning in Neural Networks: An Overview

Table of Contents / Videos and Lectures

• Natural Language Processing By Chris Manning in Stanford

Table of Contents / Papers

• Ask Me Anything: Dynamic Memory Networks for Natural Language Processing

Table of Contents / Tutorials

• VGG Convolutional Neural Networks Practical

Researchers / Datasets

• AT&T Laboratories Cambridge face database

• AVHRR Pathfinder

• Air Freight - The Air Freight data set is a ray-traced image sequence along with ground truth segmentation based on textural characteristics. (455 images + GT, each 160x120 pixels). (Formats: PNG)

• Amsterdam Library of Object Images - ALOI is a color image collection of one-thousand small objects, recorded for scientific purposes. In order to capture the sensory variation in object recordings, we systematically varied viewing angle, illumination angle, and illumination color for each object, and additionally captured wide-baseline stereo images. We recorded over a hundred images of each object, yielding a total of 110,250 images for the collection. (Formats: png)

• Annotated face, hand, cardiac & meat images - Most images & annotations are supplemented by various ASM/AAM analyses using the AAM-API. (Formats: bmp,asf)

• Image Analysis and Computer Graphics

• Brown University Stimuli - A variety of datasets including geons, objects, and "greebles". Good for testing recognition algorithms. (Formats: pict)

• CAVIAR video sequences of mall and public space behavior - 90K video frames in 90 sequences of various human activities, with XML ground truth of detection and behavior classification (Formats: MPEG2 & JPEG)

• Machine Vision Unit

• CCITT Fax standard images - 8 images (Formats: gif)

• CMU CIL's Stereo Data with Ground Truth - 3 sets of 11 images, including color tiff images with spectroradiometry (Formats: gif, tiff)

• CMU PIE Database - A database of 41,368 face images of 68 people captured under 13 poses, 43 illuminations conditions, and with 4 different expressions.

• CMU VASC Image Database - Images, sequences, stereo pairs (thousands of images) (Formats: Sun Rasterimage)

• Caltech Image Database - about 20 images - mostly top-down views of small objects and toys. (Formats: GIF)

• Columbia-Utrecht Reflectance and Texture Database - Texture and reflectance measurements for over 60 samples of 3D texture, observed with over 200 different combinations of viewing and illumination directions. (Formats: bmp)

• Computational Colour Constancy Data - A dataset oriented towards computational color constancy, but useful for computer vision in general. It includes synthetic data, camera sensor data, and over 700 images. (Formats: tiff)

• Computational Vision Lab

• Efficient Content-based Retrieval Group

• Densely Sampled View Spheres - Densely sampled view spheres - upper half of the view sphere of two toy objects with 2500 images each. (Formats: tiff)

• Computer Science VII (Graphical Systems)

• El Salvador Atlas of Gastrointestinal VideoEndoscopy - Images and Videos of his-res of studies taken from Gastrointestinal Video endoscopy. (Formats: jpg, mpg, gif)

• FG-NET Facial Aging Database - Database contains 1002 face images showing subjects at different ages. (Formats: jpg)

• FVC2000 Fingerprint Databases - FVC2000 is the First International Competition for Fingerprint Verification Algorithms. Four fingerprint databases constitute the FVC2000 benchmark (3520 fingerprints in all).

• Face and Gesture images and image sequences - Several image datasets of faces and gestures that are ground truth annotated for benchmarking

• German Fingerspelling Database - The database contains 35 gestures and consists of 1400 image sequences that contain gestures of 20 different persons recorded under non-uniform daylight lighting conditions. (Formats: mpg,jpg)

• Language Processing and Pattern Recognition

• Groningen Natural Image Database - 4000+ 1536x1024 (16 bit) calibrated outdoor images (Formats: homebrew)

• ICG Testhouse sequence - 2 turntable sequences from different viewing heights, 36 images each, resolution 1000x750, color (Formats: PPM)

• Institute of Computer Graphics and Vision

• IEN Image Library - 1000+ images, mostly outdoor sequences (Formats: raw, ppm)

• INRIA's Syntim images database - 15 color image of simple objects (Formats: gif)

• INRIA

• Image Analysis Laboratory - Images obtained from a variety of imaging modalities -- raw CFA images, range images and a host of "medical images". (Formats: homebrew)

• Image Database - An image database including some textures

• ATR Research, Kyoto, Japan

• Machine Vision - Images from the textbook by Jain, Kasturi, Schunck (20+ images) (Formats: GIF TIFF)

• Mammography Image Databases - 100 or more images of mammograms with ground truth. Additional images available by request, and links to several other mammography databases are provided. (Formats: homebrew)

• ftp://ftp.cps.msu.edu/pub/prip - many images (Formats: unknown)

• Middlebury Stereo Data Sets with Ground Truth - Six multi-frame stereo data sets of scenes containing planar regions. Each data set contains 9 color images and subpixel-accuracy ground-truth data. (Formats: ppm)

• Middlebury Stereo Vision Research Page - Middlebury College

• Modis Airborne simulator, Gallery and data set - High Altitude Imagery from around the world for environmental modeling in support of NASA EOS program (Formats: JPG and HDF)

• NIST Fingerprint and handwriting - datasets - thousands of images (Formats: unknown)

• NLM HyperDoc Visible Human Project - Color, CAT and MRI image samples - over 30 images (Formats: jpeg)

• OSU (MSU) 3D Object Model Database - several sets of 3D object models collected over several years to use in object recognition research (Formats: homebrew, vrml)

• OSU (MSU/WSU) Range Image Database - Hundreds of real and synthetic images (Formats: gif, homebrew)

• Signal Analysis and Machine Perception Laboratory

• Otago Optical Flow Evaluation Sequences - Synthetic and real sequences with machine-readable ground truth optical flow fields, plus tools to generate ground truth for new sequences. (Formats: ppm,tif,homebrew)

• LIMSI-CNRS

• SEQUENCES FOR OPTICAL FLOW ANALYSIS (SOFA) - 9 synthetic sequences designed for testing motion analysis applications, including full ground truth of motion and camera parameters. (Formats: gif)

• Computer Vision Group

• Sequences for Flow Based Reconstruction - synthetic sequence for testing structure from motion algorithms (Formats: pgm)

• Stereo Images with Ground Truth Disparity and Occlusion - a small set of synthetic images of a hallway with varying amounts of noise added. Use these images to benchmark your stereo algorithm. (Formats: raw, viff (khoros), or tiff)

• Stuttgart Range Image Database - A collection of synthetic range images taken from high-resolution polygonal models available on the web (Formats: homebrew)

• Purdue Robot Vision Lab

• The MIT-CSAIL Database of Objects and Scenes - Database for testing multiclass object detection and scene recognition algorithms. Over 72,000 images with 2873 annotated frames. More than 50 annotated object classes. (Formats: jpg)

• The RVL SPEC-DB (SPECularity DataBase) - A collection of over 300 real images of 100 objects taken under three different illuminaiton conditions (Diffuse/Ambient/Directed). -- Use these images to test algorithms for detecting and compensating specular highlights in color images. (Formats: TIFF )

• Robot Vision Laboratory

• The Xm2vts database - The XM2VTSDB contains four digital recordings of 295 people taken over a period of four months. This database contains both image and video data of faces.

• Traffic Image Sequences and 'Marbled Block' Sequence - thousands of frames of digitized traffic image sequences as well as the 'Marbled Block' sequence (grayscale images) (Formats: GIF)

• U Bern Face images - hundreds of images (Formats: Sun rasterfile)

• U Michigan textures (Formats: compressed raw)

• UNC's 3D image database - many images (Formats: GIF)

• USF Range Image Data with Segmentation Ground Truth - 80 image sets (Formats: Sun rasterimage)

• University of Oulu Physics-based Face Database - contains color images of faces under different illuminants and camera calibration conditions as well as skin spectral reflectance measurements of each person.

• Machine Vision and Media Processing Unit

• University of Oulu Texture Database - Database of 320 surface textures, each captured under three illuminants, six spatial resolutions and nine rotation angles. A set of test suites is also provided so that texture segmentation, classification, and retrieval algorithms can be tested in a standard manner. (Formats: bmp, ras, xv)

• Machine Vision Group

• Usenix face database - Thousands of face images from many different sites (circa 994)

• View Sphere Database - Images of 8 objects seen from many different view points. The view sphere is sampled using a geodesic with 172 images/sphere. Two sets for training and testing are available. (Formats: ppm)

• PRIMA, GRAVIR

• Vision-list Imagery Archive - Many images, many formats

• Wiry Object Recognition Database - Thousands of images of a cart, ladder, stool, bicycle, chairs, and cluttered scenes with ground truth labelings of edges and regions. (Formats: jpg)

• 3D Vision Group

• Yale Face Database - 165 images (15 individuals) with different lighting, expression, and occlusion configurations.

• Center for Computational Vision and Control

Researchers / Frameworks

• MatConvNet: CNNs for MATLAB (⭐1.4k)

Researchers / Miscellaneous

• A recurrent neural network designed to generate classical music. (⭐1.9k)

Aug 03 - Aug 09, 2015

Researchers / Websites

• Deep Learning News

Researchers / Frameworks

• char-rnn (⭐11k)

Jul 20 - Jul 26, 2015

Table of Contents / Papers

• Supervised Sequence Labelling with Recurrent Neural Networks

• Statistical Language Models based on Neural Networks

• Training Recurrent Neural Networks

• Recursive Deep Learning for Natural Language Processing and Computer Vision

• Bi-directional RNN

• LSTM

• GRU - Gated Recurrent Unit

• GFRNN . .

• LSTM: A Search Space Odyssey

• A Critical Review of Recurrent Neural Networks for Sequence Learning

• Visualizing and Understanding Recurrent Networks

• Wojciech Zaremba, Ilya Sutskever, An Empirical Exploration of Recurrent Network Architectures

• Recurrent Neural Network based Language Model

• Extensions of Recurrent Neural Network Language Model

• Recurrent Neural Network based Language Modeling in Meeting Recognition

• Deep Neural Networks for Acoustic Modeling in Speech Recognition

• Speech Recognition with Deep Recurrent Neural Networks

• Reinforcement Learning Neural Turing Machines

• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

• Memory Networks

• Policy Learning with Continuous Memory States for Partially Observed Robotic Control

• Microsoft - Jointly Modeling Embedding and Translation to Bridge Video and Language

• Neural Turing Machines

Researchers / Websites

• deeplearning.cs.toronto.edu

• jeffdonahue.com/lrcn/

• visualqa.org

• www.mpi-inf.mpg.de/departments/computer-vision...

Researchers / Datasets

• Flickr 8k

• Flickr 30k

• Microsoft COCO

• VQA

• Image QA

Researchers / Frameworks

• RNNLM Toolkit

• RNNLIB - A recurrent neural network library

Researchers / Miscellaneous

• An efficient, batched LSTM.

Jul 13 - Jul 19, 2015

Researchers / Frameworks

• Chainer - A flexible framework of neural networks for deep learning

Jul 06 - Jul 12, 2015

Researchers / Miscellaneous

• Google deepdream - Neural Network art (⭐13k)

Jun 08 - Jun 14, 2015

Researchers / Miscellaneous

• The original code from the DeepMind article + tweaks (⭐1.8k)

Jun 01 - Jun 07, 2015

Researchers / Frameworks

• Nvidia DIGITS - a web app based on Caffe (⭐4.1k)

Researchers / Miscellaneous

• Caffe DockerFile (⭐83)

May 25 - May 31, 2015

Researchers / Websites

• cs.brown.edu/research/ai

• eecs.umich.edu/ai

• cs.utexas.edu/users/ai-lab

• cs.washington.edu/research/ai

• aiai.ed.ac.uk

• www-aig.jpl.nasa.gov

• csail.mit.edu

• cgi.cse.unsw.edu.au/~aishare

• cs.rochester.edu/research/ai

• ai.sri.com

• isi.edu/AI/isd.htm

• nrl.navy.mil/itd/aic

• hips.seas.harvard.edu

• AI Weekly

Researchers / Frameworks

• Keras - Theano based Deep Learning Library

May 18 - May 24, 2015

Researchers / Frameworks

• Neon - Python based Deep Learning Framework (⭐3.9k)

Mar 09 - Mar 15, 2015

Researchers / Frameworks

• MGL

Mar 02 - Mar 08, 2015

Researchers / Miscellaneous

• Wiki2Vec. Getting Word2vec vectors for entities and word from Wikipedia Dumps (⭐598)

Jan 19 - Jan 25, 2015

Table of Contents / Videos and Lectures

• Unsupervised Deep Learning - Stanford by Andrew Ng in Stanford (2011)

Table of Contents / Papers

• Training tricks by YB

Table of Contents / Tutorials

• Theano Tutorial

• Neural Networks for Matlab

Researchers / Websites

• nlp.stanford.edu

• ai-junkie.com

Researchers / Datasets

• UC Irvine Machine Learning Repository

Researchers / Frameworks

• convetjs (⭐10k)

• DeepLearnToolbox (⭐3.7k)

• Deepnet (⭐893)

• Deeppy (⭐1.4k)

• JavaNN (⭐1.2k)

• hebel (⭐1.2k)

• Mocha.jl (⭐1.3k)

• OpenDL (⭐218)

• cuDNN

Researchers / Miscellaneous

• gfx.js (⭐124)

• Misc from MIT's 'Machine Learning' course

• Misc from MIT's 'Networks for Learning: Regression and Classification' course

• Misc from MIT's 'Neural Coding and Perception of Sound' course

• Implementing a Distributed Deep Learning Network over Spark

• A chess AI that learns to play chess using deep learning. (⭐762)

Jan 12 - Jan 18, 2015

Table of Contents / Books

• Neural Networks and Deep Learning by Michael Nielsen (Dec 2014)

Table of Contents / Courses

• Machine Learning - Stanford by Andrew Ng in Coursera (2010-2014)

• Machine Learning - Caltech by Yaser Abu-Mostafa (2012-2014)

• Machine Learning - Carnegie Mellon by Tom Mitchell (Spring 2011)

• Neural Networks for Machine Learning by Geoffrey Hinton in Coursera (2012)

• Neural networks class by Hugo Larochelle from Université de Sherbrooke (2013)

• Deep Learning Course by CILVR lab @ NYU (2014)

• A.I - Berkeley by Dan Klein and Pieter Abbeel (2013)

• A.I - MIT by Patrick Henry Winston (2010)

• Vision and learning - computers and brains by Shimon Ullman, Tomaso Poggio, Ethan Meyers @ MIT (2013)

Table of Contents / Videos and Lectures

• The Next Generation of Neural Networks By Geoffrey Hinton at GoogleTechTalks

• The wonderful and terrifying implications of computers that can learn By Jeremy Howard at TEDxBrussels

Researchers / Frameworks

• Brain (⭐8k)

Jan 05 - Jan 11, 2015

Table of Contents / Videos and Lectures

• How To Create A Mind By Ray Kurzweil

• Deep Learning, Self-Taught Learning and Unsupervised Feature Learning By Andrew Ng

• Recent Developments in Deep Learning By Geoff Hinton

• The Unreasonable Effectiveness of Deep Learning by Yann LeCun

• Deep Learning of Representations by Yoshua bengio

• Principles of Hierarchical Temporal Memory by Jeff Hawkins

• Machine Learning Discussion Group - Deep Learning w/ Stanford AI Lab by Adam Coates

• Visual Perception with Deep Learning By Yann LeCun

Table of Contents / Papers

• ImageNet Classification with Deep Convolutional Neural Networks

• Using Very Deep Autoencoders for Content Based Image Retrieval

• Learning Deep Architectures for AI

• CMU’s list of papers

Table of Contents / Tutorials

• UFLDL Tutorial 1

• UFLDL Tutorial 2

• Deep Learning for NLP (without Magic)

• A Deep Learning Tutorial: From Perceptrons to Deep Networks

• Deep Learning from the Bottom up

Researchers / Websites

• deeplearning.net

• deeplearning.stanford.edu

Researchers / Datasets

• MNIST Handwritten digits

• Google House Numbers from street view

• IMAGENET

• Tiny Images 80 Million tiny images6.

• Berkeley Segmentation Dataset 500

Researchers / Frameworks

• Caffe

• Torch7

• Theano

• cuda-convnet

• Ccv

• NuPIC

• DeepLearning4J

Researchers / Miscellaneous

• Caffe Webinar

• 100 Best Github Resources in Github for DL

• Word2Vec

• TorontoDeepLEarning convnet (⭐504)