Deep learning educational resources

Blog resources

To get an easy-to-read, but still quality overview of the progress and ideas behind deep learning, here are good blogs and sites made by researchers.

• Sebastian Ruder’s site and blog is a must-read with extremely high quality readings in deep learning, with an applicative focus on NLP, but there is really very general machine learning stuff as well.
• Lilian’s blog is very very good in summarizing within a few pages only all the important material and concepts of deep learning.
• Tryolabs blog, wich major breakthroughs in deep learning, year by year.

Advanced blogs

• New directions of research about generative models, beyond GAN and VAE:
  • Diffusion models: see blog post
  • Score-based models: see blog post

Training resources

• Some courses we give: ML at Mines, UE901 M2 TAL, Auto-encodeur en Français et en Java…

• Special mention to Jeremy Fix’s teaching material and lab work must read !

• Recent list of ML courses on Youtube

• Sergei Levine’s course on deep learning

• A very good course on Machine Learning: These video courses by Nando De Freitas are quite generic about Machine Learning (beyond deep learning) and are of very high quality. This link is just to the first video of the serie, you have to look for all the others there.

• Great lectures by Stanford Winter 2017

The above lectures are great as well, and they are more specialized into deep learning for Natural Language Processing.

• Video lectures by A. Karpathy

Then you have these lectures above by A. Karpathy that complete the Standford lectures from the image processing point of view.

• Older course videos

• Deep learning book

• Three excellent free e-books by Kevin Murphy: https://probml.github.io/pml-book/

Specific AI topics

Explanable AI

• Collection of rich tutorials (from Hima Lakkaraju, Harvard):
  • NeurIPS 2020
  • AAAI 2021
  • FAccT 2021
  • Harvard 2019 course
  • CHIL 2021

Security and AI

• Machine learning for security, with lots of resources

Hands on

There are many tutorials about deep learning on the internet, with enlightening practical programming exercices. Here are just a few of them:

• A gentle do-it-yourself free online book, on basics about deep neural networks.
• The pytorch tutorials
• Keras tutorials
• Tensorflow tutorials

Other resources

• There are many other video courses, papers, datasets available at Academic Torrents . Go there, look for the keywords that are of interest for you, and enjoy !