📚 Bibliography
A curated collection of key resources on Artificial Intelligence and Machine Learning. Organized by topic and level to facilitate progressive learning, from the fundamentals to advanced readings and practical resources.
Table of Contents
- Foundational Works
- Core Machine Learning
- Deep Learning & Neural Networks
- Mathematical Foundations
- Natural Language Processing & Large Language Models
- Advanced Topics
- Classic Papers & Seminal Works
- Learning Platforms & Courses
Foundational Works
Essential books for understanding the fundamentals of Machine Learning and AI.
Canonical References
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| The Elements of Statistical Learning | Hastie, Tibshirani, Friedman | 2009 | 🇬🇧 English | Statistical learning theory, rigorous foundations | Buy |
| Pattern Recognition and Machine Learning | Christopher M. Bishop | 2006 | 🇬🇧 English | Probabilistic models, Bayesian methods | Buy |
| An Introduction to Statistical Learning | James, Witten, Hastie, Tibshirani | 2021 | 🇬🇧 English | Accessible statistical learning (with R/Python) | Free Download |
| Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow | Aurélien Géron | 2022 | 🇬🇧 English | Practical ML with Scikit-Learn, Keras, TensorFlow | Buy |
| The Hundred-Page Machine Learning Book | Andriy Burkov | 2019 | 🇬🇧 English | Concise ML fundamentals overview | Buy |
| Introduction to the Theory of Computation | Michael Sipser | 2013 | 🇬🇧 English | Computational complexity, algorithms | Buy |
Core Machine Learning
Comprehensive coverage of supervised learning, unsupervised learning, and model evaluation.
Regression & Supervised Learning
| Title | Author(s) | Language | Focus | Access |
|---|
| Applied Linear Regression | Sanford Weisberg | 🇬🇧 English | Practical linear regression, diagnostics | — |
| Generalized Linear Models | P. McCullagh, J.A. Nelder | 🇬🇧 English | GLM theory and applications | — |
| Regression Modeling Strategies | Frank E. Harrell Jr. | 🇬🇧 English | Advanced regression techniques | — |
Classification & Evaluation
| Title | Author(s) | Language | Focus | Access |
|---|
| Classification and Regression Trees | Breiman, Friedman, Olshen, Stone | 🇬🇧 English | Decision trees, CART methodology | — |
| The Art and Science of Machine Learning | David Sculley et al. (Google) | 🇬🇧 English | ML systems design, best practices | Free |
Clustering & Unsupervised Learning
| Title | Author(s) | Language | Focus | Access |
|---|
| Finding Groups in Data | Kaufman & Rousseeuw | 🇬🇧 English | Clustering algorithms and theory | — |
| Unsupervised Learning | Richard Baraniuk (Rice University) | 🇬🇧 English | Comprehensive unsupervised methods | Free Course |
Deep Learning & Neural Networks
Foundational texts on neural networks, optimization, and deep architectures.
Neural Networks Fundamentals
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Deep Learning | Goodfellow, Bengio, Courville | 2016 | 🇬🇧 English | Comprehensive DL theory and practice | Free Online |
| Neural Networks and Deep Learning | Michael Nielsen | 2015 | 🇬🇧 English | Visual, intuitive introduction | Free Online |
| Neuron to Brain | Dayan & Abbott | 2005 | 🇬🇧 English | Computational neuroscience perspective | — |
Optimization & Training
| Title | Author(s) | Language | Focus | Access |
|---|
| An overview of gradient descent optimization algorithms | Sebastian Ruder | 🇬🇧 English | Comprehensive optimization methods review | Free |
| Optimization Methods for Large-Scale Machine Learning | Bottou, Curtis, Nocedal | 🇬🇧 English | Theoretical foundations of SGD and variants | Free |
Convolutional & Recurrent Networks
| Title | Author(s) | Language | Focus | Access |
|---|
| Convolutional Neural Networks: From Theory to Implementation | Dumoulin & Visin | 🇬🇧 English | CNNs architecture and theory | Free |
| Understanding LSTM Networks | Christopher Olah | 🇬🇧 English | RNNs and LSTM intuitions | Free Blog |
Mathematical Foundations
Essential mathematics for understanding AI algorithms.
Linear Algebra
| Title | Author(s) | Language | Focus | Access |
|---|
| Linear Algebra and Its Applications | Gilbert Strang | 🇬🇧 English | Comprehensive linear algebra | MIT OpenCourseWare |
| Essence of Linear Algebra | 3Blue1Brown | 🇬🇧 English | Visual intuitive understanding | Free YouTube |
Probability & Statistics
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Probability and Statistics for Engineers and Scientists | Hayter | 2012 | 🇬🇧 English | Foundations in statistics | — |
| Statistical Rethinking | Richard McElreath | 2020 | 🇬🇧 English | Bayesian statistics and causal reasoning | Free Course |
| Bayesian Data Analysis | Gelman et al. | 2013 | 🇬🇧 English | Comprehensive Bayesian methods | Free |
Calculus & Optimization
| Title | Author(s) | Language | Focus | Access |
|---|
| Calculus | Michael Spivak | 🇬🇧 English | Rigorous mathematical foundations | — |
| Convex Optimization | Boyd & Vandenberghe | 2004 | 🇬🇧 English | Optimization theory, convex methods |
Natural Language Processing & Large Language Models
Modern NLP and the emergence of large language models.
Foundational NLP
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Speech and Language Processing | Jurafsky & Martin | 2023 | 🇬🇧 English | Comprehensive NLP textbook (3rd ed.) | Free Online |
| Natural Language Processing with Transformers | Tunstall, von Werra, Wolf | 2022 | 🇬🇧 English | Modern NLP with HuggingFace | Buy |
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Attention Is All You Need | Vaswani et al. | 2017 | 🇬🇧 English | Seminal Transformer architecture paper | Free |
| The Illustrated Transformer | Jay Alammar | 2018 | 🇬🇧 English | Visual explanation of Transformers | Free Blog |
Large Language Models
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| A Primer on Neural Network Architectures for Natural Language Processing | Goldberg | 2015 | 🇬🇧 English | NLP architectures fundamentals | Free |
| Language Models are Unsupervised Multitask Learners | Radford et al. (OpenAI) | 2019 | 🇬🇧 English | GPT-2 technical report | Free |
| Language Models are Few-Shot Learners | Brown et al. (OpenAI) | 2020 | 🇬🇧 English | GPT-3 technical report | Free |
Advanced Topics
Specialized areas and cutting-edge research.
Reinforcement Learning
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Reinforcement Learning: An Introduction | Sutton & Barto | 2018 | 🇬🇧 English | Comprehensive RL foundations (2nd ed.) | Free Draft |
| Deep Reinforcement Learning Hands-On | Maxim Lapan | 2020 | 🇬🇧 English | Practical DRL implementation | Buy |
Computer Vision
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Computer Vision: Algorithms and Applications | Richard Szeliski | 2022 | 🇬🇧 English | Comprehensive CV textbook (2nd ed.) | Free |
| Deep Learning for Computer Vision with Python | Adrian Rosebrock | 2017-2021 | 🇬🇧 English | Practical DL for CV | Buy |
Interpretability & Explainability
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| Interpretable Machine Learning | Christoph Molnar | 2022 | 🇬🇧 English | Comprehensive explainability guide | Free Online |
| Explaining Deep Learning | Ian Goodfellow & Others | — | 🇬🇧 English | Understanding neural network predictions | Free |
Causal Inference
| Title | Author(s) | Year | Language | Focus | Access |
|---|
| The Book of Why | Judea Pearl, Dana Mackenzie | 2018 | 🇬🇧 English | Causal inference fundamentals | Buy |
| Causal Inference: The Mixtape | Scott Cunningham | 2021 | 🇬🇧 English | Practical causal inference methods | Free |
Classic Papers & Seminal Works
Landmark papers that shaped the field of AI and ML.
Foundational Papers
| Title | Authors | Year | Area | Access |
|---|
| A Logical Calculus of Ideas Immanent in Nervous Activity | McCulloch & Pitts | 1943 | Neural Networks | Free |
| The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain | Rosenblatt | 1958 | Neural Networks | Free |
| Backpropagation and its Applications to Handwritten Letter Recognition | LeCun et al. | 1990 | Deep Learning | Free |
Modern Classics
| Title | Authors | Year | Area | Access |
|---|
| ImageNet Classification with Deep Convolutional Neural Networks (AlexNet) | Krizhevsky et al. | 2012 | Computer Vision | Free |
| Very Deep Convolutional Networks for Large-Scale Image Recognition (VGG) | Simonyan & Zisserman | 2014 | Computer Vision | Free |
| Deep Residual Learning for Image Recognition (ResNet) | He et al. | 2015 | Computer Vision | Free |
| Attention Is All You Need (Transformer) | Vaswani et al. | 2017 | NLP/Transformers | Free |
| BERT: Pre-training of Deep Bidirectional Transformers | Devlin et al. | 2018 | NLP | Free |
| An Image is Worth 16x16 Words (Vision Transformer) | Dosovitskiy et al. | 2020 | Computer Vision | Free |
Reinforcement Learning Classics
| Title | Authors | Year | Access |
|---|
| Playing Atari with Deep Reinforcement Learning (DQN) | Mnih et al. | 2013 | Free |
| Mastering the Game of Go with Deep Neural Networks and Tree Search (AlphaGo) | Silver et al. | 2016 | Free |
| Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm (AlphaZero) | Silver et al. | 2018 | Free |
High-quality educational resources for different learning styles.
University Courses (Free Online)
| Institution | Course | Instructor | Language | Access |
|---|
| Stanford | CS229 - Machine Learning | Andrew Ng | 🇬🇧 English | Free |
| MIT | 6.034 - Artificial Intelligence | Patrick Winston | 🇬🇧 English | Free |
| MIT | 6.S191 - Introduction to Deep Learning | MIT CSAIL | 🇬🇧 English | Free |
| UC Berkeley | CS188 - Artificial Intelligence | Pieter Abbeel | 🇬🇧 English | Free |
| Andrew Ng | Machine Learning Specialization | Andrew Ng | 🇬🇧 English | Coursera |
| Platform | Specialization | Quality | Cost |
|---|
| Coursera | Machine Learning Specialization | ⭐⭐⭐⭐⭐ | Free/Paid |
| edX | Artificial Intelligence | ⭐⭐⭐⭐⭐ | Free/Paid |
| FastAI | Practical Deep Learning | ⭐⭐⭐⭐⭐ | Free |
| DataCamp | ML & Data Science | ⭐⭐⭐⭐ | Paid |
| Kaggle | Learn (Competitions & Courses) | ⭐⭐⭐⭐ | Free |