Machine Learning Overview
What is Machine Learning
Machine Learning is a core branch of AI that studies how computers can automatically learn patterns from data rather than being explicitly programmed. Recommendation systems, spam filters, speech recognition — all powered by ML.
Why Learn Machine Learning
Fundamental skill for AI engineers. Deep learning, reinforcement learning, and LLMs are all built on ML foundations.
Interview core. Bias-variance tradeoff, overfitting, gradient descent — these are high-frequency AI interview topics.
Foundation for understanding AI systems. Without ML understanding, you can only call APIs; with it, you can judge why models work or fail.
Core Knowledge Modules
Fundamental Concepts
- Supervised vs. unsupervised vs. semi-supervised vs. self-supervised learning
- Training / validation / test sets
- Overfitting and underfitting
- Bias-Variance Tradeoff
- Cross-Validation
- Evaluation metrics: accuracy, precision, recall, F1, AUC-ROC
Classic Algorithms
- Linear regression, logistic regression
- Decision trees, random forests, XGBoost
- SVM, KNN, Naive Bayes
- K-Means clustering, PCA
Model Tuning
- Regularization: L1, L2, Dropout
- Feature engineering
- Hyperparameter tuning
- Ensemble methods
How to Learn
Start with Andrew Ng, then do Kaggle. Andrew Ng's course builds solid theory; Kaggle transforms it into practice.
Implement from scratch with NumPy. Don't just call scikit-learn APIs.
Learn by topic. Linear models first, then trees, then clustering.
Resources in This Module
| Resource | Type | Description |
|---|---|---|
| Andrew Ng Machine Learning | Course | Andrew Ng ML course, best starting point |
| Hung-Yi Lee Machine Learning | Course | Hung-Yi Lee ML course, Chinese lectures |
| Watermelon Book | Textbook | Zhou Zhihua Machine Learning |
| PRML | Textbook | Bishop Pattern Recognition and Machine Learning |