Skip to content

Machine Learning Overview

What is Machine Learning

Machine Learning is a core branch of AI that studies how computers can automatically learn patterns from data rather than being explicitly programmed. Recommendation systems, spam filters, speech recognition — all powered by ML.

Why Learn Machine Learning

Fundamental skill for AI engineers. Deep learning, reinforcement learning, and LLMs are all built on ML foundations.

Interview core. Bias-variance tradeoff, overfitting, gradient descent — these are high-frequency AI interview topics.

Foundation for understanding AI systems. Without ML understanding, you can only call APIs; with it, you can judge why models work or fail.

Core Knowledge Modules

Fundamental Concepts

  • Supervised vs. unsupervised vs. semi-supervised vs. self-supervised learning
  • Training / validation / test sets
  • Overfitting and underfitting
  • Bias-Variance Tradeoff
  • Cross-Validation
  • Evaluation metrics: accuracy, precision, recall, F1, AUC-ROC

Classic Algorithms

  • Linear regression, logistic regression
  • Decision trees, random forests, XGBoost
  • SVM, KNN, Naive Bayes
  • K-Means clustering, PCA

Model Tuning

  • Regularization: L1, L2, Dropout
  • Feature engineering
  • Hyperparameter tuning
  • Ensemble methods

How to Learn

Start with Andrew Ng, then do Kaggle. Andrew Ng's course builds solid theory; Kaggle transforms it into practice.

Implement from scratch with NumPy. Don't just call scikit-learn APIs.

Learn by topic. Linear models first, then trees, then clustering.

Resources in This Module

Resource Type Description
Andrew Ng Machine Learning Course Andrew Ng ML course, best starting point
Hung-Yi Lee Machine Learning Course Hung-Yi Lee ML course, Chinese lectures
Watermelon Book Textbook Zhou Zhihua Machine Learning
PRML Textbook Bishop Pattern Recognition and Machine Learning