Loading learning path...
Master Machine Learning from fundamentals to advanced techniques through 19 comprehensive chapters. This path covers 318 carefully curated problems spanning linear algebra, probability, classical ML, deep learning, reinforcement learning, and more.
This comprehensive learning path covers 318 problems across 19 chapters, taking you from mathematical foundations to advanced ML techniques.
Learning Path Structure: • Chapters 1-2: Mathematical Foundations - Linear algebra and probability • Chapter 3: Data Preprocessing - Feature engineering and data pipelines • Chapter 4: Calculus & Optimization - Gradients and optimization theory • Chapter 5-6: Classical ML - Traditional algorithms and evaluation metrics • Chapters 7-8: Neural Networks - Fundamentals and training techniques • Chapters 9-11: Deep Learning - CNNs, RNNs, and Transformers • Chapters 12-14: Advanced Topics - Modern architectures and RL • Chapters 15-18: Applications - NLP, CV, LLM evaluation, and MLOps
Each chapter builds on previous concepts for a cohesive learning experience.
Vectors and Vector Spaces: The Language of Machine Learning
Coordinate Transformation Between Bases
Coordinate Transformation Between Bases
Closed-Form Linear Model Fitting
Column Compressed Sparse Matrix Format
Component-wise Vector Addition
Linear Kernel Computation (Dot Product Similarity)
Linear Transformation of a Vector
Square Matrix Determinant and Trace Evaluator
Matrix Dimension Restructuring
Computing the Multiplicative Inverse of a 2×2 Matrix
Matrix Row-Column Interchange
Scaling a Matrix by a Constant Factor
Polynomial Kernel Similarity Computation
Hyperplane Separation Width for Linear Classifiers
Three-Dimensional Vector Cross Product
Vector Inner Product Computation
Vector Projection onto a Line
Construct Diagonal Matrix from Vector
Column Space Basis Extraction
Doubly Stochastic Stream Mixing Forward Pass
Gauss-Seidel Linear System Solver
Gaussian Kernel Similarity Matrix
Hyperdimensional Row Encoding Using Bind-Bundle Operations
Low-Rank Adaptation Forward Computation
Pairwise Matrix Product Computation
Surprise-Driven Neural Memory Update with Momentum
Two-Dimensional Orthonormal Basis Generator
Row Reduced Canonical Form
Similarity Matrix Transformation
Spatial Translation Transformation in 2D
Spectral Analysis of a Square Matrix
Probability Fundamentals
Binary Association Coefficient
Binary Association Coefficient
Dataset Summary Metrics Calculator
Discrete Frequency Distribution Calculator
Statistical Moments of a Uniform Die
Information Divergence Between Gaussian Distributions
Gaussian Nonlinear Activator
Log Softmax Transformation
Compute Arithmetic Mean Along Matrix Axis
Computing Event Likelihood Using the Poisson Model
Sample Mean Distribution Simulator
Logistic Sigmoid Transformation
Softmax Probability Distribution
Aggregate Probability Computation via Event Partitioning
Bernoulli Trial Success Probability
Chi-Square Distribution Density Evaluator
Conditional Likelihood from Joint Event Distribution
Pearson Correlation Matrix Computation
Experiment Detection Power Analysis
Finite Sampling Probability Calculator
Gaussian Distribution Divergence Measure
Gaussian Probability Density Evaluator
Independent Samples Mean Comparison
Shared Information from Joint Probability Distribution
Computing Covariance from Joint Probability Distributions
Failure Count Probability Before Success Goal
Principal Component Extraction
Shared Date Coincidence Calculator
Probability-Weighted Ensemble Classification
Stochastic State Evolution Simulator
Symmetric Distribution Divergence Measure
Bayesian Function Predictor
Differential Calculus Review
Activation Function Gradient Computation
Activation Function Gradient Computation
Adamax Gradient Optimizer Update Step
Adaptive Gradient Parameter Updater
Binary Classification Loss
Bounded Gradient Constraint for Training Stabilization
Sparse Matrix Compression: Row-Based Storage Transformation
Epoch-Based Learning Rate Decay Scheduler
Exponential Decay Learning Rate Scheduler
Optimizing Linear Model Coefficients via Gradient Descent
Gradient Vector Analysis for Optimization
Gradient Descent with L2 Regularization Penalty
Margin Penalty Loss Computation for Binary Classifiers
Momentum-Based Parameter Updater
Nesterov Accelerated Momentum Optimizer
Piecewise Linear Sigmoid Approximation
Polynomial Series Function Estimation
Polynomial Term Rate of Change
Sequential Function Chain Evaluator
Training Convergence Halt Detector
Training Halt Monitor: Validation Stagnation Detector
Adaptive Delta Gradient Optimizer
Adaptive Gradient Scaling Optimizer
Adaptive Moment Estimation Optimizer Step
Adaptive Moment Estimation Optimizer
Segmented 8-Bit Floating Point Tensor Compression
Composite Function Differentiation via Chain Rule
Constrained Quadratic Optimizer with Dual Variables
Cosine Decay Learning Rate Scheduler
Curvature-Based Optimization Step
Decoupled Weight Decay Parameter Update
Determinant-Based Linear System Solver
Exhaustive Hyperparameter Search
Direct Linear System Solver Using Row Reduction
Global Norm Gradient Rescaling
Glorot/Xavier Weight Initialization
Gradient Field Matrix Computation
Gradient Vector Computation for Scalar Fields
Gradient Verification via Finite Difference Approximation
Hessian-Based Critical Point Classification
Hybrid Precision Computation for Deep Learning
Hybrid Regularized Linear Optimizer
Iterative Linear System Solver
Momentum-Based Orthogonal Optimizer with Iterative Matrix Conditioning
Muon Optimizer Update with Newton-Schulz Preconditioning
Parameter Optimization Using Gradient-Based Algorithms
Polynomial Global Minimum Finder
Derivative of Polynomial Ratio Using Division Rule
Quantized Low-Rank Adaptation Forward Pass
Robust Hybrid Regression Loss
Second-Order Curvature Matrix Computation
Masked Gradient Descent for Localized Knowledge Editing
Training a Single Neuron with Gradient Descent
Gradient of Softmax Cross-Entropy Loss
Jacobian Matrix of the Softmax Transformation
Sparse Regression Optimizer with L1 Penalty
Dynamic Temperature Scheduling for Stochastic Neural Networks
Warmup Cosine Annealing Learning Rate Scheduler
Binary Classifier Gradient Optimizer
Iterative Solution of Symmetric Positive-Definite Linear Systems Using Conjugate Gradients
Computing the Determinant of a 4×4 Matrix via Cofactor Expansion
Two-by-Two Matrix Decomposition via Jacobi Rotation
Kernel-Based Support Vector Classifier Training
Orthogonal-Triangular Matrix Factorization
Decomposing a 2×2 Matrix via Singular Value Factorization
Softmax Classifier Optimization via Gradient Descent
Feature Engineering Mastery
Categorical Binary Encoding
Categorical Binary Encoding
Categorical Distribution Entropy
Dataset Batch Generator for Training Pipelines
Feature Covariance Computation
Data Normalization Techniques: Z-Score and Min-Max Scaling
Interval Normalization Transform
Polynomial Basis Expansion for Feature Engineering
Range-Bounded Feature Scaling
Synchronized Data Permutation
Ordered Polynomial Feature Generator
Partition Dataset by Feature Threshold
Proportional Class Partitioning for Dataset Splitting
Random Dataset Subset Generation for Ensemble Learning
Simple Linear Regression
Categorical Cross-Entropy Loss Computation
Categorical Cross-Entropy Loss Computation
Majority Vote Ensemble Classifier
L2-Regularized Linear Regression Loss Computation
Sigmoid-Based Binary Classifier
Single Neuron Binary Classifier with Sigmoid Activation
Centroid-Based Data Partitioning
Decision Tree Complexity Threshold Analysis
Density-Based Spatial Clustering
Energy Demand Forecasting with Seasonal Detrending
Focused Loss Computation for Class Imbalance
Information Gain Split Finder
Optimal Gini Split Finder for Binary Classification Trees
Regression Tree Predictor
Soft Target Classification Loss
AdaBoost Ensemble Classifier Training
Recursive Classification Tree Builder
Biological Inspiration
Adaptive Hyperbolic Tangent Transformation
Adaptive Hyperbolic Tangent Transformation
Bounded Linear Activation Function
Exponential Linear Activation Function
Hyperbolic Tangent Activation Function
Kaiming Weight Initialization Strategy
Self-Gating Smooth Activation: The Mish Function
Parametric Rectified Linear Activation
Rectified Linear Activation Function
Self-Gated Neural Activator
Self-Normalizing Exponential Activation
Skip Connection Residual Unit
Smooth Rectifier Activation Function
Bounded Smooth Activation: The Softsign Function
Sparse Expert Efficiency Ratio
Activation Substitution for Neural Circuit Analysis
Gradient Computation Engine (Basic Autograd)
Teacher-Student Soft Target Transfer Loss
Neural Network Trainable Parameter Counter
RLHF Pre-training Regularization Loss for Knowledge Retention
Stochastic Neuron Deactivation for Network Regularization
Stochastic Top-K Expert Routing for Mixture-of-Experts Networks
Building a Fully Connected Neural Network Layer
The Convolution Operation
Channel-wise Batch Normalization for 4D Feature Maps
Channel-wise Batch Normalization for 4D Feature Maps
Grayscale Image Luminance Analyzer
Grayscale Image Intensity Range Analyzer
Image Border Padding with Zeros
Mirror Image Transformation
Perceptual Grayscale Conversion Using Luminosity Weights
Spatial Channel Aggregation
Spatial Mean Downsampling
Smooth Image Rescaling with Bilinear Interpolation
Channel Group Normalization
Channel-Wise Spatial Normalization
2D Convolution Operation
Cross-Channel Lateral Inhibition Normalization
Gradient-Based Edge Detection
Motion Vector Endpoint Error Metric
Derivative of Polynomial Product Using Product Rule
Strided Maximum Pooling with Overlap
Bounding Box Overlap Filtering
Convolutional Network Backpropagation Trainer
Densely Connected Convolutional Block
PCA-Based Color Perturbation for Image Augmentation
Volumetric Convolution Forward Pass
Attention Mechanism
Gated Linear Unit with Swish Activation
Gated Linear Unit with Swish Activation
Attention Head Pruning for Model Compression
Attention Score Clipping Stabilizer
Causal Attention Mechanism
Two-Layer Feed-Forward Network with Skip Connection and Dropout
Gated Attention Mechanism
Localized Sliding Attention Mechanism
Scaled Dot-Product Attention
Self-Attention Weighted Aggregation
Sequence-Wise Feature Normalization with Affine Transform
Sparse Mixture-of-Experts: Dynamic Expert Selection and Aggregation
Autoregressive Text Synthesis Engine
Memory-Efficient Tiled Attention Forward Pass
Parallel Attention Heads Mechanism
Sparse Mixture of Experts Forward Pass
Transformer Position Embedding Generator
Generative Model Fundamentals
Bidirectional Diffusion Transformation
Bidirectional Diffusion Transformation
Diffusion Model Denoising Reconstruction Error
Diffusion Noise Propagation
Optimal Game Move Strategy
Adversarial Network for Gaussian Distribution Synthesis
RL Fundamentals
Cumulative Reward with Temporal Decay
Cumulative Reward with Temporal Decay
Exploration Bonus Action Selector
Intra-Group Advantage Normalization for Policy Training
Unbiased Policy Divergence Estimation for Regularized Optimization
Sample Accuracy and Consensus Voting Metrics
Streaming Average Update for Real-Time Estimation
Bellman Prediction Error for State Value Updates
Trajectory Cumulative Discounted Reward
Adversarial Critic Reward Computation
Token-Budget Aware Reinforcement Learning Loss
Exploration-Exploitation Action Chooser
Grid Navigation Value Estimation
Initial Encounter Value Estimation from Episodic Experience
Action Value Estimation in Markov Decision Processes
Multi-Step Value Estimation
On-Policy Temporal Difference Learning for Action-Value Estimation
Preference-Based Action Selector with Softmax Probabilities
Recency Weighted Value Estimate
State-Value Function Bellman Update
Temporal Difference Value Estimator for Sequential Decision Problems
Unbiased Policy Gradient Objective Computation
Coin Flip Wealth Strategy Optimizer
Group Policy Optimization Objective
Policy Gradient Computation via REINFORCE
Sequence-Level Policy Gradient Objective
Simulation-Based Game Tree Exploration
TD(λ) Value Estimation with Eligibility Traces
Classification Metrics
Average Absolute Deviation Score
Average Absolute Deviation Score
Batch Inference Health Monitor
Binary Classification Outcome Matrix
Binary Overlap Coefficient Calculation
Binary Set Similarity Coefficient
Classification Accuracy Metric
Coefficient of Determination Calculator
Conditional Probability Estimation from Categorical Observations
Statistical Divergence Between Probability Distributions
Computing Gini Impurity for Classification Labels
Harmonic Balance Metric for Binary Classification
Weighted Harmonic Mean of Precision and Recall
Inference Performance Metrics Calculator
Language Model Perplexity Score
Model Fit Diagnosis: Identifying Generalization Issues
Compute Service Level Agreement Metrics for ML Inference Endpoints
Precision Evaluation Metric for Binary Classification
Prediction Error Magnitude Calculator
Sensitivity Score for Binary Classifier
Service Latency Percentile Metrics
Text Accuracy Evaluator with Normalization
Vector Angular Similarity Measure
Binary Classifier Evaluation Suite
Binary Classifier Performance Curve
Binary Feature Probabilistic Classifier
Canary Deployment Health Analysis for ML Model Rollouts
Sample Mean Convergence to Gaussian Distribution
Classification Outcome Matrix Builder
Cluster Cohesion Coefficient for Clustering Quality Assessment
Code Output Validator for Automated Assessment
Data Partitioning with Cross-Validation Splits
Dataset Integrity Metrics for Production ML Systems
Distribution Stability Analysis Using Stability Divergence Index
Inference Request Batching
LaTeX Delimited Answer Extraction
Mathematical Expression Equivalence Validator
Binary Classification Quality Score Using Matthews Correlation
Multi-Evaluator Quality Assessment Score
Multiple Choice Log-Probability Evaluation
Pairwise Ranking Score Adjustment for Competitive Models
Pairwise Ranking Strength Estimator
Population Mean Confidence Estimator
Posterior Parameter Estimation with Conjugate Prior
Precision-Recall Curve for Binary Classification
Model Prediction Distribution Drift Detector
Probabilistic Gaussian Classifier
Probability Calibration Assessment
Proximity-Based Neighbor Retrieval
Receiver Operating Characteristic Curve Area Computation
Symmetric 8-Bit Integer Quantization
N-Gram Precision Score for Text Generation Evaluation
Translation Alignment Metric for Quality Assessment
Unigram Overlap Evaluation Metric
Variance Ratio Criterion for Cluster Quality Assessment
Weighted Model Response Evaluator
Approximate Posterior Quality Metric via Monte Carlo Sampling
Workflow Dependency Scheduler with Critical Path Analysis
Automated Feature Engineering
Single Word Frequency Likelihood
Single Word Frequency Likelihood
Association Strength Metric Between Events
Optimal String Edit Metric
Probabilistic Document Relevance Scorer (BM25)
Computing Document Term Relevance Scores
Complete this path to earn a personalised certificate. You choose whether to make it public.