Sample vs Population Covariance 07/20/2026 Statistics Why does **Sample Covariance** have: $\frac{1}{n-1} \sum_{i=1}^n (x_i - \bar{x})^2$ but **Population Covariance** $\frac{1}{n} \sum_{i=1}^n (x_i - \bar{x})^2$ Why does **Sample Covariance** have: $\frac{1}{n-1} \sum_{i=1}^n (x_i - \bar{x})^2$ but **Population Covariance** $\frac{1}{n} \sum_{i=1}^n (x_i - \bar{x})^2$ Read more →
Vector Normalization 05/05/2026 Generalization Statistics Dataset normalization & uses including: LayerNorm, Dynamic Tanh, BatchNorm, RMSNorm, L1, & L2 Dataset normalization & uses including: LayerNorm, Dynamic Tanh, BatchNorm, RMSNorm, L1, & L2 Read more →
L1 Lasso vs L2 Ridge Regression 05/01/2026 Generalization Statistics L1 Lasso vs L2 Ridge Constraint's Effect on Weight Minimization L1 Lasso vs L2 Ridge Constraint's Effect on Weight Minimization Read more →
L1 Lasso Regularization & Sparsity 04/28/2026 Generalization Statistics $L(w) = ||y-Xw||^2 + \lambda ||w||_1$ L1 Lasso Regularization & Weight Sparsity $L(w) = ||y-Xw||^2 + \lambda ||w||_1$ L1 Lasso Regularization & Weight Sparsity Read more →
Bias Variance of L2 Ridge Regression 04/24/2026 Generalization Statistics How $\lambda$ affect the Bias & Variance for Ridge Regression? How $\lambda$ affect the Bias & Variance for Ridge Regression? Read more →
Decomposition of L2 Ridge Regression 04/23/2026 Statistics Generalization What happens when we increase $\lambda$ in $L(W) = ||y - Wx||^2 + \lambda ||W||^2$ What happens when we increase $\lambda$ in $L(W) = ||y - Wx||^2 + \lambda ||W||^2$ Read more →
Different Forms of Linear Regression 04/23/2026 Statistics It's "M" for mini, should be "W" for "wumbo". - Patrick Star on Isomorphic Representations It's "M" for mini, should be "W" for "wumbo". - Patrick Star on Isomorphic Representations Read more →
Linear Regression as MLE Under Gaussian Noise 04/20/2026 Statistics Finding the Maximum Likelihood Estimation of Data with Gaussian Noise Equivalent to Linear Regression Finding the Maximum Likelihood Estimation of Data with Gaussian Noise Equivalent to Linear Regression Read more →
Linear Regression Solution from Projections onto Subspaces 04/18/2026 Statistics Deriving Linear Regression Normal Form & Showing its Properties Deriving Linear Regression Normal Form & Showing its Properties Read more →