No Holes Allowed! What's a Complete Space? June 04, 2026 Math When Cauchy Sequences Converge we get no Holes! Read more β
Closed, Open, Clopen June 01, 2026 Math What's a Clopen? Open Sets, Closure, Closed Sets, Clopen Sets, & Connected Sets Read more β
Metric Space vs Inner Product Space May 31, 2026 Math Introductory Comparison & Definitions of a Metric Space vs an Inner Product Space Read more β
Tokenization & Embeddings May 12, 2026 Transformers π GitHub Words $\rightarrow$ Tokens $\rightarrow$ Embeddings $\rightarrow$ Network Read more β
Vector Normalization May 05, 2026 Generalization Statistics Dataset normalization & uses including: LayerNorm, Dynamic Tanh, BatchNorm, RMSNorm, L1, & L2 Read more β
L1 Lasso vs L2 Ridge Regression May 01, 2026 Generalization Statistics L1 Lasso vs L2 Ridge Constraint's Effect on Weight Minimization Read more β
L1 Lasso Regularization & Sparsity April 28, 2026 Generalization Statistics $L(w) = ||y-Xw||^2 + \lambda ||w||_1$ L1 Lasso Regularization & Weight Sparsity Read more β
Bias Variance of L2 Ridge Regression April 24, 2026 Generalization Statistics How $\lambda$ affect the Bias & Variance for Ridge Regression? Read more β
Decomposition of L2 Ridge Regression April 23, 2026 Generalization Statistics What happens when we increase $\lambda$ in $L(W) = ||y - Wx||^2 + \lambda ||W||^2$ Read more β