Kafka Queues 08/08/2026 System Design Databases Ordered Message Queues Across Distributed Systems Ordered Message Queues Across Distributed Systems Read more →
Logistic Regression: Deriving Gradients using Matrix Calculus 07/23/2026 ML Foundations Information Theory Derivation of $\frac{\partial L}{\partial M}$ for Cross Entropy Loss $L(y) = - \sum_{i=1}^C g\ log(y)$ with ground truth $g$, predicted $y$ Derivation of $\frac{\partial L}{\partial M}$ for Cross Entropy Loss $L(y) = - \sum_{i=1}^C g\ log(y)$ with ground truth $g$, predicted $y$ Read more →
The Core of Backprop 3: Deriving $\frac{\partial L}{\partial M}$ using Matrix Calculus 07/22/2026 ML Foundations Very elegant & short derivation of: $\frac{\partial L}{\partial M}$ for loss $L$ to update $M$ in Linear Layers Very elegant & short derivation of: $\frac{\partial L}{\partial M}$ for loss $L$ to update $M$ in Linear Layers Read more →
Sample vs Population Covariance 07/20/2026 Statistics Why does **Sample Covariance** have: $\frac{1}{n-1} \sum_{i=1}^n (x_i - \bar{x})^2$ but **Population Covariance** $\frac{1}{n} \sum_{i=1}^n (x_i - \bar{x})^2$ Why does **Sample Covariance** have: $\frac{1}{n-1} \sum_{i=1}^n (x_i - \bar{x})^2$ but **Population Covariance** $\frac{1}{n} \sum_{i=1}^n (x_i - \bar{x})^2$ Read more →
Redis Clusters 07/13/2026 System Design Databases What if we need more than one Redis Instance? What if we need more than one Redis Instance? Read more →
Fourier Series as Basis Functions 06/28/2026 Math How the Fourier Series act as Basis Functions in Function Space $L^2[-\pi,\pi]$ How the Fourier Series act as Basis Functions in Function Space $L^2[-\pi,\pi]$ Read more →
Sinusoidal Positional Encodings 06/26/2026 Transformers Overview of Sinusoidal Positional Encodings from *Attention is All You Need* & *NeRF* Overview of Sinusoidal Positional Encodings from *Attention is All You Need* & *NeRF* Read more →
We're so Banach 06/07/2026 Math Banach Spaces: Complete, Normed Vector Spaces Banach Spaces: Complete, Normed Vector Spaces Read more →
No Holes Allowed! What's a Complete Space? 06/04/2026 Math When Cauchy Sequences Converge we get no Holes! When Cauchy Sequences Converge we get no Holes! Read more →
Closed, Open, Clopen 06/01/2026 Math What's a Clopen? Open Sets, Closure, Closed Sets, Clopen Sets, & Connected Sets What's a Clopen? Open Sets, Closure, Closed Sets, Clopen Sets, & Connected Sets Read more →