math 3 Doing MORE To consume LESS – Flash Attention V1 Feb 8, 2025 The Hidden Beauty of Sinusoidal Positional Encodings in Transformers Nov 1, 2024 Vanishing and exploding Gradients – A non-flat-earther's perspective. Oct 28, 2024