transformers 2 KV cache – The how not to waste your FLOPS starter Nov 21, 2024 Attention scores, Scaling and Softmax Nov 11, 2024