inference 2 Guidance – Structuring your outputs is easier than you think Jan 4, 2025 KV cache – The how not to waste your FLOPS starter Nov 21, 2024