2025-12-8

how does kv cache work?

i built a toy inference engine to understand kv cache