Accurate KV Cache Eviction via Anchor Direction Projection for Efficient LLM Inference

Devs

Accurate KV Cache Eviction via Anchor Direction Projection for Efficient LLM Inference | Read Paper on Bytez