Stop Wasting GPU VRAM — PagedAttention & vLLM Architecture
Led the group through the PagedAttention paper (Kwon et al., SOSP 2023): how vLLM pages the KV cache like virtual memory instead of reserving GPU memory for it up front.
Paper Reading Club · ML Indore · Online