CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving
| Image |  |
|---|---|
| Description | scientific article published on 31 July 2024 |
| Author/s |
author: Ari Holtzman Hanchen Li Yihua Cheng Siddhant Ray Qizheng Zhang Kuntai Du Yuyang Huang Ganesh Ananthanarayanan Junchen Jiang Shan Lu Henry Hoffmann Yuhan Liu Michael Maire Jiayi Yao |
| Publication date | July 31, 2024 |
| Language | |
| Country of origin | |
| Wikipedia link | |
| Copyright status | |
| Missing/wrong data? | Edit Wikidata item |