Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
hasanar1f
9 months ago
|
parent
|
context
|
favorite
| on:
Lossless LLM 3x Throughput Increase by LMCache
Is LMCache entirely lossless? Cuz, the kv cache streamig in the Cachegen paper was not lossless. Or is there any way to control the loss in LMCache?
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: