kvcache.ai
KVCache.AI is an open source orgnization between MADSys and top industry collaborators, focusing on efficient Agent/LLM serving.
Pinned Loading
Repositories
Showing 10 of 20 repositories
- Mooncake Public
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
- firecracker Public
- kvcache-blog Public
- firecracker-next Public Forked from DecOperations/firecracker-next
Secure and fast lightweight microVMs for serverless computing. This is a fork from loopholelabs that adds live migration and optionally PMV support. (No KVM or Nested Virtualization Needed)
- sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
- ktransformers Public
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Top languages
Loading…
Most used topics
Loading…