An LLM inference engine written in pure Rust, designed to run large models on hardware that would normally refuse them.
rust deep-learning mmap io-uring large-language-models llm-inference sparse-routing weight-streaming low-memory-inference activation-bloom-filters
-
Updated
Jun 1, 2026 - Rust