Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions docs/content/blog/2024-04-24-reranker-api.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
+++
title = "Reranker API"
date = 2024-04-24
description = "A new reranker backend implementing the Jina rerankers API."
url = "/blog/reranker-api/"
+++

A new reranker backend lands, implementing the Jina rerankers API, in [PR #2121](https://github.com/mudler/LocalAI/pull/2121).

See [Reranker]({{% relref "features/reranker" %}}).
13 changes: 13 additions & 0 deletions docs/content/blog/2024-05-14-distributed-and-p2p-inferencing.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
+++
title = "Distributed and decentralized P2P inferencing"
date = 2024-05-14
description = "Distributed llama.cpp inferencing, followed by fully decentralized peer-to-peer inference."
url = "/blog/distributed-and-p2p-inferencing/"
+++

Two changes that set up everything LocalAI later built on top of:

- [Distributed llama.cpp inferencing](https://github.com/mudler/LocalAI/pull/2324), splitting a model across machines.
- [Totally decentralized, private, distributed peer-to-peer inference](https://github.com/mudler/LocalAI/pull/2343).

See [Distributed inferencing]({{% relref "features/distributed_inferencing" %}}).
15 changes: 15 additions & 0 deletions docs/content/blog/2024-08-02-p2p-federation-and-swarms.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
+++
title = "P2P dashboard, federated mode and AI swarms"
date = 2024-08-02
description = "A P2P dashboard, federation, AI swarms, global community pools, FLUX-1 support and the P2P Explorer."
url = "/blog/p2p-federation-and-swarms/"
+++

The peer-to-peer work matured over July and August:

- [A P2P dashboard, federated mode and AI swarms](https://github.com/mudler/LocalAI/pull/2723).
- [Global community pools](https://github.com/mudler/LocalAI/issues/3113), for sharing federated instances and workers.
- FLUX-1 support.
- The [P2P Explorer](https://explorer.localai.io).

See [Distributed inferencing]({{% relref "features/distributed_inferencing" %}}).
8 changes: 8 additions & 0 deletions docs/content/blog/2024-10-01-examples-moved-out.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
+++
title = "Examples move to LocalAI-examples"
date = 2024-10-01
description = "The examples directory leaves the main repository and gets its own home."
url = "/blog/examples-moved-out/"
+++

The examples have moved out of the main repository into [LocalAI-examples](https://github.com/mudler/LocalAI-examples), where they can be versioned and maintained independently of the runtime.
9 changes: 9 additions & 0 deletions docs/content/blog/2024-11-20-vad-and-bark-cpp.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
+++
title = "Voice Activity Detection and bark.cpp"
date = 2024-11-20
description = "Silero-based Voice Activity Detection, plus a bark.cpp backend for audio generation."
url = "/blog/vad-and-bark-cpp/"
+++

- [Voice Activity Detection](https://github.com/mudler/LocalAI/pull/4204), via a Silero VAD backend. See [Voice activity detection]({{% relref "features/voice-activity-detection" %}}).
- [A bark.cpp backend](https://github.com/mudler/LocalAI/pull/4287) for audio generation.
10 changes: 10 additions & 0 deletions docs/content/blog/2024-12-03-stablediffusion-cpp-backend.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
+++
title = "stablediffusion.cpp backend (ggml)"
date = 2024-12-03
description = "A ggml-based stablediffusion.cpp backend for image generation."
url = "/blog/stablediffusion-cpp-backend/"
+++

A ggml-based `stablediffusion.cpp` backend lands for image generation, in [PR #4289](https://github.com/mudler/LocalAI/pull/4289).

See [Image generation]({{% relref "features/image-generation" %}}).
12 changes: 12 additions & 0 deletions docs/content/blog/2025-07-24-modular-backend-architecture.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
+++
title = "Backends move outside the main binary"
date = 2025-07-24
description = "All backends migrate out of the main binary, leaving a lightweight modular core that pulls engines on demand."
url = "/blog/modular-backend-architecture/"
+++

All backends have been migrated outside the main binary. The core stays small, and each backend is an isolated service installed on demand.

This is the architecture LocalAI still runs on: install, update or remove engines independently, and mix CPU, NVIDIA, AMD, Intel, Apple Silicon, Vulkan and Jetson in one deployment.

See [Backends]({{% relref "features/backends" %}}) and the [v3.2.0 release notes](https://github.com/mudler/LocalAI/releases/tag/v3.2.0).
10 changes: 10 additions & 0 deletions docs/content/blog/2025-08-12-apple-silicon-backends.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
+++
title = "MLX, MLX-VLM, Diffusers and llama.cpp on Apple Silicon"
date = 2025-08-12
description = "Apple Silicon gains first-class backend coverage."
url = "/blog/apple-silicon-backends/"
+++

MLX, MLX-VLM, Diffusers and llama.cpp are now supported on Apple Silicon, giving Mac users the same backend choice available elsewhere.

Released as part of [v3.4.0](https://github.com/mudler/LocalAI/releases/tag/v3.4.0).
13 changes: 13 additions & 0 deletions docs/content/blog/2025-09-03-launcher-and-extended-backends.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
+++
title = "New launcher, extended backend support, MLX-Audio and WAN 2.2"
date = 2025-09-03
description = "A desktop launcher for macOS and Linux, wider backend coverage for Mac and Nvidia L4T, MLX-Audio and WAN 2.2."
url = "/blog/launcher-and-extended-backends/"
+++

- A new [launcher app](https://github.com/mudler/LocalAI/pull/6127) for macOS and Linux, so LocalAI can be started and managed without the terminal.
- Extended backend support for Mac and Nvidia L4T.
- MLX-Audio.
- WAN 2.2.

Released as part of [v3.5.0](https://github.com/mudler/LocalAI/releases/tag/v3.5.0).
10 changes: 10 additions & 0 deletions docs/content/blog/2025-10-05-mcp-support.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
+++
title = "Model Context Protocol (MCP) support"
date = 2025-10-05
description = "Agentic capabilities through MCP, with a new chat/completion endpoint that can call MCP tools."
url = "/blog/mcp-support/"
+++

LocalAI gains [Model Context Protocol](https://modelcontextprotocol.io) support for agentic capabilities, through [a new chat/completion endpoint](https://github.com/mudler/LocalAI/pull/6381) that can reach MCP tools, plus [a UI toggle to enable it](https://github.com/mudler/LocalAI/pull/6400).

See [MCP]({{% relref "features/mcp" %}}).
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
+++
title = "Import models via URL, multiple chats and history"
date = 2025-11-24
description = "Point LocalAI at a model URL to import it, and keep several chat threads with their history in the UI."
url = "/blog/import-models-via-url-and-chat-history/"
+++

Two usability changes:

- [Import models via URL](https://github.com/mudler/LocalAI/pull/7245). Paste a model URL and LocalAI handles the download and configuration.
- [Multiple chats and history](https://github.com/mudler/LocalAI/pull/7325) in the UI, so conversations persist and can run in parallel.
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
+++
title = "Dynamic memory reclaimer, multi-GPU fitting and Vibevoice"
date = 2025-12-16
description = "Reclaim GPU memory from idle models, fit llama.cpp models across multiple GPUs automatically, and generate long-form speech with Vibevoice."
url = "/blog/memory-reclaimer-and-multi-gpu-fitting/"
+++

Three additions this month:

- [A dynamic memory resource reclaimer](https://github.com/mudler/LocalAI/pull/7583), which frees GPU memory held by idle models.
- [Automatic multi-GPU model fitting for llama.cpp](https://github.com/mudler/LocalAI/pull/7584), so a model too large for one device is split across several without hand-tuning.
- [The Vibevoice backend](https://github.com/mudler/LocalAI/pull/7494) for long-form speech.
17 changes: 17 additions & 0 deletions docs/content/blog/2026-01-18-localai-3-10-0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
+++
title = "LocalAI 3.10.0"
date = 2026-01-18
description = "Anthropic API support, the Open Responses API, video and image generation with LTX-2, unified GPU backends, tool streaming, Moonshine and Pocket-TTS."
url = "/blog/localai-3-10-0/"
+++

LocalAI 3.10.0 is out.

- Anthropic API support.
- The Open Responses API.
- Video and image generation with LTX-2.
- Unified GPU backends.
- Tool streaming.
- Moonshine and Pocket-TTS.

[Full release notes](https://github.com/mudler/LocalAI/releases/tag/v3.10.0).
11 changes: 11 additions & 0 deletions docs/content/blog/2026-02-05-realtime-api-and-ace-step.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
+++
title = "Realtime API and ACE-Step 1.5"
date = 2026-02-05
description = "Audio-to-audio with tool calling through the Realtime API, plus ACE-Step 1.5 music generation."
url = "/blog/realtime-api-and-ace-step/"
+++

Two additions this month:

- [The Realtime API for audio-to-audio with tool calling](https://github.com/mudler/LocalAI/pull/6245). See [Realtime API]({{% relref "features/openai-realtime" %}}).
- [ACE-Step 1.5 support](https://github.com/mudler/LocalAI/pull/8396) for music generation.
16 changes: 16 additions & 0 deletions docs/content/blog/2026-03-14-localai-4-0-0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
+++
title = "LocalAI 4.0.0: native agentic orchestration"
date = 2026-03-14
description = "The Agenthub community hub, a full React UI rewrite with Canvas mode, MCP Apps with tool streaming, WebRTC realtime audio, and MLX-distributed."
url = "/blog/localai-4-0-0/"
+++

LocalAI 4.0.0 brings agentic orchestration into the core.

- Native agentic orchestration, with the new [Agenthub](https://agenthub.localai.io) community hub.
- A full React UI rewrite, including Canvas mode.
- [MCP Apps and client-side MCP](https://github.com/mudler/LocalAI/pull/8947) with tool streaming.
- [WebRTC realtime audio](https://github.com/mudler/LocalAI/pull/8790).
- [MLX-distributed](https://github.com/mudler/LocalAI/pull/8801).

[Full release notes](https://github.com/mudler/LocalAI/releases/tag/v4.0.0).
17 changes: 17 additions & 0 deletions docs/content/blog/2026-04-02-localai-4-1-0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
+++
title = "LocalAI 4.1.0: LocalAI becomes a control tower"
date = 2026-04-02
description = "Distributed cluster mode with VRAM-aware routing and autoscaling, a multi-user platform with OIDC, per-user quotas, in-UI fine-tuning, and a visual pipeline editor."
url = "/blog/localai-4-1-0/"
+++

LocalAI 4.1.0 turns LocalAI into a control tower rather than a single inference server.

- Distributed cluster mode, with VRAM-aware smart routing and autoscaling.
- A multi-user platform with OIDC and API keys.
- Per-user quotas with predictive analytics.
- In-UI fine-tuning with TRL, including automatic export to GGUF.
- An on-the-fly quantization backend.
- A visual pipeline editor.

[Full release notes](https://github.com/mudler/LocalAI/releases/tag/v4.1.0).
20 changes: 20 additions & 0 deletions docs/content/blog/2026-04-22-face-recognition-backend.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
+++
title = "Face recognition backend"
date = 2026-04-22
description = "insightface-powered 1:1 verification, 1:N identification, face embedding, detection and demographic analysis."
url = "/blog/face-recognition-backend/"
+++

A new face recognition backend, powered by `insightface`, covering:

- 1:1 verification
- 1:N identification
- Face embedding
- Face detection
- Demographic analysis

It ships with two model options: the non-commercial `buffalo_l`, and an Apache 2.0 alternative from the OpenCV Zoo.

See [Face recognition]({{% relref "features/face-recognition" %}}). Shipped in [PR #9480](https://github.com/mudler/LocalAI/pull/9480).

The engine was later rewritten from scratch in C++/ggml: see [Native biometric backends]({{% relref "blog/2026-06-28-native-biometric-backends" %}}).
19 changes: 19 additions & 0 deletions docs/content/blog/2026-05-04-audio-transform.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
+++
title = "Audio Transform"
date = 2026-05-04
description = "A generic audio-in / audio-out endpoint with an optional reference signal. First implementation: LocalVQE, a joint AEC, noise suppression and dereverberation engine."
url = "/blog/audio-transform/"
+++

Audio Transform is a generic audio-in / audio-out endpoint, with an optional reference signal for tasks that need one.

The first implementation is [LocalVQE](https://github.com/localai-org/LocalVQE), a C++ backend doing joint acoustic echo cancellation, noise suppression and dereverberation in a DeepVQE-style model.

Both call styles are supported:

- Batch, via `POST /audio/transformations`.
- Bidirectional streaming, via the `/audio/transformations/stream` WebSocket.

Studio gains a "Transform" tab with synchronized waveform players for the input, reference and output signals.

See [Audio transform]({{% relref "features/audio-transform" %}}). Shipped in [PR #9640](https://github.com/mudler/LocalAI/pull/9640).
17 changes: 17 additions & 0 deletions docs/content/blog/2026-05-05-speaker-diarization.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
+++
title = "Speaker diarization"
date = 2026-05-05
description = "A /v1/audio/diarization endpoint returning who spoke when, backed by sherpa-onnx and vibevoice-cpp."
url = "/blog/speaker-diarization/"
+++

`POST /v1/audio/diarization` is a new endpoint that returns "who spoke when" as a list of segments.

Two backends serve it:

- `sherpa-onnx` for pure diarization, combining pyannote-3.0, speaker embeddings and clustering.
- `vibevoice-cpp` for diarization bundled with long-form ASR.

Responses are available as `json`, `verbose_json` or `rttm`.

See [Audio diarization]({{% relref "features/audio-diarization" %}}). Shipped in [PR #9654](https://github.com/mudler/LocalAI/pull/9654).
Loading
Loading