LocalAI
Open-source, OpenAI-compatible API server for running models locally.
Research notes
How we research- Official site loadsChecked Oct 14, 2026: localai.io
- Pricing checked on the vendor siteConfirmed against the vendor's own site
- Free / DIY pathOpen source
Listed because it fits the Local AI category. Listings are free; sponsored placements, if any, are labeled and never change rankings.
Alternatives
Ollama
Local AIRun open models locally with one command and a local API.
LM Studio
Local AIDesktop app to download and chat with local models (GGUF/MLX).
llama.cpp
Local AIC/C++ LLM inference engine behind many local AI apps.
MLX
Local AIApple's array framework for fast ML on Apple silicon.
Open WebUI
Local AISelf-hosted ChatGPT-style web UI for Ollama and other backends.
vLLM
Local AIHigh-throughput LLM serving engine for NVIDIA GPU servers.
Mac Studio (hardware)
Local AIApple desktop with large unified memory, popular for local LLMs.
NVIDIA DGX Spark (hardware)
Local AIDesktop Grace Blackwell AI system with 128GB unified memory.
GPT4All (Nomic)
Local AIDesktop app for running local LLMs privately.
AnythingLLM
Local AIAll-in-one local/self-hosted AI app with RAG and agents.
Msty
Local AIDesktop app for local and cloud LLMs.
Llama (llama.app)
Local AIFree open-source Mac/Windows tray app from ggml-org that runs Hugging Face models locally on llama.cpp with an OpenAI-compatible API.
Mac mini (hardware)
Local AICompact Apple Silicon desktop for small local-model setups.