llama.cpp
C/C++ LLM inference engine behind many local AI apps.
Research notes
How we research- Official site loadsChecked Oct 13, 2026: github.com
- Pricing checked on the vendor siteSource: https://github.com/ggml-org/llama.cpp
- Pricing note re-checked Oct 13, 2026No correction needed.
- Free / DIY pathOpen source (MIT)
Listed because it fits the Local AI category. Listings are free; sponsored placements, if any, are labeled and never change rankings.
Alternatives
Ollama
Local AIRun open models locally with one command and a local API.
LM Studio
Local AIDesktop app to download and chat with local models (GGUF/MLX).
MLX
Local AIApple's array framework for fast ML on Apple silicon.
Open WebUI
Local AISelf-hosted ChatGPT-style web UI for Ollama and other backends.
vLLM
Local AIHigh-throughput LLM serving engine for NVIDIA GPU servers.
Mac Studio (hardware)
Local AIApple desktop with large unified memory, popular for local LLMs.
NVIDIA DGX Spark (hardware)
Local AIDesktop Grace Blackwell AI system with 128GB unified memory.
GPT4All (Nomic)
Local AIDesktop app for running local LLMs privately.
AnythingLLM
Local AIAll-in-one local/self-hosted AI app with RAG and agents.
LocalAI
Local AIOpen-source, OpenAI-compatible API server for running models locally.
Msty
Local AIDesktop app for local and cloud LLMs.
Llama (llama.app)
Local AIFree open-source Mac/Windows tray app from ggml-org that runs Hugging Face models locally on llama.cpp with an OpenAI-compatible API.
Mac mini (hardware)
Local AICompact Apple Silicon desktop for small local-model setups.