Directory / Local AI
Local AI: AI tools for contractors
15 tools. Links last checked Oct 13, 2026.
Ollama
Local AIRun open models locally with one command and a local API.
LM Studio
Local AIDesktop app to download and chat with local models (GGUF/MLX).
llama.cpp
Local AIC/C++ LLM inference engine behind many local AI apps.
MLX
Local AIApple's array framework for fast ML on Apple silicon.
Open WebUI
Local AISelf-hosted ChatGPT-style web UI for Ollama and other backends.
vLLM
Local AIHigh-throughput LLM serving engine for NVIDIA GPU servers.
Mac Studio (hardware)
Local AIApple desktop with large unified memory, popular for local LLMs.
NVIDIA DGX Spark (hardware)
Local AIDesktop Grace Blackwell AI system with 128GB unified memory.
GPT4All (Nomic)
Local AIDesktop app for running local LLMs privately.
AnythingLLM
Local AIAll-in-one local/self-hosted AI app with RAG and agents.
LocalAI
Local AIOpen-source, OpenAI-compatible API server for running models locally.
Msty
Local AIDesktop app for local and cloud LLMs.
Llama (llama.app)
Local AIFree open-source Mac/Windows tray app from ggml-org that runs Hugging Face models locally on llama.cpp with an OpenAI-compatible API.
Mac mini (hardware)
Local AICompact Apple Silicon desktop for small local-model setups.