NVIDIA DGX Spark setup for local AI

Reviewed by the Contractor AI Shop research team · Last updated Oct 14, 2026 · How we research

The DGX Spark is a desktop Grace Blackwell system with 128GB of unified memory, so it can serve models to the office.

1. First boot

Follow the official DGX Spark User Guide for setup, networking and updates.

2. Use NVIDIA playbooks

build.nvidia.com/spark has step-by-step playbooks (Ollama, Open WebUI, vLLM, fine-tuning).

3. Serve models

Start simply with Ollama. Use vLLM for higher-throughput, multi-user, OpenAI-compatible serving.

4. Team access

Put Open WebUI in front with user accounts. Keep it on the LAN or VPN, not open to the internet.