Ollama
One-command local LLM runtime.
OPEN SOURCECPU-CAPABLE
Local LLM Runners
Best AI tools for run llms locally
Run large language models on your own hardware.
21 TOOLS INDEXED · HARDWARE-VERIFIED
[ BEFORE YOU CHOOSE ]
The decision that matters
Select for model-format support, context needs, and the amount of CPU/GPU offload you can tolerate—not only for the largest model the launcher can download.
Check these constraints
- Exact quantization and model size
- Target context and concurrent sessions
- GPU backend and system-RAM headroom
Compare the catalogue
FILTERS //21 / 21 SHOWN
HARDWARE:
21 TOOLS
Cline
Agentic coding in VS Code — reads, writes, runs, browses.
OPEN SOURCECLOUD · NO GPU
Open WebUI
Self-hosted ChatGPT-style frontend for Ollama / OpenAI.
OPEN SOURCEVIA OLLAMA
LM Studio
Desktop GUI for running local LLMs.
FREEMIUMCPU-CAPABLE
llama.cpp
The C++ inference engine powering most local LLMs.
OPEN SOURCECPU-CAPABLE
Continue
Open-source Copilot — VS Code & JetBrains, any model.
OPEN SOURCECPU-CAPABLE
LobeChat
Beautifully designed chat UI with plugins and image generation.
OPEN SOURCECPU-CAPABLE
Jan
Open-source ChatGPT desktop — runs models locally or via API.
OPEN SOURCECPU-CAPABLE
faster-whisper
Whisper, 4× faster, same accuracy. CTranslate2 backend.
OPEN SOURCE2–6 GB VRAM
VRAM fit2–6 GB
Msty
Polished local-LLM client with split chats and knowledge stacks.
FREEMIUM · $4.16/MOCPU-CAPABLE
Aider
Terminal-native AI pair programmer with git awareness.
OPEN SOURCECPU-CAPABLE
AnythingLLM
RAG-first local LLM workspace with workspaces and agents.
OPEN SOURCECPU-CAPABLE
Text Generation WebUI
The "A1111 for LLMs" — multi-loader local chat UI.
OPEN SOURCE6–24 GB VRAM
VRAM fit6–24 GB
Open Interpreter
Natural-language code execution on your machine.
OPEN SOURCECPU-CAPABLE
Stable Audio Open
Open-weight text-to-audio — 47-second sound effects and music.
OPEN SOURCE6–8 GB VRAM
VRAM fit6–8 GB