Local Models & Runtimes
Run LLMs on your own laptop or server.
6 projects · catalog last checked 2026-10-20. "Highlight" is editorial; status, commit and release come from the weekly evidence refresh.
Comparison
| Project | What it does | Highlight (editorial) | Deployment | Hardware | Licence | Status |
|---|---|---|---|---|---|---|
| GPT4All | Desktop app for private local LLM chat | Non-technical desktop users | local | cpu-ok | MIT | active |
| Ollama | One-command local model runner with OpenAI-compatible API | Easiest local API | local | cpu-ok | MIT | active |
| llama.cpp | Portable C/C++ inference for GGUF models | CPU / Apple Silicon | local | cpu-ok | MIT | active |
| llamafile | Single-file executable LLMs | Zero-install distribution | local | cpu-ok | Apache-2.0 ⚠ needs review | active |
| LocalAI | Drop-in OpenAI API replacement for local models | Multi-modal local API | local | cpu-ok | MIT | active |
| Text Generation WebUI | Gradio UI supporting many backends | Experimenting with backends | local | cpu-ok | AGPL-3.0 | active |
Quick start
curl -fsSL https://ollama.com/install.sh | sh
ollama run llama3.2
Project details
GPT4All
Desktop app for private local LLM chat
| Upstream repository | GPT4All on GitHub |
| Setup docs | GPT4All setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2025-05-27 |
| Latest release | v3.10.0 (2025-02-25) |
| Deployment | local |
| Hardware | cpu-ok |
| Languages | C++ |
| Evidence collected | 2026-10-20 |
Ollama
One-command local model runner with OpenAI-compatible API
| Upstream repository | Ollama on GitHub |
| Setup docs | Ollama setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-10-20 |
| Latest release | v0.40.6 (2026-10-16) |
| Deployment | local |
| Hardware | cpu-ok |
| Languages | Go |
| Evidence collected | 2026-10-20 |
llama.cpp
Portable C/C++ inference for GGUF models
| Upstream repository | llama.cpp on GitHub |
| Setup docs | llama.cpp setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-10-20 |
| Latest release | v0.7.0 (2026-10-15) |
| Deployment | local |
| Hardware | cpu-ok |
| Languages | C++ |
| Evidence collected | 2026-10-20 |
llamafile
Single-file executable LLMs
| Upstream repository | llamafile on GitHub |
| Setup docs | llamafile setup guide |
| Licence | Apache-2.0 ⚠ needs review · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | NOASSERTION |
| Repository state | active |
| Licence review reason | LICENSE text is Apache-2.0 but GitHub's detector returns NOASSERTION; vendored third-party components not reviewed. |
| Last lookup | ok |
| Last commit | 2026-10-08 |
| Latest release | 0.10.6 (2026-09-15) |
| Deployment | local |
| Hardware | cpu-ok |
| Languages | C++ |
| Evidence collected | 2026-10-20 |
LocalAI
Drop-in OpenAI API replacement for local models
| Upstream repository | LocalAI on GitHub |
| Setup docs | LocalAI setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-10-20 |
| Latest release | v4.11.0 (2026-10-02) |
| Deployment | local |
| Hardware | cpu-ok |
| Languages | Go |
| Evidence collected | 2026-10-20 |
Text Generation WebUI
Gradio UI supporting many backends
| Upstream repository | Text Generation WebUI on GitHub |
| Setup docs | Text Generation WebUI setup guide |
| Licence | AGPL-3.0 · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | AGPL-3.0 |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-08-17 |
| Latest release | v4.9 (2026-05-20) |
| Deployment | local |
| Hardware | cpu-ok |
| Languages | Python |
| Evidence collected | 2026-10-20 |