★ 11k
April 2024
MIT
Local AI
What we checked ourselves
Not copied from the project's own blurb. These are things we opened and verified, with the date.
- 7 Sept 2026We checked that the link to the project still resolves.
- 13 Sept 2026We read the licence text itself (LICENSE.md). No unusual restrictions were stated.
- 31 Aug 2026We read the project's own documentation and found no sign that development has stopped.
Where this sits among the 47 tools we list in Local AI
- No API key required45 of 47
- Commercial use confirmed as allowed32 of 47
- Requires terminal commands27 that do not →
- Sends your input to the provider34 that do not →
Only 31 of the 47 meet all of the conditions above.
Counted from our own checks: every tool we list is examined against the same criteria.
What it does
Self-hosted and offline by design, with nothing leaving the machine — installable on umbrelOS home servers, M1/M2 Macs, plain Docker or Kubernetes, and exposing an OpenAI-compatible API so other tools can call it. The caveat is age: development stopped in April 2024 and the bundled options are Llama 2 era models, which read as noticeably weaker than current ones. Worth it if you already run umbrelOS; otherwise newer local runtimes are easier. MIT.
Summary based on the project's own description. The Japanese page has a fuller beginner guide: setup difficulty, what to prepare, and a step-by-step start.
Screenshots & visuals
Before you start
- Setup difficultySome setup needed
- Command lineRequired
- API keyNot required
- Sends data onlineYes
Judged automatically from the project's own metadata. Always confirm on the official page.
llama-gpt FAQ
- Is llama-gpt free?
- Yes. It runs on your own machine, so there is no usage-based cost either.
- Do I need to install anything or write code to use llama-gpt?
- It needs the command line. If you are not comfortable typing commands, expect to get stuck during setup.
- Does llama-gpt work on a phone?
- No. It needs a computer.
- Can I use llama-gpt commercially?
- The licence is MIT, which permits commercial use. Conditions such as keeping the copyright notice still apply, so read the licence text before shipping it inside something.
How it compares
The conditions that decide whether you can actually use it, side by side.
| Tool | Command line | API key | Sends data out | Phone | Commercial use |
|---|---|---|---|---|---|
| llama-gpt (this page) | Required | Not needed | Yes | No | Yes |
| Ollama | Required | Not needed | No | No | Yes |
| Open WebUI | Required | Not needed | No | No | Yes |
| llama.cpp | Required | Not needed | No | No | Yes |
"Sends data out" means your input is uploaded to someone's server. Pick "No" when the material cannot leave your organisation.