Local AI

llama-gpt

A fully offline ChatGPT-style chat, frozen in 2024

Visit official page 日本語で詳しく見る

Popularity

★ 11k

Last update

April 2024

License / pricing

MIT

What it does

Self-hosted and offline by design, with nothing leaving the machine — installable on umbrelOS home servers, M1/M2 Macs, plain Docker or Kubernetes, and exposing an OpenAI-compatible API so other tools can call it. The caveat is age: development stopped in April 2024 and the bundled options are Llama 2 era models, which read as noticeably weaker than current ones. Worth it if you already run umbrelOS; otherwise newer local runtimes are easier. MIT.

Summary based on the project's own description. The Japanese page has a fuller beginner guide: setup difficulty, what to prepare, and a step-by-step start.

Screenshots & visuals

Before you start

Setup difficultySome setup needed
Command lineRequired
API keyNot required
Sends data onlineYes

Judged automatically from the project's own metadata. Always confirm on the official page.

llama-gpt FAQ

Is llama-gpt free?: Yes. It runs on your own machine, so there is no usage-based cost either.
Do I need to install anything or write code to use llama-gpt?: It needs the command line. If you are not comfortable typing commands, expect to get stuck during setup.
Does llama-gpt work on a phone?: No. It needs a computer.
Can I use llama-gpt commercially?: The licence is MIT, which permits commercial use. Conditions such as keeping the copyright notice still apply, so read the licence text before shipping it inside something.

How it compares

The conditions that decide whether you can actually use it, side by side.

Tool	Command line	API key	Sends data out	Phone	Commercial use
llama-gpt (this page)	Required	Not needed	Yes	No	Yes
Ollama	Required	Not needed	No	No	Yes
Open WebUI	Required	Not needed	No	No	Yes
llama.cpp	Required	Not needed	No	No	Yes

"Sends data out" means your input is uploaded to someone's server. Pick "No" when the material cannot leave your organisation.

Other local ai tools

Ollama

Run AI models on your own computer with one command

Open WebUI

A ChatGPT-style interface for your local AI

llama.cpp

The lightweight engine that runs LLMs anywhere

vLLM

Serve AI models fast and at scale

Browse all tools Home

What it does

Summary based on the project's own description. The Japanese page has a fuller beginner guide: setup difficulty, what to prepare, and a step-by-step start.

llama-gpt FAQ

Is llama-gpt free?

Yes. It runs on your own machine, so there is no usage-based cost either.

Do I need to install anything or write code to use llama-gpt?

It needs the command line. If you are not comfortable typing commands, expect to get stuck during setup.

Does llama-gpt work on a phone?

No. It needs a computer.

Can I use llama-gpt commercially?

The licence is MIT, which permits commercial use. Conditions such as keeping the copyright notice still apply, so read the licence text before shipping it inside something.

How it compares

The conditions that decide whether you can actually use it, side by side.

Tool	Command line	API key	Sends data out	Phone	Commercial use
llama-gpt (this page)	Required	Not needed	Yes	No	Yes
Ollama	Required	Not needed	No	No	Yes
Open WebUI	Required	Not needed	No	No	Yes
llama.cpp	Required	Not needed	No	No	Yes

"Sends data out" means your input is uploaded to someone's server. Pick "No" when the material cannot leave your organisation.