llamafile

What it does

Combines llama.cpp with Cosmopolitan Libc so a model and its runtime collapse into a single executable that runs unmodified on Windows, macOS and Linux — no environment to prepare on the receiving end. A Mozilla Builders project now maintained by Mozilla.ai, covering text models and Whisper-family speech recognition. Files run to several gigabytes, and the usual caution about running executables from strangers applies with full force here. Apache-2.0.

Summary based on the project's own description. The Japanese page has a fuller beginner guide: setup difficulty, what to prepare, and a step-by-step start.

Screenshots & visuals

Before you start

• Setup difficultyEasy to start
• Command lineRequired
• API keyNot required
• Sends data onlineNo

Judged automatically from the project's own metadata. Always confirm on the official page.

llamafile FAQ

Is llamafile free?

Yes. It runs on your own machine, so there is no usage-based cost either.

Do I need to install anything or write code to use llamafile?

It needs the command line. If you are not comfortable typing commands, expect to get stuck during setup.

Does llamafile work on a phone?

No. It needs a computer.

Can I use llamafile commercially?

The licence is Apache-2.0, which permits commercial use. Conditions such as keeping the copyright notice still apply, so read the licence text before shipping it inside something.

How it compares

The conditions that decide whether you can actually use it, side by side.

"Sends data out" means your input is uploaded to someone's server. Pick "No" when the material cannot leave your organisation.

Other local ai tools