llama.cpp

What it does

Runs AI models efficiently on ordinary CPUs and laptops. The core technology under many local-AI apps.

Summary based on the project's own description. The Japanese page has a fuller beginner guide: setup difficulty, what to prepare, and a step-by-step start.

Screenshots & visuals