airunner

What it does

Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows

Summary based on the project's own description. The Japanese page has a fuller beginner guide: setup difficulty, what to prepare, and a step-by-step start.

Screenshots & visuals