KoboldCpp runs AI models on your own computer. This guide takes you from download to your first chat in four steps. You don't need to know anything about AI.
Download KoboldCpp: one file from GitHub. There is no installer.
Start KoboldCpp: open the file. A settings window, the launcher, appears.
Choose a model and launch: the model is the AI itself. The launcher can download one for you.
Chat: KoboldAI Lite opens in your web browser.
What you need
Section titled “What you need”- A computer with Windows, Linux, or a Mac with an Apple Silicon (M-series) chip.
- Up to about 8 GB of free disk space for KoboldCpp and a beginner model.
- A graphics card is not required. With one, replies come much faster.
Stuck at any point? See Help and next steps. Everything beyond the basics is in the wiki.