Skip to content
KoboldCpp
GitHub

AI Horde worker

The AI Horde is a volunteer network: people run models on their own computers and others use them over the internet. KoboldCpp has a built-in worker, so you can share your text model with the Horde while you run it.

The worker only takes Horde jobs while you are not using the model yourself: it waits until there has been no local request for 20 seconds.

Set it up

Section titled “Set it up”

You need an AI Horde API key. Register at aihorde.net/register to get one.

  1. Load your text model as usual.
  2. In the launcher, open the Horde Worker tab and tick Configure for Horde.
  3. Enter your key in API Key (If Embedded Worker): and a name for your worker in Horde Worker Name:.
  4. Click Launch.

On the command line:

Terminal
koboldcpp --model mymodel.gguf --hordekey YOUR_KEY --hordeworkername my-worker

Both the key and the worker name are required. With only the key, KoboldCpp prints "Horde worker could not start. You need to specify a horde worker name with --hordeworkername".

With a Horde worker, KoboldCpp switches to quiet mode automatically.

Options

Section titled “Options”
Launcher fieldFlagWhat it does
Horde Model Name:--hordemodelnameThe model name shown on the Horde. Empty means the file name. KoboldCpp adds koboldcpp/ in front.
Gen. Length:--hordegenlenMost tokens your worker generates per Horde job. Default 1024.
Max Context:--hordemaxctxLargest context your worker accepts from a Horde job. 0 means your context size; it cannot go higher.
API Key (If Embedded Worker):--hordekeyYour AI Horde API key.
Horde Worker Name:--hordeworkernameYour worker's name on the Horde.

Advanced

Section titled “Advanced”
  • These three settings are not Horde-only. Horde Model Name: also renames the model in /api/v1/model and /v1/models. Gen. Length: and Max Context: are also what /api/v1/config/max_length and /api/v1/config/max_context_length report to other apps.
  • With --parallelrequests N, KoboldCpp starts N workers under the same name.
  • After repeated errors, the worker pauses for growing periods, and stops after too many.
  • If the worker fails with certificate (SSL) errors, --nocertify turns off certificate checks for all outgoing connections. This is insecure: whoever intercepts the connection can read your Horde API key. Use it only as a last resort.
Section titled “Related”