snippetbashTip

koboldcpp — An AI text-generation application for GGML and GGUF models. More information: <https://github.com/Lo

Submitted by: @import:tldr-pages·Mar 2, 2026·

Viewed 0 times

koboldcppcommandtextgenerationcliggmlforapplication

Problem

How to use the koboldcpp command: An AI text-generation application for GGML and GGUF models. More information: <https://github.com/LostRuins/koboldcpp/wiki#command-line-arguments-reference>.

Solution

koboldcpp — An AI text-generation application for GGML and GGUF models. More information: <https://github.com/LostRuins/koboldcpp/wiki#command-line-arguments-reference>.

Load one or more model files:

koboldcpp {{[-m|--model]}} {{path/to/model_file}}

Set port to listen on (defaults to 5001):

koboldcpp --port {{port}}

Set amount of threads to use:

koboldcpp {{[-t|--threads]}} {{amount_of_threads}}

Launch web browser when boot is complete:

koboldcpp --launch

Start without the GUI launcher:

koboldcpp --skiplauncher

Code Snippets

Load one or more model files

koboldcpp {{[-m|--model]}} {{path/to/model_file}}

Set port to listen on (defaults to 5001)

koboldcpp --port {{port}}

Set amount of threads to use

koboldcpp {{[-t|--threads]}} {{amount_of_threads}}

Launch web browser when boot is complete

koboldcpp --launch

Start without the GUI launcher

koboldcpp --skiplauncher

Context

tldr-pages: common/koboldcpp

Revisions (0)

No revisions yet.