Skip to main content

Docker

This guide explains how to launch Tabby using docker.

For CUDA support in Tabby, install the NVIDIA Container Toolkit. After installation, you can start Tabby with the following command:

run.sh
docker run -it --gpus all \
-p 8080:8080 -v $HOME/.tabby:/data \
registry.tabbyml.com/tabbyml/tabby \
serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct --device cuda