Docker

This guide explains how to launch Tabby using docker.

CUDA

For CUDA support in Tabby, install the NVIDIA Container Toolkit. After installation, you can start Tabby with the following command:

run.sh

docker run -it --gpus all \
  -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby serve --model StarCoder-1B --device cuda

CPU

run.sh

docker run --entrypoint /opt/tabby/bin/tabby-cpu -it \
  -p 8080:8080 -v $HOME/.tabby:/data \
  tabbyml/tabby serve --model StarCoder-1B