Skip to main content
These commands serve a model behind an OpenAI-compatible endpoint and control who can call it. Deployments explains the sequence.

monte deployment create

Deploy a checkpoint or a base model as version v1 of a new deployment. Give exactly one of <checkpoint> or --model. --base loads a LoRA adapter into a running base deployment. Before it deploys a checkpoint, the command checks each servable file against its sha256: the safetensors weights, or the PEFT adapter of a LoRA run.

monte deployment list

List deployments with their status, version, checkpoint, replicas, and endpoint URL.

monte deployment show

Show one deployment: status, endpoint URL, versions and traffic shares, replicas, and queue.

monte deployment update

Change how a deployment scales, or start a new version and move traffic to it. Monte moves the share when the new version is ready. Scaling and Versions explains the rules.

monte deployment logs

Print the model server logs of a deployment, with the replica and the version on each line. The logs never include prompts or completions.

monte deployment rollback

Return to the previous version, or to the version that --to names. Rollback starts replicas for that version if it has none, and moves all traffic to it when it is ready. The current version serves until then.

monte deployment delete

Stop all replicas, remove every version, and free the name. Requests to the name then return 404. The checkpoints and the runs stay.

monte key create

Create an API key for the inference endpoint. The command prints the key once, and Monte keeps only its hash.

monte key list

List the team’s keys with name, prefix, deployments, and last use. The command never prints a full key.

monte key revoke

Revoke a key. Requests with the key get 401 within one minute while the operator is connected. Without the operator, delete the deployment to stop a key.