Skip to main content
Train an open-weight model on a team’s own tasks. A training run takes a training config, training data, and a starting point, and saves checkpoints as it trains. Every checkpoint can be scored on the experiment’s evals and deployed.
The run saves a checkpoint every 50 steps and at its last step, so this run ends with train-07/200. A run starts only after every eval in the experiment has a baseline.

Choose a Method

The training config sets the method. The method sets the kind of training data.

Choose Full Fine-Tune or LoRA

A lora block in the training config trains low-rank adapters, and the base weights do not change. Without the block, the run trains every weight.

Continue From a Checkpoint

--parent train-07/200 starts a new run from that checkpoint with any config and data, and monte train resume continues a run for more steps. A LoRA run with --parent on a LoRA checkpoint continues the same adapter, so it serves on the same base. Several runs from one parent give several adapters on one base.