monte env add as they are.
In This Section
An eval environment and a training environment can use the same server. The training grader can add terms, such as a judge’s tone score, that the eval grader leaves out. Rows without a grader are a dataset, not an environment.
Eval and Training Environments
An environment holds one set of tasks, so it is an eval environment or a training environment, never both.Versions
monte env add makes an immutable version, such as support-escalation@2, with a fingerprint over the grader code, the task rows, and the configs. An experiment pins each eval version, and a run refuses to start when the fingerprint does not match, so a changed grader needs a new version and a new experiment.
Create and Add an Environment
--eval takes an eval config under monte-gym/benchmarks/. --training takes a server whose config declares training rows. Tasks shows where each file goes. Environment Commands lists every flag.
