Skip to main content
An environment is the package that a model is scored or trained in. Monte builds environments on NeMo Gym. A NeMo Gym resources server and its configs add with monte env add as they are.

In This Section

An eval environment and a training environment can use the same server. The training grader can add terms, such as a judge’s tone score, that the eval grader leaves out. Rows without a grader are a dataset, not an environment.

Eval and Training Environments

An environment holds one set of tasks, so it is an eval environment or a training environment, never both.

Versions

monte env add makes an immutable version, such as support-escalation@2, with a fingerprint over the grader code, the task rows, and the configs. An experiment pins each eval version, and a run refuses to start when the fingerprint does not match, so a changed grader needs a new version and a new experiment.

Create and Add an Environment

--eval takes an eval config under monte-gym/benchmarks/. --training takes a server whose config declares training rows. Tasks shows where each file goes. Environment Commands lists every flag.