Skip to main content
An environment is the package that a model is scored or trained in. Monte builds environments on NeMo Gym, so any Gym environment works unchanged.

Components

The same grader gives the eval score and the training reward. Rows without a grader are a dataset, not an environment.

Choose an Eval or a Training Environment

An environment holds one set of tasks, so it is an eval environment or a training environment, never both.

Versions

monte env add makes an immutable version, such as support-escalation@2, with a fingerprint over the grader code, the task rows, and the configs. An experiment pins each eval version, and a run refuses to start when the fingerprint does not match, so a changed grader needs a new version and a new experiment.

Create and Add an Environment

--eval takes an eval config under monte-gym/benchmarks/. --training takes a server whose config declares training rows. Tasks shows where each file goes. Environment Commands lists every flag.