POYOPlusMultitaskPretrain#
- class pretrain.models.POYOPlusMultitaskPretrain(cfg, rank, world_size)[source]#
Bases:
core.trainer.BaseTrainerSupervised pretraining of POYO+ on every behavior at once, via its readout heads.
- setup(ckpt)[source]#
Set up the trainer.
This method is called after setting up distributed, loading the checkpoint, and setting up logging.