Preference Model develops reinforcement learning environments for training AI systems to perform machine learning research.