Autonomous research systems, such as Andrej Karpathy’s autoresearch, demonstrate a simple yet powerful paradigm for iterative model improvement. In this framework, an agent modifies a training script, executes short experiments, evaluates performance against a defined metric, and retains only those changes that yield measurable improvements. While minimal in implementation,