This video documents a project to train a reinforcement learning AI to master the iconic TrackMania track, A01. The initial goal was to challenge the human world record. Through iterative learning, the AI independently discovered key driving techniques like optimal jump timing and the "speed drift" bug. After reaching a plateau where it could match but not beat the record, human intervention with a targeted reward system enabled the AI to master a more complex drift and shatter the human time.
The project's scope then expanded to challenge the near-perfect Tool-Assisted Speedrun (TAS). To close the performance gap, the AI was augmented with an "auto-drift" tool and a segmented run approach was implemented. The ultimate breakthrough, however, came from human exploration. While investigating a mythical glitch, the creator accidentally discovered a previously unknown geometric flaw in the track—a tiny hole. By exploiting this flaw to create a novel jump, a new hybrid run combining the human-discovered strategy with the AI's optimized driving successfully beat the TAS, establishing a new limit for the legendary track.
An AI's Journey to Break TrackMania's Most Iconic Record
0:00:02 The Challenge: An AI is trained using reinforcement learning with the goal of beating the long-standing human world record on A01, the first and most famous track in the game TrackMania.
0:01:21 Reinforcement Learning: The AI learns through trial and error. It is given a reward for progressing along the track, motivating it to find faster routes and techniques over thousands of attempts.
0:03:04 Independent Discovery: The AI independently discovers advanced strategies used by human players. It learns to release the accelerator before a jump to land earlier and regain speed sooner, and it also rediscovers the "speed drift"—a bug that grants extra acceleration.
0:06:41 Matching the World Record: After training for an equivalent of 400 hours, the AI manages to perfectly equalize the human world record. However, it hits a performance plateau, unable to execute a second, more complex speed drift that is key to the record-holding run.
0:08:14 Human Intervention and a New Record: To overcome this, the creator provides the AI with extra rewards specifically for attempting the difficult drift. With this guidance, the AI masters the technique and shatters the human world record by a significant 0.4 seconds.
0:10:12 The Ultimate Goal: Beating the TAS: With the human record broken, the new target becomes the Tool-Assisted Speedrun (TAS), a theoretically perfect run crafted frame-by-frame by humans, representing the game's true limit.
0:20:54 An Accidental Discovery: While manually searching for a mythical "blue bug" glitch, the creator makes a groundbreaking discovery: a tiny, previously unnoticed hole in the track's geometry caused by misaligned road pieces.
0:23:41 Exploiting the Track Flaw: This newly found hole is used to trigger a massive jump in the downhill section, a strategy no one had ever used. This allows the car to maintain significantly more speed than was possible in the established TAS.
0:25:28 Beating the Unbeatable: A final run is created by combining the new "hole jump" strategy with the AI's flawless driving for the rest of the track. This hybrid human-AI approach successfully beats the long-standing TAS, setting a new record.
0:26:17 Community Collaboration: The discovery was shared with the TrackMania community, who then refined the new strategy to push the record even further, showcasing a powerful synergy between AI-driven optimization and human creativity.