Playing for Data: Using GTA to teach self-driving cars to navigate the real-world
Playing for Data
Is driving around for hundreds of thousands of hours (in the real-world) the only possible way for us to teach cars how to drive autonomously? Sure, simulation can help but it has its limitations. There might be another alternative to simulation – researchers at TU Darmstadt, Germany and Intel Labs are using Grand Theft Auto’s streets for data!
In the paper, “Playing for Data: Ground Truth from Computer Games“, the authors extracted 25,000 frames with varying weather conditions at different times of day from GTA to be used as training data for classification of pedestrians and another objects a self-driving car is likely to encounter in the real-world.
Really interesting approach for getting ground truth for your classification algorithm. Who knew all those gaming videos on Youtube might turn out to be research material for self-driving cars later on!
Data and more information
Interested in reading the paper? It’s available here. The data and the labels used for training the algorithms is available here (the code isn’t available yet).