Robots Learn to Use Kitchen Tools by Watching YouTube Videos

Robots Learn to Use Kitchen Tools by Watching YouTube Videos
University of Maryland computer scientist Yiannis Aloimonos (center) is developing robotic systems able to visually recognize objects and generate new behavior based on those observations. John T. Consoli/University of Maryland

Imagine having a personal robot prepare your breakfast every morning. Now, imagine that this robot didn’t need any help figuring out how to make the perfect omelet, because it learned all the necessary steps by watching videos on YouTube. It might sound like science fiction, but a team at the University of Maryland has just made a significant breakthrough that will bring this scenario one step closer to reality.

Researchers at the University of Maryland Institute for Advanced Computer Studies (UMIACS) partnered with a scientist at the National Information Communications Technology Research Centre of Excellence in Australia (NICTA) to develop robotic systems that are able to teach themselves. Specifically, these robots are able to learn the intricate grasping and manipulation movements required for cooking by watching online cooking videos. The key breakthrough is that the robots can “think” for themselves, determining the best combination of observed motions that will allow them to efficiently accomplish a given task.

"We are trying to create a technology so that robots eventually can interact with humans," said Cornelia Fermüller
The College of Computer, Mathematical, and Natural Sciences
The College of Computer, Mathematical, and Natural Sciences
Author
Related Topics