Scroll Top

Google built a four legged robot that then taught itself to walk



If we have to teach robots how to do everything the rate innovation in the field is going to be lethargic, but if robots can teach themselves it’ll dramatically accelerate their rate of development.


Interested in the Exponential Future? Connect, download a free E-Book, watch a keynote, or browse my blog.

There’s now a robot with the walking capabilities of Bambi, which is more impressive than it sounds especially when you realise that this robot, like only a few before it who now sort recycling, and drive race cars, has learned it’s new skill not by being programmed as is normally the case with robots, but has learned how to walk using intuition alone.

Researchers at Google, the Georgia Institute of Technology, and UC Berkeley, who published a paper this week, all worked together to create a robot that used nothing more than AI to teach itself how to walk, and they nicknamed the little four legged robot “Rainbow Dash.”


Meet the new harvesting robots that can pick 10,000 apples an hour


The new type of robot uses a kind of AI called deep reinforcement learning that combines aspects from two different kinds of AI – deep learning and reinforcement learning. With reinforcement learning, an algorithm learns how to perform a task through trial-and-error, where it receives rewards and punishments depending on how close to achieving its task it gets, and deep learning allows systems to process and evaluate raw input data from their environments.


See Rainbow Dash in action

Normally tests of reinforcement learning algorithms are performed within simulated computer environments so this latest step into the real world is a big one, literally and figuratively. Researcher Jie Tan, who is also head of locomotion at Google, said the research took about a year to complete.

“We are interested in helping robots navigate in diverse and complex real world environments and it’s difficult to manually engineer a robotic locomotion controller that can handle the complexity of the real world. Meanwhile human learning is automatic, requires little prior knowledge, and can scale up with the amount of experience collected, so we believe that for these legged robots to operate in the real world the ability for them to learn by themselves is crucial,” he said.


The first ever bacterial display can run DOOM really slowly


The researchers started Rainbow Dash out on a flat surface, where it figured out how to walk within 1.5 hours. Next they tested it out on some slightly more challenging surfaces — a squishy memory-foam mattress and a doormat with lots of crevices. The robot took 5.5 hours to figure out walking backwards and forwards on the mattress, while the doormat only took 4.5 hours.

Rainbow Dash was not entirely bereft of human supervision though, since researchers still had to intervene when the robot accidentally left the space it was meant to learning in, and when it fell over — although they were able to tweak its algorithm to stop it wandering out of the space. But looking to the future Tan sees legged robots as being increasingly useful.


After four year wait Cape Canaveral gets its license to launch commercial space planes


“Legged robots will have great mobility. They will be able to walk in all the places that humans can go, as well as environments that humans cannot,” he said. “Now is still the early days of research. Next, we plan to test our learning system on a wide range of robots and in a more diverse set of environments,” he added.

Related Posts

Leave a comment


1000's of articles about the exponential future, 1000's of pages of insights, 1000's of videos, and 100's of exponential technologies: Get The Email from 311, your no-nonsense briefing on all the biggest stories in exponential technology and science.

You have Successfully Subscribed!

Pin It on Pinterest

Share This