If we have to teach robots how to do everything the rate innovation in the field is going to be lethargic, but if robots can teach themselves it’ll dramatically accelerate their rate of development.


Interested in the Exponential Future? Connect, download a free E-Book, watch a keynote, or browse my blog.

There’s now a robot with the walking capabilities of Bambi, which is more impressive than it sounds especially when you realise that this robot, like only a few before it who now sort recycling, and drive race cars, has learned it’s new skill not by being programmed as is normally the case with robots, but has learned how to walk using intuition alone.

Researchers at Google, the Georgia Institute of Technology, and UC Berkeley, who published a paper this week, all worked together to create a robot that used nothing more than AI to teach itself how to walk, and they nicknamed the little four legged robot “Rainbow Dash.”


AI can now listen to individuals in a crowd


The new type of robot uses a kind of AI called deep reinforcement learning that combines aspects from two different kinds of AI – deep learning and reinforcement learning. With reinforcement learning, an algorithm learns how to perform a task through trial-and-error, where it receives rewards and punishments depending on how close to achieving its task it gets, and deep learning allows systems to process and evaluate raw input data from their environments.


See Rainbow Dash in action

Normally tests of reinforcement learning algorithms are performed within simulated computer environments so this latest step into the real world is a big one, literally and figuratively. Researcher Jie Tan, who is also head of locomotion at Google, said the research took about a year to complete.

“We are interested in helping robots navigate in diverse and complex real world environments and it’s difficult to manually engineer a robotic locomotion controller that can handle the complexity of the real world. Meanwhile human learning is automatic, requires little prior knowledge, and can scale up with the amount of experience collected, so we believe that for these legged robots to operate in the real world the ability for them to learn by themselves is crucial,” he said.


The worlds first virtual CEO takes the reigns at a Chinese gaming company


The researchers started Rainbow Dash out on a flat surface, where it figured out how to walk within 1.5 hours. Next they tested it out on some slightly more challenging surfaces — a squishy memory-foam mattress and a doormat with lots of crevices. The robot took 5.5 hours to figure out walking backwards and forwards on the mattress, while the doormat only took 4.5 hours.

Rainbow Dash was not entirely bereft of human supervision though, since researchers still had to intervene when the robot accidentally left the space it was meant to learning in, and when it fell over — although they were able to tweak its algorithm to stop it wandering out of the space. But looking to the future Tan sees legged robots as being increasingly useful.


Researchers extend the range of super speed 5G mmWave with lasers


“Legged robots will have great mobility. They will be able to walk in all the places that humans can go, as well as environments that humans cannot,” he said. “Now is still the early days of research. Next, we plan to test our learning system on a wide range of robots and in a more diverse set of environments,” he added.

About author

Matthew Griffin

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series. Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future. A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries. Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.

Your email address will not be published. Required fields are marked *