Robots struggle with tasks that involve dexterity, but that problem could soon be solved.
Artificial Intelligence (AI) advances are increasingly making headlines as we witness breakthrough after breakthrough, whether it’s in the creation of self-driving cars, or in the creation of the world’s first creative machines, but robots on the other hand, other than the world’s most advanced humanoid robot Atlas, have been advancing at an altogether slower pace. But now researchers working at OpenAI, an AI foundation funded by Elon Musk that hopes to help democratise access to AI for everyone, are hoping to solve one of robotics biggest challenges – creating robots with human like levels of dexterity.
In a blog released their website this week OpenAI revealed the latest version of their OpenAI Five learning algorithm that they’ve now wrapped into a system called “Dactyl” which lets them train robots in new ways and without the need to use “physical based modelling.” The result, when combined with the Shadow Dexterous Hand, which you can see in the video below, is a robot hand that can manipulate objects with near human-like dexterity.
“We’ve trained a human-like robot hand to manipulate physical objects with unprecedented dexterity,” reads the non-profit’s blog.
See the hand in action
OpenAI explained that Dactyl is trained entirely within a virtual simulated environment and successfully adapts that acquired knowledge into the real world.
During their experiments the researchers place a block in the palm of the robotic hand and order Dactyl to reposition it. Dactyl then processes the hand’s fingertip coordinates and images from three cameras positioned around it and elegantly twirls the block around. The resulting motion is eerily human-like.
Robotic humanoid hands were first introduced decades ago but traditional robotics techniques have so far proved ineffective in coming up with solutions to help them manipulate objects efficiently so OpenAI decided to use domain randomization, a process created by the lab to solve the difficulties related to transferring simulated experiences into the real world referred to as the reality gap to come up with a new approach.
Instead of training a model on a single simulated environment, domain randomization exposes it to a wide range of environments in a simulation designed with many experiences, and bingo, they had a winner.
OpenAI then further adapted Dactyl to allow it to manipulate random objects, not just those modified to support tracking. To achieve this, Dactyl was trained to process the information from the camera images to estimate the position and orientation of objects using a traditional Convolutional Neural Network, and in the end OpenAI created a system that could learn to mimic human levels of dexterity on its own.
“We noticed that Dactyl uses a rich set of in-hand dexterous manipulation strategies to solve the task,” read the blog, “these strategies are commonly used by humans as well. However, we do not teach them to our system explicitly, all behaviours are discovered autonomously,” further explained the blog.
Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series.
Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future.
A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries.
Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.
FANATICALFUTURIST PODCAST! Hear about ALL the latest futures news and breakthroughs!SUBSCRIBE
1000's of articles about the exponential future, 1000's of pages of insights, 1000's of videos, and 100's of exponential technologies: Get The Email from 311, your no-nonsense briefing on all the biggest stories in exponential technology and science.