0

WHY THIS MATTERS IN BRIEF

Humans can’t always predict the outcome of their code and the effect that it will have on decisions, so now AI’s are being given the ability to write their own algorithms.

 

Love the Exponential Future? Join our free XPotential Community, enjoy premium content, futureproof yourself with XPotential Universityconnect, watch a keynote, or browse my blog.

When Deep Blue defeated world chess champion Garry Kasparov in 1997, it may have seemed Artificial Intelligence (AI) had finally arrived. After all, a mere computer had just taken down one of the top chess players of all time. But it wasn’t to be.

Though Deep Blue was meticulously programmed top-to-bottom to play chess, the approach was too labour intensive, too dependent on needing to have clearly defined rules and bounded possibilities to succeed at more complex games – let alone in the real world. The next revolution in AI would take a decade and a half, when vastly more computing power and data revived machine learning, an old idea in AI just waiting for the world to catch up.

 

RELATED
Michigan greens lights the use of autonomous vehicles on all its roads

 

Today, machine learning dominates, mostly by way of a family of algorithms called deep learning, while symbolic AI, the dominant approach in Deep Blue’s day, has now faded into the background.

Key to deep learning’s success is the fact the algorithms basically write themselves – an increasingly literal statement as we continue to see the rise of so called Machine Programmers – AI’s that design and program themselves, as well as create their own children AI’s, and even dream. Given some high-level programming and a dataset, they learn from experience. No engineer anticipates every possibility in code, so increasingly the algorithms just figure it out by themselves.

 

RELATED
Inside the Sony lab making the world's first AI music album

 

Now though, as we see AI’s elsewhere learn to deal with chaos and even evolve themselves, Alphabet’s DeepMind is taking this automation further by developing deep learning algorithms that can handle programming tasks which have been, to date, the sole domain of the world’s top computer scientists and take them years to write.

In a paper recently published on the pre-print server arXiv, a database for research papers that haven’t been peer reviewed yet, the DeepMind team described a new deep reinforcement learning algorithm that was able to discover its own value function, a critical programming rule in deep reinforcement learning, from scratch and without the need for any human intervention which is ground breaking.

 

RELATED
OpenAI trains its bots to speak using Reddit

 

Surprisingly, the algorithm was also effective beyond the simple environments it trained in, going on to play Atari games – a different, more complicated task – at a level that was, at times, competitive with human-designed algorithms and achieving superhuman levels of play in 14 games.

DeepMind says the approach could accelerate the development of reinforcement learning algorithms and even lead to a shift in focus, where instead of spending years writing the algorithms themselves, researchers could instead just work to perfect the environments in which they train.

About author

Matthew Griffin

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series. Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future. A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries. Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.

Your email address will not be published. Required fields are marked *