As we produce more systems that rely on machine vision to do their jobs or keep people safe, systems that can’t see the world accurately pose both a danger and a risk.


Machine Vision has come a long way since Imagenet, a large repository of labelled images  that researchers use to train their newest Artificial Intelligence (AI) agents with, was released, but still to this day images with bad, tricky or just plain weird lighting can still confuse even the best AI’s algorithms and get them to misreport whatever it is they’re looking at. And there are a multitude of examples where an AI has been tricked or confused, such as an AI that was being used to run an autonomous train prototype that mistook a shadow for a rock and came to a dead stop on the track, and even Nvidia’s DAVE 2.0 self-driving car software that under certain lighting conditions would send a simulated car off a cliff, both of which exemplify the issue that machine vision enthusiasts everywhere still face.


A new particle accelerator just created the brightest medical X-Rays ever


Over the past couple of years in order to try to overcome the issue researchers have either tried to create special hand crafted rules about how light interacts with objects or used  data sets that cover as many lighting situations as possible, but there is a nearly limitless combination of items and light in the real world and that handicaps both approaches.

Now though a paper by researchers from MIT and DeepMind has detailed a new AI process that can identify images in different lighting without having to hand craft new rules or train on a huge data set. The process, called a Rendered Intrinsics Network, or RIN for short, automatically separates an image into reflectance, shape, and lighting layers. It then recombines the layers into a reconstruction of the original image.

To train their RIN the researchers started off by creating a data set consisting of five shapes including cones, cubes, cylinders, spheres and torus’s, and rendered each one with ten different orientations and over five hundred different colours.


Scientists breakthrough turns common garbage into miracle material Graphene


As a proof of concept they then showed how breaking down an image into the three layers could help a computer identify what an item in an image is, or at least figure out what the real shape of objects in said image could be. For example, the model also learned to spot and categorise much more complicated objects, such as the classic image test models Stanford bunnyUtah teapot, and Blender’s Suzanne, after being trained on the basic sample shapes, without ever seeing specifically labelled examples.

Beyond offering a new way to overcome the problem of infinite lighting situations for an image RIN is also an example of learning with unlabelled data. Most AI still needs labelled data to learn, and preparing it takes hours of repetitive human labour so finding a way to learn from unlabelled data itself is yet another AI frontier that needs overcome, so the teams, especially DeepMind, who recently created one of the world’s first self-learning AI’s called Alpha Zero, have made progress on both fronts.

About author

Matthew Griffin

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series. Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future. A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries. Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.

Your email address will not be published. Required fields are marked *