Google's AI can rate photos on aesthetic appeal

By Matthew Griffin Intelligence and the Senses 27th February 2018

WHY THIS MATTER IN BRIEF

Google’s AI is moving from just being able to identify and categorise images to being able to identify them according to their aesthetics, and that’s big.

Today’s slew of photo apps can help you find objects in your pictures but they don’t tell you whether or not those images are actually worth sharing. For now, at least, that’s still up to you.

Samsung's impressive AI turns video into digitally rendered VR worlds

If Google has its way though Artificial Intelligence (AI) may soon become an art critic. After more than a year in development recently Google detailed their work on what they’re calling a Neural Image Assessment (NIMA) system that uses a deep learning to rate photos based on what it believes you’d, or the critics out in the wider world, might like both technically and aesthetically.

Google trained NIMA using sets of images based on histogram of ratings, such as from photo contests, that gave the platform a sense of the overall “quality” or aesthetic of a picture in a range of different areas, not just a mean score or a simple high-low rating, and now, after having been trained, the system can use reference photos to compare one image with another, if they’re available, but it can also turn to its statistical model if it hasn’t seen anything like it before.

The result is an AI that “closely” replicates the mean scores of humans when judging photos, and that, in turn, has all kinds of implications for photography apps and smartphones. After all, imagine a smartphone with a built in photo critic that can help you take perfect shots time and time again… sounds fun doesn’t it!?

ChatGPT listed as an author on research papers and scientists disapprove

To begin with, NIMA could help you quickly find the best photos in your albums while avoiding poorly composed shots, or blurry ones, although here too Google has another AI agent that can help un-blur even the blurriest photos, called RAISR, which I wrote about a while ago, and Google adds that NIMA would be helpful for editing too because you could use it to help fine tune automatic editing tools, for example, your favourite editing app could tweak exposure, brightness and other details based on artistic appeal rather than arbitrary values.

While there’s a lot of work still to be done, this hints at a day when your phone could have as discerning a taste in photos as you do, so don’t be surprised if in a year or so you see NIMA turn up in an Android update… I hope you enjoy taking awesome photos.

Matthew Griffin / About Author

Described by NASA as a "Walking Encyclopaedia of the Future" and one of the world’s most in demand keynote speakers Matthew Griffin, Founder and Futurist in Chief of the 311 Institute, a global Futures and Deep Futures advisory firm, is a multi-award winning Futurist and strategic foresight expert, author, lecturer, mentor, podcast and YouTube host.

With a distinguished career running global business units at Atos, EMC, and IBM today Matthew helps leaders and titans of industry from all over the world explore the impact of the inter sections of technology, culture, and leadership, then helps them create high performance organisations that can continuously disrupt, outpace, and outthink their competition.

15 times author of the hit series the Codex of the Future series Matthew's ability to identify, track, and explain the impacts of hundreds of emerging technologies and trends on global business, culture, and society has earned him a powerful reputation and a roster of clients that include royal households, world leaders across the G7, G20, and G77, and many of the world's most recognised and exceptional organisations including ABB, Accenture, ABN Amro, Adidas, AON, ARM, BCG, Centrica, Citi Group, Coca Cola, Deloitte, Dentons, Disney, Dow, EY, Google, KPMG, Lego, Microsoft, Legal & General, LinkedIn, Nokia, Paramount, PepsiCo, PWC, Qualcomm, RWE, Samsung, T-Mobile, UBS, Visa, WIRED, WPP and hundreds of others.

Matthew is regularly featured in the global media including the AP, BBC, Bloomberg, CNBC, Discovery, Forbes, Khaleej Times, Telegraph, TIME, ViacomCBS, WIRED, and the WSJ, and his mission is to help organisations create a fair and sustainable future whose benefits are shared by everyone irrespective of their ability, background, or circumstances.