As AI becomes increasingly adept at helping unlock the secrets of the brain it’s also becoming more adept at helping decode and visualise complex thoughts onto TV’s and other devices.


The capabilities and accuracy of Artificial Intelligence (AI) “mind reading” systems, as they are increasing being called, are improving faster than ever. Over the past few years they’ve been increasingly used and developed to help decode and then visualise, by putting on the small screen, a wide range of things, everything from pulling images, movies and other content, out of people’s heads, to helping patients with ALS, or “Locked in Syndrome” communicate with loved ones. Now though a team from Carnegie Mellon University (CMU) has developed an AI that can accurately read other complex concepts from just a brain scan, and even piece together entire sentences as they’re being thought.


Google launches BARD its ChatGPT rival and sees $170 Billion vanish


Even the most basic sentence is loaded with more information than you might realise, every word represents a new “concept,” and their placement and relationship to each other can drastically change the meaning of the whole sentence.

During their research the CMU team found that the “building blocks” the mind uses to construct thoughts are made up of multiple concepts, rather than being based on simple words themselves, and that suggested to them that the brain processes concepts in a universal way, regardless of a person’s language and culture.

“One of the big advances of the human brain was the ability to combine individual concepts into complex thoughts, to think not just of ‘bananas,’ but ‘I like to eat bananas in evening with my friends’,” says Marcel Just, lead researcher on the study, “now we have finally developed a way to see thoughts of that complexity in the fMRI signal. The discovery of this correspondence between thoughts and brain activation patterns tells us what the [individual] thoughts are built of.”


Google's Project Magenta wants to be a musician


The study tested how the brain codes complex thoughts, and how an fMRI scanner, which detects minute changes in the blood flow within a person’s brain as they think, with help from machine learning algorithms, can decode them.

The researchers put together 240 “complex events,” which were sentences like “The witness shouted during the trial,” and each of these events were made up of 42 different building blocks, or meaningful components like person, setting, size, social interaction and physical action.

Each of these different kinds of information are processed in different parts of the brain, and CMU’s new AI was able to pick out the general category of what was on a person’s mind. To test its prowess, the researchers had seven participants read the sentences, recording the brain activation patterns that went along with them every time, and after training the algorithm on 239 of the sentences, and the matching scans, it was then able to put together the last sentence based solely on the brain scan data.


Artificial intelligence gets a seat in the boardroom in Hong Kong


Then the team ran the test 240 times, systematically leaving out each of the sentences in turn, and found that the AI was able to predict the missing sentence from a brain activation pattern with 87 percent accuracy. Going the other way, the researchers could feed the program a sentence and it would spit out an accurate brain activation pattern.

“Our method overcomes the unfortunate property of fMRI to smear together the signals emanating from brain events that occur close together in time, like the reading of two successive words in a sentence,” says Just, “this advance makes it possible for the first time to decode thoughts containing several concepts. That’s what most human thoughts are composed of. A next step might be to decode the general type of topic a person is thinking about, such as geology or skateboarding. We are on the way to making a map of all the types of knowledge in the brain.”

The research was published in the journal Human Brain Mapping.

About author

Matthew Griffin

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series. Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future. A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries. Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.

Your email address will not be published. Required fields are marked *