Artificial intelligence has a problem with nuance but that didn’t stop it from correctly predicting the outcome of most of the cases.


An artificial intelligence system has correctly predicted the outcomes of hundreds of cases heard at the European Court of Human Rights, researchers have claimed and, what makes the announcement perhaps even more staggering is that it was right 79% of the time.

While AI is increasingly being used in fields such as journalism, law and accountancy critics so far have said no AI would be able to understand the nuances of a legal case, but now, ironically, it might look as if their own case is being undermined.

The study, which was conducted by researchers at University College London and the universities of Sheffield and Pennsylvania does not spell an end to lawyers – yet – but it does potentially set AI on the road to becoming judge, jury and, well, you know.

“There is a lot of hype about AI but we don’t see it replacing judges or lawyers any time soon. What we do think is they’d find it useful for rapidly identifying patterns in cases that lead to certain outcomes,” said Dr Nikolaos Aletras, who led the study at UCL.

“It could also be a valuable tool for highlighting which cases are most likely to be violations of the European Convention on Human Rights.”


Self-evolving killer robots are almost here, and experts want a debate


How they did it

The team identified English language datasets for 584 cases related to three articles of the Convention on Human Rights – Article 3, that has cases involving torture or degrading treatment, Article 6 which refers to the rights to a fair trial and Article 8, the respect for private life. These articles were picked both because they represented cases about fundamental rights and because there was a large amount of published data on them and then the AI algorithm looked for patterns in the text and was able to label each case either as a “violation” or “non-violation”.

To prevent bias and mislearning, the team selected an equal number of violation and non-violation cases for the AI to learn from.

“Ideally, we’d test and refine our algorithm using the applications made to the court rather than the published judgements, but without access to that data we rely on the court published summaries,” said co-author Dr Vasileios Lampos.

The algorithm tended to get judgements wrong when there were two similar cases – one a violation and one not, suggesting that the platform was not able to detect the finer subtleties of the law so the next stage for the researchers is to test the system with more data.

“There is no reason why it cannot be extended to understand testimonies from witnesses or lawyers’ notes,” said Dr Aletras.

Increasingly law firms, such as Dentons, the world’s largest law firm, and Baker & Hostetler, are experimenting with AI – primarily from companies such as Ross Intelligence to help them wade through vast amounts of legal data.


Microsoft drops $1 Billion on OpenAI to fund Artificial General Intelligence development


Matt Jones, an analyst at data science consultancy Tessella, said of the research project: “It has huge potential as a big timesaver in legal cases by automating some of the less interesting tasks and helping people make decisions on chances of success. But AI is some way off being used as a tool to advise legal decisions.”

He added that such systems were not yet capable of “understanding nuance”.

“An AI can make a good guess but without direct appreciation of the wider context outside of its training data and experience, that guess may be widely off the mark, and in a legal situation that may be dangerous for the case.”

Nevertheless, as they say in legal circles, this experiment sets an interesting precedent.

About author

Matthew Griffin

Matthew Griffin, described as “The Adviser behind the Advisers” and a “Young Kurzweil,” is the founder and CEO of the World Futures Forum and the 311 Institute, a global Futures and Deep Futures consultancy working between the dates of 2020 to 2070, and is an award winning futurist, and author of “Codex of the Future” series. Regularly featured in the global media, including AP, BBC, Bloomberg, CNBC, Discovery, RT, Viacom, and WIRED, Matthew’s ability to identify, track, and explain the impacts of hundreds of revolutionary emerging technologies on global culture, industry and society, is unparalleled. Recognised for the past six years as one of the world’s foremost futurists, innovation and strategy experts Matthew is an international speaker who helps governments, investors, multi-nationals and regulators around the world envision, build and lead an inclusive, sustainable future. A rare talent Matthew’s recent work includes mentoring Lunar XPrize teams, re-envisioning global education and training with the G20, and helping the world’s largest organisations envision and ideate the future of their products and services, industries, and countries. Matthew's clients include three Prime Ministers and several governments, including the G7, Accenture, Aon, Bain & Co, BCG, Credit Suisse, Dell EMC, Dentons, Deloitte, E&Y, GEMS, Huawei, JPMorgan Chase, KPMG, Lego, McKinsey, PWC, Qualcomm, SAP, Samsung, Sopra Steria, T-Mobile, and many more.


Your email address will not be published. Required fields are marked *