Scroll Top

UK government ditches biased algorithm that downgraded hundreds of thousands of students exam grades

futurist_Exam_stress

WHY THIS MATTERS IN BRIEF

Our futures will increasingly be dictated for us by algorithms, and that could be very dangerous for us all.

 

Interested in the Exponential Future? Join our XPotential Community, future proof yourself with courses from our XPotential Universityconnect, watch a keynote, or browse my blog.

As the debate around the benefits of Artificial Intelligence (AI) rage, and the spectre of AI bias keeps rearing its ugly head the UK government, who in 2018 proposed using AI to rate schools, opted to use AI to decide students grades after national exams were disrupted by Covid-19 and lockdown, has said that students in England and Wales will no longer receive exam results based on the controversial algorithm they used after accusations that the system was biased against students from poorer backgroundsReuters and BBC News report. The announcement followed a weekend of demonstrations at which protesters chanted “fuck the algorithm” outside the country’s Department for Education.

 

RELATED
Futurist Keynote, UK: The Future of AI, Cyber, and Data with Bytes

 

Now, instead of being graded by AI, students will receive grades based on their teachers’ estimates after formal exams were cancelled due to the global pandemic. The announcement follows a similar U-turn in Scotland, which had previously seen 125,000 results downgraded.

In the UK, A-levels are the set of exams taken by students around the age of 18. They’re the final exams taken before university, and they have a huge impact on which institution students attend. Universities make offers based on students’ predicted A-level grades, and usually, a student will have to achieve certain grades to secure their place.

In other words: It’s a stressful time of year for students, even before the country’s exam regulator used a cock-eyed controversial algorithm to automatically estimate their grades.

 

RELATED
Invisible AI helps cars makers see what machines and humans do wrong

 

As the BBC explains, the UK’s Office of Qualifications and Examinations Regulation (Ofqual), whose CEO just quit because of the fiasco, relied primarily on two pieces of information to calculate grades – namely, the ranking of students within a school and their school’s historical performance.

The system was designed to generate what are, on a national level, broadly similar results to previous years. And overall, that’s what the algorithm accomplished, with The Guardian reporting that overall results are up compared to previous years, but only slightly – the percentage of students achieving an A* to C based on the algorithm’s grading rose by 2.4 percent compared to last year.

But it’s also led to thousands of grades being lowered from teachers’ estimations: 35.6 percent of grades were adjusted down by a single grade, while 3.3 percent went down by two grades, and 0.2 went down by three. That means a total of almost 40 percent of results were downgraded. That’s life-changing news for anyone who needed to achieve their predicted grades to secure their place at the university of choice.

 

RELATED
Shutterstock integrates AI generated images into its library of 700 Million images

 

Worse still, data suggests that fee-paying private schools, also known as “independent schools,” disproportionately benefited from the algorithm used. These schools saw the amount of grades A and above increase by 4.7 percent compared to last year, Sky News reports. Meanwhile, state funded “comprehensive” schools saw an increase of less than half that at just 2 percent.

There is a variety of factors that seem to have biased the algorithm. One theory put forward by FFT Education Datalab is that Ofqual’s approach varied depending on how many students took a given subject, and this decision seems to have led to fewer grades getting degraded at independent schools, which tend to enter fewer students per subject. The Guardian also points out that what it calls a “shockingly unfair” system was happy to boost the number of “U” grades, aka fails, and round down the amount of A* grades, while one university lecturer has pointed out other failings in the regulator’s approach.

 

RELATED
Automated trading algorithms accidentally wiped $22Bn off Facebooks share price

 

Fundamentally, however, because the algorithm placed so much importance on a school’s historical performance it was always going to cause more problems for high-performing students at underperforming schools, where the individual’s work would be lost in the statistics. Average students at better schools, meanwhile, seem to have been treated with more leniency. Part of the reason the results have caused so much anger is that this outcome reflects what many see as the wider biases of the UK’s education system.

The government’s decision to ignore the algorithmically determined grades has been welcomed by many, but even using teachers’ predictions comes with its own problems. As Wired notes, some studies have suggested such predictions can suffer from racial biases of their own. One study from 2009 found that Pakistani pupils, for example, were predicted a lower score, 62.9 percent, more than their white counterparts in one set of English exams and that results for boys from Black and Caribbean backgrounds can spike when they’re assessed anonymously starting from age 16.

 

RELATED
IBM Watson filters public opinion to help Bloomberg debate redistributing wealth

 

However, while this is just yet another example of how algorithms can make or break your future, whether it’s by being used to decide your grades or your mortgage application, or the outcome of your job interview, and much more, the only thing that’s certain is that they’re here to stay. So, one way or another we now have to solve the problem of AI bias, for example, by developing explainable AI systems and finding fairer ways to create AI models, and the consequences of an increasingly algorithmic first society.

Related Posts

Leave a comment

EXPLORE MORE!

1000's of articles about the exponential future, 1000's of pages of insights, 1000's of videos, and 100's of exponential technologies: Get The Email from 311, your no-nonsense briefing on all the biggest stories in exponential technology and science.

You have Successfully Subscribed!

Pin It on Pinterest

Share This