Scroll Top

ChatGPT just passed a Wharton business school exam

Futurist_whartonb

WHY THIS MATTERS IN BRIEF

While it’s feared that ChatGPT could make a great cheating tool most exams are taken in controlled environments, so this test shows its grasp of the subject matter.

 

Love the Exponential Future? Join our XPotential Community, future proof yourself with courses from XPotential University, read about exponential tech and trendsconnect, watch a keynote, or browse my blog.

ChatGPT, the Artificial Intelligence (AI) chatbot from OpenAI, that so far has passed English, History, and even US medical exams, is apparently smart enough to pass prestigious graduate level exams as well – though not with particularly high marks.

 

RELATED
World first as scientists turn your DNA into a disease fighting computer

 

The powerful new AI chatbot tool recently passed law exams in four courses at the University of Minnesota Law School and a business exam at University of Pennsylvania’s Wharton School of Business, according to professors at the schools.

 

We wrote a book using ChatGPT!

 

To test how well ChatGPT could generate answers on exams for the four law courses, professors at the University of Minnesota Law School graded the tests blindly. After completing 95 multiple choice questions and 12 essay questions, the bot performed on average at the level of a C+ student, achieving a low but passing grade in all four courses.

ChatGPT fared better though during a business management course exam at Wharton, where it earned a B to B- grade. In a paper detailing the performance, Christian Terwiesch, a Wharton business professor, said ChatGPT did “an amazing job” at answering basic operations management and process-analysis questions but struggled with more advanced prompts and made “surprising mistakes” with basic math.

 

RELATED
No humans required, the fully autonomous AI running a Wall Street hedge fund

 

“These mistakes can be massive in magnitude,” he wrote.

The test results come as a growing number of schools and teachers express concerns about the immediate impact of ChatGPT on students and their ability to cheat on assignments. Some educators are now moving with remarkable speed to rethink their assignments in response to ChatGPT, even as it remains unclear how widespread use is of the tool among students and how harmful it could really be to learning.

Since it was made available in late November, ChatGPT has been used to generate original essays, stories and song lyrics in response to user prompts. It has drafted research paper abstracts that fooled some scientists. Some CEOs have even used it to write emails or do accounting work.

ChatGPT is trained on vast amounts of online data in order to generate responses to user prompts. While it has gained traction among users, it has also raised some concerns, including about inaccuracies and its potential to perpetuate biases and spread misinformation.

 

RELATED
"Terrifying" new AI lets you create your very own DeepFakes using just text

 

Jon Choi, one of the University of Minnesota law professors, told reporters the goal of the tests was to explore ChatGPT’s potential to assist lawyers in their practice and to help students in exams, whether or not it’s permitted by their professors, because the questions often mimic the writing lawyers do in real life.

“ChatGPT struggled with the most classic components of law school exams, such as spotting potential legal issues and deep analysis applying legal rules to the facts of a case,” Choi said. “But ChatGPT could be very helpful at producing a first draft that a student could then refine.”

He argues human-AI collaboration is the most promising use case for ChatGPT and similar technology.

“My strong hunch is that AI assistants will become standard tools for lawyers in the near future, and law schools should prepare their students for that eventuality,” he said. “Of course, if law professors want to continue to test simple recall of legal rules and doctrines, they’ll need to put restrictions in place like banning the internet during exams to enforce that.”

 

RELATED
Scientists have 3D printed the world's first physical neural network

 

Likewise, Wharton’s Terwiesch found the chatbot was “remarkably good” at modifying its answers in response to human hints, such as reworking answers after pointing out an error, suggesting the potential for people to work together with AI.

In the short-term, however, discomfort remains with whether and how students should use ChatGPT. Public schools in New York City and Seattle, for example, have already banned students and teachers from using ChatGPT on the district’s networks and devices.

Considering ChatGPT performed above average on his exam, Terwiesch told reporters he agrees restrictions should be put in place for students while they’re taking tests.

 

RELATED
Techs biggest names are working together to regulate AI research

 

“Bans are needed,” he said. “After all, when you give a medical doctor a degree, you want them to know medicine, not how to use a bot. The same holds for other skill certification, including law and business.”

But Terwiesch believes this technology still ultimately has a place in the classroom.

“If all we end up with is the same educational system as before, we have wasted an amazing opportunity that comes with ChatGPT,” he said.

Related Posts

Leave a comment

EXPLORE MORE!

1000's of articles about the exponential future, 1000's of pages of insights, 1000's of videos, and 100's of exponential technologies: Get The Email from 311, your no-nonsense briefing on all the biggest stories in exponential technology and science.

You have Successfully Subscribed!

Pin It on Pinterest

Share This