ChatGPT Passes MBA Exam Given By a Wharton Professor

An anonymous reader quotes a report from NBC News: New research (PDF) conducted by a professor at University of Pennsylvania’s Wharton School found that the artificial intelligence-driven chatbot GPT-3 was able to pass the final exam for the school’s Master of Business Administration (MBA) program. Professor Christian Terwiesch, who authored the research paper “Would Chat GPT3 Get a Wharton MBA? A Prediction Based on Its Performance in the Operations Management Course,” said that the bot scored between a B- and B on the exam. The bot’s score, Terwiesch wrote, shows its “remarkable ability to automate some of the skills of highly compensated knowledge workers in general and specifically the knowledge workers in the jobs held by MBA graduates including analysts, managers, and consultants.” The bot did an “amazing job at basic operations management and process analysis questions including those that are based on case studies,” Terwiesch wrote in the paper, which was published on Jan. 17. He also said the bot’s explanations were “excellent.” The bot is also “remarkably good at modifying its answers in response to human hints,” he concluded. While Chat GPT3’s results were impressive, Terwiesch noted that Chat GPT3 “at times makes surprising mistakes in relatively simple calculations at the level of 6th grade Math.” The present version of Chat GPT is “not capable of handling more advanced process analysis questions, even when they are based on fairly standard templates,” Terwiesch added. “This includes process flows with multiple products and problems with stochastic effects such as demand variability.” Still, Terwiesch said ChatGPT3’s performance on the test has “important implications for business school education, including the need for exam policies, curriculum design focusing on collaboration between human and AI, opportunities to simulate real world decision making processes, the need to teach creative problem solving, improved teaching productivity, and more.” The latest findings come as educators become increasingly concerned that AI chatbots like ChatGPT could inspire cheating. Earlier this month, New York City’s education department banned access to ChatGPT. While the education department cited “safety and accuracy” as reasons for the decision, the Washington Post notes how some teachers are “in a near-panic” about the technology enabling students to cheat on assignments. Yesterday, for example, The Stanford Daily reported that a large number of Stanford students have already used ChatGPT on their final exams. It’s prompting anti-plagiarism software Turnitin to build a tool to detect text generated by AI. Read more of this story at Slashdot.