An anonymous reader quotes an NBC News report: new research (PDF) conducted by a professor at the Wharton School of the University of Pennsylvania found that the artificial intelligence-driven chat GPT-3 was able to pass the final exam for the school’s Master of Business Administration (MBA) program. Professor Christian Terwiesch, who wrote the research paper “Would Chat GPT3 Get a Wharton MBA? A Prediction Based on Its Performance in the Operations Management Course,” said the bot scored between B- and B on the exam.
The bot’s score, Terwiesch wrote, shows its “remarkable ability to automate some of the skills of highly compensated knowledge workers in general and specifically the knowledge workers in the jobs held by MBA graduates including analysts, managers and consultants.” The bot did “a fantastic job on basic operations management and process analysis questions including those that are based on case studies,” Terwiesch wrote in the paper, which was published on January 17. He also said the bot’s explanations were “excellent.” The robot is also “remarkably adept at modifying its responses in response to human feedback,” he concluded.
While Chat GPT3’s results were impressive, Terwiesch noted that Chat GPT3 “sometimes makes surprising mistakes in relatively simple calculations at the level of 6th grade Math.” The current version of Chat GPT “is not capable of handling more advanced process analysis questions, even when they are based on fairly standard patterns,” Terwiesch added. “This includes process flows with multiple products and problems with stochastic effects such as demand variability.” However, Terwiesch said ChatGPT3’s performance in the test has “important implications for business school education, including the need for exam policies, curriculum design focusing on human-AI collaboration, opportunities to simulate real-world decision-making processes, the need to teach creative problem. solving, improved teaching productivity, and more.” The latest findings come as educators grow increasingly concerned that AI chatbots like ChatGPT could inspire cheating. Earlier this month, New York’s education department prohibited access to ChatGPT. While the education department cited “security and accuracy” as reasons for the decision, the Washington Post notes how some teachers are “in near panic” about the technology. enabling students to cheat on assignments.
Yesterday, for example, The Stanford Daily reported that a large number of Stanford students have already used ChatGPT during their final exams. It prompts anti-plagiarism software Turnitin to build a tool for detect text generated by AI.