What do you believe is the single most important factor driving up the cost of living in Nigeria?

It's been nearly two years since generative artificial intelligence was made widely available to the public. Some models showed great promise by passing academic and professional exams.

For instance, GPT-4 scored higher than 90% of the United States bar exam test takers. These successes led to concerns AI systems might also breeze through university-level assessments. However, my recent study paints a different picture, showing it isn't quite the academic powerhouse some might think it is.

My study

To explore generative AI's academic abilities, I looked at how it performed on an undergraduate criminal law final exam at the University of Wollongong—one of the core subjects students need to pass in their degrees. There were 225 students doing the exam.

The exam was for three hours and had two sections. The first asked students to evaluate a case study about criminal offenses—and the likelihood of a successful prosecution. The second included a short essay and a set of short-answer questions.

• Read More