Authors from MIT released a paper that claimed that GPT-4 can ace EECS and Math exams. In fact, they claimed it can score 100%. Except, there were numerous issues with the paper. Apparently, they allowed the model to answer questions until it got it right, and also the evaluation was done by GPT-4 itself.
Share this post
The AI Report #5: GPT-4 aces MIT.. or not
Share this post
Authors from MIT released a paper that claimed that GPT-4 can ace EECS and Math exams. In fact, they claimed it can score 100%. Except, there were numerous issues with the paper. Apparently, they allowed the model to answer questions until it got it right, and also the evaluation was done by GPT-4 itself.