Authors from MIT released a paper that claimed that GPT-4 can ace EECS and Math exams. In fact, they claimed it can score 100%. Except, there were numerous issues with the paper. Apparently, they allowed the model to answer questions until it got it right, and also the evaluation was done by GPT-4 itself.
The AI Report #5: GPT-4 aces MIT.. or not
The AI Report #5: GPT-4 aces MIT.. or not
The AI Report #5: GPT-4 aces MIT.. or not
Authors from MIT released a paper that claimed that GPT-4 can ace EECS and Math exams. In fact, they claimed it can score 100%. Except, there were numerous issues with the paper. Apparently, they allowed the model to answer questions until it got it right, and also the evaluation was done by GPT-4 itself.