Skip to content

StudentBench standard proves AI tutoring matches teachers on GRE tests at a cost that falls 918 times

Share
StudentBench standard proves AI tutoring matches teachers on GRE tests at a cost that falls 918 times

Listen to this article

Read by Anchor

A comprehensive research study led by researcher Kurtz Northcat and his scientific team, presented in a paper deposited in the arXiv archive, found that AI models now achieve educational gains that are statistically equivalent to specialized human teaching in graduate academic ability tests (GRE), outperforming teachers in five of the seven areas covered by the assessment. The research relied on launching a standard and open platform called "StudentBench", which aimed to monitor and collect more than 175,000 interactive messages between students and the models, and to measure the actual educational return with scientific precision that goes beyond measuring the pure technical capabilities of language models.

The learning clinical trial included 2,383 human participants who were assigned to three experimental tracks: one that received AI-based instruction, one supervised by expert human teachers, and a control track that received no instruction.The results showed a statistical equivalence between AI and expert human teaching in learning gains for mathematics and language sections (significance level p =.015), with the best AI instructor outperforming the average human teachers in most test domains.

In a parallel sub study, the researchers subjected the models' outputs to a double blind peer review involving 2,028 qualitative comparisons carried out by expert teachers to assess the quality of lesson plans and practice problems. The standard concluded by categorising AI teachers' performance across five critical dimensions: curriculum planning, creation of practice problems, dialogic instruction, operational cost, and student engagement level. One smart teaching model achieved educational equivalence with a human teacher (p =.044) while reducing material cost by a factor of 918, with the cost of a single percentage point gained in achievement amounting to $0.0052 via the model, compared with $4.81 via the human teacher.

Experimental data for the mathematics section also revealed that the model's response speed was not merely a technical feature, but was positively correlated with the number of student messages, and the increase in messages corresponded with higher rates of correct answers in practical training, directly leading to a doubling of final educational gains with a strong statistical significance (p <.002).

This fundamental shift in the cost time equation places the supplemental education and training sector in the Gulf, Egypt and the Levant before an inevitable restructuring of business models.While families and training centres in the region spend large sums to secure teachers for preparing students for admission and aptitude tests, this research shows that the cost of delivering a student to the same achievement outcome approaches zero mathematically through automated systems. What actually changes for regional edtech firms is not merely acquiring ready-made models, but shifting from selling human teaching hours to building interfaces that focus on interaction engineering and response speed, as the statistical difference demonstrates that server response time and text generation speed directly affect learners' academic outcomes.

Don't miss the next story

Subscribe for updates