Can supervised AI tutor maths safely?

Introduction

The LearnLM and Eedi maths tutoring trial is one of the clearest early tests of a larger AI bloom question: can advanced AI help people genuinely think better, rather than merely automate answers? In a small but closely supervised UK study, researchers explored whether an AI model designed for learning could support secondary-school mathematics students as effectively as human tutors. The striking result was not that AI replaced teachers. It was that an AI system operating inside carefully designed constraints, with expert humans overseeing its messages, appeared able to match or even slightly outperform human-only tutoring on some measures of learning transfer. arXiv[2eedi-labs-67qwnm2lxu4blqi5.webflow.io]eedi-labs-67qwnm2lxu4blqi5.webflow.ioction was delivered by LearnLM—a family of models from Google and Google…Read more…

That matters because mathematics tutoring is a demanding test case. A useful maths tutor must identify misconceptions, ask the right questions, avoid giving away answers too quickly, and help students apply ideas to new problems. If AI can reliably assist with those tasks, it offers evidence for a broader possibility: that high-quality cognitive support could become far more widely available. But the trial also highlights an equally important lesson. The encouraging results came from a tightly controlled system with expert oversight, not from simply handing students a general-purpose chatbot.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025 2eedi.com

What the UK maths trial actually tested

The study was conducted across five UK secondary schools using Eedi, a mathematics learning platform focused on diagnosing student misconceptions and providing targeted support. Researchers ran an exploratory randomised controlled trial involving 165 students. Pupils were assigned to different forms of support after encountering difficulties with maths questions.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025[Learning]learning-engineering-virtual-institute.orgEedi Showing How AI Tutoring Can Deliver Personalized…19 Dec 2025 — Eedi, a UK-based mathematics learning platform that diagnoses stud…

The comparison was more sophisticated than a simple AI-versus-human contest. Students encountered three broad conditions:

• Traditional static hints already used on the platform.
• Live human tutors communicating through chat.
• LearnLM-generated tutoring messages operating under human supervision.[eedi.substack.com]eedi.substack.comA I in Education #7: Five Things I Learned from Bibi GrootAI in Education #7: Five Things I Learned from Bibi Groot…May 12, 2026 — It is a randomised control trial with 165 students, run over…Published: May 12, 2026

LearnLM is Google’s family of AI models adapted specifically for educational use. Rather than optimising solely for correct answers, it is designed around learning-science principles such as guided questioning, scaffolding and encouraging student reasoning.[Google Cloud]cloud.google.comGoogle CloudLearnLMBuilt in collaboration with experts in education, LearnLM represents our capabilities fine-tuned for learning informed…

The researchers were not primarily asking whether AI could solve maths problems. Modern language models can often do that already. The question was whether an AI tutor could help students learn mathematics in a way that transferred beyond the immediate exercise. That distinction is crucial. Education systems care far more about durable understanding than about short-term answer production.

How expert oversight shaped the AI messages

One reason the study attracted attention is that it avoided a common weakness in AI education discussions. Students were not simply chatting freely with a frontier model.

Instead, expert human tutors remained in the loop. LearnLM generated tutoring responses, but human supervisors reviewed and approved messages before they reached students. This arrangement created a hybrid system: AI handled much of the conversational generation while human experts provided quality control and safety oversight.[eedi-labs-67qwnm2lxu4blqi5.webflow.io]eedi-labs-67qwnm2lxu4blqi5.webflow.ioction was delivered by LearnLM—a family of models from Google and Google…Read more…[Business Wire]businesswire.comNew Exploratory Research From Eedi and Google…Nov 11, 2025 — Under the supervision of expert human tutors, we tested a model in which…

The approach addressed several concerns that have emerged around educational chatbots:

Eedi described the tutor as “constrained” rather than open-ended. In later trials, the system was designed to activate when a student answered a diagnostic question incorrectly, and the conversation remained focused on the specific mathematical concept involved. This limited the tendency for discussions to drift into unrelated territory and kept tutoring aligned with a defined learning objective.[eedi.com]eedi.comjust launched our second ai tutor rctLaunched: Our Second AI Tutor RCTThis blog announces our second "constrained" AI Tutor RCT, started in April 2026, in partnership with Go…Published: April 2026

This design choice reflects an increasingly important lesson in AI-assisted education: educational value often depends less on raw model capability than on the structure surrounding it. The strongest results tend to come from systems that deliberately channel AI toward proven teaching practices rather than treating the model as an unrestricted conversational partner.[Brookings]brookings.eduwhat the research shows about generative ai in tutoringWhat the research shows about generative AI in tutoring27 Jan 2026 — The study rigorously compared static hints, human tutoring…

Why novel problem performance mattered so much

The most interesting finding was not that students received help. It was how researchers measured success.

Educational interventions often look impressive when students repeat a problem type they have just practised. The harder question is whether they can apply the underlying concept somewhere new.

The Eedi-LearnLM research therefore examined performance on subsequent and unfamiliar problems. Students who received supervised LearnLM tutoring were reported to be around 5.5 percentage points more likely to solve novel problems successfully than students who worked with human tutors alone. The reported success rates were approximately 66.2% for supervised LearnLM tutoring compared with 60.7% for human tutoring. Both interactive tutoring approaches outperformed static hints.[socialscienceregistry.org]socialscienceregistry.orgTesting the efficacy of AI tutoring in secondary mathematics13 Apr 2026 — In that trial, an AI tutor integrated into the Eedi mathematics…[3blog.google]blog.googleai learning commitmentsOur latest commitments in AI and learning11 Nov 2025 — Students who received short tutoring sessions from LearnLM were 5.5 percentage poi…

That result matters because educational researchers often view transfer to new problems as one of the strongest indicators that real understanding has developed. A student who merely memorises a procedure can often solve familiar exercises. A student who understands the concept can adapt it when the presentation changes.

The researchers therefore focused on a question central to cognitive empowerment: can AI help learners build mental models rather than simply obtain solutions?

The early evidence suggests that carefully designed tutoring systems may be capable of doing so. But the evidence remains preliminary, and the trial was not large enough to settle the question on its own.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025

Why the tutoring style mattered more than the model

A common misunderstanding is that the positive results prove increasingly powerful AI models automatically produce better learning outcomes.

The study points in a different direction. LearnLM’s design emphasised pedagogical behaviour. Reports from researchers and educational commentators describe a tutoring style that encouraged students to explain their reasoning, identify mistakes themselves and work through problems step by step.[Third Space Learning]thirdspacelearning.comai tutoring evidenceThird Space LearningWhat is the current AI tutoring evidence and the impact…23 Mar 2026 — LearnLM, their carefully designed AI tutor…

This resembles long-established educational research on effective tutoring. Strong tutors typically do not reveal answers immediately. Instead, they:

In other words, much of the value may come from embedding educational expertise into the interaction rather than simply increasing model intelligence.

For the broader AI bloom debate, this is significant. A future of abundant intelligence may depend not only on creating more capable systems but also on designing them so that they strengthen human reasoning. An AI that instantly completes every task could undermine learning. An AI that helps people think through difficult ideas could expand human capability.

What the trial did not prove

The findings are promising, but the study has important limits.

First, it was relatively small. The trial involved 165 students across five schools. That is enough to generate useful evidence but not enough to establish a definitive educational effect across all contexts.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025[Learning]learning-engineering-virtual-institute.orgEedi Showing How AI Tutoring Can Deliver Personalized…19 Dec 2025 — Eedi, a UK-based mathematics learning platform that diagnoses stud…

Second, the tutoring sessions were short and focused. The study does not show what happens when students rely on AI tutors for months or years, nor whether benefits persist over long periods.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025

Third, the system operated with substantial human oversight. The results therefore cannot be interpreted as proof that unsupervised educational chatbots are equally effective or safe. In fact, some education researchers have warned that unrestricted generative AI can encourage shallow engagement, shortcut-taking and reduced reflection if used without carefully designed guardrails.[Brookings]brookings.eduwhat the research shows about generative ai in tutoringWhat the research shows about generative AI in tutoring27 Jan 2026 — The study rigorously compared static hints, human tutoring…

Fourth, mathematics is only one subject area. Success in structured mathematical reasoning does not automatically imply similar results for writing, history, scientific inquiry or creative work.

The researchers themselves framed the work as exploratory rather than conclusive. That caution is important because AI education discussions often move too quickly from interesting pilot results to sweeping claims about educational transformation.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025

Why this case matters for cognitive empowerment

Even with those caveats, the trial represents something unusual: evidence that AI may be able to support high-quality reasoning rather than merely automate information retrieval.

Historically, individual tutoring has been among the most effective educational interventions available, but it remains expensive and difficult to scale. If systems like Eedi and LearnLM can preserve meaningful parts of tutoring quality while dramatically lowering costs, they could expand access to forms of personalised learning previously available mainly to wealthier families or better-resourced schools.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025

This connects directly to the larger AI bloom vision.

A flourishing future is not only about producing more goods and services. It also depends on increasing humanity’s collective ability to understand, discover, reason and create. Scientific progress, better governance, technological innovation and long-term civilisational resilience all rely on human cognitive capacity.

The strongest version of the optimistic case is therefore not “AI learns for us”. It is “AI helps more people learn”. The Eedi-LearnLM experiment is notable because it tested that possibility in a concrete educational setting rather than treating it as a distant aspiration.

The deeper question: can AI become a scalable teaching partner?

The most important implication may be methodological rather than technological.

The trial suggests that educational AI works best when it combines three elements:

That differs sharply from the popular image of education being transformed by a single all-purpose chatbot.

Instead, the emerging model looks closer to a layered system in which diagnostic tools, learning science, curriculum design, teacher expertise and AI generation are combined into a structured tutoring environment. Eedi’s subsequent larger trials involving more than 1,500 students were launched partly to test whether this supervised and constrained approach can scale beyond the original pilot.[eedi.com]eedi.substack.comA I in Education #7: Five Things I Learned from Bibi GrootAI in Education #7: Five Things I Learned from Bibi Groot…May 12, 2026 — It is a randomised control trial with 165 students, run over…Published: May 12, 2026

Whether that scaling succeeds remains uncertain. Questions about cost, governance, access, teacher roles, student dependence and long-term learning effects remain open. But the trial offers an early glimpse of a version of educational AI that is neither simple automation nor science-fiction superintelligence.

Instead, it is a practical experiment in making expert guidance more abundant. For advocates of a future in which AI expands human potential, that may be one of the most important questions to test. If advanced systems can help millions of people learn mathematics, reasoning and problem-solving more effectively while remaining under meaningful human direction, they would provide evidence that AI can increase not only what machines know, but what humans are able to understand and achieve.[arXiv]arxiv.orgAI tutoring can safely and effectively support studentsDecember 29, 2025 — by LLM Team · 2025 · Cited by 2 — We integrated LearnLM…Published: December 29, 2025[Learning]learning-engineering-virtual-institute.orgEedi Showing How AI Tutoring Can Deliver Personalized…19 Dec 2025 — Eedi, a UK-based mathematics learning platform that diagnoses stud…

Amazon book picks

Further Reading

Books and field guides related to Can supervised AI tutor maths safely?. Use these as the next step if you want deeper reading beyond the article.

Book

The AI Classroom

By Dan Fitzpatrick, Amanda Fox et al.

Directly relevant to supervised AI tutoring and classroom deployment.

See on Amazon

Book

Make It Stick

By Peter C. Brown, Henry L. Roediger III et al.

Strong match for measuring genuine learning transfer rather than short-term performance.

See on Amazon

Book

Why Don't Students Like School?

By Daniel T. Willingham

Explains the cognitive foundations of effective maths learning.

See on Amazon

Book

How Learning Happens

By Paul A. Kirschner, Carl Hendrick

Provides context for structured tutoring and transfer-focused assessment.

See on Amazon

Browse more on Amazon:The AI ClassroomMake It StickWhy Don't Students Like School?

As an Amazon Associate I earn from qualifying purchases.

eBay marketplace picks

Marketplace Samples

Example marketplace items related to this page. Use the search link to explore similar finds on eBay.

Shop location

UsingUSA USA USAUKCanadaAustraliaIreland

Example eBay listing

Makeblock mBot STEM Educational Robot Kit – Bluetooth Version Boxed

SearcheBay.co.uk: educational robot

Browse similar oneBay.co.uk

Example eBay listing

TTS Blue-Bot Educational Bluetooth Robot + USB Cable - Fully Tested

SearcheBay.co.uk: educational robot

Browse similar oneBay.co.uk

Example eBay listing

🤖 Wonder Workshop Dash Robot - Award-Winning Interactive Coding Toy for Kids 🤖

SearcheBay.co.uk: educational robot

Browse similar oneBay.co.uk

Example eBay listing

5 in 1 STEM RC Robot Building Kit 795Pcs Blocks App & Remote Control Bricks

SearcheBay.co.uk: educational robot

Browse similar oneBay.co.uk

Browse more oneBay.co.uk

Example items shown for inspiration; availability and pricing can change. Branchoria may earn a commission if you purchase through outbound eBay links.

Endnotes

1. Source: arxiv.org
Link:https://arxiv.org/abs/2512.23633

Published: December 29, 2025

2. Source: eedi-labs-67qwnm2lxu4blqi5.webflow.io
Link:https://eedi-labs-67qwnm2lxu4blqi5.webflow.io/news/new-exploratory-research-from-eedi-and-google-deepmind-reveals-human-in-the-loop-ai-tutoring-outperforms-human-only-support

3. Source: blog.google
Title: ai learning commitments
Link:https://blog.google/products-and-platforms/products/education/ai-learning-commitments/

4. Source: eedi.com
Title: just launched our second ai tutor rct
Link:https://www.eedi.com/news/just-launched—our-second-ai-tutor-rct

Published: April 2026

5. Source: brookings.edu
Title: what the research shows about generative ai in tutoring
Link:https://www.brookings.edu/articles/what-the-research-shows-about-generative-ai-in-tutoring/

6. Source: learning-engineering-virtual-institute.org
Link:https://learning-engineering-virtual-institute.org/eedi-showing-how-ai-tutoring-can-deliver-personalized-learning-safely-and-effectively/

7. Source: learning-engineering-virtual-institute.org
Link:https://learning-engineering-virtual-institute.org/ai-tutoring-can-safely-and-effectively-support-students-an-exploratory-rct-in-uk-classrooms/

8. Source: eedi.substack.com
Title: A I in Education #7: Five Things I Learned from Bibi Groot
Link:https://eedi.substack.com/p/ai-in-education-7-five-things-i-learned

Published: May 12, 2026

9. Source: cloud.google.com
Link:https://cloud.google.com/solutions/learnlm

10. Source: the74million.org
Title: ai tutors with a little human help offer reliable instruction study finds
Link:https://www.the74million.org/article/ai-tutors-with-a-little-human-help-offer-reliable-instruction-study-finds/

11. Source: eedi.substack.com
Link:https://eedi.substack.com/p/ai-empowers-the-teacher-so-they-can

12. Source: socialscienceregistry.org
Link:https://www.socialscienceregistry.org/trials/18079

13. Source: school.eedi.com
Link:https://school.eedi.com/login

14. Source: eedi.com
Link:https://www.eedi.com/news/new-uk-study-finds-students-using-eedi-gain-2-4-months-of-additional-maths-progress

15. Source: eedi.com
Link:https://www.eedi.com/learn

16. Source: arxiv.org
Link:https://arxiv.org/html/2512.23633v1

17. Source: businesswire.com
Link:https://www.businesswire.com/news/home/20251111406294/en/New-Exploratory-Research-From-Eedi-and-Google-DeepMind-Reveals-Human-in-the-Loop-AI-Tutoring-Outperforms-Human-Only-Support

18. Source: thirdspacelearning.com
Title: ai tutoring evidence
Link:https://thirdspacelearning.com/blog/ai-tutoring-evidence/

Additional References

19. Source: linkedin.com
Link:https://www.linkedin.com/posts/benkornell_breakthrough-aiedu-aiforeducation-activity-7394047991826870272-mP3s

20. Source: facebook.com
Link:https://www.facebook.com/marius.comper/posts/students-tutored-by-googles-learnlm-a-generative-ai-model-fine-tuned-for-pedagog/10164198281704621/

21. Source: linkedin.com
Link:https://www.linkedin.com/posts/bencaulfield_id-like-to-thank-the-teachers-and-young-activity-7421925548903403520-5Huv

22. Source: edtechinnovationhub.com
Title: eedi and google deepmind begin second ai tutoring trial across 1525 uk students
Link:https://www.edtechinnovationhub.com/news/eedi-and-google-deepmind-begin-second-ai-tutoring-trial-across-1525-uk-students

Published: May 2026

23. Source: future-ed.org
Title: research notes two emerging strategies for using ai in tutoring
Link:https://www.future-ed.org/research-notes-two-emerging-strategies-for-using-ai-in-tutoring/

24. Source: finance.yahoo.com
Title: exploratory research eedi google deepmind 090000225
Link:https://finance.yahoo.com/news/exploratory-research-eedi-google-deepmind-090000225.html

25. Source: youtube.com
Title: Google Learn Your Way: How This AI Tool Can Changes Everything!
Link:https://www.youtube.com/watch?v=AN8NHzXtWKE

26. Source: youtube.com
Link:https://www.youtube.com/watch?v=H3ycjuBCJQY

27. Source: youtube.com
Title: I Tested Google’s New AI Model For Education (Complete Tutorial)
Link:https://www.youtube.com/watch?v=g2NICl1beLs

28. Source: youtube.com
Title: Google’s Learn LM: AI Tutor Redefines Education?
Link:https://www.youtube.com/watch?v=FteeQsy4nsU