Test moderators use AI-generated writing to judge literacy standards
Get the Tech newsletter
Daily tech — startups, AI labs, chips, the launches that shape the next decade. Free.
- The UK Department for Education is testing ChatGPT's GPT-5 to generate writing samples used by around 2,000 moderators standardising Key Stage 2 pupil literacy assessments, claiming a 95% cost cut from the current ~£100,000/year process.
- DfE's rollout is limited to three AI-generated collections for one standardisation exercise this year and next, while one full exercise in 2026-27 and 2027-28 will retain scripts written by real children.
- Around 20 experienced local authority moderation managers will review the GPT-5 output for authenticity before deployment, with DfE planning to decide in spring 2027 whether to keep the AI approach or revert to an external supplier.
- DfE's own risk assessment acknowledges that LLMs often produce texts lacking the atypical vocabulary and sentence structures used by neurodivergent or non-native English-speaking pupils, which it plans to mitigate through "thorough review."
- Rebecca Clarkson at Anglia Ruskin University called the use of non-real children's writing a "philosophical and ethical issue," warning AI could shift perceptions of what counts as acceptable writing standards.
- Jo-Anne Baird at the University of Oxford warned of a "backwash" effect in which AI-generated materials become the standards teachers push pupils to emulate, narrowing what is recognised as competent writing.
- The KS2 writing assessment itself doesn't determine school placement, but how well children match up to the synthetic samples dictates the level of support they receive when entering secondary school.
Why it matters: DfE's own risk assessment already flags that AI samples may underrepresent neurodivergent and non-native English speakers, yet no formal impact assessment is listed for the system. A 95% cost cut on a ~£100,000 annual budget is modest — but with ~2,000 moderators shaping the literacy benchmark that determines secondary-school support, the stakes for an entire cohort are disproportionate to the sum saved.
Ask SkimNews
