Warnings ignored – Toby Young of New Schools Network still pushes free school superiority despite ‘serious limitations’ of analysis
We’ve been here before. Time and again this site has said there isn’t enough data to come to a firm conclusion about the performance of free schools as a group.
Claims about the superiority of free schools, regularly spewed out by the Department for Education and the New Schools Network (NSN), are misleading. One example, a DfE press release in September, was even censured by the UK Statistics Authority.
‘There is insufficient data to reach robust conclusions on the effectiveness – good or bad – of free schools in terms of Ofsted outcomes and pupil attainment and progress.’
Nevertheless, the EPI report published analyses showing pupil attainment and progress in free schools. This has been cherry-picked by Toby Young, NSN’s director, in a TES article:
‘The report also highlights the success of free schools at key stage 1, where pupils are more likely to achieve the expected standard in reading, writing and mathematics than any other type of school.’
But he ignores the analysis of performance at the end of key stage 2 (KS2):
- In 2016 and 2017 ‘the proportion of pupils that reached the expected standard in each of reading, writing and mathematics in free schools was relatively low.’
- Free schools were the lowest performing school group in writing and mathematics … well behind converter academies and local authority schools.’
It would be misleading, however, to use the two findings above to slate free schools. The report gives further warnings about the primary free school data:
- Only a tiny number of free schools had pupils taking end of KS2 tests
- These are unlikely to be representative of all free schools
- KS1 analysis didn’t control for level of development on entry
- KS1 analysis didn’t consider whether teacher assessments were reliable
Young ignores these warnings and cited the KS1 analysis at face value.
Young’s article was in response to a TES piece arguing the report showed a need to ‘rethink’ the free school programme. Young wrote:
‘A more accurate summary of the report would be to say it found free schools have had a positive impact in London and the South East, reducing social segregation and raising standards, particularly for the most disadvantaged.’
This, again, is misleading. The EPI made it abundantly clear its analysis presented ‘a mixed picture’. Analysing Ofsted judgements and performance in tests had ‘serious limitations’ regarding how far they could be used to measure how effective free schools as a group are.
The New Schools Network (and the DfE) should take note.
UPDATE 12.06 17 November 2017: The New Schools Network has published its spin on the EPI report here. Unsuprisingly, there's no mention of the warnings and 'serious limitations'.
This is a companion piece to ‘20% of free schools are below Progress 8 floor standard’, ‘Free school headlines - stuffed full of selected stats Part 1’ and ‘Free school headlines – stuffed full of selected stats Part 2’