DfE accepts (in court) that academies do no better once GCSE equivalents are stripped out

Henry Stewart's picture
 9
Last week the High Court ruled that the Secretary of State was within his rights to force The Warren Comprehensive to become an academy. This was an interesting court case, as the arguments were based around the differing analysis of the results of the Local Schools Network and the DfE.

The DfE could produce no evidence that academies perform better compared to similar schools once equivalent qualifications are stripped out. They won the case because the judge was persuaded that it was valid to use GCSE comparisons that included equivalents - even though the DfE and Michael Gove have both stated that they regard these as "devaluing" those results, and even though these.will mainly not be included from this year.

Academisation of The Warren was opposed by parents and staff, with the local consultation showing 85% against (out of 431 responses). In 2013 the GCSE benchmark figure jumped by 17%, from 39% to 56% achieving 5 GCSEs including English and Maths ("a dramatic rise" according to Ofsted) and is expected to go above the national average this year.

However the school is still in special measures and neither local opposition nor strong and improving results are, under the Academies Act, grounds to question Michael Gove's actions. To stop the conversion the school had to show that his decision was based on "a material error of fact".

In court the local authority (Barking and Dagenham) challenged the Academies Order on the basis that the claim that "the statistical evidence shows that sponsored academies are more likely to deliver attainment and improved progress" is a material error of fact. They relied on the LSN analysis that shows that the increase in attainment is "broadly similar" in academies and non-academies, once similar schools are compared.

The DfE has never challenged this LSN analysis and did not challenge the LSN analysis in any of its evidence.

The DfE did respond with its own analysis for different periods of time. This found that "results in sponsored academies were marginally higher than in a group of similar local authority schools" (quote from High Court judgement).

Unlike what it says in its press releases, when giving evidence to the High Court the DfE was able to claim only "marginally higher" achievement for academies.

Under the Academies Act the demands on the Secretary of State are not great and a "marginal" gain would be sufficient to make his action legal. Counsel acting for the local authority challenged the DfE's research on the basis that this marginal gain was based on GCSE results that included equivalents, which Michael Gove himself described as "devaluing" the measures. The evidence is clear that academies make far greater use of equivalents.

Counsel contended that any marginal rates would evaporate if equivalents were stripped out. For instance the DfE's own document "Attainment at Key Stage 4 by pupils in Academies 2011" found the marginally higher figure for sponsored academies (46% v 45.7% for similar non-academies) fell to 32.6% for academies v 35.6% for similar non-academies once equivalents were stripped out. Counsel pointed out that it was not possible to use more recent DfE analysis as these have not reported the statistics without equivalents.

DfE were not able to claim that academies do better than similar non-academies once equivalents are stripped out, and at no point put forward that claim

The DfE accepted that it had itself described equivalents as devaluing the GCSE measures and acknowledged that these would mainly be removed from 2014 onwards. Unable to argue that sponsored academies did better once equivalents are removed, it was left to argue that it was valid to use the figures that included equivalents as at the time of the analysis they were a "valid measure of a school's performance".

Counsel for the LA argued that whether to convert The Warren to an academy was a forward-looking question and so using figures that included equivalents was not relevant, and that it was irrational for the Secretary of State to use statistics based on equivalents that "in his view devalue the figures".

Ultimately the burden of proof under the Academies Act is very low and the judge ruled that to use one measure instead of another - even if it will no longer be valid in 2014 and beyond - does not represent "a material error of fact". Thus the local authority lost the case. However this battle of statistics was revealing.

When challenged in court, the DfE only claims a "marginally higher" improvement for academies over similar non-academies and is only able to do so with figures that include GCSE equivalents that the department itself regards as devaluing the measure. The implication is that, once equivalents are removed or once the new 2014 WOLF measure is used, there is no evidence of better performance from academies.

This is backed up by the first analysis of the effect of using the WOLF measure, which shows that in 2013 academy results would have fallen by 7.4% - almost twice the level of the 3.8% of schools overall.

 

Postscript: For the full judgement, click here

 

 

Comments

Peter Nye's picture
Sun, 13/07/2014 - 19:46

Full text of judgement is available at Bailii.org - England and Wales High Court (Administrative Court) Decisions


Peter Martin's picture
Mon, 14/07/2014 - 06:05

Here's the judgment:

http://www.bailii.org/ew/cases/EWHC/Admin/2014/2252.html

Finds for SoS, but agrees (contrary to DfE assertions) no basis to accept Sponsored Academies improve any better than like-for-likes once 'equivalents' are stripped out?

rogertitcombe's picture
Mon, 14/07/2014 - 07:46

Surely this judgement should prevent DfE claiming the contrary.


Janet Downs's picture
Mon, 14/07/2014 - 08:00

Roger - unfortunately this Government and much of the media have a habit of repeating untrue statements (eg using the discredited 2000 PISA figures, saying academy conversion is a silver bullet, saying non-academies are under LA "control" or, the latest myth, controlled by "local politicians").

A discussion in Court is unlikely to deter them - they'll just brush it aside on the grounds the DfE won.

Janet Downs's picture
Mon, 14/07/2014 - 08:11

Henry - what made me really angry was the judgement that Gove was "entitled to take a different view to those who responded to the consultation".

This is an admission by a judge that a Government minister is "entitled" to ignore the views of people who are supposed to be consulted by law. But what is the point of consulting if a minister is "entitled" to ignore the consultation's findings?

http://www.bbc.co.uk/news/uk-england-london-28251605

Janet Downs's picture
Mon, 14/07/2014 - 08:26

Thanks, Peter. I've now read the judgement in full. The Judge's conclusion said an e-mail from Ofsted said it is "possible" for the [Warren] school to be removed from special measures this Autumn. The Judge also said Gove had noted the improvement in GCSE results.

It appears, then, the enforced conversion of Warren is part of a pattern - convert a school quickly when green shoots are emerging so any future improvement can be attributed to the sponsor (eg Downhills and others).


Peter Martin's picture
Mon, 14/07/2014 - 08:33

That entitlement opens the Minister's actions to claims of arbitrariness, methinks?


John Mountford's picture
Tue, 15/07/2014 - 20:41

More than anything for me, this case demonstrates that our democratic rights are being surely eroded as, in spite of claims to the contrary, 'big government' is slowly taking over. Other commentators are right to point to the futility of challenging ministers, when the judicial system is primed to ignore the views of consultees in this case.

Peter, the minister in question, finally having been given the boot, knew his actions would be vindicated by the judicial system because his government made damn sure the wording of the Academies Act would place a higher burden of proof on those who dared to challenge politicians' right to dictate to mere, insignificant ordinary citizens.

agov's picture
Wed, 16/07/2014 - 11:15

Nope, just as election manifestos (as NuLab went to court to establish) are worthless but will continue for the gullible -

http://lordsoftheblog.net/2012/07/06/misleading-by-manifesto/

"manifestos are not worth the paper they are written on"

Add new comment

Already a member? Click here to log in before you comment. Or register with us.