TEF and the Controlled Reputational Range

One core function of the Teaching Excellence Framework (TEF) is to celebrate teaching in our universities and other providers.  The publication of the results of the second round have been widely discussed in the sector, with some inevitable media coverage of what it means to be given the ‘silver’ or ‘bronze’ levels, particularly whether those providers are second or third rate.  But, for all my concerns about TEF, I wonder if there is a message that the sector should take away from this process – that it confirms the continued existence of the Controlled Reputational Range.

One of the concepts that Sir David Watson explored in his writing was that of the Controlled Reputational Range.  This was the notion that in UK Higher Education, although there could not be exact parity between all universities, there was a framework that meant that no institution was able to behave so badly that it damaged the overall reputation of the sector.  He described it in 2002, but returned to it several times.

Watson not only described the range, but he did much to bring it into effect.  He was closely involved in the merger of the two HE sectors in 1992, working on the funding arrangements for the new sector and more prominently on the quality assurance of the new sector.  The 1992 merger, particularly the awarding of university title to all the polytechnics and two colleges, caused much alarm.  Quality assurance was more systematic on the PCFC side; a function of both CNAA and HMI regimes.  The autonomous universities on the UFC side had a better public perception of their quality, but not necessarily their quality assurance.   The regime of Teaching Quality Assurance – which later became Subject Review – was vital in calming down nerves about a unified sector which suddenly looked as if it had jumped from an elite to a mass system.  The former UFC universities did better than might have been expected, generally achieving a higher number of ‘excellent’ judgements, but the PCFC side held up well.  By 2001 it was clear that the mass inspection system had played its role, and it was dropped in favour of Teaching Quality Information (TQI).  You could argue TEF is the apotheosis of TQI.

TEF accentuates the difference between providers with the Gold, Silver and Bronze awards, but the analysis done by both WonkHe and THE shows that these judgements are not based on the metrics alone.  Some Silver providers have ‘better’ outcomes on the benchmarked metrics than those awarded Gold.  Ranking using z-scores accentuates the difference between providers, but the benchmarking closes the gap in performance overall.  I think this shows that the controlled reputational range has worked; clearly universities recruiting highly prepared students have better absolute outcomes, but universities have exceeeded expectations across the reputational range.

Given that higher education has always been wider than those institutions with university title or access to government funding, the TEF does show how the new registration regime with OfS may help to maintain the reputational range.  The write-up for Moorlands College achieving a provisional grade might be slightly over the top, but being in the TEF will be a new marker of quality in the sector.  Those alternative providers with sufficient data to be graded achieved each of the three levels.


The funded part of the HE sector was subject to some very considerable, if sometimes invisible, regulation through their data.  HEFCE rules on, say, completion drove institutional behaviour.  The TEF may have a similar effect.  That is why the review must look at the data chosen for the exercise as it will drive performance – probably even for universities who you might have thought could shrug off a ‘bronze’ award.  Of course, if we could just drop the pretence that the TEF was actually about teaching excellence and abandon the gimmicky grading system (and the further rankings coming from it), then it could be a light touch system of ensuring that providers stay within that controlled reputational range.

 

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s