Good analysis is inherently multi-disciplinary. It draws on a range of professional perspectives and it is driven by providing insight into problems, and answers to questions.
So too is the work of the Office for Statistics Regulation(OSR). We support the entire analysis function.
We do this in two ways.
First, through the Code of Practice for Statistics. This Code is not a set of rules for rigid application to official statistics. It is a philosophy, built around three principles: trustworthiness, quality and value; and it is a philosophy that focuses on how to support confidence in analytical work.
These concepts of trustworthiness, quality and value should underpin all analytical work. Trustworthiness is about providing evidence of how you’ve followed a rigorous process, had rigorous governance. It aligns closely with other sources of guidance, like the Aqua Book. Quality is about ensuring that the figures that you produce are not misleading – that they represent the best estimate based on the data available. Quality is consistent with professional guides like the Green Book. And value is about ensuring that your analysis addresses the questions raised by your customer – whether that be a Minister, a policy team, or a Parliamentary committee.
Indeed, the idea of value that is a core part of the Code is central to good analysis. Good analysis enables the relevant department or agency to make good policy, deliver good services, address risks and create opportunities The analysis will provide value to an organisation – it is needing the analysis to support some activities –which in turn provides benefits to society.
So the Code has wide applicability. But OSR wouldn’t take a role in reviewing or commenting on internal advice within government. Our support, through the Code, is therefore indirect – but no less valuable for that.
But OSR does support the whole analysis function more directly in a second way: we stand up for appropriate use of analysis in the public domain. This is because a lot of the analysis function’s work is published in one form or another, and informs public debate. When the Government communicates policy or delivery, it does so not just using the regularly published official statistics. It draws on a wider range of analytical outputs – economic modelling, social research, operational research, data science.
For example during the coronavirus (COVID-19) pandemic, we have stepped in on several occasions to encourage departments to publish information that Ministers have referred to in their explanations of policy. We’ve done this on rough sleeping, Universal Credit, as well as a range of more directly health-related issues. We have also sought to protect analysis from inappropriate interpretation – to ensure that the analysis is fairly represented. We did this for example on analysis in Scotland of the impact on care homes of discharging people from hospital.
When we do this, we are quite deliberately standing up for the analysis function – we want your work to be used appropriately and fairly.
That’s because we’re not a regulator of statisticians as a professional group. We’re a regulator that supports the publication of statistics to serve the public good – and the focus is not just on official statistics, but a broader range of outputs that draw on numerical analysis. They should all be trustworthy, high quality and high value. These goals of the Code of Practice – trustworthiness, quality and value – are also the goals that sit at the heart of the public use of analysis.
Most importantly, we always defend the principle of equality of access. If the Government refers to a model or a piece of research, it should be easy for the public to access the underlying information.
The word public is crucial here. We do not want to over-reach. We focus on numbers in the public eye. So much of the work of analysts is in fact in support of policy and operational decisions within Government – for example, looking at the potential impact of different policy options. There are fantastic tools available to support this work – the Green Book and the Aqua Book for example. We don’t see OSR as having a role in this crucial aspect of analysis.
But when analysis goes into the public domain, the Code’s principles are all triggered. And especially the principle of equality of access.
So perhaps the message of this blog is this. It doesn’t matter if you’re a social researcher or a geographer; an operational researcher or an actuary. The Code is a framework to support confidence in your work no matter what the audience. And whether or not your analysis goes public, think TQV: trustworthiness, quality and value!
Written by Ed Humpherson, Office for Statistics Regulation
Follow this news feed: HM Government