The National Audit Office uses OR to assess the value for money of public services

Supreme audit institutions (SAIs) have an important role in assessing value for money in the delivery of public services. Assessing value for money necessarily involves assessing counterfactuals: good value for money has been achieved if a policy could not reasonably have been delivered more efficiently, effectively, or economically. Operations research modelling has the potential to help in the assessment of these counterfactuals. However, is such modelling too arcane, complex, and technically burdensome for organisations that, like SAIs, operate in a time- and resource-constrained and politically charged environment? We report on three applications of modelling at the UK's SAI, the National Audit Office, in the context of studies on demand management in tax collection, end-of-life care, and health-care associated infections. In all cases, the models have featured in the audit reports and helped study teams come to a value-for-money judgment. We conclude that OR modelling is indeed a valuable addition to the value-for-money auditor's methodological tool box.

Classification in e-procurement

Three coupled knowledge transfer partnerships used pattern recognition techniques to produce an e-procurement system which, the National Audit Office reports, could save the National Health Service £500 m per annum. An extension to the system, GreenInsight, allows the environmental impact of procurements to be assessed and savings made. Both systems require suitable products to be discovered and equivalent products recognised, for which classification is a key component. This paper describes the innovative work done for product classification, feature selection and reducing the impact of mislabelled data.

Evaluation of the Met Office global forecast model using Geostationary Earth Radiation Budget (GERB) data

Simulations of the top-of-atmosphere radiative-energy budget from the Met Office global numerical weather-prediction model are evaluated using new data from the Geostationary Earth Radiation Budget (GERB) instrument on board the Meteosat-8 satellite. Systematic discrepancies between the model simulations and GERB measurements greater than 20 Wm-2 in outgoing long-wave radiation (OLR) and greater than 60 Wm-2 in reflected short-wave radiation (RSR) are identified over the period April-September 2006 using 12 UTC data. Convective cloud over equatorial Africa is spatially less organized and less reflective than in the GERB data. This bias depends strongly on convective-cloud cover, which is highly sensitive to changes in the model convective parametrization. Underestimates in model OLR over the Gulf of Guinea coincide with unrealistic southerly cloud outflow from convective centres to the north. Large overestimates in model RSR over the subtropical ocean, greater than 50 Wm-2 at 12 UTC, are explained by unrealistic radiative properties of low-level cloud relating to overestimation of cloud liquid water compared with independent satellite measurements. The results of this analysis contribute to the development and improvement of parametrizations in the global forecast model.

Habituation and dishabituation to speech and office noise

The authors examined whether background noise can be habituated to in the laboratory by using memory for prose tasks in 3 experiments. Experiment 1 showed that background speech can be habituated to after 20 min exposure and that meaning and repetition had no effect on the degree of habituation seen. Experiment 2 showed that office noise without speech can also be habituated to. Finally, Experiment 3 showed that a 5-min period of quiet, but not a change in voice, was sufficient to partially restore the disruptive effects of the background noise previously habituated to. These results are interpreted in light of current theories regarding the effects of background noise and habituation; practical implications for office planning are discussed.

The development of a new dust uplift scheme in the Met Office Unified Model

Aeolian mineral dust aerosol is an important consideration in the Earth's radiation budget as well as a source of nutrients to oceanic and land biota. The modelling of aeolian mineral dust has been improving consistently despite the relatively sparse observations to constrain them. This study documents the development of a new dust emissions scheme in the Met Office Unified ModelTM (MetUM) based on the Dust Entrainment and Deposition (DEAD) module. Four separate case studies are used to test and constrain the model output. Initial testing was undertaken on a large dust event over North Africa in March 2006 with the model constrained using AERONET data. The second case study involved testing the capability of the model to represent dust events in the Middle East without being re-tuned from the March 2006 case in the Sahara. While the model is unable to capture some of the daytime variation in AERONET AOD there is good agreement between the model and observed dust events. In the final two case studies new observations from in situ aircraft data during the Dust Outflow and Deposition to the Ocean (DODO) campaigns in February and August 2006 were used. These recent observations provided further data on dust size distributions and vertical profiles to constrain the model. The modelled DODO cases were also compared to AERONET data to make sure the radiative properties of the dust were comparable to observations. Copyright © 2009 Royal Meteorological Society and Crown Copyright

A retrospective audit of medicines use review forms

The medicines use review (MUR) service was introduced in England and Wales in 2005 to improve patients’ knowledge and use of medicines through a private, patient–pharmacist consultation. The pharmacist completes a standard form as a record of the MUR consultation and the patient receives a copy. The 2008 White Paper, Pharmacy in England[1] notes some MURs are of poor or questionable quality and there are anecdotal reports that pharmacists elect to conduct ‘easy’ MURs with patients on a single prescribed medicine only.[2] In 2009, the Royal Pharmaceutical Society of Great Britain (RPSGB) launched a multi-disciplinary audit template to review the effectiveness of MURs and improve their quality.[3] Prior to this, we conducted a retrospective MUR audit in a 1-month period in 2008. Our aims were to report on findings from this audit and the validity of using MUR forms as data for audit.