Unbiased Analysis of Today's Healthcare Issues

Did pay-for-performance work in the UK?

Written By: Jason Shafrin - Feb• 15•10

A paper by Sutton, Elder Guthrie and Watt (2010) describes the UK’s National Health Service’s (NHS) adoption of the Quality and Outcomes Framework (QOF) in April 2004. In general, P4P programs can have positive or negative spillovers.  An example of a positive spillover would be the adoption of EMR to comply with certain P4P initiatives, but which also improves productivity in other areas.  A negative spillover would occur if physicians focus on getting the P4P bonuses, but decrease effort in unmeasured areas which could be more important to the patient’s health.

The authors describe the QOF more fully as follows:

In the first 2 years of the QOF scheme, practices were rewarded according to the performance they reported on 146 indicators. Through their performance on these indicators, practices earned up to 1050 QOF points. Practices were rewarded for these points according to a complex, non-linear function of the prevalence of disease in, and size of, their registered populations…An average practice was paid £75 per point in the first year and £125 per point in the second year of the scheme.

Seventy-six of the indicators, and 57% of the financial rewards, were offered for the quality of clinical care. These 76 indicators were focused on the care of people with 10 targeted chronic diseases and involved the maintenance of disease registers, the verification of diagnoses, the recording and management of risk factors and the provision of selected treatments. Points were awarded based on reported coverage rates if they were above a lower threshold of 25%. Maximum points were awarded if the coverage rate equalled or exceeded an upper threshold, which varied across indicators.

The authors examine whether the QOF increased effort levels for physician treatment of five groups of patients who had diseases for which physicians could earn QOF bonuses.  The paper also examines changes in quality for “Untargeted” patients, who did not have any diseases for which physicians could earn additional income under QOF.  The analysis is based on a before and after structure.  It evaluates the change in both quality metrics that were reimbursed under QOF and the quality metrics which were not subject to QOF bonuses.  If there are negative spillovers, one would expect the rewarded metrics would increase after QOF, but the unrewarded quality would decrease as physicians shift their priorities.

The paper finds that the effect on incentivized factors was substantially larger on the targeted patient groups (+19.9 percentage points) than on the untargeted groups (+5.3 percentage points).  The authors claim that there was no obvious evidence of effort diversion but there was evidence of substantial positive spillovers (+10.9 percentage points) onto non-incentivized factors for the targeted groups.

One issue here is that paper only looks at observable quality metrics.  The physician may believe that observable quality that is not currently rewarded will be rewarded in the future.  Thus, these positive spillovers may extend over to quality factors observable by the NHS.  On the other hand, unobserved quality may have decreased, but this would not have shown up in the econometric analysis.

  • Sutton, Elder Guthrie and Watt (2010) “Record rewards: the effects of targeted quality incentives on the recording of risk factors by primary care providers,” Health Economics, v19(1):1-13.

You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Leave a Reply

Your email address will not be published. Required fields are marked *