• Biosimilars
  • Drug Development/R&D
  • All Topics
OHE OHE
Newsletter SignupSubscribe

News & Insights
  • News
  • Events
  • Insights
  • Bulletin
  • News
  • Events
  • Insights
  • Bulletin

News & Insights

  • News
  • Events
  • Insights
  • Bulletin
Newsletter SignupSubscribe
  • News
  • Events
  • Insights
  • Bulletin

Close
OHE OHE
  • Research & Publications
  • News & Insights
  • Education
  • Innovation Policy Prize
  • Events
  • About Us
  • OHE Experts
  • Contact Us
Newsletter SignupSubscribe

Research & Publications

All Publications

Filter by:
  • Antimicrobial Resistance (AMR)
  • Biosimilars
  • Cell and Gene Therapies
  • Chronic Diseases
  • Combination Therapies
  • COVID-19 Research
  • Digital Health
  • Drug Development/R&D
  • Emerging Markets
  • EQ-5D and PROMs
  • Health Care Systems
  • Health Data and Statistics
  • Health Technology Assessment
  • Precision Medicine
  • Real World Evidence
  • Use of Medicines
  • Value-Based Pricing
  • Vaccine Research
  • Economics of Innovation
  • Measuring and Valuing Outcomes
  • Policy, Organisation and Incentives in Health Systems
  • Value, Affordability and Decision Making

News & Insights

  • News
  • Events
  • Insights
  • Bulletin

Education

  • Education Hub
  • OHE Graduate School
  • EVIA Programme

Innovation Policy Prize

  • The Prize Fund
  • 2022 Prize Fund

Latest Research & Publications

Proposal for a General Outcome-based Value Attribution Framework for Combination Therapies

CombTher_Adobe_photoguns_portrait
Read more
© photoguns
  • Digital Health

Navigating the Landscape of Digital Health – United Kingdom

Healthcare_Adobe_elenabsl
Read more

2021 OHE Annual Report to the Charity Commission

charityreport_lina-trochez-unsplash_landscape
Read more
© Lina Trochez/Unsplash

Supporting the Era of Green Pharmaceuticals in the UK

Sustainability_AdobeStock_270582392_landscape
Read more

Quality of life and wellbeing in individuals with experience of fertility problems and assisted reproductive techniques

Quality of life assisted reproduction Cover
Read more
  • Cell and Gene Therapies
  • Value, Affordability, and…

Health Technology Assessment of Gene Therapies: Are Our Methods Fit for Purpose?

gene_therapies_national-cancer-institute-unsplash_landscape
Read more
© NCI/Unsplash
  • Drug Development/R&D
  • Economics of Innovation
  • Health Policy and Regulation

Limitations of CBO’s Simulation Model of New Drug Development as a Tool for Policymakers

CBO-US_mayer-tawfik-K4Ckc0AxgDI-unsplash_landscape
Read more
© Mayer Tawfik/Unsplash
  • Measuring and Valuing Outcomes

When Generic Measures Fail to Reflect What Matters to Patients: Three Case Studies

PROMS_unsplash_National Cancer Institute_landscape
Read more
© NCI/Unsplash
Close
OHE
  • All Publications

    Filter by:
    • Antimicrobial Resistance (AMR)
    • Biosimilars
    • Cell and Gene Therapies
    • Chronic Diseases
    • Combination Therapies
    • COVID-19 Research
    • Digital Health
    • Drug Development/R&D
    • Emerging Markets
    • EQ-5D and PROMs
    • Health Care Systems
    • Health Data and Statistics
    • Health Technology Assessment
    • Precision Medicine
    • Real World Evidence
    • Use of Medicines
    • Value-Based Pricing
    • Vaccine Research
    • Economics of Innovation
    • Measuring and Valuing Outcomes
    • Policy, Organisation and Incentives in Health Systems
    • Value, Affordability and Decision Making
    • News
    • Events
    • Insights
    • Bulletin
    • Education Hub
    • OHE Graduate School
    • EVIA Programme
    • The Prize Fund
    • 2022 Prize Fund
  • Events
  • About Us
  • OHE Experts
  • Contact Us
Newsletter SignupSubscribe
Back
  • News
11 min read 20th February 2012

Analysing Hospital Variation at the Level of EQ-5D Dimensions

Measuring and publishing hospital data on achieved health outcomes is becoming routine in many health care systems. League tables of hospital quality – based on post-surgical survival rates, for example – are used to highlight variation in performance across providers.…

Share:
  •  Twitter
  •  LinkedIn
  •  Facebook
  • has-icon Email
Prof Nancy Devlin

Measuring and publishing hospital data on achieved health outcomes is becoming routine in many health care systems. League tables of hospital quality – based on post-surgical survival rates, for example – are used to highlight variation in performance across providers. These measures, however, reveal little about the health of the vast majority of patients and may fail to detect important variations in quality.

Prof Nancy Devlin

Prof Devlin

Measuring and publishing hospital data on achieved health outcomes is becoming routine in many health care systems.  League tables of hospital quality – based on post-surgical survival rates, for example – are used to highlight variation in performance across providers. These measures, however, reveal little about the health of the vast majority of patients and may fail to detect important variations in quality. More comprehensive measures of patients’ health outcomes are needed as the basis for a better assessment of hospital performance and identification of best practice.

In this paper, OHE’s Nancy Devlin collaborated with colleagues from the Centre of Health Economics at the University of York to measure variation in hospital quality using a new, routinely collected dataset on patient‐reported outcome measures (PROMs). Since April 2009, all providers of publicly‐funded inpatient care in the English NHS have been required to collect such measures for four elective procedures: unilateral hip and knee replacements, varicose vein surgery, and groin hernia repairs. Patients undergoing these procedures are asked to complete the EQ-5D, which produces generic measures of health, as well as a condition-specific questionnaire both before and several months after surgery.

The use of PROMs in the context of routine performance assessment on a national scale is new; it requires an appropriate methodology that takes into account both the characteristics of the data and their intended use as measures of relative quality of hospital treatment. The NHS Information Centre (IC) has developed a preliminary risk-adjustment methodology that currently is applied to the PROMs data. In this study, the authors build on these efforts and propose the following two refinements.

First, the authors argue that the data should be analysed at the level of PROM-item responses instead of summarizing them as a single score. Collapsing EQ‐5D health profile data into a single value by means of weighting loses some information on the underlying nature of the patient’s health and can bias statistical inference. It also raises questions about whose views the scores should reflect – those of the general public (as is generally the case when EQ-5D data are used in economic evaluation) or those of patients.

Second, the authors note that patients’ health outcomes are likely to be influenced by both observed factors (e.g., age and gender) and unobserved factors (e.g., differences in the way patients report their health, unobserved medical conditions) that are outside the hospitals’ control. These factors need to be taken into account to allow for a fair comparison of hospital quality. The authors argue that the risk‐adjustment methodology should distinguish random variation and differences across patients from systematic variation in quality among providers. Because PROMs data are available both at the patient level and at the provider level, multi-level models are a good way of exploring this.

This study focuses on hip replacement patients and studies hospital variation in changes in self-reported health on the five dimensions of the EQ-5D: mobility, self-care, usual activities, pain & discomfort, and anxiety & depression. The results suggest that patients undergoing hip replacement surgery report, on average, improvements in health along each of the five dimensions six months after surgery. However, hospitals vary in their systematic impact on post-treatment health. This is especially pronounced on dimensions related to functioning (i.e., mobility, usual activities) where several performance outliers can be identified. In contrast, pain relief, one of the primary goals of hip replacement surgery, is achieved by all hospitals to a similar extent. Given that the EQ-5D utility index attaches high weights to the pain dimension, but relatively low weights to mobility and usual activities, the authors demonstrate how quality assessment using summary scores can provide an incomplete, potentially misleading assessment of hospital performance.

This study is the first to analyse hospital performance in terms of the EQ-5D dimensions and to use multilevel modelling methods to do so. It demonstrates how the data being generated from the NHS PROMs programme can be used in creative ways to generate completely new insights into hospital performance and quality. Previously, PROMs data were available to download only in an aggregated form, for example, as averages for each hospital. Now, patient level data, including patients’ self-reported health on the dimensions of the EQ-5D before and after surgery, are available for download from the NHS IC.

This research was undertaken as part of an ongoing research programme funded by an NIHR Health Services Research Grant.

Download Gutacker, N., Bojke, C., Daidone, S., Devlin, N., and Street, A. (2012) Analysing hospital variations in health outcomes at the level of EQ-5D dimensions. CHE research paper. 74. York: Centre for Health Economics, University of York.

For a related paper by this research team, download
Gutacker, N., Bojke, C., Daidone, S., Devlin, N., Parkin, D. and Street, A. (2011) Truly inefficient or providing better quality of care? Analysing the relationship between risk-adjusted hospital costs and patients’ health outcomes. CHE Research Paper. 68. York: Centre for Health Economics, University of York.

For more on PROMs, download Devlin, N. and Appleby, J. (2010) Getting the most out of PROMs: Putting health outcomes at the heart of NHS decision making. London: King’s Fund and Office of Health Economics.

See also Parkin, D. and Devlin, N. (2011) Using health status to measure NHS performance: Casting light in dark places. BMJ Quality and Safety. Online first. 21 September. [Available for download by subscribers only]

  • EQ-5D and PROMs
  • Measuring and Valuing Outcomes
  • External Publications

Related News

  • News
  • September 2020

Establishing a Reasonable Price for an Orphan Drug

Read more
  • News
  • April 2020

Augmenting Cost-Effectiveness Analysis for Uncertainty: The Implications for Value Assessment—Rationale and Empirical Support

Read more
  • News
  • April 2020

Financing and Scaling Innovation for the COVID Fight: A Closer Look at Demand-Side Incentives for a Vaccine

Read more
  • News
  • February 2020

Unpacking the Black Box of Payer Policy: A Demand-Side Approach for Equitable Uptake of Cost-Effective Health Innovation

Read more
footer_ohe_logo

Leading intellectual authority on global health economics

Sign Up for the OHE News Bulletin

Newsletter SignupStart Sign Up

Research & Publications

News & Insights

Innovation Policy Prize

Education

Events

About Us

OHE Experts

Contact Us

Sign Up for the OHE News Bulletin

Newsletter SignupStart Sign Up

The Office of Health Economics (OHE) is a company limited by guarantee registered in England and Wales (registered number 09848965) and its registered office is at 2nd Floor Goldings House, Hay’s Galleria, 2 Hay’s Lane, London, SE1 2HB.

Terms & Conditions

Privacy Policy

Cookies Policy

© 2023 Website Design

An error has occurred, please try again later.An error has occurred, please try again later.

We are using cookies to give you the best experience on our website.

You can find out more about which cookies we are using or switch them off in settings.

 Twitter
 Facebook
 LinkedIn
 Copy
 Email
Powered by  GDPR Cookie Compliance
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

3rd Party Cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!