• Biosimilars
  • Drug Development/R&D
  • All Topics
OHE OHE
Newsletter SignupSubscribe

News & Insights
  • News
  • Events
  • Insights
  • Bulletin
  • News
  • Events
  • Insights
  • Bulletin

News & Insights

  • News
  • Events
  • Insights
  • Bulletin
Newsletter SignupSubscribe
  • News
  • Events
  • Insights
  • Bulletin

Close
OHE OHE
  • Research & Publications
  • News & Insights
  • Education
  • Innovation Policy Prize
  • Events
  • About Us
  • OHE Experts
  • Contact Us
Newsletter SignupSubscribe

Research & Publications

All Publications

Filter by:
  • Antimicrobial Resistance (AMR)
  • Biosimilars
  • Cell and Gene Therapies
  • Chronic Diseases
  • Combination Therapies
  • COVID-19 Research
  • Digital Health
  • Drug Development/R&D
  • Emerging Markets
  • EQ-5D and PROMs
  • Health Care Systems
  • Health Data and Statistics
  • Health Technology Assessment
  • Precision Medicine
  • Real World Evidence
  • Use of Medicines
  • Value-Based Pricing
  • Vaccine Research
  • Economics of Innovation
  • Measuring and Valuing Outcomes
  • Policy, Organisation and Incentives in Health Systems
  • Value, Affordability and Decision Making

News & Insights

  • News
  • Events
  • Insights
  • Bulletin

Education

  • Education Hub
  • OHE Graduate School
  • EVIA Programme

Innovation Policy Prize

  • The Prize Fund
  • 2022 Prize Fund

Latest Research & Publications

Proposal for a General Outcome-based Value Attribution Framework for Combination Therapies

CombTher_Adobe_photoguns_portrait
Read more
© photoguns
  • Digital Health

Navigating the Landscape of Digital Health – United Kingdom

Healthcare_Adobe_elenabsl
Read more

2021 OHE Annual Report to the Charity Commission

charityreport_lina-trochez-unsplash_landscape
Read more
© Lina Trochez/Unsplash

Supporting the Era of Green Pharmaceuticals in the UK

Sustainability_AdobeStock_270582392_landscape
Read more

Quality of life and wellbeing in individuals with experience of fertility problems and assisted reproductive techniques

Quality of life assisted reproduction Cover
Read more
  • Cell and Gene Therapies
  • Value, Affordability, and…

Health Technology Assessment of Gene Therapies: Are Our Methods Fit for Purpose?

gene_therapies_national-cancer-institute-unsplash_landscape
Read more
© NCI/Unsplash
  • Drug Development/R&D
  • Economics of Innovation
  • Health Policy and Regulation

Limitations of CBO’s Simulation Model of New Drug Development as a Tool for Policymakers

CBO-US_mayer-tawfik-K4Ckc0AxgDI-unsplash_landscape
Read more
© Mayer Tawfik/Unsplash
  • Measuring and Valuing Outcomes

When Generic Measures Fail to Reflect What Matters to Patients: Three Case Studies

PROMS_unsplash_National Cancer Institute_landscape
Read more
© NCI/Unsplash
Close
OHE
  • All Publications

    Filter by:
    • Antimicrobial Resistance (AMR)
    • Biosimilars
    • Cell and Gene Therapies
    • Chronic Diseases
    • Combination Therapies
    • COVID-19 Research
    • Digital Health
    • Drug Development/R&D
    • Emerging Markets
    • EQ-5D and PROMs
    • Health Care Systems
    • Health Data and Statistics
    • Health Technology Assessment
    • Precision Medicine
    • Real World Evidence
    • Use of Medicines
    • Value-Based Pricing
    • Vaccine Research
    • Economics of Innovation
    • Measuring and Valuing Outcomes
    • Policy, Organisation and Incentives in Health Systems
    • Value, Affordability and Decision Making
    • News
    • Events
    • Insights
    • Bulletin
    • Education Hub
    • OHE Graduate School
    • EVIA Programme
    • The Prize Fund
    • 2022 Prize Fund
  • Events
  • About Us
  • OHE Experts
  • Contact Us
Newsletter SignupSubscribe
Back
  • News
11 min read 30th August 2016

The Application of Anchoring Vignettes to the EQ-5D-5L: A Possible Solution to Reporting Heterogeneity in PROMs

Responses on subjective scales (like the EQ-5D) will be inaccurate if groups systematically differ in their use and/or interpretation of the categories. Anchoring vignettes offer a promising solution to reporting heterogeneity. For the last 5 years OHE’s Deputy Director, Paula…

Share:
  •  Twitter
  •  LinkedIn
  •  Facebook
  • has-icon Email
vignette_0

Responses on subjective scales (like the EQ-5D) will be inaccurate if groups systematically differ in their use and/or interpretation of the categories. Anchoring vignettes offer a promising solution to reporting heterogeneity.

For the last 5 years OHE’s Deputy Director, Paula Lorgelly has been researching reporting behaviour/reporting heterogeneity in self-reported health (SRH) measures, including the EQ-5D. Paula, along with colleagues at the Centre for Health Economics, Monash University; Curtin Business School, Curtin University; Faculty of Health and Medicine, Lancaster University and the Centre for Health Economics, University of York, has worked on a programme of research designing and testing tools to identify reporting heterogeneity in the EQ-5D-5L.

Intergroup comparisons using SRH rely on the measure being an accurate reflection of the latent underlying health of the groups or individuals concerned. However, responses to questions on subjective scales, such as the domains of the EQ-5D, will be incomparable if certain groups of people systematically differ in their use of the response categories. Systematic variation in the use of response categories is known as reporting heterogeneity, response-scale heterogeneity, or differential item functioning (DIF), and has been observed across a range of respondent characteristics including age, socioeconomic status and nationality. DIF has been shown to exist in other self-reported measures of health, but has largely been overlooked in the case of the increasingly popular Patient Reported Outcome Measures (PROMs). 

Anchoring vignettes have been shown to be a promising approach for detecting DIF. This approach involves presenting a series of vignettes (brief descriptions of the health state of a hypothetical individual) for each health construct of interest, at varying levels of severity.

Consider the figure below. Suppose we have two vignettes, where the person in vignette 1 (Olivia) is described as having fewer health problems (in this example mobility) compared to the person described in vignette 2 (Vicky).

How two groups (A and B) might rate the health/mobility of the vignettes on average is illustrated below (where the fixed health of each vignette is represented by the dotted horizontal lines). Group B is relatively optimistic; their ratings are more favourable than Group A’s ratings for both vignettes (i.e. mean ratings for the two vignettes are slight problems (vignette 1) and severe problems (vignette 2) for Group A, and no problems (vignette 1) and moderate problems (vignette 2) for Group B). Although relatively simple in its execution, there are two underlying assumptions that must hold: response consistency and vignette equivalence.

Figure: Logic underlying anchoring vignettes to locate respondent thresholds

The programme of work began with a phase of qualitative research in order to design vignettes that satisfied the identifying assumptions. We found that EQ-5D domain specific and more holistic vignettes were feasible (Au and Lorgelly, 2014).

Next we sought to establish if the anchoring vignette approach could be used to identify DIF, and specifically if it passed tests for response consistency and vignette equivalence. Utilising data collected in two surveys in Australia we were able to identify DIF in the EQ-5D-5L, at least for certain age groups (Knott et al., 2016).

We further found that failing to adjust for DIF in the EQ-5D could imply conclusions regarding group differences that are misleading. The next phase of research is to test whether vignettes collected in one dataset can be used to adjust for DIF in another dataset. This follows from similar work using SRH (Harris et al., 2016). Our early results discussed at a recent HESG meeting suggests that this is possible (Knott and Lorgelly, 2016).

Future work will extend this research into other countries in order to understand cross-cultural reporting behaviour, and what effect this might have on multi-national trials.

Slides of a recent presentation of this programme of work given at the London Health Economics Group are available here.

Additional references:

Knott, R., Au, N., Hollingsworth, B., Lorgelly, P. (in press). Response-scale heterogeneity in the EQ-5D. Health Economics Letters.

  • EQ-5D and PROMs
  • Measuring and Valuing Outcomes
  • External Publications

Related News

  • News
  • September 2020

Establishing a Reasonable Price for an Orphan Drug

Read more
  • News
  • April 2020

Augmenting Cost-Effectiveness Analysis for Uncertainty: The Implications for Value Assessment—Rationale and Empirical Support

Read more
  • News
  • April 2020

Financing and Scaling Innovation for the COVID Fight: A Closer Look at Demand-Side Incentives for a Vaccine

Read more
  • News
  • February 2020

Unpacking the Black Box of Payer Policy: A Demand-Side Approach for Equitable Uptake of Cost-Effective Health Innovation

Read more
footer_ohe_logo

Leading intellectual authority on global health economics

Sign Up for the OHE News Bulletin

Newsletter SignupStart Sign Up

Research & Publications

News & Insights

Innovation Policy Prize

Education

Events

About Us

OHE Experts

Contact Us

Sign Up for the OHE News Bulletin

Newsletter SignupStart Sign Up

The Office of Health Economics (OHE) is a company limited by guarantee registered in England and Wales (registered number 09848965) and its registered office is at 2nd Floor Goldings House, Hay’s Galleria, 2 Hay’s Lane, London, SE1 2HB.

Terms & Conditions

Privacy Policy

Cookies Policy

© 2023 Website Design

An error has occurred, please try again later.An error has occurred, please try again later.

We are using cookies to give you the best experience on our website.

You can find out more about which cookies we are using or switch them off in settings.

 Twitter
 Facebook
 LinkedIn
 Copy
 Email
Powered by  GDPR Cookie Compliance
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

3rd Party Cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!