Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study

Elisabet Jacobsen; Dwayne Boyers; Alison Avenell

doi:10.1007/s40273-019-00878-2

Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study

Elisabet Jacobsen^* (Corresponding Author), Dwayne Boyers, Alison Avenell

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

18 Citations (Scopus)

5 Downloads (Pure)

Abstract

Decision makers increasingly require cost-effectiveness evidence to inform resource allocation and the need for systematic reviews of economic evaluations (SREE) has grown accordingly.

The objective was to describe current practice and identify unique challenges in conducting and reporting SREEs.

Current guideline documents for SREEs were consulted and summarised. A rapid review of English language SREEs, using Medline and Embase, published in 2017/18, containing at least 20 studies was undertaken to describe current practice. Information on data extraction methods, quality assessment tools, and reporting methods were narratively summarised. Lessons learned from a recently conducted SREE of weight loss interventions for severely obese adults were discussed.

63 publications were included in the rapid review. Substantial heterogeneity in review methods, reporting standards, and quality assessment approaches was evident. Our recently conducted SREE on weight loss interventions identified scope to improve process efficiency, opportunity for more transparent and succinct reporting, and potential to improve consistency of quality assessment. Practical solutions may include 1) using pre-piloted data extraction forms linked explicitly to results tables; 2) consistently reporting on key assumptions and sensitivity analyses that drive results and 3) using checklists that include topic-specific items where relevant and that allow reviewers to distinguish between reporting, justification and quality assessment.

The lack of a mutually agreed, standardised set of best practice guidelines has led to substantial heterogeneity in the conduct and reporting of SREEs. Future work is required to standardise the approach to conducting SREEs so that they can generate efficient, timely and relevant evidence to support decision-making. We suggest only data extracting information that will be reported, focussing discussion around the key drivers of cost-effectiveness, and improving consistency in quality assessment by distinguishing between what is reported, justified by authors, and deemed appropriate by the reviewer.

Original language	English
Pages (from-to)	259-267
Number of pages	9
Journal	Pharmacoeconomics
Volume	38
Issue number	3
Early online date	13 Jan 2020
DOIs	https://doi.org/10.1007/s40273-019-00878-2
Publication status	Published - 1 Mar 2020

Bibliographical note

Acknowledgements

The authors would like to thank the REBALANCE team for commenting on the REBALANCE systematic review used as a case-study. We also wish to thank Karin Gøthe Áslakksdóttir for contributing to the rapid review of reviews.

Funding: The authors received no direct funding for this study and/or preparation of this manuscript. However, the REBALANCE study was funded by the National Institute for Health Research HTA programme, project number 15/09/04.

Keywords

HEALTH-CARE DECISIONS
GUIDELINES
TRANSFERABILITY
QUALITY
PREPARE

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1007/s40273-019-00878-2Licence: CC BY-NC

Jacobsen_etal_Pharmacoecon_Challenges_SystematicReviews_VOR
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.
Final published version, 834 KBLicence: CC BY-NC

Cite this

@article{c8ab95b654644b1bbebb3a45bc3de0de,

title = "Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study",

abstract = "Decision makers increasingly require cost-effectiveness evidence to inform resource allocation and the need for systematic reviews of economic evaluations (SREE) has grown accordingly.The objective was to describe current practice and identify unique challenges in conducting and reporting SREEs.Current guideline documents for SREEs were consulted and summarised. A rapid review of English language SREEs, using Medline and Embase, published in 2017/18, containing at least 20 studies was undertaken to describe current practice. Information on data extraction methods, quality assessment tools, and reporting methods were narratively summarised. Lessons learned from a recently conducted SREE of weight loss interventions for severely obese adults were discussed.63 publications were included in the rapid review. Substantial heterogeneity in review methods, reporting standards, and quality assessment approaches was evident. Our recently conducted SREE on weight loss interventions identified scope to improve process efficiency, opportunity for more transparent and succinct reporting, and potential to improve consistency of quality assessment. Practical solutions may include 1) using pre-piloted data extraction forms linked explicitly to results tables; 2) consistently reporting on key assumptions and sensitivity analyses that drive results and 3) using checklists that include topic-specific items where relevant and that allow reviewers to distinguish between reporting, justification and quality assessment.The lack of a mutually agreed, standardised set of best practice guidelines has led to substantial heterogeneity in the conduct and reporting of SREEs. Future work is required to standardise the approach to conducting SREEs so that they can generate efficient, timely and relevant evidence to support decision-making. We suggest only data extracting information that will be reported, focussing discussion around the key drivers of cost-effectiveness, and improving consistency in quality assessment by distinguishing between what is reported, justified by authors, and deemed appropriate by the reviewer.",

keywords = "HEALTH-CARE DECISIONS, GUIDELINES, TRANSFERABILITY, QUALITY, PREPARE",

author = "Elisabet Jacobsen and Dwayne Boyers and Alison Avenell",

note = "Acknowledgements The authors would like to thank the REBALANCE team for commenting on the REBALANCE systematic review used as a case-study. We also wish to thank Karin G{\o}the {\'A}slakksd{\'o}ttir for contributing to the rapid review of reviews. Funding: The authors received no direct funding for this study and/or preparation of this manuscript. However, the REBALANCE study was funded by the National Institute for Health Research HTA programme, project number 15/09/04.",

year = "2020",

month = mar,

day = "1",

doi = "10.1007/s40273-019-00878-2",

language = "English",

volume = "38",

pages = "259--267",

journal = "Pharmacoeconomics",

issn = "1170-7690",

publisher = "Adis International Ltd",

number = "3",

}

TY - JOUR

T1 - Challenges of Systematic Reviews of Economic Evaluations

T2 - A Review of Recent Reviews and an Obesity Case Study

AU - Jacobsen, Elisabet

AU - Boyers, Dwayne

AU - Avenell, Alison

N1 - Acknowledgements The authors would like to thank the REBALANCE team for commenting on the REBALANCE systematic review used as a case-study. We also wish to thank Karin Gøthe Áslakksdóttir for contributing to the rapid review of reviews. Funding: The authors received no direct funding for this study and/or preparation of this manuscript. However, the REBALANCE study was funded by the National Institute for Health Research HTA programme, project number 15/09/04.

PY - 2020/3/1

Y1 - 2020/3/1

N2 - Decision makers increasingly require cost-effectiveness evidence to inform resource allocation and the need for systematic reviews of economic evaluations (SREE) has grown accordingly.The objective was to describe current practice and identify unique challenges in conducting and reporting SREEs.Current guideline documents for SREEs were consulted and summarised. A rapid review of English language SREEs, using Medline and Embase, published in 2017/18, containing at least 20 studies was undertaken to describe current practice. Information on data extraction methods, quality assessment tools, and reporting methods were narratively summarised. Lessons learned from a recently conducted SREE of weight loss interventions for severely obese adults were discussed.63 publications were included in the rapid review. Substantial heterogeneity in review methods, reporting standards, and quality assessment approaches was evident. Our recently conducted SREE on weight loss interventions identified scope to improve process efficiency, opportunity for more transparent and succinct reporting, and potential to improve consistency of quality assessment. Practical solutions may include 1) using pre-piloted data extraction forms linked explicitly to results tables; 2) consistently reporting on key assumptions and sensitivity analyses that drive results and 3) using checklists that include topic-specific items where relevant and that allow reviewers to distinguish between reporting, justification and quality assessment.The lack of a mutually agreed, standardised set of best practice guidelines has led to substantial heterogeneity in the conduct and reporting of SREEs. Future work is required to standardise the approach to conducting SREEs so that they can generate efficient, timely and relevant evidence to support decision-making. We suggest only data extracting information that will be reported, focussing discussion around the key drivers of cost-effectiveness, and improving consistency in quality assessment by distinguishing between what is reported, justified by authors, and deemed appropriate by the reviewer.

AB - Decision makers increasingly require cost-effectiveness evidence to inform resource allocation and the need for systematic reviews of economic evaluations (SREE) has grown accordingly.The objective was to describe current practice and identify unique challenges in conducting and reporting SREEs.Current guideline documents for SREEs were consulted and summarised. A rapid review of English language SREEs, using Medline and Embase, published in 2017/18, containing at least 20 studies was undertaken to describe current practice. Information on data extraction methods, quality assessment tools, and reporting methods were narratively summarised. Lessons learned from a recently conducted SREE of weight loss interventions for severely obese adults were discussed.63 publications were included in the rapid review. Substantial heterogeneity in review methods, reporting standards, and quality assessment approaches was evident. Our recently conducted SREE on weight loss interventions identified scope to improve process efficiency, opportunity for more transparent and succinct reporting, and potential to improve consistency of quality assessment. Practical solutions may include 1) using pre-piloted data extraction forms linked explicitly to results tables; 2) consistently reporting on key assumptions and sensitivity analyses that drive results and 3) using checklists that include topic-specific items where relevant and that allow reviewers to distinguish between reporting, justification and quality assessment.The lack of a mutually agreed, standardised set of best practice guidelines has led to substantial heterogeneity in the conduct and reporting of SREEs. Future work is required to standardise the approach to conducting SREEs so that they can generate efficient, timely and relevant evidence to support decision-making. We suggest only data extracting information that will be reported, focussing discussion around the key drivers of cost-effectiveness, and improving consistency in quality assessment by distinguishing between what is reported, justified by authors, and deemed appropriate by the reviewer.

KW - HEALTH-CARE DECISIONS

KW - GUIDELINES

KW - TRANSFERABILITY

KW - QUALITY

KW - PREPARE

UR - http://www.scopus.com/inward/record.url?scp=85077876530&partnerID=8YFLogxK

U2 - 10.1007/s40273-019-00878-2

DO - 10.1007/s40273-019-00878-2

M3 - Article

C2 - 31930461

SN - 1170-7690

VL - 38

SP - 259

EP - 267

JO - Pharmacoeconomics

JF - Pharmacoeconomics

IS - 3

ER -

Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study

Abstract

Bibliographical note

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Elisabet Jacobsen

Cite this

Challenges of Systematic Reviews of Economic Evaluations: A Review of Recent Reviews and an Obesity Case Study

Abstract

Bibliographical note

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Profiles

Elisabet Jacobsen

Cite this