Abstract
Background
There is now clear systematic review evidence that measurement can affect the people being measured; much of this evidence focusses on how asking people to complete a questionnaire can result in changes in behaviour. Changes in measured behaviour and other outcomes due to this reactivity may introduce bias in otherwise well-conducted randomised controlled trials (RCTs), yielding incorrect estimates of intervention effects. Despite this, measurement reactivity is not currently adequately considered in risk of bias frameworks. The present research aims to produce a set of guidance statements on how best to avoid or minimise bias due to measurement reactivity in studies of interventions to improve health, with a particular focus on bias in RCTs.
Methods
The MERIT study consists of a series of systematic and rapid reviews, a Delphi study and an expert workshop to develop guidance on how to minimise bias in trials due to measurement reactivity. An existing systematic review on question-behaviour effects on health-related behaviours will be updated and three new rapid reviews will be conducted to identify (1) existing guidance on measurement reactivity; (2) systematic reviews of studies that have quantified the effects of measurement on outcomes relating to behaviour and affective outcomes in health and non-health contexts and (3) trials that have investigated the effects of objective measurements of behaviour on concurrent or subsequent behaviour itself. A Delphi procedure will be used to combine the views of experts with a view to reaching agreement on the scope of the guidance statements. Finally, a workshop will be held in autumn 2018, with the aim of producing a set of guidance statements that will form the central part of new MRC guidance on how best to avoid bias due to measurement reactivity in studies of interventions to improve health.
Discussion
Our ambition is to produce MRC guidance on measurement reactions in trials which will be used by future trial researchers, leading to the development of trials that are less likely to be at risk of bias.
There is now clear systematic review evidence that measurement can affect the people being measured; much of this evidence focusses on how asking people to complete a questionnaire can result in changes in behaviour. Changes in measured behaviour and other outcomes due to this reactivity may introduce bias in otherwise well-conducted randomised controlled trials (RCTs), yielding incorrect estimates of intervention effects. Despite this, measurement reactivity is not currently adequately considered in risk of bias frameworks. The present research aims to produce a set of guidance statements on how best to avoid or minimise bias due to measurement reactivity in studies of interventions to improve health, with a particular focus on bias in RCTs.
Methods
The MERIT study consists of a series of systematic and rapid reviews, a Delphi study and an expert workshop to develop guidance on how to minimise bias in trials due to measurement reactivity. An existing systematic review on question-behaviour effects on health-related behaviours will be updated and three new rapid reviews will be conducted to identify (1) existing guidance on measurement reactivity; (2) systematic reviews of studies that have quantified the effects of measurement on outcomes relating to behaviour and affective outcomes in health and non-health contexts and (3) trials that have investigated the effects of objective measurements of behaviour on concurrent or subsequent behaviour itself. A Delphi procedure will be used to combine the views of experts with a view to reaching agreement on the scope of the guidance statements. Finally, a workshop will be held in autumn 2018, with the aim of producing a set of guidance statements that will form the central part of new MRC guidance on how best to avoid bias due to measurement reactivity in studies of interventions to improve health.
Discussion
Our ambition is to produce MRC guidance on measurement reactions in trials which will be used by future trial researchers, leading to the development of trials that are less likely to be at risk of bias.
| Original language | English |
|---|---|
| Article number | 653 |
| Number of pages | 8 |
| Journal | Trials |
| Volume | 19 |
| DOIs | |
| Publication status | Published - 26 Nov 2018 |
Bibliographical note
AcknowledgementsThe authors would like to acknowledge Dr. Angela Rodrigues and Prof. Falko Sniehotta who are co-authors working on the systematic review of the question-behaviour effect on health-related behaviours and Dr. Katerina Kassavou who is a co-author of the three rapid reviews described in this protocol.
Funding
The MERIT study is funded by the MRC/NIHR Methodology Research Programme (reference MC_PC_17229); funders have had no role in the design of the study or the writing of this manuscript.
Keywords
- measurement
- reactivity
- measurement reactions
- guidance
- trials
- bias
- Hawthorne effect