Rounding, but not randomization method, non-normality, or correlation, affected baseline P-value distributions in randomized trials

Mark J Bolland (Corresponding Author), Greg D Gamble, Alison Avenell, Andrew Grey

Research output: Contribution to journalArticlepeer-review

20 Citations (Scopus)
4 Downloads (Pure)

Abstract

OBJECTIVE: To investigate whether comparing observed with expected p-value distributions for baseline continuous variables in randomised controlled trials (RCTs) might be limited by randomisation methods, normality and correlation of variables, or calculation of p-values from rounded summary statistics.

STUDY DESIGN AND SETTING: We assessed how each factor affects differences from expected for p-value distributions and area under the curve of the cumulative distribution function (AUC-CDF) of baseline p-values in 13 RCTs and in simulations.

RESULTS: The p-value distributions and AUC-CDF for variables with possible non-normal distribution and in simulations using eight different randomisation methods were consistent with the theoretical uniform distribution and AUC-CDF respectively, although stratification and minimisation produced smaller-than-expected proportions of p-values <0.10. 77% of 3813 pairwise correlations between baseline variables in the 13 individual RCTs were between -0.2 and 0.2. P-value distribution and AUC-CDF remained consistent with the uniform distribution in simulations with incrementally increasing correlation strength. The p-value distributions calculated from rounded summary statistics were not uniform, but expected distributions could be empirically generated.

CONCLUSIONS: Randomisation methods, non-normality and strength of correlation of baseline variables did not have important effects on baseline p-value distribution or AUC-CDF, but baseline p-values calculated from rounded summary statistics are non-uniformly distributed.

Original languageEnglish
Pages (from-to)50-62
Number of pages13
JournalJournal of Clinical Epidemiology
Volume110
Early online date8 Mar 2019
DOIs
Publication statusPublished - Jun 2019

Bibliographical note

Corrigendum to Rounding, but not randomization method, non-normality, or correlation, affected baseline P-value distributions in randomized trials. J Clin Epidemiol 2019;110:50-62 (Journal of Clinical Epidemiology (2019) 110 (50–62), (S0895435618310321), (10.1016/j.jclinepi.2019.03.001))
M. J. Bolland, G. D. Gamble, A. Avenell, A. Grey, 2020, vol. 126, p. 226. Journal of Clinical Epidemiology
Corrigendum:
The authors regret that during the final manuscript sub-mission we provided an incorrect high resolution version of Figure 7. We mistakenly provided a second copy of Appendix Figure 8 rather than the correct figure, which we have now provided. We would like to apologise for any inconvenience caused. Journal of Clinical Epidemiology (2020)

Acknowledgements: The authors acknowledge the contribution of Professor Thomas Lumley who provided expert guidance in using the area under the curve of the cumulative distribution function of the baseline p-values for these analyses

No specific funding was received for this study. MB receives salary support from the Health Research Council of New Zealand. The Health Services Research Unit is funded by the Chief Scientist Office of the Scottish Government Health and Social Care Directorates.The funders had no role in the study design; collection, analysis, and interpretation of the data; writing of the report; and in the decision to submit the paper for publication

Keywords

  • Statistical Methods
  • Research Integrity
  • P-values
  • Correlation
  • Randomisation
  • Rounding
  • Research integrity
  • Statistical methods
  • STATISTICS
  • NORMAL POSTMENOPAUSAL WOMEN
  • HEALTHY
  • DENSITY
  • CALCIUM SUPPLEMENTATION
  • ZOLEDRONATE
  • THERAPY
  • INTEGRITY
  • BONE

Fingerprint

Dive into the research topics of 'Rounding, but not randomization method, non-normality, or correlation, affected baseline P-value distributions in randomized trials'. Together they form a unique fingerprint.

Cite this