Design and Analysis of Replication Studies

Provides utilities for the design and analysis of replication studies. Features both traditional methods based on statistical significance and more recent methods such as the sceptical p-value; Held L. (2020) , Held et al. (2022) , Micheloud et al. (2023) . Also provides related methods including the harmonic mean chi-squared test; Held, L. (2020) , and intrinsic credibility; Held, L. (2019) . Contains datasets from five large-scale replication projects.

ReplicationSuccess

Provides utilities for the design and analysis of replication studies. Features both traditional methods based on statistical significance and more recent methods such as the sceptical p-value. Also provides related methods including the harmonic mean chi-squared test and intrinsic credibility. Contains datasets from four large-scale replication projects.

Installation

CRAN version:

install.packages("ReplicationSuccess")

Development version from github with latest developments:

devtools::install_github(repo = "crsuzh/ReplicationSuccess")

Introduction in vignette

To access the vignette from R use:

library("ReplicationSuccess")
vignette("ReplicationSuccess")

Publications

Held, L. (2019). The assessment of intrinsic credibility and a new argument for p < 0.005. Royal Society Open Science, 6(3):181534. https://doi.org/10.1098/rsos.181534
Held, L. (2020). A new standard for the analysis and design of replication studies (with discussion). Journal of the Royal Statistical Society: Series A (Statistics in Society). 183(2):431-448. https://doi.org/10.1111/rssa.12493
Held, L. (2020). The harmonic mean chi-squared test to substantiate scientific findings. Journal of the Royal Statistical Society: Series C (Applied Statistics). 69(3):697-708. https://doi.org/10.1111/rssc.12410
Pawel, S., Held, L. (2020). Probabilistic forecasting of replication studies. PLOS ONE. 15(4):e0231416. https://doi.org/10.1371/journal.pone.0231416
Micheloud, C., Held, L. (2021). Power Calculations for Replication Studies. Statistical Science. 37(3):369–379. https://doi.org/10.1214/21-STS828
Held, L., Micheloud, C., Pawel, S. (2022). The assessment of replication success based on relative effect size. The Annals of Applied Statistics. 16:706–720. https://doi.org/10.1214/21-AOAS1502
Micheloud, C., Balabdaoui, F., Held, L. (2023). Assessing replicability with the sceptical p-value: Type-I error control and sample size planning. Statistica Neerlandica. https://doi.org/10.1111/stan.12312
Held, L., Pawel, S., Micheloud, C. (2024). The assessment of replicability using the sum of p-values. Royal Society Open Science. 11(8):11240149. https://doi.org/10.1098/rsos.240149