References
Allaire, J. J., Teague, C., Scheidegger, C., Xie, Y., & Dervieux, C.
(2024). Quarto: An open-source scientific and technical publishing
system. https://quarto.org/
Anaconda Inc. (2023). Anaconda software distribution. https://docs.anaconda.com/
Association for Computing Machinery. (2020). Artifact review and
badging — version 1.1. ACM publications policy. https://www.acm.org/publications/policies/artifact-review-and-badging-current
Baker, M. (2016). 1,500 scientists lift the lid on reproducibility.
Nature, 533(7604), 452–454. https://doi.org/10.1038/533452a
Barker, M., Chue Hong, N. P., Katz, D. S., et
al. (2022). Introducing the FAIR principles for
research software. Scientific Data, 9, 622. https://doi.org/10.1038/s41597-022-01710-x
Begley, C. G., & Ellis, L. M. (2012). Raise standards for
preclinical cancer research. Nature, 483(7391),
531–533. https://doi.org/10.1038/483531a
Blischak, J. D., Carbonetto, P., & Stephens, M. (2019). Creating and
sharing reproducible research code the workflowr way. F1000Research, 8,
1749. https://doi.org/10.12688/f1000research.20843.1
Boettiger, C. (2015). An introduction to docker for reproducible
research. ACM SIGOPS Operating Systems Review, 49(1),
71–79. https://doi.org/10.1145/2723872.2723882
Boettiger, C., & Eddelbuettel, D. (2017). An introduction to
Rocker: Docker containers for R.
The R Journal, 9(2), 527–536. https://doi.org/10.32614/RJ-2017-065
Brinckman, A., Chard, K., Gaffney, N., et
al. (2019). Computing environments for reproducibility: Capturing
the Whole Tale. Future Generation Computer
Systems, 94, 854–867. https://doi.org/10.1016/j.future.2017.12.029
Buckheit, J. B., & Donoho, D. L. (1995). WaveLab and reproducible
research. Wavelets and Statistics, 103, 55–81. https://doi.org/10.1007/978-1-4612-2544-7_5
Chan, C., & Schoch, D. (2023). Rang: Reconstructing reproducible
R computational environments. PLOS ONE,
18(6), e0286761. https://doi.org/10.1371/journal.pone.0286761
Claerbout, J. F., & Karrenbach, M. (1992). Electronic documents give
reproducible research a new meaning. SEG Technical Program Expanded
Abstracts 1992, 601–604. https://doi.org/10.1190/1.1822162
Development Containers Project. (2022). Development containers
specification. https://containers.dev/
Dolstra, E., Jonge, M. de, & Visser, E. (2004). Nix: A
safe and policy-free system for software deployment. Proceedings of
the 18th USENIX Conference on System Administration (LISA ’04),
79–92.
Gentleman, R., & Temple Lang, D. (2007). Statistical analyses and
reproducible research. Journal of Computational and Graphical
Statistics, 16(1), 1–23. https://doi.org/10.1198/106186007X178663
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016). What does
research reproducibility mean? Science Translational Medicine,
8(341), 341ps12. https://doi.org/10.1126/scitranslmed.aaf5027
Ioannidis, J. P. A. (2005). Why most published research findings are
false. PLOS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
Knuth, D. E. (1984). Literate programming. The Computer
Journal, 27(2), 97–111. https://doi.org/10.1093/comjnl/27.2.97
Kurtzer, G. M., Sochat, V., & Bauer, M. W. (2017). Singularity:
Scientific containers for mobility of compute. PLOS ONE,
12(5), e0177459. https://doi.org/10.1371/journal.pone.0177459
Landau, W. M. (2021). The targets R package: A dynamic
make-like function-oriented pipeline toolkit for reproducibility and
high-performance computing. Journal of Open Source Software,
6(57), 2959. https://doi.org/10.21105/joss.02959
Leek, J. T., & Peng, R. D. (2015). Reproducible research can still
be wrong: Adopting a prevention approach. Proceedings of the
National Academy of Sciences, 112(6), 1645–1646. https://doi.org/10.1073/pnas.1421412111
Loo, M. van der. (2020). Tinytest: Lightweight and feature complete
unit testing framework. https://CRAN.R-project.org/package=tinytest
Marwick, B., Boettiger, C., & Mullen, L. (2018). Packaging data
analytical work reproducibly using R (and friends). The
American Statistician, 72(1), 80–88. https://doi.org/10.1080/00031305.2017.1375986
McBain, M. (2023). Capsule: Reproducible project libraries via a
lazy renv. https://github.com/MilesMcBain/capsule
National Academies of Sciences, Engineering, and Medicine. (2019).
Reproducibility and replicability in science. The National
Academies Press. https://doi.org/10.17226/25303
Nüst, D., Boettiger, C., & Marwick, B. (2018). How to read a
research compendium. arXiv Preprint arXiv:1806.09525. https://arxiv.org/abs/1806.09525
Nüst, D., Eddelbuettel, D., Bennett, D., Cannoodt,
R., Clark, D., Daroczi, G., Edmondson, M., Fay, C., Hughes, E., et
al. (2020). The Rockerverse: Packages and
applications for containerisation with R. The R
Journal, 12(1), 437–461. https://doi.org/10.32614/RJ-2020-007
Nüst, D., & Eglen, S. J. (2021). CODECHECK: An open
science initiative for the independent execution of computations
underlying research articles during peer review to improve
reproducibility. F1000Research, 10, 253. https://doi.org/10.12688/f1000research.51738.2
Nüst, D., Sochat, V., Marwick, B., Eglen, S. J., Head, T., Hirst, T.,
& Evans, B. D. (2020). Ten simple rules for writing
Dockerfiles for reproducible data science. PLOS
Computational Biology, 16(11), e1008316. https://doi.org/10.1371/journal.pcbi.1008316
Open Science Collaboration. (2015). Estimating the reproducibility of
psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
Patil, P., Peng, R. D., & Leek, J. T. (2016). A statistical
definition for reproducibility and replicability. bioRxiv,
066803. https://doi.org/10.1101/066803
Peng, R. D. (2011). Reproducible research in computational science.
Science, 334(6060), 1226–1227. https://doi.org/10.1126/science.1213847
Peng, R. D. (2009). Reproducible research and
Biostatistics. Biostatistics, 10(3),
405–408. https://doi.org/10.1093/biostatistics/kxp014
Peng, R. D., Dominici, F., & Zeger, S. L. (2006). Reproducible
epidemiologic research. American Journal of Epidemiology,
163(9), 783–789. https://doi.org/10.1093/aje/kwj093
prefix.dev. (2024). Pixi: A fast
software package manager. https://pixi.sh/
Project Jupyter, Bussonnier, M., Forde, J., Freeman, J., Granger, B.,
Head, T., Holdgraf, C., Kelley, K., Nalvarte, G., Osheroff, A., Pacer,
M., Panda, Y., Perez, F., Ragan-Kelley, B., & Willing, C. (2018).
Binder 2.0 — reproducible, interactive, sharable environments for
science at scale. Proceedings of the 17th Python in Science
Conference (SciPy 2018), 113–120. https://doi.org/10.25080/Majora-4af1f417-011
R Core Team. (2019). R: A language and environment for statistical
computing. R Foundation for Statistical Computing. https://www.R-project.org/
R Core Team. (2020). R: A language and environment for statistical
computing. R Foundation for Statistical Computing. https://www.R-project.org/
Rodrigues, B., & Baumann, P. (2024). Rix: Reproducible data
science environments with Nix. https://docs.ropensci.org/rix/
Saju, L. et al. (2025). Computational
reproducibility of R code supplements on OSF.
arXiv Preprint arXiv:2505.21590. https://arxiv.org/abs/2505.21590
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013). Ten
simple rules for reproducible computational research. PLOS
Computational Biology, 9(10), e1003285. https://doi.org/10.1371/journal.pcbi.1003285
Simonsohn, U. (2026). Groundhog: Version-control for
CRAN, GitHub, and GitLab
packages. https://groundhogr.com/
Stodden, V., Seiler, J., & Ma, Z. (2018). An empirical analysis of
journal policy effectiveness for computational reproducibility.
Proceedings of the National Academy of Sciences,
115(11), 2584–2589. https://doi.org/10.1073/pnas.1708290115
The Turing Way Community. (2022). The Turing
Way: A handbook for reproducible, ethical and collaborative
research. Zenodo. https://doi.org/10.5281/zenodo.3233853
Thomas, R. G. (2026). Zzcollab: A flexible extension of rrtools for
reproducible, collaborative research compendia in R
[Unpublished manuscript].
Trisovic, A., Lau, M. K., Pasquier, T., & Crosas, M. (2022). A
large-scale study on research code quality and execution. Scientific
Data, 9(1), 60. https://doi.org/10.1038/s41597-022-01143-6
Ushey, K. (2020). Renv: Project environments for R. R
Package Version 0.12.0. https://CRAN.R-project.org/package=renv
Vandewalle, P., Kovacevic, J., & Vetterli, M. (2009). Reproducible
research in signal processing. IEEE Signal Processing Magazine,
26(3), 37–47. https://doi.org/10.1109/MSP.2009.932122
Wickham, H. (2015). R packages: Organize, test, document, and share
your code. O’Reilly Media.
Wilkinson, M. D., Dumontier, M., Aalbersberg, Ij.
J., Appleton, G., et al. (2016). The FAIR guiding
principles for scientific data management and stewardship.
Scientific Data, 3, 160018. https://doi.org/10.1038/sdata.2016.18
Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M.,
Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley,
M. D., Waugh, B., White, E. P., & Wilson, P. (2014). Best practices
for scientific computing. PLOS Biology, 12(1),
e1001745. https://doi.org/10.1371/journal.pbio.1001745
Wilson, G., Bryan, J., Cranston, K., Kitzes, J., Nederbragt, L., &
Teal, T. K. (2017). Good enough practices in scientific computing.
PLOS Computational Biology, 13(6), e1005510. https://doi.org/10.1371/journal.pcbi.1005510
Xie, Y. (2015). Dynamic documents with R and knitr
(2nd ed.). Chapman; Hall/CRC.
Xie, Y., Allaire, J. J., & Grolemund, G. (2018). R markdown: The
definitive guide. Chapman; Hall/CRC. https://bookdown.org/yihui/rmarkdown/