References

Allen, Christopher, and David M. A. Mehler. 2019. “Open Science Challenges, Benefits and Tips in Early Career and Beyond.” PLOS Biology 17 (5): e3000246. https://doi.org/10.1371/journal.pbio.3000246.

Barrett, Malcolm, and Richard Iannone. 2020a. “The YAML Fieldguide.” 2020. https://cran.r-project.org/web/packages/ymlthis/vignettes/yaml-fieldguide.html.

———. 2020b. “Ymlthis: Write YAML for R Markdown, Bookdown, Blogdown, and More.” February 3, 2020. https://ymlthis.r-lib.org/.

Bissell, Mina. 2013. “Reproducibility: The Risks of the Replication Drive.” Nature News 503 (7476): 333. https://doi.org/10.1038/503333a.

Blischak, John, Peter Carbonetto, and Matthew Stephens. 2020. “A Framework for Reproducible and Collaborative Data Science.” 2020. https://jdblischak.github.io/workflowr/index.html.

Blischak, John D., Peter Carbonetto, and Matthew Stephens. 2019. “Creating and Sharing Reproducible Research Code the Workflowr Way.” F1000Research 8 (October): 1749. https://doi.org/10.12688/f1000research.20843.1.

Bollen, Kenneth, John T. Cacioppo, Robert M. Kaplan, Jon A. Krosnick, James L. Olds, and Heather Dean. 2015. “Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science.” Report of the Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences 3 (4).

Brandt, Mark J., Hans IJzerman, Ap Dijksterhuis, Frank J. Farach, Jason Geller, Roger Giner-Sorolla, James A. Grange, Marco Perugini, Jeffrey R. Spies, and Anna van ’t Veer. 2014. “The Replication Recipe: What Makes for a Convincing Replication?” Journal of Experimental Social Psychology 50 (January): 217–24. https://doi.org/10.1016/j.jesp.2013.10.005.

Brown, Andrew W., Kathryn A. Kaiser, and David B. Allison. 2018. “Issues with Data and Analyses: Errors, Underlying Themes, and Potential Solutions.” Proceedings of the National Academy of Sciences 115 (11): 2563–70. https://doi.org/10.1073/pnas.1708279115.

Burchell, Jodie. 2016. “A Crash Course in Reproducible Research in R.” October 14, 2016. http://t-redactyl.io/blog/2016/10/a-crash-course-in-reproducible-research-in-r.html.

Carpenter, Siri. 2012. “Psychology’s Bold Initiative.” Science 335 (6076): 1558–61. https://doi.org/10.1126/science.335.6076.1558.

Ebersole, Charles R., Jordan R. Axt, and Brian A. Nosek. 2016. “Scientists’ Reputations Are Based on Getting It Right, Not Being Right.” PLOS Biology 14 (5): e1002460. https://doi.org/10.1371/journal.pbio.1002460.

“FAIRDOM.” n.d. Accessed June 5, 2020. https://fair-dom.org/.

Fanelli, Daniele. 2018. “Opinion: Is Science Really Facing a Reproducibility Crisis, and Do We Need It to?” Proceedings of the National Academy of Sciences 115 (11): 2628–31. https://doi.org/10.1073/pnas.1708272114.

Federer, Lisa M., Christopher W. Belter, Douglas J. Joubert, Alicia Livinski, Ya-Ling Lu, Lissa N. Snyders, and Holly Thompson. 2018. “Data Sharing in PLOS ONE: An Analysis of Data Availability Statements.” PLoS ONE 13 (5). https://doi.org/10.1371/journal.pone.0194768.

“Find, Analyze and Share Water Data | CUAHSI HydroShare.” n.d. Accessed June 5, 2020. https://www.hydroshare.org/.

Gandrud, Christopher. 2018. Reproducible Research with R and R Studio. Chapman and Hall/CRC. https://doi.org/10.1201/9781315382548.

Gelman, Andrew. 2013. “Commentary: P Values and Statistical Practice.” Epidemiology 24 (1): 69–72. http://www.jstor.org/stable/41739720.

Giofrè, David, Geoff Cumming, Luca Fresc, Ingrid Boedker, and Patrizio Tressoldi. 2017. “The Influence of Journal Submission Guidelines on Authors’ Reporting of Statistics and Use of Open Research Practices.” PLOS ONE 12 (4): e0175583. https://doi.org/10.1371/journal.pone.0175583.

Hampton, Stephanie E., Sean S. Anderson, Sarah C. Bagby, Corinna Gries, Xueying Han, Edmund M. Hart, Matthew B. Jones, et al. 2015. “The Tao of Open Science for Ecology.” Ecosphere 6 (7): art120. https://doi.org/10.1890/ES14-00402.1.

“Harvard Dataverse.” n.d. Accessed June 5, 2020. https://dataverse.harvard.edu/.

Head, Megan L., Luke Holman, Rob Lanfear, Andrew T. Kahn, and Michael D. Jennions. 2015. “The Extent and Consequences of P-Hacking in Science.” PLOS Biology 13 (3): e1002106. https://doi.org/10.1371/journal.pbio.1002106.

“IEDA: Marine Geoscience Data System.” n.d. Accessed June 5, 2020. http://www.marine-geo.org/index.php.

Ihle, Malika, Isabel S. Winney, Anna Krystalli, and Michael Croucher. 2017. “Striving for Transparent and Credible Research: Practical Guidelines for Behavioral Ecologists.” Behavioral Ecology 28 (2): 348–54. https://doi.org/10.1093/beheco/arx003.

Ioannidis, John P. A. 2005. “Why Most Published Research Findings Are False.” PLOS Medicine 2 (8): e124. https://doi.org/10.1371/journal.pmed.0020124.

Iqbal, Shareen A., Joshua D. Wallach, Muin J. Khoury, Sheri D. Schully, and John P. A. Ioannidis. 2016. “Reproducible Research Practices and Transparency Across the Biomedical Literature.” PLOS Biology 14 (1): e1002333. https://doi.org/10.1371/journal.pbio.1002333.

“ISA Dashboard.” n.d. Accessed June 5, 2020. https://ec.europa.eu/isa2/dashboard/db_portal_home.

John Gruber, and Aaron Swartz. 2004. Markdown (version 1.0.1). https://daringfireball.net/projects/markdown/.

John MacFarlane. 2020. Pandoc: A Universal Document Converter (version 2.9.2.1). pandoc.org.

Key, Ellen M. 2016. “How Are We Doing? Data Access and Replication in Political Science.” PS: Political Science & Politics 49 (2): 268–72. https://doi.org/10.1017/S1049096516000184.

Konkol, Markus, Christian Kray, and Max Pfeiffer. 2019. “Computational Reproducibility in Geoscientific Papers: Insights from a Series of Studies with Geoscientists and a Reproduction Study.” International Journal of Geographical Information Science 33 (2): 408–29. https://doi.org/10.1080/13658816.2018.1508687.

Laitin, David D., and Rob Reich. 2017. “Trust, Transparency, and Replication in Political Science.” PS: Political Science & Politics 50 (1): 172–75. https://doi.org/10.1017/S1049096516002365.

Leek, Jeff, Blakeley B. McShane, Andrew Gelman, David Colquhoun, Michèle B. Nuijten, and Steven N. Goodman. 2017. “Five Ways to Fix Statistics.” Nature 551 (7682, 7682): 557–59. https://doi.org/10.1038/d41586-017-07522-z.

Leek, Jeffrey T., and Roger D. Peng. 2015. “Opinion: Reproducible Research Can Still Be Wrong: Adopting a Prevention Approach.” Proceedings of the National Academy of Sciences 112 (6): 1645–6. https://doi.org/10.1073/pnas.1421412111.

LeVeque, Randall J., Ian M. Mitchell, and Victoria Stodden. 2012. “Reproducible Research for Scientific Computing: Tools and Strategies for Changing the Culture.” Computing in Science Engineering 14 (4): 13–17. https://doi.org/10.1109/MCSE.2012.38.

McElreath, Richard, and Paul E. Smaldino. 2015. “Replication, Communication, and the Population Dynamics of Scientific Discovery.” PLOS ONE 10 (8): e0136088. https://doi.org/10.1371/journal.pone.0136088.

“NSF Arctic Data Center the Primary Data and Software Repository for NSF Arctic Research.” n.d. Accessed June 5, 2020. https://arcticdata.io/.

“Open Pharmacological Space.” n.d. Accessed June 5, 2020. https://www.openphacts.org/index.php.

Pashler, Harold, and Christine R. Harris. 2012. “Is the Replicability Crisis Overblown? Three Arguments Examined:” Perspectives on Psychological Science, November. https://doi.org/10.1177/1745691612463401.

Patil, Prasad, Roger D. Peng, and Jeffrey T. Leek. 2016. “A Statistical Definition for Reproducibility and Replicability.” bioRxiv, July, 066803. https://doi.org/10.1101/066803.

R Core Team. 2020a. R: A Language and Environment for Statistical Computing. (version 4.01). Vienna: R Foundation for Statistical Computing. https://cran.r-project.org.

———. 2020b. “R: The R Project for Statistical Computing.” 2020. https://www.r-project.org/.

Redish, A. David, Erich Kummerfeld, Rebecca Lea Morris, and Alan C. Love. 2018. “Opinion: Reproducibility Failures Are Essential to Scientific Inquiry.” Proceedings of the National Academy of Sciences 115 (20): 5042–6. https://doi.org/10.1073/pnas.1806370115.

Rosenthal, Robert. 1979. “The File Drawer Problem and Tolerance for Null Results.” Psychological Bulletin 86 (3): 638–41. https://doi.org/10.1037/0033-2909.86.3.638.

RStudio Team. 2020a. “Developing Packages with RStudio.” RStudio Support. 2020. http://support.rstudio.com/hc/en-us/articles/200486488.

———. 2020b. “R Markdown.” R Markdown from RStudio. 2020. https://rmarkdown.rstudio.com/.

———. 2020c. RStudio: Integrated Development for R. Boston, MA: RStudio, PBC. http://www.rstudio.com.

———. 2020d. “RStudio | Open Source & Professional Software for Data Science Teams.” 2020. https://rstudio.com/.

Smaldino, Paul E., and Richard McElreath. 2016. “The Natural Selection of Bad Science.” Royal Society Open Science 3 (9): 160384. https://doi.org/10.1098/rsos.160384.

“Socioeconomic Data and Applications Center | SEDAC.” n.d. Accessed June 5, 2020. https://sedac.ciesin.columbia.edu/.

Stall, Shelley, Lynn Yarmey, Joel Cutcher-Gershenfeld, Brooks Hanson, Kerstin Lehnert, Brian Nosek, Mark Parsons, Erin Robinson, and Lesley Wyborn. 2019. “Make Scientific Data FAIR.” Nature 570 (7759, 7759): 27–29. https://doi.org/10.1038/d41586-019-01720-7.

Tidyverse Development Team. 2020. “Tidyverse.” 2020. https://www.tidyverse.org/.

Torvalds, Linus, and Junio Hamano. 2020. Git (version 2.27.0). https://git-scm.com/.

Wickham, Hadley. 2015. “R Packages.” R Packages by Hadley Wickham. 2015. http://r-pkgs.had.co.nz/.

Wickham, Hadley, and Jennifer Bryan. 2020a. R Packages. 2nd ed. https://r-pkgs.org/.

———. 2020b. “Usethis: Automate Package and Project Setup.” 2020. https://usethis.r-lib.org/.

Wickham, Hadley, Peter Danenberg, Gábor Csárdi, and Manuel Eugster. 2020. “Roxygen2: In-Line Documentation for R.” Roxygen2. 2020. https://roxygen2.r-lib.org/.

Wickham, Hadley, Jay Hesselberth, and RStudio Team. 2020. “Pkgdown: Build Websites for R Packages.” Pkgdown. 2020. https://pkgdown.r-lib.org/.

Wickham, Hadley, Jim Hester, and Winston Chang. 2020. “Devtools: Tools to Make Developing R Packages Easier.” Devtools. 2020. https://devtools.r-lib.org/.

Wilkinson, Mark D., Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, et al. 2016. “The FAIR Guiding Principles for Scientific Data Management and Stewardship.” Scientific Data 3 (1, 1): 1–9. https://doi.org/10.1038/sdata.2016.18.

Willmott, Cort J., and Kenji Matsuura. 1995. “Smart Interpolation of Annually Averaged Air Temperature in the United States.” Journal of Applied Meteorology 34 (12): 2577–86. https://doi.org/10.1175/1520-0450(1995)034<2577:SIOAAA>2.0.CO;2.

Xie, Yihui. 2020a. “Knitr: Elegant, Flexible, and Fast Dynamic Report Generation with R.” 2020. https://yihui.org/knitr/.

———. 2020b. “TinyTeX: A Lightweight, Cross-Platform, Portable, and Easy-to-Maintain LaTeX Distribution Based on TeX Live.” 2020. https://yihui.org/tinytex/.

Xie, Yihui, J. J. Allaire, and Garrett Grolemund. 2020. R Markdown: The Definitive Guide. https://bookdown.org/yihui/rmarkdown/.

Zhu, Hao, Thomas Travison, Timothy Tsai, Will Beasley, Yihui Xie, GuangChuang Yu, Stéphane Laurent, et al. 2019. kableExtra: Construct Complex Table with ’Kable’ and Pipe Syntax (version 1.1.0). https://CRAN.R-project.org/package=kableExtra.