Rigor and Reproducibility – Resources and Training
Brown University Library provides rigor and reproducibility resources.
Advance-CTR offers additional resources for faculty, including a video of a seminar entitled, "Mentoring for an Evolving Academic Career", presented by Ian Paul, Ph.D., Professor of Psychiatry and Human Behavior, and Director of Medical Student Education in Psychiatry at the University of Mississippi School of Medicine
The NIH Office of Behavioral and Social Science Research offers comprehensive training resources for NIH investigators
The NIH Office of Disease Prevention developed a free, seven-part, online course that provides a detailed guide to designing and analyzing group-randomized trials (GRTs).
Other NIH institutes and research centers have developed training modules and tutorials on reproducibility, many of which can be found within NIH’s online clearinghouse.
Center for Open Science Reproducible Research and Statistics Training Online Materials (COS)
Topic: Scientific Rigor
Topic: Mentorship/Lab Management
The Advance Clinical Translational Research (Advance - CTR) Mentoring Training Program offers an in-person, peer-driven training program for faculty in mentor roles. The program covers skills and techniques that will help mentors improve their relationships with mentees, while improving communication and driving professional development and success training programs and seminars
Related Articles/Interesting Reads
“Making the right moves: A Practical Guide to Scientifıc Management for Postdocs and New Faculty,” put together by the Burroughs Wellcome Fund and the Howard Hughes Medical Institute.
“Nature’s Guide for mentors,” by Adrian Lee, Carina Dennis, and Philip Campbell, Nature volume447, pages791–797 (14 June 2007)
“Enhancing Research Reproducibility,” Recommendations from the Federation of American Societies for Experimental Biology (FASEB), Jan 14, 2016
March 2018 special issue of Proceedings of the National Academy of Sciences (PNAS) with several interesting articles on rigor and reproducibility, including:
- “Scientific progress despite irreproducibility: A seeming paradox,” by Richard M. Shiffrin, Katy Börner, and Stephen M. Stigler
- “Issues with data and analyses: Errors, underlying themes, and potential solutions,” by Andrew W. Brown, Kathryn A. Kaiser, and David B. Allison
- “Enhancing Primary Reports of Randomized Controlled Trials: Three Most Common Challenges and Suggested Solutions,” by Guowei Li et al.
- “The Preregistration Revolution,” by Brian Nosek, Charles R. Ebersole, Alexander c. DeHaven, and David T. Mellor.
- “Metastudies for Robust Tests of Theory,” by Beth Baribault et al.
- “Misrepresentation and Distortion of Research in Biomedical Literature,” by Isabelle Boutron and Philippe Ravaud
- “Crisis or Self-correction: Rethinking Media Narratives about the Well-being of Science,” by Kathleen Hall Jamieson.
- “Is Science Really Facing a Reproducibility Crisis, and Do We Need It To?,” by Daniele Fanelli.