Systematic replications and statistical reproducibility of educational research

Crues, Robert Wesley

Permalink

https://hdl.handle.net/2142/104986 Copy

Description

Title

Systematic replications and statistical reproducibility of educational research

Author(s)

Crues, Robert Wesley

Issue Date

2019-04-01

Director of Research (if dissertation) or Advisor (if thesis)

Anderson, Carolyn J.

Doctoral Committee Chair(s)

Anderson, Carolyn J.

Committee Member(s)

• Perry, Michelle
• Paquette, Luc
• Zhai, ChengXiang

Department of Study

Educational Psychology

Discipline

Educational Psychology

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

systematic replication, statistical reproducibility, text mining

Abstract

Science is at a critical juncture: the findings of many studies are unable to be replicated and reproduced, while scientific output is growing exponentially and becoming easily accessible. The inability of findings to replicate has been particularly prominent in the field of psychology, where it has been estimated that less than half of findings are able to be replicated. A similar conclusion has been drawn about educational research. At the same time, thousands of papers are published making it increasingly difficult for researchers to know whether or not findings have replicated. This thesis addresses the replicability and reproducibility of educational research and proposes tools that could help researchers sift through large amounts of scholarly output. The first paper of this thesis differentiates between the ideas of replicability and reproducibility, and describes how educational researchers can design systematic replications and report the details needed to reproduce statistical analyses. The second paper examines the use of different text classifiers to extract details about the findings and contextual factors of published articles, where this information can be used by researchers to determine whether two papers are systematic replications of one another. The third paper develops text classifiers to identify the details needed to reproduce the statistical analyses in published papers. These three papers demonstrate there are many components needed to replicate and reproduce educational studies, and these details are sometimes easily identified by text classifiers.

Graduation Semester

2019-05

Type of Resource

text

Permalink

http://hdl.handle.net/2142/104986

Copyright and License Information

Copyright 2019 Robert Crues

Owning Collections