Files in this item

FilesDescriptionFormat

application/pdf

application/pdfDickinson_AlexanderS.pdf (566kB)
(no description provided)PDF

Description

Title:Replication of Results Using Code from Published Physics Research
Author(s):Dickinson, Alexander S.; Krafczyk, Matthew; Stodden, Victoria
Subject(s):Replication
Physics
Computation
Science
Programming
Abstract:To speedily weed out error, scientific research must be reproduced. Because of the difficulty of reproducing computational research without access to code, computational scientists must provide the code that they used to generate all numerical data and figures in their papers. Papers with code that is capable of this are replicable. In this project, I assess the replicability of eleven computational physics papers by attempting to compile and run provided code, and then by comparing any output with figures and data in the manuscript. I hypothesize that computational physics papers do not provide code that is capable of replicating results, and that considerable effort will be required to achieve replication. I find that, out of eleven papers, none achieved complete replication, while only four achieved partial replication. The remaining eight provided code producing output with no resemblance to data in the paper. I determine that code is written in an ad hoc fashion, with little thought given to replicability or continued maintenance.
Issue Date:2017
Genre:Conference Poster
Type:Image
URI:http://hdl.handle.net/2142/98454
Sponsor:National Science Foundation
Rights Information:Copyright 2017 Alexander S. Dickinson
Date Available in IDEALS:2017-10-03


This item appears in the following Collection(s)

Item Statistics