Replication in Economics : When the Code Contradicts the Text

 

In recent years, the process of evaluating economic research articles has evolved with the introduction of a key step for studies based on empirical analyses. After peer review and approval by the editor, authors must engage with the Data Editor, who ensures that the codes and datasets used reproduce the reported results. The Data Editor has the authority to reject publication if significant data issues arise. If the article is accepted, the associated code and data are made publicly available in line with open science principles, allowing other researchers to verify and replicate the analysis. However, strict replicability of the results is not always guaranteed, as the consistency between the methodology described in the article and the code used to implement it is not systematically verified. This gap highlights the need for a re-evaluation of current practices and greater emphasis on replicating scientific studies.

Read the blog article in French
 

References

Bertoli, S., Clerc, M., Loper, J., et Roca Fernández, È. (2024). Understanding cultural persistence and change: A replication of Giuliano and Nunn (2021). Economic Inquiry. Replication files.

Giuliano, P., et Nunn, N. (2021). Understanding cultural persistence and change. The Review of Economic Studies, 88(4), 1541-1581.

Giuliano, P., et Nunn, N. (2024). Correction to: Understanding Cultural Persistence and Change, The Review of Economic Studies, 91(1), 597.