Try the following experiment. Take any article accepted for publication at any journal. Now \u00a0submit it to another journal. What are odds it will be accepted as is? Zero. There is even a pretty good chance it will be rejected. Our profession seemingly believes that its published articles are in fact not\u00a0good enough to publish!<\/p>\n
That’s from forthcoming editorial<\/a>\u00a0(link opens a .pdf) in the Review of Financial Studies<\/em> by the Yale School of Management’s\u00a0Matthew Spiegel.<\/p>\n Spiegel’s point is that editors and reviewers should stop chasing perfection. No paper is or will ever be perfect. For Spiegel, the real peer review process begins after an article has been published:<\/p>\n There is almost no reason to worry if a particular article is “right.” What horrors will befall us if a paper with a mistaken conclusion is published? Not many. The vast majority of articles are quickly forgotten. Who cares if their findings are accurate? The profession will not use the material regardless.\u00a0What if an article is important — that is, people read and cite it? In that case, academics will dissect its every aspect. Some will examine the article’s data filters; others will check for coding errors;\u00a0still others will look for missing factors or reverse causality explanations. The list is endless. But, that is the point. The list is<\/em> endless. Authors, referees, and editors cannot even scratch the surface. Nor do they\u00a0have to. The fact that our colleagues will stress test any important publication means our profession’s\u00a0received canon of knowledge has a self-correcting mechanism built in.<\/strong> We have faith that important\u00a0articles are “right” because their results have been tested over and over again in myriad ways.<\/p>\n A recent example of the vetting process described by Spiegel relevant to development economics is that of\u00a0David Roodman and Jonathan Morduch failing to replicate<\/a>\u00a0failing to replicate earlier findings by Mark Pitt and Shahidur Khandker<\/a>.<\/p>\n