A Quasi-natural Experiment…

Academic publishing is not always a mechanical process. The same paper, evaluated by the same referee with essentially the same report, can lead to different editorial outcomes.

I recently experienced a revealing case. A paper presented at a conference was first considered for a special issue of a journal and rejected after revision. I tackled all the major comments and send a letter to the Editor in Chief between Christmas and New Year’s Eve (I was really motivated…) but the paper was ultimately rejected. The same conference later offered a second special issue. The guest editor (the same guy) selected the same referees, which created something close to a quasi-natural experiment in peer review: the paper, the referee pool, and the substance of the report were almost unchanged, but the editorial outcome differed. The paper was eventually published in the second journal.

The episode illustrates that referee reports matter, but they do not mechanically determine decisions. Editors interpret reports. They assess whether criticisms are fatal or manageable, how the paper fits the journal, and whether the contribution is sufficiently clear for the intended audience.

The lesson is not to dismiss referee comments. Critical reports often help improve a paper. But a rejection is not always a final judgment on the scientific value of the work. Sometimes it reflects editorial interpretation, journal fit, timing, or the specific context of a special issue.

For authors, the implication is simple: separate the substance of the referee report from the editorial decision. Revise carefully, address valid criticisms, clarify the contribution, and resubmit where the paper is better aligned.

In this case, the same review process produced different outcomes. That contrast is useful. It reminds us that peer review is informative, but not absolute. A rejection is an editorial decision, not the final verdict on a research paper.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.