A couple years ago, I reviewed a paper for a highly reputable journal (note: not ASR or AJS). The paper had substantial merit, but did an extra analysis that I didn’t think made sense. (Worse, really, I thought it was outright misleading.) I explained why in my review. The paper was given an R&R in which the authors were instructed to answer various reviewer criticisms. The paper was re-submitted, and, in the revision, the questionable analysis was removed. I recommended acceptance, and, as it turned out, I was the only reviewer on the second round. The paper was published.
Recently, I was reminded of the paper and looked up the published version. I saw that the authors had put the questionable analysis back in the paper.
Does this happen often? Should I be bothered? Annoyed? Upset? Angry? Is there anything I should do, beyond the catharsis of posting this?
Obviously, there are many complaints about the review processes and how reviewers can make authors do things that the authors don’t think are right. I’m pretty confident in my views about this analysis, but the authors may well disagree (after all, they were the ones who did it in the first place). So, I can empathize with a certain degree of “Screw Reviewer C!” thinking. But, well, as Reviewer C, I’m feeling a little defrauded.