What to do if authors don't respond to my serious concerns about their paper?












6















I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.



As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.



The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.



I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.



A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:




  1. Send the authors a follow-up email. (If so, what should I say to get the message across?)

  2. Contact the journal with my concerns.

  3. Write a response. (Would such a thing get published?)

  4. Do nothing. (I think the paper is too important.)










share|improve this question



























    6















    I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.



    As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.



    The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
    It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.



    I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.



    A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:




    1. Send the authors a follow-up email. (If so, what should I say to get the message across?)

    2. Contact the journal with my concerns.

    3. Write a response. (Would such a thing get published?)

    4. Do nothing. (I think the paper is too important.)










    share|improve this question

























      6












      6








      6


      1






      I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.



      As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.



      The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
      It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.



      I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.



      A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:




      1. Send the authors a follow-up email. (If so, what should I say to get the message across?)

      2. Contact the journal with my concerns.

      3. Write a response. (Would such a thing get published?)

      4. Do nothing. (I think the paper is too important.)










      share|improve this question














      I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.



      As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.



      The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
      It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.



      I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.



      A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:




      1. Send the authors a follow-up email. (If so, what should I say to get the message across?)

      2. Contact the journal with my concerns.

      3. Write a response. (Would such a thing get published?)

      4. Do nothing. (I think the paper is too important.)







      errors-erratum






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked 5 hours ago









      ThomasThomas

      14k63051




      14k63051






















          2 Answers
          2






          active

          oldest

          votes


















          9
















          1. Write a response. (Would such a thing get published?)




          This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).



          As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.






          share|improve this answer































            0














            There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.




            1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/


            2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).







            share|improve this answer








            New contributor




            guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
            Check out our Code of Conduct.
















            • 1





              I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

              – Thomas
              4 hours ago






            • 1





              Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

              – guest
              4 hours ago











            Your Answer








            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "415"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            noCode: true, onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f125806%2fwhat-to-do-if-authors-dont-respond-to-my-serious-concerns-about-their-paper%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            2 Answers
            2






            active

            oldest

            votes








            2 Answers
            2






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            9
















            1. Write a response. (Would such a thing get published?)




            This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).



            As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.






            share|improve this answer




























              9
















              1. Write a response. (Would such a thing get published?)




              This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).



              As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.






              share|improve this answer


























                9












                9








                9









                1. Write a response. (Would such a thing get published?)




                This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).



                As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.






                share|improve this answer















                1. Write a response. (Would such a thing get published?)




                This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).



                As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered 5 hours ago









                Massimo OrtolanoMassimo Ortolano

                39.2k12118147




                39.2k12118147























                    0














                    There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.




                    1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/


                    2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).







                    share|improve this answer








                    New contributor




                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.
















                    • 1





                      I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

                      – Thomas
                      4 hours ago






                    • 1





                      Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

                      – guest
                      4 hours ago
















                    0














                    There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.




                    1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/


                    2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).







                    share|improve this answer








                    New contributor




                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.
















                    • 1





                      I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

                      – Thomas
                      4 hours ago






                    • 1





                      Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

                      – guest
                      4 hours ago














                    0












                    0








                    0







                    There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.




                    1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/


                    2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).







                    share|improve this answer








                    New contributor




                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.










                    There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.




                    1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/


                    2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).








                    share|improve this answer








                    New contributor




                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.









                    share|improve this answer



                    share|improve this answer






                    New contributor




                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.









                    answered 4 hours ago









                    guestguest

                    743




                    743




                    New contributor




                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.





                    New contributor





                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.






                    guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
                    Check out our Code of Conduct.








                    • 1





                      I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

                      – Thomas
                      4 hours ago






                    • 1





                      Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

                      – guest
                      4 hours ago














                    • 1





                      I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

                      – Thomas
                      4 hours ago






                    • 1





                      Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

                      – guest
                      4 hours ago








                    1




                    1





                    I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

                    – Thomas
                    4 hours ago





                    I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.

                    – Thomas
                    4 hours ago




                    1




                    1





                    Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

                    – guest
                    4 hours ago





                    Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.

                    – guest
                    4 hours ago


















                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Academia Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f125806%2fwhat-to-do-if-authors-dont-respond-to-my-serious-concerns-about-their-paper%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    GameSpot

                    日野市

                    Tu-95轟炸機