{"id":32073,"date":"2014-07-31T16:08:09","date_gmt":"2014-07-31T15:08:09","guid":{"rendered":"http:\/\/stg-blogs.bmj.com\/bmj\/?p=32073"},"modified":"2014-07-31T16:40:35","modified_gmt":"2014-07-31T15:40:35","slug":"jane-feinmann-a-way-forward-for-quality-peer-review","status":"publish","type":"post","link":"https:\/\/stg-blogs.bmj.com\/bmj\/2014\/07\/31\/jane-feinmann-a-way-forward-for-quality-peer-review\/","title":{"rendered":"Jane Feinmann: A way forward for quality peer review"},"content":{"rendered":"

\"jane_feinmann\"<\/a>Blind faith that the publication of medical research in peer reviewed journals elevates a study to the status of “the evidence,” and therefore “the truth,” may be on the wane among those in the know. But for the public, and a vast number\u00a0of doctors, this “na\u00efve and misplaced” credulousness persists.<\/p>\n

According to\u00a0Dr Jigisha Patel, medical editor of BioMed Central,\u00a0this idea\u00a0must be challenged. Writing in an opinion piece published this week<\/a>\u00a0in the open access journal\u00a0BMC Medicine<\/em>, Patel calls for innovation in medical publishing that addresses the quality of peer review,\u00a0rather than simply the process. To this end, Patel proposes mandatory training for peer reviewers, with a “kitemark” identifying research papers that have been peer reviewed by people with the necessary skills.<\/p>\n

What is in effect the launch of a new initiative, which parallels the demand for greater transparency in clinical trials, has been commended by\u00a0Professor Doug Altman, director of the Centre for Statistics in Medicine at Oxford University. In his open peer review, published alongside the online paper<\/a>, Professor Altman says the issues raised “are of major importance to the integrity and value of the medical research literature.” The problems identified by Patel are well known, although “not amenable to easy resolution,” he says.<\/p>\n

According to Patel, these problems can be summed up as: “the aims of peer review are poorly defined, with no evidence that it works, and no established way to provide training.” There is evidence, she says that “reviewers fail to detect deliberately introduced errors and do not detect deficiencies in reporting methods, sometimes even suggesting inappropriate revisions.” Yet current initiatives focus on the need to reduce delays for authors and the burden for reviewers, while ignoring the fundamental weaknesses of a system on which evidence based medicine relies.<\/p>\n

What’s more, adds Altman, “editors generally explain inadequately to reviewers what they are expecting them to do [so that] . . . peer review is quite poor on some of the major issues.” Indeed, as a peer reviewer, he chides Patel for understating the scale of the problem.\u00a0In an early draft, she quotes only one study as evidence of peer review’s all too frequent poor quality. Yet Altman points out: “In fact, we know from dozens of reviews of peer reviewed publications that many published articles contain methodological errors and also that reporting is poor . . . [to the point that] key information is frequently not provided.”<\/p>\n

So what\u2019s the way forward? Patel points to CONSORT (Consolidated Standards of Reporting Trials)<\/a>, updated in 2010, as providing a model for establishing a single, universal framework, which should be taken on board by any journal publishing randomised controlled trials.<\/p>\n

But peer reviewers need more than CONSORT, Professor Altman told The BMJ<\/em>. “This is a guideline for reporting what was done, but [it] does not give guidance on how to judge whether what was done was sensible. And we can see very clear reporting of very bad, biased methods,” he explains. Which leads us back to Patel’s essential point:\u00a0reviewers need to learn “to spot fundamental flaws,”\u00a0and be tested on this skill on a regular basis.<\/p>\n

A wide number of bodies\u2014including medical schools, regulatory and accreditation organisations, funding bodies, publishers, journal editors, and lay people\u2014would need to be involved, although “initially a positive response from journal editors could get the process going,” she told The BMJ.<\/em> The endpoint would be peer reviewed papers with \u2018\u2018a searchable quality assurance symbol . . . so that readers [including lay people] know whether a study was reviewed by at least one appropriately trained and accredited expert.”<\/p>\n

Professor Altman wonders whether, on its own, such a scheme “would have much impact,” as well as whether the suggested quality assurance scheme is practical. “Partly this is because there is no truth about what is a reliable paper, or indeed what is a high quality review.”<\/p>\n

But he does see value in further discussion of the evidence that peer reviewers “miss a lot” and are “generally rather poor at detecting errors and omissions.” And he is in favour of postgraduate mandatory training for peer reviewers, which he suggests could be provided by research organisations. “All parties need to take steps,” he says. “We should try to make progress and this paper offers one way forward.”<\/p>\n

Jane Feinmann<\/strong>\u00a0is a freelance medical journalist and copywriter based in London. She writes about patient safety issues including pharmacovigilance, mental health, ageing, and women’s issues.\u00a0<\/em><\/p>\n

Competing interests: The author has no competing interests to declare.<\/p>\n","protected":false},"excerpt":{"rendered":"

Blind faith that the publication of medical research in peer reviewed journals elevates a study to the status of “the evidence,” and therefore “the truth,” may be on the wane among those in the know. But for the public, and a vast number\u00a0of doctors, this “na\u00efve and misplaced” credulousness persists. According to\u00a0Dr Jigisha Patel, medical […]<\/p>\n

Read More…<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-32073","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/32073","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/comments?post=32073"}],"version-history":[{"count":0,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/32073\/revisions"}],"wp:attachment":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/media?parent=32073"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/categories?post=32073"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/tags?post=32073"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}