{"id":41473,"date":"2018-02-22T15:03:17","date_gmt":"2018-02-22T14:03:17","guid":{"rendered":"http:\/\/stg-blogs.bmj.com\/bmj\/?p=41473"},"modified":"2018-03-02T14:24:53","modified_gmt":"2018-03-02T13:24:53","slug":"giles-maskell-impossible-errors","status":"publish","type":"post","link":"https:\/\/stg-blogs.bmj.com\/bmj\/2018\/02\/22\/giles-maskell-impossible-errors\/","title":{"rendered":"Giles Maskell: Impossible errors"},"content":{"rendered":"<p class=\"standfirst\">Hindsight bias is a real and very powerful phenomenon, and not just in radiology<\/p>\n<p><!--more--><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-39428\" src=\"https:\/\/stg-blogs.bmj.com\/bmj\/files\/2017\/06\/giles_maskell.jpg\" alt=\"\" width=\"160\" height=\"160\" srcset=\"https:\/\/stg-blogs.bmj.com\/bmj\/files\/2017\/06\/giles_maskell.jpg 160w, https:\/\/stg-blogs.bmj.com\/bmj\/files\/2017\/06\/giles_maskell-150x150.jpg 150w\" sizes=\"auto, (max-width: 160px) 100vw, 160px\" \/><span style=\"font-weight: 400\"><span style=\"font-weight: 400\">There is a discipline in academic law concerned with what are known as &#8220;impossible crimes.&#8221; These are \u201ccrimes which are not crimes.\u201d One of the classic examples involves an international traveller who is found to be in possession of a bag of white powder which he believes to be cocaine, but which on testing turns out to be a bland substitute, say chalk dust. Importing chalk dust is not a crime so on the face of it no crime has been committed. It\u2019s an impossible crime.<\/span><\/span><\/p>\n<p><span style=\"font-weight: 400\">I would like to adopt a similar formulation to describe events which sometimes happen in radiology and could be designated \u201cimpossible errors,\u201d that is to say errors which are not errors. Consider Mrs X who undergoes a computed tomography (CT) examination because of bowel symptoms. The scan reveals a tumour in her colon. While reporting this examination, the radiologist notes that she had a CT scan performed a couple of years earlier for suspected kidney stones. The technique used on that occasion was focused on the identification of any stones and was far from ideal for looking at the colon. Nevertheless, the radiologist, <\/span><i><span style=\"font-weight: 400\">knowing precisely where a tumour has subsequently been identified, <\/span><\/i><span style=\"font-weight: 400\">is able<\/span> <span style=\"font-weight: 400\">with hindsight to identify something at the same location which looks like a polyp on the earlier study. No reader could have called this a polyp at the time, but its presence on the images is indisputable.<\/span><\/p>\n<p><span style=\"font-weight: 400\">This is not a new concept. The <\/span><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/1991274\"><span style=\"font-weight: 400\">Mayo Lung Project<\/span><\/a><span style=\"font-weight: 400\"> in the 1970s was a study of screening male smokers for lung cancer using four monthly chest x rays and pooled sputum samples.\u00a0<\/span><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pubmed\/6308709\"><span style=\"font-weight: 400\">Retrospective analysis<\/span><\/a><span style=\"font-weight: 400\"> found that 90% of 50 peripheral cancers identified during the study were visible on at least one of the chest x rays obtained earlier in the study. Had the previous films been misinterpreted? Not necessarily. Some of these\u2014perhaps a majority\u2014would have been \u201cimpossible errors.\u201d Only with hindsight, knowing the location of the subsequently diagnosed cancer, could the earlier image be interpreted as abnormal.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Hindsight bias is a real and very powerful phenomenon and <\/span><a href=\"http:\/\/qualitysafety.bmj.com\/content\/12\/4\/304\"><span style=\"font-weight: 400\">not just in radiology<\/span><\/a><span style=\"font-weight: 400\">. Once the outcome of any event is known, it assumes a degree of inevitability and it becomes very difficult to imagine an alternative. For us as medical imagers, once a particular reader has identified an abnormality, it becomes extraordinarily difficult to understand how another reader, on a different occasion, might have missed it. It is impossible to \u201cun-see\u201d something once it has been seen. Of course radiological abnormalities (and errors) come in a full spectrum from the truly \u201conly visible in retrospect\u201d to the glaringly obvious, but there are reasons why even the latter can be missed on occasions. Anybody unfamiliar with the <\/span><a href=\"https:\/\/www.youtube.com\/watch?v=vJG698U2Mvo\"><span style=\"font-weight: 400\">\u201cinvisible gorilla\u201d clip<\/span><\/a><span style=\"font-weight: 400\"> is strongly urged to view it and you will see what I mean.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Experience suggests that patients and the public are not particularly aware of the limitations of diagnostic tests, leading sometimes to a degree of shock and even anger when diagnostic errors come to light. There appears currently to be a wide gap between what radiologists know to be our error rate and what patients might believe it to be. It is surely in the interests of both doctors and patients to try to close that gap.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Is it time to consider whether all diagnostic tests should come with a \u201chealth warning?&#8221; These issues have been explored mainly in the context of <\/span><a href=\"http:\/\/www.bmj.com\/content\/319\/7212\/722?variant=full-text&amp;sso=\"><span style=\"font-weight: 400\">screening tests<\/span><\/a><span style=\"font-weight: 400\"> designed to identify a single condition in which it is possible to make some estimation of the rates of false positives and false negatives. The situation is far more complex when we consider tests such as abdominal CT scanning which have the potential to identify (or miss) a very wide range of abnormalities ranging from the immediately life-threatening to the completely harmless. Exactly what information would most help a particular patient to appreciate the strengths and limitations, advantages and disadvantages, of undergoing the test?<\/span><\/p>\n<p><span style=\"font-weight: 400\">In the case of impossible crimes, legal thinking has gradually shifted to place more emphasis on intent. Opinions will differ as to whether the patient\u2019s interests are best served by including or excluding a particular finding\u2014positive or negative\u2014from a radiology report, but the intent is always the same. The job of the radiologist after all is the same as that of any other doctor\u2014to improve the health of the patient, not simply to identify a list of things which might be wrong.<\/span><\/p>\n<p><em><strong>Giles Maskell<\/strong> is a radiologist in Truro. He is past president of the Royal College of Radiologists.<\/em><\/p>\n<p><em><strong>Competing interests<\/strong>: None declared.\u00a0<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hindsight bias is a real and very powerful phenomenon, and not just in radiology [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/stg-blogs.bmj.com\/bmj\/2018\/02\/22\/giles-maskell-impossible-errors\/\">Read More&#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":41474,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[18893],"tags":[],"class_list":["post-41473","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-giles-maskell"],"jetpack_featured_media_url":"https:\/\/stg-blogs.bmj.com\/bmj\/files\/2018\/02\/ct_scan_abdomen.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/41473","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/comments?post=41473"}],"version-history":[{"count":0,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/posts\/41473\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/media\/41474"}],"wp:attachment":[{"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/media?parent=41473"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/categories?post=41473"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stg-blogs.bmj.com\/bmj\/wp-json\/wp\/v2\/tags?post=41473"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}