![\"Richard](\"http:\/\/www.bmj.com\/home\/icons\/bmjh7648e.jpg\")
Recently in Bangladesh I had breakfast with a Harvard professor of economics who told me: “Economists pay no attention to what people say, only to what they do.” Now I know, as we all do, that there is a big gap between what people say and what they do, and consequently I\u2019ve always been wary of surveys; but we did publish them in the BMJ when I was the editor. The more I think about it, however, the more I think that we should ignore all surveys. Life is too short.<\/p>\n
And the gap between what people say and what they do is not the only problem with surveys. There are hundreds of problems, but I\u2019ll pick out two that render meaningless stories that appear almost every day in the media\u2014because silly surveys are important for filling newspapers and even more important for public relations people and editors of small time publications to create stories from nothing.<\/p>\n
Firstly, these publications stick a questionnaire into their pages and ask readers to respond. Or you can do the same thing online. It\u2019s cheap and easy. Probably less than 1% respond, but if you have a large circulation that can be a lot of individuals. Needless to say, the 1% are probably wildly different from the 99% who didn\u2019t respond.<\/p>\n
This is, I think, what must have happened with the survey by GP magazine<\/a> that led to this report in The Times<\/a>: \u201cA survey of 251 family doctors, published today, shows that 90 per cent believe that other diseases risk going undetected because their symptoms are similar to those caused by swine flu.\u201d The circulation of GP Magazine is probably about 40 000\u2014so those 251 doctors constitute a response rate well below 1%. The results are meaningless.<\/p>\n The second trick is, of course, in the questions. For example, here\u2019s one that\u2019s a favourite of the BMA<\/a>, the British Misery Association: “Have you ever contemplated leaving the NHS?” Well, if you\u2019ve been a doctor for 25 years you\u2019d be odd if you hadn\u2019t.\u201d The result is a headline that says: “Two thirds of doctors ready to quit NHS.” Another common variant is: “Have you ever thought of moving to Australia?”<\/p>\n And sex is of course the best topic to survey in order to get coverage. I\u2019m thinking of surveying BMJ editorial staff<\/a> asking: “If you woke up to find yourself in bed with two sexually gorgeous people would you get immediately get out?” The resulting headline, perhaps in The Lancet<\/a>, would read: “50% of BMJ editors ready for three in a bed romp.”<\/p>\n Next time you see the results of a survey, cast a cold eye on it and move on.<\/p>\n","protected":false},"excerpt":{"rendered":" Recently in Bangladesh I had breakfast with a Harvard professor of economics who told me: “Economists pay no attention to what people say, only to what they do.” Now I know, as we all do, that there is a big gap between what people say and what they do, and consequently I\u2019ve always been wary […]<\/p>\n