Already a member?

Sign In

iBlog

Bad Data Examples Appeal

Back in early April, I canvassed the IASSIST list for examples of articles, studies, or any publication that misuses data.  My original message:

“Do you keep news stories that mis-state, misinterpret or otherwise misuse numeric data?  I have a faculty member who would like to use such examples to demonstrate to her students the importance of numeracy in real life.  I have a few examples but suspect others of you may stash this kind of thing in a "Can you believe this?!" kind of folder.  If you would be willing to share citations with me, I would very much appreciate it.  This could be opening a floodgate, I realize, so let's say English-language stories that have appeared in the last year.

Thanks!”

In fact, it wasn’t a floodgate and I’m hoping to collect more examples, but below is a summary of the responses I received.

=========================================

Book:  "The Obesity Myth" by Paul Campos might be worth looking at. The first few chapters are all about how questionable studies with relatively small samples have been used to shape health care policy regarding obesity, while larger studies whose methods are less controversial are ignored.

Sources for Such Stories

1. One very nice resource for this sort of thing is the Statistical Assessment Service at George Mason University (STATS) at: http://www.stats.org/          (2 people suggested)

2. (the following two are more about visualizations of data) http://junkcharts.typepad.com/junk_charts/      (2 people suggested) http://statisticalgraphics.blog.com/

3. Many sessions at the annual conference of the American Association for Public Opinion Research (AAPOR) have touched on this topic over the years.  You might take a look at past conference programs for sessions dealing with "The Media and Public Opinion Research" (or similar titles) to identify specific panelists who could provide numerous examples.  The AAPOR web site is http://aapor.org/.

=========================================

The trouble is, these examples/sources mostly point out why they’re bad examples.  The faculty member I’m working with would like to have her students read the items (so, preferably articles) and then identify for themselves why each is a bad use of data.  Obviously, there could be a wide range of “badness” and what level of student would recognize the problem(s), but she is working with first-year undergraduates so things for that audience are of greatest interest.  I think it would be great to keep a bibliography of such examples.  Or is this a libelous venture?  Am I better off culling citations for bad examples from these sources?

Posted on behalf of Michele Hayslett

Comments

This year's Radical

This year's Radical Statistics conference in London had some relevant presentations, at http://www.radstats.org.uk/conf2007/conf2007post.htm and the papers are also written up in the journal (not yet on the web, issue 94). See in particular Aubrey Blumsohn's Can I have my data? Access to data and control of the pharmaceutical scientific literature (scandalous) and Petra Boynton's Misuse of surveys in PR campaigns (hilarious). Petra also keeps a blog where she tries to monitor misuse of data, though her focus is mainly on sex research. http://www.drpetra.co.uk/blog/ Finally, have you seen the Guardian's column Bad Science? It's written by a GP, Ben Goldacre. His website, which says it archives all his columns, as well as hosts a blog and a forum is at http://www.badscience.net/

On the subject of 'bad data

On the subject of 'bad data examples - there's quite an interesting presentation on 'the worst social statistic ever' at:http://streaming.osu.edu/knowledgebank/111406/index.htm as detailed in Joel Best's book 'Damned Lies and Statistics' (http://www.ucpress.edu/books/pages/9358/9358.intro.html)

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.
  • IASSIST Quarterly

    Publications Special issue: A pioneer data librarian
    Welcome to the special volume of the IASSIST Quarterly (IQ (37):1-4, 2013). This special issue started as exchange of ideas between Libbie Stephenson and Margaret Adams to collect

    more...

  • Resources

    Resources

    A space for IASSIST members to share professional resources useful to them in their daily work. Also the IASSIST Jobs Repository for an archive of data-related position descriptions. more...

  • community

    • LinkedIn
    • Facebook
    • Twitter

    Find out what IASSISTers are doing in the field and explore other avenues of presentation, communication and discussion via social networking and related online social spaces. more...