• Home
  • Blog
  • About
  • Contact
CloudAve
Software in Business. The Business of Software.
  • Business
    • Analysis
    • Entrepreneurship
    • Marketing
    • Strategy
    • Small business
  • Technology
    • Application Software
    • Infrastructure
    • Open Source
    • Mobile
    • Platforms
    • Product reviews
    • Security
  • Misc
    • Design
    • Just for fun
    • Trends & Concepts
  • Sponsors
Browse: Home / Where Idiots Get Their Data: Other Idiots (Don’t Let it Happen in Your Company)

Where Idiots Get Their Data: Other Idiots (Don’t Let it Happen in Your Company)

By Timo Elliott on November 5, 2010

The video below is an entertaining look at where global warming myths come from, by science journalist Peter Hadfield. At the risk of spoiling the video, the short answer is “idiots who don’t understand numbers”.

Here’s an example from the video, where somebody claims in a blog post that global temperatures have been dropping, using this straight-line “analysis”:

image

As the video makes clear, to work out what’s really happening to the average global temperature, you have to do sophisticated statistical analysis to adjust for the cyclical trends and/or doing a rolling average.

But looking at the longer-term data set, it should have been pretty obvious that 1998 isn’t a great year to start the comparison from (unless you’re a willful global warming denier?)

image

The ramblings of these self-declared experts are then picked up and promoted throughout “the internets”, and end up being widely believed (a good example of confirmation bias). Thankfully, journalists like Peter and web sites like Ben Goldacre’s excellent Bad Science blog do a great job of trying to minimize the damage caused by this disinformation.

Sadly, though the same thing happens in organizations, too – bad data is too often badly analyzed and simplified, then passed on as “truth” to the rest of the organization. Just like on the internet, some people are happy to jump on data that confirm their existing biases, and may not be keen to figure out whether it’s actually true or not (a former boss, Dave Kellogg, once told me the first question to ask any executive who requests a research study is “do you want a high number or a low number?”).

This problem will never go away, since it’s firmly anchored in the weaknesses of human psychology. The best long-term remedy is to have pervasive business intelligence (so there’s less reliance on anecdotal evidence), to employ information analysts (the equivalent of Peter and Ben) in a BI competency Center, and to expose bad analysis to more people using collaborative decision-making environments like SAP StreamWork.

Share:

  • Twitter
  • Facebook
  • LinkedIn
  • Google +1
  • StumbleUpon

(Cross-posted @ BI Questions Blog)

Posted in Featured Posts, Trends & Concepts | Tagged All, Analytics, Bad Analysis, Bad Data, Bad Science, Ben Goldacre, BI, business analytics, Business Intelligence, Confirmation Bias, data, Featured, global warming, Idiots, Peter Hadfield, sap, Science journalism, statistics

Timo Elliott

« Previous Next »
feed mail facebook twitter linkedin

Sponsor Posts

HR Tech Vendors: Who’s Out There?
HR Tech Vendors: Who’s Out There?
The Next Revolution for Finance -- Embedded Analytics
The Next Revolution for Finance -- Embedded Analytics
The Cloud as a Process Reengineering Platform
The Cloud as a Process Reengineering Platform
The Simple Economic Principle Ruining Your Marketing Content
The Simple Economic Principle Ruining Your Marketing Content
  • Tags
  • Calendar
  • Comments

accy2 amazon android Apple aws briefs cloud cloud computing collaboration conferences Enterprise enterprise 2.0 Entrepreneurship facebook google humor iaas IBM innovation insights integration ipad iphone marketing microsoft netsuite open source openstack paas platform services saas salesforce.com sap Security Social Business social media software as a service Startup Advice startups Tech Market Analysis twitter vc funding venture capital vmware xero

May 2013
M T W T F S S
« Apr    
 12345
6789101112
13141516171819
20212223242526
2728293031  
  • CloudAve: 5 Key Essentials of Cloud Workloads...
  • jasonlkn: It’s natural … especially...
  • Rick: Great article Jason! I feel the same way...
  • James Strayer: there are companies out there...
  • 5 Key Essentials of Cloud Workloads Migration: ...
  • nielsjhansen: Good post. I also liked the quote...
  • Keith: You are optimistic that the nature of...
  • Michael: Datahero looks like a cool product....
  • DataH: Chirag, we are seeing an increase in...
  • Cyberculture History: The Origin Of E-Mail: ...
  • CloudAve: Yesterday I wrote a post about...
  • CloudAve: Related post: Why Early-Stage VCs...
  • CloudAve: If You Sell Your Company, Use a Banker
  • Jarret Pazahanick: Appreciate the kind words...
  • Lincoln Gupta: That is a very good story...

Archives

Authors

  • Adron Hall
  • Ben Kepes
  • Chirag Mehta
  • Chris Yeh
  • Christian Reilly
  • Colin Berkshire
  • Dan Morrill
  • Dan Pepper
  • Dave Michels
  • Dave Roberts
  • Hutch Carpenter
  • Jacob Morgan
  • Jarret Pazahanick
  • Jason M. Lemkin
  • Jeffrey Vocell
  • Joel York
  • John Taschek
  • Krishnan Subramanian
  • Mark Fidelman
  • Mark Suster
  • Martijn Linssen
  • Michael Krigsman
  • Ofir Nachmani
  • Paul Miller
  • Rakesh Malhotra
  • Randy Bias
  • Sadagopan
  • Scott Bils
  • Zoli Erdos
Sponsored by: