The dangers of Big Data and the biases of interpretation

Health services in South West London are in the process of being reconfigured. Which means the A&E department and maternity ward at my local hospital could soon close.

Residents have been told not to worry as it will only take 13 minutes to travel to the reallocated wards in Tooting.

How was the 13 minutes calculated? We aren’t told. Cut the data by traffic-dodging, siren-blazing ambulances and perhaps it is an accurate reflection. But does it factor in peak-time traffic? Does it accurately reflect the travel-time for visiting relatives or women in labour who have no sirens or means of dodging traffic?

The data has been cut to show what it needs to show and interpreted with underlying biases.

Which is why we should be welcoming Big Data with open arms and a healthy dose of critical thinking.

The risk of human bias in both the cutting and analysing of Big Data remains just as real – as does the danger of attributing cause to effect.

Take, for example, the Twitter and Foursquare data captured around Hurricane Sandy. In a recent article for Harvard Business Review, Kate Crawford, dissects a study into the real-world implications of social data. Crawford reveals that the data captured during Hurricane Sandy indicated a grocery shopping peak the night before the storm – no doubt people stocking up – with a peak in nightlife the night after – perhaps people letting off tension.

The data also indicated that Manhattan was at the centre of the disaster – with significantly more tweets about the storm coming from the city. What this data doesn’t factor in is the higher level of smartphone ownership or Twitter uptake in Manhattan, comparative with other, worse hit locations.  Or the impact that power blackouts, battery outages and limited phone access had on the ability for those worst hit to convey their experience of the storm on social media.

In short, data can and does often paint part of a picture. It’s up to the interpreter whether he chooses to accept that portrait as conclusive, or whether he continues searching for the bigger picture.

 

Latest Posts

How can CMOs stop Q4 paid social costs from spiralling? CMOs cannot change Q4 seasonality, but they can change how exposed they are to it. Instead of leaving all budget in live auctions when CPMs peak, use Meta’s Reservation buying to pre book key Q4 reach at fixed prices, then keep a smaller auction budget for agile tests and trading. Lock creative and plans earlier in the year, use Q2 and Q3 to find winning hooks and formats, and use AI to build CPM and ROAS scenarios. You turn Q4 from a chaotic bidding war into a planned portfolio with clear risk and upside.
Read More
Is it me? Am I the problem? Or did the Christmas ads sneak onto our tellies WAY too quickly!!!? So I guess it’s that time again – the battle of the brands to make us chuckle, and shed a tear. Let’s unwrap this year’s finest festive offerings, shall we? Coca-Cola:…
Read More
Buyers decide early. Your funnel is late. Social Day B2B this year made it crystal clear the rulebook has changed for marketers under pressure to prove growth from social. Session after session, the same message landed from different angles. The funnel you have in your deck is not how buying…
Read More