Informed Guesswork

The great Bob Hoffman referred in his AdContrarian blog to ‘informed guessing’. His point being that despite wrapping ourselves in scientific-sounding words and phrases there is precious little in the advertising world that a qualified scientist would recognise as ‘science’.

What there is, what we do, is informed guesswork.

How could it be otherwise? Circumstances change; people act unpredictably; moods swing; ad qualities vary; ad contexts fluctuate from the deeply inappropriate to the highly relevant. Advertising is not an industry conducting regular scientific experiments under laboratory conditions.

The more information you have, and the clearer your objectives the better the chances that your guesses will pay off.

 Here’s a simple choice. Would you prefer to focus on your ad being seen by masses of people, or to take actions that contribute to you selling more stuff?

It’s a choice because these two things are not inextricably linked.

The ‘masses of people’ who ‘saw’ your ad may not actually have done so. They might have had an opportunity to do so, but that’s quite a different thing.

And when we say ‘saw’, or even ‘opportunity to see’ we don’t mean ‘notice’ let alone ‘remember’. What we mean is that a pair of eyes were (possibly) on a screen for a second, maybe two during which an ad may have played.

Did it play? If we’re talking online, we think so, but we’re not sure. Nobody will guarantee anything beyond saying the likelihood is the ad was served. Was it all played? Shrug.

Can we say where and within what context the ad appeared (if it appeared)? No. We can guess but we don’t know.

Furthermore, when we say ‘masses…’ we’re not sure how many masses. And when we say ‘people’ we more accurately mean devices. And when we say ‘devices’ many of those may be phones racked up in their thousands and programmed to click away automatically.

So, the first part of your choice might more accurately read: … for your ad to have been served (not necessarily at all, let alone in its entirety), but has not necessarily appeared on many (we’re not sure how many) sites (we’re not sure which), on an unvalidated number of devices some of which (but not all) may or may not involve a pair of eyes (we don’t know how many) open (we hope) in front of the screen for a second or two.

I once wrote a chart for an MRG Conference paper. Goodness knows where it is now, but from memory it contained a pyramid the base of which read: ‘How many people saw any edition of a magazine used by my client?’

The next step up changed ‘any edition’ to ‘an average edition’.

Then moving up: ‘How many people saw the actual edition of a magazine in which my client’s ad appeared?’; and on to ‘How many people saw the actual page on which my client’s ad appeared?’.

There were several other stages until at the top of the pyramid we got to ‘How many people saw my client’s ad and acted upon it?’

My point was we were stuck on the lowest segments of the pyramid.

This was in 1980. 45+ years ago.

Now replace ‘magazine’ with ‘website’ and change some of the obvious descriptors.

At least back then we knew that our ads had appeared, where, and the surrounding context. Now we don’t.

Back then there was one unquestioned source of audience data. It may have been guesswork but everyone had the same base. No longer.

Remember the digital evangelists sneering how we have so much more audience knowledge today than back in the ‘dark ages’?

On 23rd January, ‘Private Eye’ reported, in the context of several states considering banning under 16s from social media: “Both META and Snapchat have said there is a significant margin of error when seeking to determine whether a user is in fact under 16.”

And yet the platforms sell on the basis that they can tell advertisers exactly who their ads reach, on a one-to-one, minute-by-minute basis.

The foundation of advertising is to be Legal, Decent, Honest and Truthful. Those words are important; over time they’ve shielded advertising from external regulation.

The ASA builds on these foundations:

  • Truthful: substantiate all objective claims.
  • Non-misleading: must not deceive, omit or mislead through exaggeration
  • Social responsibility: must not encourage illegal, unsafe or anti-social behaviour.

Shouldn’t these foundations apply to the collection and use of online audience data as much as to any other advertising discipline?

There is plenty of evidence on which media forms deliver consistent business results for advertisers.

Guesswork informed by evidence beats buying the salesman’s patter. Without question.

|
|
|
|
3 Comments
  1. It always seems to me that whether we’re talking about those that promote the perfection of online ‘big’ data OR those who denigrate it, both sides share a substantial level of ignorance of the complexities at play in measurement. I think our industry would be in a healthier position if public proclamations/accusations on both sides resulted from an attempt to understand some of the detail first. Actually those underlying issues are not actually massively complicated but they can be surprising and counter-intuitive sometimes.

  2. Andrew: There is no doubt that you understand the intricate details of online device-based ‘big data’ (and the “dare you to criticize” ‘first party data’) far far better than most including the critical caveat that most of it is not fully and independently verified by those that “mark their own homework”! Echoing Brian’s fundamental observations regarding media measurement ‘guesswork’ (and as we have previously shared), without rigorously understanding, “How many people saw (heard) the actual page on which my client’s ad appeared?” all the device-based, unverified, content-rendered-counts, aka viewable impressions, i.e., no REAL OTS, are surely no better than “informed guesswork” in terms of “acted on it”, or ‘ad effect’, even for leading data experts like yourself. What are ‘we’ missing?

  3. Hi Andrew

    It was ever thus.

    I would make the exact same point about 90% of comments on advertising creativity. So many made by people who’ve never been close to the creative process and yet they believe they’re experts anyway…

    Many online technicians have told me MR has no future, why listen to a sample when you can explore universe data etc. Nonsense, of course.

    Personally I’ve always tried to understand. Which is why I’ve asked so many times to take the survey, fill out the questionnaire, be treated like a respondent etc. Funnily enough some research companies are dead against that idea!

Leave a Reply

Your email address will not be published. Required fields are marked *