The Data Analytics Blog

Our news and views relating to Data Analytics, Big Data, Machine Learning, and the world of Credit.

All Posts

Maladies And Misadventures Of A Marketing Analyst

April 2, 2019 at 7:01 AM

For a while, we have been running a blog series on cognitive biases and logical fallacies that data scientists should avoid. In this final blog on the subject, we look at some of the other logical fallacies and how they might crop up in data analytics.

False Dichotomy

The false dichotomy is the assumption of a binary state when there is none.

Either the conclusion is X, or it is Y.

ying-yangIn many cases, there may be other conclusions that the analyst has not considered possible. I first came across an example of this assessing a marketing communication exercise with a retailer’s credit customers many years ago.  We split the population randomly into two groups “A” and “B”. To “A” we allocated vouchers (i.e. get R100 off when you spend more than R300); to “B” we allocated nothing (hold-out). 

We measured the results six months later and found no difference in spending. Our then conclusion was that customers were not attracted by the R100 discount offer. We assumed a binary scenario state (either they were or were not attracted by the offer). After subsequent analysis, however, we found that the retailer had forgotten to send out the vouchers to the customers. Our assumption of a binary scenario state was therefore flawed, and we had initially not considered a problem with the test itself. The lesson here is that the world has very few purely binary states and it is worth thinking more broadly about other scenarios.  

The Cobra Effect

mohan-moolepetlu-735364-unsplashWhen setting up tests in data science, occasionally one is faced by unintended consequences of the test (also known as the “Cobra Effect”). In the British colonial days in India, the British government was concerned about the number of venomous cobras in Delhi. They established a bounty for every dead cobra. While many killed cobras, some enterprising people began breeding cobras too. The British then scrapped the programme, and the bred cobras were set free causing a bigger problem than before.

This phenomenon is also occasionally seen in the marketing space. I have personally come across it in account management strategies where a retailer attempts to reactivate a dormant account (the account had no spend on it for six months) by offering them vouchers to start spending. This strategy led to many customers spending the voucher and then purposely going back to being dormant as they knew they would receive another voucher in a few months again – an unintended effect of a marketing strategy.

Personal Incredulity

This is a continuous matter of debate in data analytics. It deals with the matter of “explainability” in the data. If I can’t understand a trend should I trust it? The advice is to be sceptical, but also be prepared to trust unexplainable trends particularly if they are shown to be consistent in multiple data sets.

 

 

 

 

 

 

 

 

 

We have written more extensively about this is in our blog Automation And Machine Learning: How Much Is Too Much?

There are a host of other informal logical fallacies and cognitive biases some of which manifest themselves in data science.  If you’d like to read more, I’d like to recommend the following graphics here, here and here or you can scroll through Wikipedia who has excellent entries on each fallacy and bias.

Truthseeker - logical fallacies

Thomas Maydon
Thomas Maydon
Thomas Maydon is the Head of Credit Solutions at Principa. With over 13 years of experience in the Southern African, West African and Middle Eastern retail credit markets, Tom has primarily been involved in consulting, analytics, credit bureau and predictive modelling services. He has experience in all aspects of the credit life cycle (in multiple industries) including intelligent prospecting, originations, strategy simulation, affordability analysis, behavioural modelling, pricing analysis, collections processes, and provisions (including Basel II) and profitability calculations.

Latest Posts

Exploring Customer Engagement In The Digital Age

We’re looking forward to attending this year’s Digital Customer Experience conference. The 2019 conference will be hosted by Trade Conferences International (TCI) on the 4th and 5th of September at the Indaba Hotel, Fourways, Johannesburg.

15 Vital Customer Service Statistics You Need To Know In 2019

Today, more than ever before, customer service is the most important aspect of your business. With all your competitor’s that your clients can choose from, you need to offer the best experience and service to keep your customers happy – and to keep them as customers.

Frequently Asked Questions On Genius Leads

What is Genius Leads? Principa Genius Leads is a POPI compliant provision service of South African consumer leads. We use advanced analytics and Machine Learning to optimise lists of new or existing marketing leads, so you target your most desirable customers and those profiled as most likely to respond to your campaign – improving campaign take-up and long-term customer profitability.