The Data Analytics Blog

Our news and views relating to Data Analytics, Big Data, Machine Learning, and the world of Credit.

All Posts

Maladies And Misadventures Of A Marketing Analyst

April 2, 2019 at 7:01 AM

For a while, we have been running a blog series on cognitive biases and logical fallacies that data scientists should avoid. In this final blog on the subject, we look at some of the other logical fallacies and how they might crop up in data analytics.

False Dichotomy

The false dichotomy is the assumption of a binary state when there is none.

Either the conclusion is X, or it is Y.

ying-yangIn many cases, there may be other conclusions that the analyst has not considered possible. I first came across an example of this assessing a marketing communication exercise with a retailer’s credit customers many years ago.  We split the population randomly into two groups “A” and “B”. To “A” we allocated vouchers (i.e. get R100 off when you spend more than R300); to “B” we allocated nothing (hold-out). 

We measured the results six months later and found no difference in spending. Our then conclusion was that customers were not attracted by the R100 discount offer. We assumed a binary scenario state (either they were or were not attracted by the offer). After subsequent analysis, however, we found that the retailer had forgotten to send out the vouchers to the customers. Our assumption of a binary scenario state was therefore flawed, and we had initially not considered a problem with the test itself. The lesson here is that the world has very few purely binary states and it is worth thinking more broadly about other scenarios.  

The Cobra Effect

mohan-moolepetlu-735364-unsplashWhen setting up tests in data science, occasionally one is faced by unintended consequences of the test (also known as the “Cobra Effect”). In the British colonial days in India, the British government was concerned about the number of venomous cobras in Delhi. They established a bounty for every dead cobra. While many killed cobras, some enterprising people began breeding cobras too. The British then scrapped the programme, and the bred cobras were set free causing a bigger problem than before.

This phenomenon is also occasionally seen in the marketing space. I have personally come across it in account management strategies where a retailer attempts to reactivate a dormant account (the account had no spend on it for six months) by offering them vouchers to start spending. This strategy led to many customers spending the voucher and then purposely going back to being dormant as they knew they would receive another voucher in a few months again – an unintended effect of a marketing strategy.

Personal Incredulity

This is a continuous matter of debate in data analytics. It deals with the matter of “explainability” in the data. If I can’t understand a trend should I trust it? The advice is to be sceptical, but also be prepared to trust unexplainable trends particularly if they are shown to be consistent in multiple data sets.

 

 

 

 

 

 

 

 

 

We have written more extensively about this is in our blog Automation And Machine Learning: How Much Is Too Much?

There are a host of other informal logical fallacies and cognitive biases some of which manifest themselves in data science.  If you’d like to read more, I’d like to recommend the following graphics here, here and here or you can scroll through Wikipedia who has excellent entries on each fallacy and bias.

Truthseeker - logical fallacies

Thomas Maydon
Thomas Maydon
Thomas Maydon is the Head of Credit Solutions at Principa. With over 13 years of experience in the Southern African, West African and Middle Eastern retail credit markets, Tom has primarily been involved in consulting, analytics, credit bureau and predictive modelling services. He has experience in all aspects of the credit life cycle (in multiple industries) including intelligent prospecting, originations, strategy simulation, affordability analysis, behavioural modelling, pricing analysis, collections processes, and provisions (including Basel II) and profitability calculations.

Latest Posts

A Roundup Of Our Top Debt Collection And Call Centre Blogs of 2019

It’s that time of the year again: our annual roundup of top blogs! As always, we’ll be posting a series of lists of our best performing, and not-to be missed blogs grouped into our favourite topics. We’re starting with the top blogs which focus on collections and call centre topics. So without further ado, here are our top five debt collection and call centre blogs of 2019:

The Top 4 Advantages That Your Collections System Should Be Giving You In 2020

The current credit environment can be characterised as one of intense competition for customers, with organisations often taking additional risk to grow credit portfolios. Consumers are becoming increasingly aware of their “value” and changing their expectations of how an organisation should treat them.   

Why A New Account Processing System Should Be A Priority For 2020

Recently Principa announced their partnership with UK-based Welcom Digital. Welcom Digital’s platform Financier is one of the leading account processing platforms. Principa is now the sales and delivery partner in South Africa for Financier. We speak to Principa’s Eric Hay – a technical specialist with over 25 years’ experience with credit systems include account processing systems – who has been now appointed technical delivery head for Financier.

  • 5 min read
  • November 11, 2019 at 2:59 PM