The Data Analytics Blog

Our news and views relating to Data Analytics, Big Data, Machine Learning, and the world of Credit.

All Posts

All You Need To Know About Randomisation In The Credit Lifecycle

February 2, 2017 at 4:48 PM

If you’re involved in credit risk and existing customer marketing you’ll know that random numbers are frequently used when deploying different strategies.  As strategies grow more complex and numerous, so the role of the random number grows more important.  In this blog post, I’ll cover what randomisation is, why you should do it, when you should do it and what else to consider.

In credit and existing customer marketing, a critical component in deploying a new strategy is ensuring that results can be clearly measured against a previous strategy. This is done through a scientific test-and-learn process known as champion / challenger testing.  Here one random population receives one action (champion) and another random population receives another (typically new) action (challenger).  The process is similar to how pharmaceuticals test new drugs known as “randomised double-blinded placebo-controlled” trials.

A key principal in champion / challenger testing is to ensure that when one is comparing two strategies, one is comparing like-versus-like.  That means the two populations should look very similar.  We ensure this through a process of randomly allocating the population to two different groups (“randomisation”)

Typical examples of Champion / Challenger strategies across the credit life-cycle include:

  • Originations: New scorecards and policy rules, sensitivity to interest-rates, lower / higher, loan / limit amounts, automated / manual decisions.
  • Account Management: Credit-limit increase / decreases, authorisations, card re-pricing, and pre-delinquency.
  • Marketing: Testing cross-sell / up-sell and targeted campaigns, and testing channels.
  • Collections: Testing different account prioritisations, settlement optimisation, right-time-to-call, and agency-allocation.

In complex environments, such as account management where multiple tests are required, the use of more than one random number is becoming crucial.  As strategies get more complex (for example through deploying mathematical optimisation where many combinations of strategies might be tested), so the need for champion / challenger testing grows.

How is randomisation done in originations?

In originations we don’t know what type of application we will get when, so typically random numbers are allocated sequentially or through the use of a random-number generator. These random numbers are normally integers between 00 and 99. 

Multiple random numbers might be allocated if multiple originations tests are required. If multiple random numbers are allocated a more complex system is required (see below). 

How is randomisation done in other decision areas (or complex originations)?

In account management the process is different.  A new account entering the account processor for the first time will be allocated a random number or multiple random numbers.  For “multiple random numbers” the numbers also need to be independent in relation to each other.  For this, a random number generator is used. This generator produces sets of two, three or four numbers that are independent to each other and also, as each set is allocated to accounts, they result in each number having a random distribution between 00 and 99.  Principa has built such a system for clients to produce up to four random numbers to be deployed in a COBOL, JAVA or .Net environment. 

Ensuring randomisation remains effective: Re-randomising your book

Once random numbers are issued on an existing book, over time one finds that the random groups lose their “smoothness”.  If, for example, one uses one set of Random Digit Groups, or RDGs, for a conservative strategy of limit increases and another set for an aggressive strategy, over time the second group will likely end up with higher average balances and limits than the first group.  This would mean that any new champion/ challenger tests could break the like-versus-like rule and therefore not be “true” tests. Re-randomisation is therefore important - ideally it should be an annual event, but one should always be aware of any additional tests that might be currently running.  It should ideally be run at the end of a test-and-learn process when the new champions are “crowned” – i.e. the results of the tests are measured and a new strategy is adopted.

How do you re-randomise?

Re-randomising is an iterative process that involves the following key steps:

1. Understand your testing environment

  • What tests are being planned over which decision areas?
  • How many random numbers can the account management system support?
  • Can the reporting identify champion/challenger groups?
  • How many random numbers will need to be produced based on answers to the above? 

 2 Identify your exclusions

Certain accounts you may wish to exclude from tests, particularly if they are treated or have been treated differently, for example:
  • Staff accounts
  • VIPs
  • Accounts with unusually high limits or balances (these will skew the smoothing process)

3. Extract the full book to be re-randomised

4. Allocate random numbers to entire book

(These numbers need to be independently random from each other)

5. Test each random group across each key metric to ensure smoothness (see box below)

6. Either:

  • If distributions are uneven, then go back to step 4
  • If distributions are “smooth” then upload new random digits to accounts in the host (account processing) system

Steps 4 - 6 can take some time, but the process is important.

Typical examples of Champion / Challenger strategies across the credit life-cycle include:

  • Similar number of accounts in each Random Digit Group (RDG),
  • Similar distribution of limits, balances, delinquent accounts, over-limit accounts , utilisation%, dormant accounts across RDGs,
  • For marketing communications – checking customer cluster distribution would also be critical, and
  • Similar distributions across each combination of RDGs.

With a fully randomised (“smoothed”) population, credit and marketing analysts can have confidence that running tests using the RDGs will produce true tests.  Randomisation is an important process to understand the best actions to take for the most profitable decisions.

Principa’s key randomisation services include.

  • Random number generators,
  • The set-up of a random allocation scheme, and
  • Re-randomisation.

To find out how Principa can help with your randomisation needs get in touch for a chat!

contact us

Image credit: Shutterstock

Thomas Maydon
Thomas Maydon
Thomas Maydon is the Head of Credit Solutions at Principa. With over 13 years of experience in the Southern African, West African and Middle Eastern retail credit markets, Tom has primarily been involved in consulting, analytics, credit bureau and predictive modelling services. He has experience in all aspects of the credit life cycle (in multiple industries) including intelligent prospecting, originations, strategy simulation, affordability analysis, behavioural modelling, pricing analysis, collections processes, and provisions (including Basel II) and profitability calculations.

Latest Posts

[Slideshare] How To Make Your Business Data Work For You

Common barriers to success: Skills shortage: data scientists are in high demand and in low supply. Companies lack the skills to develop advanced data analytics or machine learning applications. Cost: recruiting and building up or training a team, as well as infrastructure costs are immense. Inefficiency and low ROI on: acquisition campaigns; re-activation and retention campaigns; outbound sales calls and debt collection. Resulting in: No or ineffective use of data. High cost to get insights from data. Low returns from campaigns. What’s the alternative? Machine Learning as a Service (MLaaS): removes infrastructure skills and requirements for machine learning, allowing you to begin benefiting from machine learning quickly with little investment. Subscription based pricing, allowing you to benefit using machine learning while minimising your set-up costs and seeing returns sooner. Answers as a Service: Use historic data and machine learning to allow answers to increase in accuracy with time. MLaaS with predictive models pre-developed to answers specific questions: Genius Call Connect: What is the best time and number to call customers? Genius Customer Growth: Which customers are most likely to respond to cross-sell? Genius Re-activation: Which dormant customers are worth re-activating? Genius Customer Retention: Which customers are most likely to churn? Genius Leads: Which contacts are likely to respond to my campaign? Genius Risk Classifier: Which debtors are most likely to pay or roll? Benefits of Genius: Quick and cost-effective ability to leverage machine learning: Minimal set-up time Minimal involvement from IT Subscription based service Looking to make your data work for your business? Read more on Genius to see how it can help your business succeed. 

5 Must-Join Facebook Pages For Data Science, Machine Learning And Artificial Intelligence In 2019

While LinkedIn has traditionally been thought of as the business or work focussed social platform, Facebook has been making headway into gaining market share in the space as well. With company pages and groups, Facebook is catering to every interest and aspiration that people might have – and combining that with their social interactions and news sources. Facebook aims to give users a one-stop-shop experience, and it’s very good at doing it.

Our 2018 Customer Acquisition And Engagement Blog Roundup

Our final roundup this year covers two of our main topics: customer acquisition and customer engagement. We’ve not covered these topics in depth this year, and so decided to combine these two to provide a roundup of the best of both.