Importance of actionable insights in analytics (with case from ICC Cricket World Cup)

Kunal Jain 13 Apr, 2015 • 5 min read

Have you ever been to a meeting, where everyone in the room has good stats to share, but no one knows how to use them? I am sure, you have! Don’t worry, you are not alone and by end of this article, you will have some tips to make your analysis better.

In this article, I will challenge how analytics is being showcased during the cricket matches. While the display is a good way to evangelize use of analytics on grand scale, it is missing the very point it should be proving!

The message I want to leave through this article is far broader than just application to cricket. Example of cricket is being used only as a case study.

P.S. If you don’t follow cricket, you can still follow the article for the points I am trying to tell. Here is a beginner’s guide to Cricket

 

Example of insights shown during a cricket match:

Here is an example of what spectators glued to the screen would typically see at the start of the match:

  • Keys to success for Team A:
    • Team A wins 85% of matches when Player X scores more than 80 runs
    • If there are 2 partnerships of more than 50 runs, team A wins in 72% matches
    • Team A wins 70% matches, if bowler Y picks up 4 wickets

There will be similar set of so called “insights” for the second team as well. The analysts performing this analysis have also attached probabilities with each event!

Here is a live example, which was shown in a recent match (South Africa vs. New Zealand):

key_to_success

These look good and exciting! What is the problem with this? Can you spot problems with these so called keys to success?

 

The problem with current insights:

While these insights are good to see, they do not help the teams play better. Let me explain – an insight saying that team A wins 85% of matches when Player X scores more than 80 runs is useless to the team coach and the captain.

It is an insight, but not an actionable insight!

The team management would want analytics to do much more than just pulling out this insight and then praying that Player X has a good outing in every match!

The current insights provide no help to the team management to utilize this information.

If I was the analyst running this model – I would go further and say what is the best strategy to make sure Player X goes on to make a big score – Which position should he bat at? What kind of areas and which bowlers should he target? Which bowlers should he negotiate?

Let’s take another example – analysts have mapped out the strong zone and the weak zone for each batsman. You would think this is clearly actionable. The bowler just needs to ball in the right areas.

But it isn’t! Why? Strong zone and weak zone for a batsman would change from bowler to bowler, with different field settings and different whether conditions. It would also depend on the current form of both – the bowler and the batsman.

Other way to look at these insights is this – they have a lot of numbers and stats, but don’t really tell what they mean.

 

Ways to improve insights (in Cricket matches):

As shown already, the current level of analysis shown during cricket matches is rudimentary at best! There are tons of ways to improve this analysis. I’ll share a few high level thoughts, which, when implemented would surely provide better use of analytics:

  • Right level of granularity: Some of the insights shown in these matches are very high level in nature to be useful. The analyst who created the key to success in above case study has not done the analysis at the right level of granularity. For example, if you look at the keys to success for South Africa – the first point mentioned is that they should score more than 280 runs! Let’s look at the granularity here – all matches played outside Asia since 2011? Even a lay man would say that the pitches prepared for World Cup have favored batsman and 300 has been a par score, which is usually not the case. The analyst did not look at the right level of granularity to take into account the right nature of pitch.
  • Focus on creating actionable insights from user perspective: Like any other piece of analysis, the focus of the analysis has to be the end user. If the analysis is for team management, then we need to bring out insights to improve performance of the players. If it is the audience watching on the TV, then it has to answer the questions which would be going on in mind of the audience. For example, there can be widgets showing the probabilities of win for each team.
  • Additional features / variables should be considered: Sadly, in almost all these insights, there are a lot of features which are missing. For example: current form of the players, the way in which a batsman paces his innings are missing from the current analysis. Needless to say, the more feature we add, the more insightful and helpful the analysis would be.
  • What if scenarios and alternate strategies: Finally, in order to make this analysis more useful and fun, there could be displays of what-if scenarios. So, what do the analysts predict, if bowler X comes up to bowl vs. if bowler Y comes to bowl. Similarly for batting as well – how does the scenario likely to emerge if the captain decides to send player X instead of Y on fall of next wicket!

There are many more ways to improve, but this should hopefully help you to understand what I mean by actionable insights.

 

End Notes:

The idea behind this article was to bring out some ways in which you can improve your analysis and to show case them through a real life case study. I have learnt some of these practices the hard way over time, but you don’t need to do that! A single minded focus on yielding actionable insights for your users can completely change the way analytics can add value to them. On the other hand, a sketchy job can lead to wrong outcomes and mis-guided views. All the best for the next piece of analysis you do.

 

Disclaimer: I have shared some of the gaps on the analysis showcased to the audience during recent cricket matches. I am sure individual teams in the tournament would be taking help of analysts for more sophisticated analysis. I do not have access to that analysis and hence do not know, how many of the shortcomings mentioned here get covered through those pieces of analytics.

 

If you like what you just read & want to continue your analytics learning, subscribe to our emailsfollow us on twitter or like our facebook page.

Kunal Jain 13 Apr 2015

Kunal is a post graduate from IIT Bombay in Aerospace Engineering. He has spent more than 10 years in field of Data Science. His work experience ranges from mature markets like UK to a developing market like India. During this period he has lead teams of various sizes and has worked on various tools like SAS, SPSS, Qlikview, R, Python and Matlab.

Frequently Asked Questions

Lorem ipsum dolor sit amet, consectetur adipiscing elit,

Responses From Readers

Clear

Sriram
Sriram 25 Mar, 2015

Your disclaimer sums it up very well. While the audience analysis needs no grain et all, I am sure there are many analysts and analytic tool helping support staff to help the playing eleven!

Philip
Philip 25 Mar, 2015

Dear Kunal I agree with your sentiment about the statistics shared with the audience. It is interesting how these figures are both non-informative and skewed. A while ago, I had a conversation with a data analyst who was involved in sports analytics. He indicated to me that they do indeed evaluate batting/bowling partnerships and a selection of appropriately granular statistics. Moreover, they all purchase data from [optasports], which collects every imaginable detail. This is where the delivery pitch maps etc. come from. I believe that their "Keys to success" statements, albeit useless, is a valuable addition for audiences, but it may also be likely that these are geared for easy viewer access, in that it is simple and easy to understand. Since they do however have access to more granular data, it is unforgivable for them not to be doing a better job ad sharing these insights with the public. I do not have access to the appropriate level of information, nor could I at fist glance get an idea about the pricing associated but I did manage some statistics that spoke more accurately about the probabilities of the outcome of that particular match. For example, batting averages, number of hundreds, number of fifties, number of 30s etc., over the last 18 month for the likely teams (in terms of player line-up) that were to take the field. Also the average per innings score of each team, batting second, batting first. I did not however group by location (pitches), but you could normalise over all batsmen to get and indication of individual form. I also looked at bowler averages, strike rate, total wickets (experience) and so forth. South Africa scored 30 100s, 43 50s to NZ's 16 and 34 respectively prior to yesterday's game for example, which tells a the tell of our batsmen heavy line-up, and similarly our bowling economy over the last 18 months, taking into account the 12 or so likely players, was over 5 where, NZ's was under 5. Our bowling strike rate and average however was better. Considering how the match played out, with the match reduced to 43 overs, the statistic (Economy) that proved fatal relates to our inability to defend a total because of poor(ish) bowling economy. Given the data available, is was obvious that NZ's in form bowling line-up would be pinned against our in from batting line-up. This coupled with their hot/cold batting line-up and our leaky bowling attack saw the game play out almost exactly like that, in particular because of the rain, a black swan event. My stats seemed to suggest that SA might have the upper hand assuming a 50 over game, and I think it's likely, given the circumstances at 37 overs into the first innings. SA should have been wearing the favourites tag going into the change of innings, had the rain stayed away. Regards, Philip

prahlad
prahlad 26 Mar, 2015

hello kunal, Excellent article. Opta is a sports analytics company and icc have outsourced it to them . I wonder how they went wrong in cricket but, they do provide good stats in football.

Sriram Ranga
Sriram Ranga 01 Apr, 2015

While I agree with some of the improvement suggestions, I think this is probably the first time anything of this sort is analyzed and displayed to the viewers, however rudimentary it is. Yeah, it is no great shakes at this point and its probably in its Alpha version, which I am sure will evolve into a more meaningful add-on to the matches in the near future. Let us give the benefit of doubt to the team who is behind this and hope that more richer analysis & insights come out for an avid viewer to make some sense out of it. Lastly, I hate over-engineering and over-analyzing an art/skill as we might end-up enjoying the art/skill as much as we do today:)

Machine Learning
Become a full stack data scientist