Have you ever been to a meeting, where everyone in the room has good stats to share, but no one knows how to use them? I am sure, you have! Don’t worry, you are not alone and by end of this article, you will have some tips to make your analysis better.
In this article, I will challenge how analytics is being showcased during the cricket matches. While the display is a good way to evangelize use of analytics on grand scale, it is missing the very point it should be proving!
The message I want to leave through this article is far broader than just application to cricket. Example of cricket is being used only as a case study.
P.S. If you don’t follow cricket, you can still follow the article for the points I am trying to tell. Here is a beginner’s guide to Cricket.
Here is an example of what spectators glued to the screen would typically see at the start of the match:
There will be similar set of so called “insights” for the second team as well. The analysts performing this analysis have also attached probabilities with each event!
Here is a live example, which was shown in a recent match (South Africa vs. New Zealand):
These look good and exciting! What is the problem with this? Can you spot problems with these so called keys to success?
While these insights are good to see, they do not help the teams play better. Let me explain – an insight saying that team A wins 85% of matches when Player X scores more than 80 runs is useless to the team coach and the captain.
The team management would want analytics to do much more than just pulling out this insight and then praying that Player X has a good outing in every match!
If I was the analyst running this model – I would go further and say what is the best strategy to make sure Player X goes on to make a big score – Which position should he bat at? What kind of areas and which bowlers should he target? Which bowlers should he negotiate?
Let’s take another example – analysts have mapped out the strong zone and the weak zone for each batsman. You would think this is clearly actionable. The bowler just needs to ball in the right areas.
But it isn’t! Why? Strong zone and weak zone for a batsman would change from bowler to bowler, with different field settings and different whether conditions. It would also depend on the current form of both – the bowler and the batsman.
Other way to look at these insights is this – they have a lot of numbers and stats, but don’t really tell what they mean.
As shown already, the current level of analysis shown during cricket matches is rudimentary at best! There are tons of ways to improve this analysis. I’ll share a few high level thoughts, which, when implemented would surely provide better use of analytics:
There are many more ways to improve, but this should hopefully help you to understand what I mean by actionable insights.
The idea behind this article was to bring out some ways in which you can improve your analysis and to show case them through a real life case study. I have learnt some of these practices the hard way over time, but you don’t need to do that! A single minded focus on yielding actionable insights for your users can completely change the way analytics can add value to them. On the other hand, a sketchy job can lead to wrong outcomes and mis-guided views. All the best for the next piece of analysis you do.
Disclaimer: I have shared some of the gaps on the analysis showcased to the audience during recent cricket matches. I am sure individual teams in the tournament would be taking help of analysts for more sophisticated analysis. I do not have access to that analysis and hence do not know, how many of the shortcomings mentioned here get covered through those pieces of analytics.
Your disclaimer sums it up very well. While the audience analysis needs no grain et all, I am sure there are many analysts and analytic tool helping support staff to help the playing eleven!
Sriram, I have a different view there. The audience analysis in current form is mis-leading. If you think there is no need to show the analysis, the media should totally skip it. However, if they do show the analysis, than it better be good. For example, a score of 280+, giving South Africa a 85% chance of success is wrong insight. I would have thought the number to be 320+, and that is what it would come to, if you normalize it for scores in World Cup. Regards, Kunal
Dear Kunal I agree with your sentiment about the statistics shared with the audience. It is interesting how these figures are both non-informative and skewed. A while ago, I had a conversation with a data analyst who was involved in sports analytics. He indicated to me that they do indeed evaluate batting/bowling partnerships and a selection of appropriately granular statistics. Moreover, they all purchase data from [optasports], which collects every imaginable detail. This is where the delivery pitch maps etc. come from. I believe that their "Keys to success" statements, albeit useless, is a valuable addition for audiences, but it may also be likely that these are geared for easy viewer access, in that it is simple and easy to understand. Since they do however have access to more granular data, it is unforgivable for them not to be doing a better job ad sharing these insights with the public. I do not have access to the appropriate level of information, nor could I at fist glance get an idea about the pricing associated but I did manage some statistics that spoke more accurately about the probabilities of the outcome of that particular match. For example, batting averages, number of hundreds, number of fifties, number of 30s etc., over the last 18 month for the likely teams (in terms of player line-up) that were to take the field. Also the average per innings score of each team, batting second, batting first. I did not however group by location (pitches), but you could normalise over all batsmen to get and indication of individual form. I also looked at bowler averages, strike rate, total wickets (experience) and so forth. South Africa scored 30 100s, 43 50s to NZ's 16 and 34 respectively prior to yesterday's game for example, which tells a the tell of our batsmen heavy line-up, and similarly our bowling economy over the last 18 months, taking into account the 12 or so likely players, was over 5 where, NZ's was under 5. Our bowling strike rate and average however was better. Considering how the match played out, with the match reduced to 43 overs, the statistic (Economy) that proved fatal relates to our inability to defend a total because of poor(ish) bowling economy. Given the data available, is was obvious that NZ's in form bowling line-up would be pinned against our in from batting line-up. This coupled with their hot/cold batting line-up and our leaky bowling attack saw the game play out almost exactly like that, in particular because of the rain, a black swan event. My stats seemed to suggest that SA might have the upper hand assuming a 50 over game, and I think it's likely, given the circumstances at 37 overs into the first innings. SA should have been wearing the favourites tag going into the change of innings, had the rain stayed away. Regards, Philip
hello kunal, Excellent article. Opta is a sports analytics company and icc have outsourced it to them . I wonder how they went wrong in cricket but, they do provide good stats in football.
While I agree with some of the improvement suggestions, I think this is probably the first time anything of this sort is analyzed and displayed to the viewers, however rudimentary it is. Yeah, it is no great shakes at this point and its probably in its Alpha version, which I am sure will evolve into a more meaningful add-on to the matches in the near future. Let us give the benefit of doubt to the team who is behind this and hope that more richer analysis & insights come out for an avid viewer to make some sense out of it. Lastly, I hate over-engineering and over-analyzing an art/skill as we might end-up enjoying the art/skill as much as we do today:)