Sep 02 2014

Mining YouTube using Python & performing social media analysis

google ALS searches

If you are someone like me, you would have been swamped by the constant feed of people pouring ice buckets over them – but you still watch that next video in the feed, just to see how the person reacted to the icy shock! Yes! you are right – I am talking about the ALS …

Continue reading »

Aug 27 2014

Understanding and analyzing the hidden structures of unstructured dataset


The key to using unstructured data set is to identify the hidden structures in the data set. This enables us to convert it to a structured and more usable format.In previous article (previous article on text mining ) we discussed the framework to use unstructured data set in predictive or descriptive modelling. In this article we …

Continue reading »

Aug 26 2014

How to use QVDs (QlikView Data files) to make your Qlikview application efficient?


In June 2013, I had been using QlikView for about a year. During those days, I was working on a QlikView project where I had to show the sales number across various channels for various periods (e.g. Daily, Monthly, Yearly) and in comparison with last year. I had two transactional tables, three mapping tables (available …

Continue reading »

Aug 25 2014

How to use big data to profit from the stock market?


I have to admit I am avid believer that everyone should invest in the stock market. We are in the age of online discount brokerages and super fast connections for both wireless and wired. Combine that with companies taking away pension plans and allowing employees to manage 401K’s and more people working a contract basis …

Continue reading »

Aug 19 2014

Step by step guide to extract insights from free text (unstructured data)


Text Mining is one of the most complex analysis in the industry of analytics. The reason for this is that, while doing text mining, we deal with unstructured data. We do not have clearly defined observation and variables (rows and columns). Hence, for doing any kind of analytics, you need to first convert this unstructured …

Continue reading »

Aug 18 2014

Market mix modeling – Simplified!

deepak rk

US market spends on an average more than $140 Billion on just marketing every year. Provided that marketing is such an important component of the total expense by every company, it is very essential to know the actual benefit from these marketing campaign. But today, marketing is not done using a single channel. Every company …

Continue reading »

Aug 14 2014

Bring it on! Analytics Vidhya Author identification challenge


What is the best form of analytics learning? Applying it to practical problems! This is exactly what led us to create this interesting problem, solving which would be a lot of fun! The challenge should be a good combo of basic text mining and predictive modeling. If you haven’t got your hands dirty learning these …

Continue reading »

Aug 13 2014

How Big data & Analytics can help Government agencies run better?

shiva baba

Over the past decade or so, analytics has undergone a rapid transformation. During its initial stages, analytics was used more as a reactionary measure i.e., to observe the business trends of the past. So, there was a significant time lapse between the pain points and the corresponding course correction. But over the years, analytics bridged …

Continue reading »

Aug 12 2014

Baby steps in Python – Exploratory analysis in Python (using Pandas)


In the last 2 posts of this series, we looked at how to install Python with iPython interface and several useful libraries and data structures, which are available in Python. If you have not gone through these posts and are new to Python, I would recommend that you go through the previous posts before going …

Continue reading »

Aug 08 2014

Training review – A Big Data Course with a ‘Big’ Difference from Jigsaw Academy

bk image 1

Big Data has emerged as one of the fastest growing fields in recent times and every business is looking to leverage Big Data to get ahead of the competition. It’s thus not surprising that the demand for skilled Big Data professionals is huge and far exceeds the current supply. So much so, that those with …

Continue reading »

Aug 07 2014

Visualizing product relationships in a market Basket analysis


Last week had been very hectic. I had slogged more than 100 hours to come out with an awesome recommender based on market basket analysis. “Now was the time to shine!” I thought, just before the meeting with stakeholders was about to start. I had prepared a good presentation and was feeling confident about the …

Continue reading »

Aug 04 2014

Effective Cross Selling using Market Basket Analysis

Have you come across a hair-dresser in the saloon offering you to undergo a head massage or a hair coloring when you go for your hair-cut? How many times have you seen a more relevant product being recommended and offered at a discounted price when you make a checkout in an online store? It’s almost …

Continue reading »

Jul 30 2014

How to interpret hidden state in Latent Markov Model

Markov chain

In some of my previous articles, I have illustrated how Markov model can be used in real life forecasting problems. As described in these articles, Simple Markov model cannot be used for customer level predictions, because it does not take into account any covariates for predictions. Latent Markov model is a modified version of the …

Continue reading »

Jul 27 2014

Review: Qlik Sense Desktop – Is this the next gen visualization tool you need?

Qlik Sense_image1

QlikTech recently announced a free version of its next-generation data visualization application – Qlik Sense. According to QlikTech, the product delivers a simple drag-and-drop interface for business users to rapidly create interactive visualizations, reports, and dashboards.  If you have been following QlikTech, Qlik Sense Desktop is the first commercially available release from the much talked about …

Continue reading »

Jul 23 2014

Solve a business case using simple Markov Chain


Markov process fits into many real life scenarios. Any sequence of event that can be approximated by Markov chain assumption, can be predicted using Markov chain algorithm. In the last article, we explained What is a Markov chain and how can we represent it graphically or using Matrices. In this article, we will go a …

Continue reading »

Older posts «