Here comes a year full of knowledge & learning!

Alvin Stroyny says:

The biggest problem I have had is access to realistic data. I would like to see a repository of “scan data”, mfg rep sales data, etc., and other types of data sets for analysis and feedback from other Data Analysts on how they approached the problem. It is extremely difficult to get good realistic data as companies jealously guard their data and trade secrets.

Sagar jaju says:

I am totally new in analytics but i got almost 10 years of experince in stock market,i want to build some stock price prediction model can we do that

Jigar says:

Hi Kunal,

Wish you and your team a very happy new year. All around the web we only find analysis on small sample of available datasets.
It would be a great idea for a section on analyzing extremely large datasets (million records strong). I have learned that a completely different approach is required with such large datasets, as you not only focus on the algorithm, but also on the data, speed and efficiency of the algorithm used. I am looking around for more guidance on the subject, and would appreciate if AV could do a series on this.

Regards,
Jigar

Gianfranco says:

Hello Kunar,

First of all thanks to you and your friends for this usefull site. I wish you a great 2016.

In my experience is one of a kind, and you and Andrew Ng (I’m quite sure you heard of him) are my personal heroes. So a deep thanks to you and Andrew for sharing your deep knowledge.

My personal barrier to learn is to find someone giving me credits enough to work for him on real task. I tried also to offer my services for free, but I was unlucky.

So my target for next year is to read all your articles, and try to participate in a competition, hardening myself until I will find a job in this industry.

Gianfranco from Italy wishes to all friends here a very good 2016 !

Hector Vega says:

Happy new year 2016!

The best wishes for everybody.

I would like to read more about multivariate data analysis, specific for QlikView.

Thank you

Hv

Hossam says:

You are really doing a good job, now I recommend to start guiding members toward main certificates in big data and build skills matrix for big data to help employers.

I think certificate section may be a good addition to your web site and build a window for those who got these certificates to tell us about their experience before and after getting it.

Trinadh says:

Hi Kunal,

Your articles on Analytics are always informative and helpful. Above all your committment to help fellow Data Analysts and Data Scientists is amazing. We always look forward to what comes from you. Keep the good work going and we wish you a wonderful New Year 2016.

Really appreciate if you could clarify the following questions.

Q1) What tools do you suggest for text mining preferbly any tools that require no or little scripting?

Q2) I am working on a project where we have 600,000 plus records in MySql database table. I need to search for a string of two words in the column2 (long text). Then pick 8 character numeric that follows the two word search string and insert both 8 character numeric from column2 and ID from column1 into a separate table..Please suggest what is the best fit tool for this requirement? If you have any code snippet please share.

Thank you as always,
Trinadh