Learn everything about Analytics

Must Read Books for Beginners on Machine Learning and Artificial Intelligence

This article was originally published on October 25, 2015, and updated on October 17, 2018.

Introduction

Machine Learning has granted incredible power to humans. The power to run tasks in an automated manner, the power to make our lives comfortable, the power to improve things continuously by studying decisions at a large scale, and the power to create species who think better than humans. This list can go on and on.

Still sceptical about AI and ML? Read what Google’s CEO Mr. Sundar Pichai had to say all the way back in 2015:

‘Machine learning is a core, transformative way by which we’re rethinking everything we’re doing. We’re thoughtfully applying it across all our products, be it search, ads, YouTube, or Play. We’re in the early days, but you’ll see us in a systematic way think about how we can apply machine learning to all these areas.’

– Sundar Pichai, CEO, Google

Must read books on machine learning and artificial intelligence

Those who know of these advancements are keen to master this concept, including us at Analytics Vidhya. When we started with this mission, we found various forms of digitized study material. They seemed promising and comprehensive, yet lacked a perspective. Our curiosity didn’t let us rest for long and we resorted to books.

When Elon Musk, one of the busiest men on the planet, was asked about his secret of success, he replied, ‘I used to read books. A LOT’. Later, Kimbal Musk, Elon’s brother, said, ‘He would even complete two books in a day’.

In this article, we’ve listed some of the must-read books on Machine Learning and Artificial Intelligence. These books are in no particular rank or order. The motive of this article is not to promote any particular book, but to make you aware of a world which exists beyond video tutorials, blogs and podcasts.

I encourage you to check out these 10 Free E-books on Machine Learning as well which are a great starting point (or a refresher) for anyone in this field.

 

Machine Learning

Machine Learning Yearning

We had to start with a book by the great Andrew Ng. It is still a work in progress, but several chapters have been released and can be downloaded FOR FREE today.

This book will help the reader get up to speed with building AI systems. It will effectively teach you how to make the various decisions required with organizing a machine learning project. There’s no better person to start off this list, in our opinion.

You can sign up on the site to receive updates as soon as a new chapter is released.

 

Programming Collective Intelligence

1

Programming Collective Intelligence, PCI as it is popularly known, is one of the best books to start learning machine learning. If there is one book to choose on machine learning – it is this one. I haven’t met a data scientist yet who has read this book and does not recommend to keep it on your bookshelf. A lot of them have re-read this book multiple times.

The book was written long before data science and machine learning acquired the cult status they have today – but the topics and chapters are entirely relevant even today! Some of the topics covered in the book are collaborative filtering techniques, search engine features, Bayesian filtering and Support vector machines. If you don’t have a copy of this book – order it as soon as you finish reading this article! The book uses Python to deliver machine learning in a fascinating manner.

 

Machine Learning for Hackers

2

 

This book is written by Drew Conway and John Myles White. It is majorly based on data analysis in R. This book is best suited for beginners having a basic knowledge and grasp of R. It covers the use of advanced R in data wrangling. It has interesting case studies which will help you to understand the importance of using machine learning algorithms.

 

 

 

Machine Learning by Tom M Mitchell

3

 

After you’ve read the above books, you are good to dive into the world of machine learning. And this is a great introductory book to start your journey. It provides a nice overview of ML theorems with pseudocode summaries of their algorithms. Apart from case studies, Tom has used basic examples to help you understand these algorithms easily.

Most of the experts you ask in this field never fail to mention this book which helped them at the start of their careers. It’s such a well-written and explained book that we feel it should be made mandatory in every machine learning course!

 

 

The Elements of Statistical Learning

4

 

This is quite a popular book. It was written by Trevor Hastie, Robert Tibshirani and Jerome Friedman. This book aptly explains various machine learning algorithms mathematically from a statistical perspective. It provides a powerful world created by statistics and machine learning. This books lays emphasis on mathematical derivations to define the underlying logic behind an algorithm. Keep in mind that you need to have a rudimentary understanding of linear algebra before picking this up.

There’s a beginner friendly version of these concepts in a book by some of the same authors, called ‘Introduction to Statistical Learning’. Make sure you check that out if this one is too complex for you right now.

Free PDF Link: Download

 

Learning from Data

5

 

This book is written by Yaser Abu Mostafa, Malik Magdon-Ismail and Hsuan-Tien Lin. It provides a perfect introduction to machine learning. This book prepares you to understand complex areas of machine learning. Yaser, a very popular and brilliant professor, has provided ‘to the point’ explanations instead of lengthy and go-around explanations. If you choose this book, I’d suggest you to refer to online tutorials of Yaser Abu Mostafa as well. They’re awesome.

Free PDF Link: Download

 

 

Pattern Recognition and Machine Learning

6

 

This book is written by Christopher M Bishop. This book serves as a excellent reference for students keen to understand the use of statistical techniques in machine learning and pattern recognition. This books assumes the knowledge of linear algebra and multivariate calculus. It provides a comprehensive introduction to statistical pattern recognition techniques using practice exercises.

Free PDF Link: Download

 

 

Natural Language Processing with Python

 

Folks interested in getting into Natural Language Processing (NLP) should read this book. It’s written in a lucid and clear manner with extremely well-presented codes in Python. Readers are given access to well-annotated datasets to analyse and deal with unstructured data, linguistic structure in text, among other NLP things.

The authors of this book are Steven Bird, Ewan Klein, and Edward Loper. A ML superteam!

 

 

Artificial Intelligence

Artificial Intelligence: A Modern Approach

11Who better to learn AI from than the great Peter Norvig? You have to take a course from Norvig to understand his style of teaching. But once you do, you will remember it for a long, long time.

This book is written by Stuart Russell and Peter Norvig. It is best suited for people new to A.I. More than just providing an overview of artificial intelligence, this book thoroughly covers subjects from search algorithms and reducing problems to search problems, working with logic, planning, and more advanced topics in AI, such as reasoning with partial observability, machine learning and language processing. Make it the first book on A.I in your book shelf.

Free PDF Link: Download

 

Artificial Intelligence for Humans

12

 

This book is written by Jeff Heaton. It teaches basic artificial intelligence algorithms such as dimensionality, distance metrics, clustering, error calculation, hill climbing, Nelder Mead, and linear regression. It explains these algorithms using interesting examples and cases. Needless to say, this book requires good commands over mathematics. Otherwise, you’ll have tough time deciphering the equations.

 

 

Paradigm of Artificial Intelligence Programming

13

 

Another one by Peter Norvig!

This book teaches advanced common lisp techniques to build major A.I systems. It delves deep into the practical aspects of A.I and teaches its readers the method to build and debug robust practical programs. It also demonstrates superior programming style and essential AI concepts. I’d recommend reading this book, if you are serious about a career in A.I specially.

 

 

Artificial Intelligence: A New Synthesis

14

 

This book is written by Nils J Nilsson. After reading the above 3 books, you’d like something which could challenge your mind. Here’s what you are looking for. This books covers topics such as Neural networks, genetic programming, computer vision, heuristic search, knowledge representation and reasoning, Bayes networks and explains them with great ease. I wouldn’t recommend this book for a beginner. However, it’s a must read for advanced level user.

 

 

 

Machine Learning Yearning

Nick Bostrom has authored (or co-authored) over 200 publications, including this book called Superintelligence. Most of the world is enthralled and captivated by what AI can do and it’s potential to change the world.

But how many of us stop to think about how AI will affect our society? Are we considering the human aspect at all when building AI products and services? If not, we really should. In this thought-provoking book, Nick Bostrom lays down a future scenario where machines reach the superintelligent stage and deliberately or accidentally lead to the extinction of humans.

This might sound like a sci-fi movie plot, but the way Mr. Bostrom has laid down his arguments and the thinking behind them will definitely sway you and make you take him seriously. We consider this a must-read for everyone working in the AI space.

 

The Singularity is Near

 

Similar to the above idea propounded by Nick Bostrom, Ray Kurzweil’s ‘Singularity is Near’ delves into the thick depths of superintelligent machines. It is a slightly long read, but well worth it in the end. The way Mr. Ray has described the Singularity is breathtaking and will make you stop in your tracks.

Singularity, as  Ray Kurzweil has described it, is the point where humans and the intelligence of machines will merge. Once this happens, machines will be far more intelligent than all of the human species combined. It’s NOT science fiction but a truly poignant description of what might happen in the future if we aren’t careful with what and how we work with AI.

 

Life 3.0 – Being Human in the Age of Artificial Intelligence

 

When Stephan Hawking endorses a book, one sits up and listens. This book by Max Tegmark is an international bestseller and deals with the topic of superintelligence.

Some of the basic questions this book asks (and answers) are (taken from Amazon’s summary): How can we grow our prosperity through automation, without leaving people lacking income or purpose? How can we ensure that future AI systems do what we want without crashing, malfunctioning or getting hacked? Should we fear an arms race in lethal autonomous weapons? Will AI help life flourish as never before, or will machines eventually outsmart us at all tasks, and even, perhaps, replace us altogether?

 

The Master Algorithm

 

This is one of our favorite books in this list. Can there be just one algorithm that deals with all the aspects of technology? Instead of building AI products for specific functions, can we build one single algorithm for all functions? This thought is quite similar to what Albert Einstein spent the latter years of his life trying to discover.

Pedro Domingos is a masterful writer, and he deals with the intricacies of his subject extremely well. Make sure you add this to your reading list!

 

Disclosure: The Amazon links in this article are affiliate links. If you buy a book through this link, we would get paid through Amazon. This is one of the ways for us to cover our costs while we continue to create these awesome articles. Further, the list reflects our recommendation based on content of book and is no way influenced by the commission.

 

End Notes

This is just the tip of the iceberg. Books are a wonderful source of knowledge for anyone willing to learn from them. This collection spans various aspects of AI and ML – from the mathematics and statistics side to the intangible factors like ethics and impact of society. All of these should be considered together when working on an AI and ML project.

Having said that, there is truly no substitute for experience. Once you’ve devoured all these books can provide, always apply your learning to real-world problems and challenges. And as always, if you have any questions or suggestions for us on this article, feel free to share them in the comments section below. We look forward to connecting with you!

You can also read this article on Analytics Vidhya's Android APP Get it on Google Play

31 Comments

  • Arun Sundar S says:

    Really good. It would be great if the pdf links are shared..

  • DK Samuel says:

    Please paste the link of some of their legal pdf’s uploaded by their authors.

  • GRT says:

    Please mail me the links of the pdfs of these books and any other data science related books materials which you have.
    It would be great and a treasure house if these are uploaded in a drive and granted access.

    • Analytics Vidhya Content Team says:

      Loved your suggestion. I’m working on it. I’ll share the link as soon as pdf links are compiled.

  • Navneeth says:

    I second DK Samuel’s comment. A reputed site like AV should be sharing only those (free) PDFs which are made available by the authors or publishers (e.g. ESL by Hastie et al.).

  • Henderake says:

    Great article! By the way, there are actually 3 authors for Learning from Data, not only Prof. Yaser Abu Mostafa. You forgot to mention the other 2 authors.

    • Analytics Vidhya Content Team says:

      I missed them! My Bad. Thank you so much for highlighting this error, I would have never known otherwise. Appreciate it.
      Added now.

  • Trinadh says:

    Quite helpful information on Machine Learning. Do share the links to PDFs.

  • ezequielm says:

    Hi. Thanks for this useful post, especially for beginers. It’ll be great if you can share those pdfs.

  • Ishan says:

    Quite fascinating list, please share the links for legal pdf’s uploaded by their authors.. And would it be possible to compile the list of books on Business/Data Analytics.

  • Deniz Appelbaum says:

    Thanks for this great list! Could you share the pdfs please?

  • Pankesh says:

    I think some of the more honourable mentions are Kevin Murphy’s Machine Learning, Pattern Classification by Duda, Hart, et, al and Hal Daume’s A course in Machine learning.

  • Analytics Vidhya Content Team says:

    Hello all,

    I have added the pdf download links below their respective books in this article. Keep Learning Machine Learning and AI. 🙂

  • SZ says:

    I’d recommend “An Introduction to Statistical Learning with Applications in R” by James, Witten, Hastie, Tibshirani before “The Elements of Statistical Learning.” I wouldn’t consider the latter an intro book.

  • Deepak Gupta says:

    What do you think about Applied Predictive Modeling?

  • Robin White says:

    After you study machine learning by yourself by reading book, you might need to study some practical exercises to be better. I would recommend to take the machine leaning courses that I took, because it covered almost everything that I wanted. http://www.thedevmasters.com/machine-learning-in-python/

  • Ramkumar says:

    One great ML book that is not in your list: ML A probabilistic perspective by Kevin P Murphy

  • Biswajit Samal says:

    I am beginners with the basic knowledge on python and want to work more on ML.

    I do not know the right direction. Please share me ur thoughts as a beginners

  • adarsh kumar says:

    Python Machine Learning by Sebastian Raschka

  • Animesh says:

    This are the indeed the best resource for machine learning. A well structured article which clearly explains the relevance of each book.

  • MOONK says:

    Boy, this site is serious about giving people information. Good going boys. Cheers.

  • Parag Pradhan says:

    Artificial Intellgience by Prof. Henry Winston is simply awesome. Some of its content needs upgrade but none the less a must for all having competency in AI at any level. The topics covering Semantic representation of networks will expand thinking of a reader.

  • ANANTHA KOMANDURI says:

    The download links for most of them are not working. Can you kindly share. Thanks

  • Vivekananda says:

    Can you provide the link

  • java says:

    Good expalination.
    As everyone is tending towards artifical intelligence as cday by day new technologies are inventing so you have to be upadate to make your stand in market.
    Thanks for sharing

%d bloggers like this:
Join 150000+ Data Scientists in our Community

Receive awesome tips, guides, infographics and become expert at:




 P.S. We only publish awesome content. We will never share your information with anyone.

Subscribe!
%d bloggers like this:
Join 150000+ Data Scientists in our Community

Receive awesome tips, guides, infographics and become expert at:




 P.S. We only publish awesome content. We will never share your information with anyone.

Subscribe!