Interview Prep
Career
GenAI
Prompt Engg
ChatGPT
LLM
Langchain
RAG
AI Agents
Machine Learning
Deep Learning
GenAI Tools
LLMOps
Python
NLP
SQL
AIML Projects

Reading list

Machine Learning Basics for a Newbie
6 Steps of Machine learning LifecycleIntroduction to Predictive Modeling
Introduction to Exploratory Data Analysis & Data InsightsDescriptive StatisticsInferential StatisticsHow to Understand Population Distributions?
Reading Data Files into PythonDifferent Variable Datatypes
Probability for Data ScienceBasic Concepts of ProbabilityAxioms of ProbabilityConditional Probability
Central Tendencies for Continuous VariablesSpread of DataKDE plots for Continuous VariableOverview of Distribution for Continuous variablesNormal DistributionSkewed DistributionSkeweness and KurtosisDistribution for Continuous Variable
Central Tendencies for Categorical VariablesUnderstanding Discrete DistributionsPerforming EDA on Categorical Variables
Dealing with Missing ValuesUnderstanding OutliersIdentifying Outliers in DataOutlier Detection in PythonOutliers Detection Using IQR, Z-score, LOF and DBSCAN
Sample and PopulationCentral Limit TheoremConfidence Interval and Margin of Error
Bivariate Analysis Introduction
Tabular and Graphical methods for Continuous-Categorical VariablesIntroduction to Hypothesis TestingP-valueTwo sample Z-testT-testT-test vs Z-testPerforming Bivariate Analysis on Continuous-Catagorical variables
Chi-Squares TestBivariate Analysis on Categorical Categorical Variables
Multivariate AnalysisA Comprehensive Guide to Data ExplorationThe Data Science behind IPL
Supervised Learning vs Unsupervised LearningReinforcement LearningGenerative and Descriminative ModelsParametric and Non Parametric model
Machine Learning PipelinePreparing DatasetBuild a Benchmark Model: RegressionBuild a Benchmark Model: Classification
Evaluation Metrics for Machine Learning Everyone should knowConfusion MatrixAccuracyPrecision and RecallAUC-ROCLog LossR2 and Adjusted R2
Dealing with Missing ValuesReplacing Missing ValuesImputing Missing Values in DataWorking with Categorical VariablesWorking with OutliersPreprocessing Data for Model Building
Understanding Cost FunctionUnderstanding Gradient DescentMath Behind Gradient DescentAssumptions of Linear RegressionImplement Linear Regression from ScratchTrain Linear Regression in PythonImplementing Linear Regression in RDiagnosing Residual Plots in Linear Regression ModelsGeneralized Linear ModelsIntroduction to Logistic RegressionOdds RatioImplementing Logistic Regression from ScratchIntroduction to Scikit-learn in PythonTrain Logistic Regression in pythonMulticlass using Logistic RegressionHow to use Multinomial and Ordinal Logistic Regression in R ?Challenges with Linear RegressionIntroduction to RegularisationImplementing RegularisationRidge RegressionLasso Regression
Introduction to K Nearest NeighboursDetermining the Right Value of K in KNNImplement KNN from ScratchImplement KNN in Python
Bias Variance TradeoffIntroduction to Overfitting and UnderfittingVisualizing Overfitting and UnderfittingSelecting the Right ModelWhat is Validation?Hold-Out ValidationUnderstanding K Fold Cross Validation
Introduction to Feature SelectionFeature Selection AlgorithmsMissing Value RatioLow Variance FilterHigh Correlation FilterBackward Feature EliminationForward Feature SelectionImplement Feature Selection in PythonImplement Feature Selection in R
Introduction to Decision TreePurity in Decision TreeTerminologies Related to Decision TreeHow to Select Best Split Point in Decision Tree?Chi-SquaresInformation GainReduction in VarianceOptimizing Performance of Decision TreeTrain Decision Tree using Scikit LearnPruning of Decision Trees
Introduction to Feature EngineeringFeature TransformationFeature ScalingFeature EngineeringFrequency EncodingAutomated Feature Engineering: Feature Tools
Introduction to Naive BayesConditional Probability and Bayes TheoremIntroduction to Bayesian Adjustment Rating: The Incredible Concept Behind Online Ratings!Working of Naive BayesMath behind Naive BayesTypes of Naive BayesImplementation of Naive Bayes
Understanding how to solve Multiclass and Multilabled Classification ProblemEvaluation Metrics: Multi Class Classification
Introduction to Ensemble TechniquesBasic Ensemble TechniquesImplementing Basic Ensemble TechniquesFinding Optimal Weights of Ensemble Learner using Neural NetworkWhy Ensemble Models Work well?
Introduction to StackingImplementing StackingVariants of StackingImplementing Variants of StackingIntroduction to BlendingBootstrap SamplingIntroduction to Random SamplingHyper-parameters of Random ForestImplementing Random ForestOut-of-Bag (OOB) Score in the Random ForestIPL Team Win Prediction Project Using Machine LearningIntroduction to BoostingGradient Boosting AlgorithmMath behind GBMImplementing GBM in pythonRegularized Greedy ForestsExtreme Gradient BoostingImplementing XGBM in pythonTuning Hyperparameters of XGBoost in PythonImplement XGBM in R/H2OAdaptive BoostingImplementing Adaptive BoosingLightGBMImplementing LightGBM in PythonCatboostImplementing Catboost in Python
Different Hyperparameter Tuning methodsImplementing Different Hyperparameter Tuning methodsGridsearchCVRandomizedsearchCVBayesian Optimization for Hyperparameter TuningHyperopt
Understanding SVM AlgorithmSVM Kernels In-depth Intuition and Practical ImplementationSVM Kernel TricksKernels and Hyperparameters in SVMImplementing SVM from Scratch in Python and R
Introduction to Principal Component AnalysisSteps to Perform Principal Compound AnalysisComputation of Covariance MatrixFinding Eigenvectors and EigenvaluesImplementing PCA in pythonVisualizing PCAA Brief Introduction to Linear Discriminant AnalysisIntroduction to Factor Analysis
Introduction to ClusteringApplications of ClusteringEvaluation Metrics for ClusteringUnderstanding K-MeansImplementation of K-Means in PythonImplementation of K-Means in RChoosing Right Value for KProfiling Market Segments using K-Means ClusteringHierarchical ClusteringImplementation of Hierarchial ClusteringDBSCANDefining Similarity between clustersBuild Better and Accurate Clusters with Gaussian Mixture Models
Understand Basics of Recommendation Engine with Case Study
8 Ways to Improve Accuracy of Machine Learning Models
Introduction to DaskWorking with CuML
Introduction to Machine Learning InterpretabilityFramework and Interpretable Modelsmodel Agnostic Methods for InterpretabilityImplementing Interpretable ModelUnderstanding SHAPOut-of-Core MLIntroduction to Interpretable Machine Learning ModelsModel Agnostic Methods for InterpretabilityGame Theory & Shapley Values
Introduction to AutoMLImplementation of MLBoxIntroduction to PyCaretTPOTAuto-SklearnEvalML
Pickle and JoblibIntroduction to Model Deployment
Deploying Machine Learning Model using StreamlitDeploying ML Models in DockerDeploy Using StreamlitDeploy on HerokuDeploy Using NetlifyIntroduction to Amazon SagemakerSetting up Amazon SageMakerUsing SageMaker Endpoint to Generate InferenceDeploy on Microsoft Azure CloudIntroduction to Flask for ModelDeploying ML model using Flask
Model Deployment in AndroidModel Deployment in Iphone

Beginner’s Guide to Pearson Correlation Coefficient

Apurva
Apurva Last Updated : 24 Jan, 2025
5 min read

When we try to infer something from what we have heard or read, the first step we do is relate a few of the parameters or scenes, etc. with each other and then proceed. Correlation means to find out the association between the two variables and Correlation coefficients are used to find out how strong the is relationship between the two variables. The most popular correlation coefficient is Pearson’s Correlation Coefficient. It is very commonly used in linear regression.

This article was published as a part of the Data Science Blogathon.

Table of contents

What is Pearson’s Correlation Coefficient?

Pearson Correlation Coefficient (r), often denoted as r, measures the strength and direction of a linear relationship between two continuous variables. It ranges from -1 to 1, where:

Example of Pearson’s Correlation Coefficient

Consider the example of car price detection where we have to detect the price considering all the variables that affect the price of the car such as carlength, curbweight, carheight, carwidth, fueltype, carbody, horsepower, etc.

Correlation can be found out between continuous variables using python:

Pearson Correlation Coefficient plot check
Pearson Correlation Coefficient graph

We can see in the above scatterplot, as the carlength, curbweight, carwidth increases price of the car also increases. So, we can say that there is a positive correlation between the above three variables with car price. Here, we also see that there is no correlation between the carheight and car price.

Pearson Correlation Coefficient graph

Cars with high prices have very low mileage as compared to the low range of cars. Hence, in this case, we can say that there is a negative correlation between car price and mileage.

Values of Pearson Correlation Coefficient (r)

Value of ‘r’ ranges from ‘-1’ to ‘+1’. Value ‘0’ specifies that there is no relation between the two variables. A value greater than ‘0’ indicates a positive relationship between two variables where an increase in the value of one variable increases the value of another variable. Value less than ‘0’ indicates a negative relationship between two variables where an increase in the value of one decreases the value of another variable.

types of correlation

Pearson correlation draws a line of best fit through two variables, indicating the distance of data points from this line. A ‘r’ value near +1 or -1 implies all data points are close to the line. An ‘r’ value close to ‘0’ suggests data points are scattered around the line.

Considering the same example of the car price, let’s find out the ‘r’ value using ‘pearsonr’ function in python.

As stated earlier, the value of Pearson correlation for Price vs Curbweight is 0.835 and as there is no correlation between Price and Carheight, hence the Pearson Correlation value between Price & Carheight is near to 0 which is 0.12.

Assumptions for a Pearson Correlation

  1. Data must be from random or representative samples for meaningful statistical inferences.
  2. Both variables should be continuous and follow a normal distribution.
  3. Homoscedasticity is crucial, ensuring similar variance around the line of best fit.
  4. Extreme outliers, whether univariate or multivariate, impact the Pearson Correlation Coefficient (r). For instance, plotting age vs. loan amount reveals a correlation, but reversing the variables might yield inconclusive results. Consider these assumptions when interpreting correlations for robust analysis.
python code

Conclusion

Understanding Pearson’s Correlation Coefficient is foundational for anyone delving into statistics or data analysis. This guide has demystified the calculation and interpretation of r, offering insights into the strength and direction of linear relationships between variables. Armed with this knowledge, beginners can make informed decisions about data relationships. As a widely used statistical tool, Pearson’s Correlation Coefficient provides a valuable entry point into quantitative analysis, unlocking possibilities for deeper exploration and comprehension of data patterns. Embrace the power of correlation to unravel meaningful insights from your datasets.

References

Frequently Asked Questions

Q1. What does Pearson correlation tell you?

A. Pearson correlation measures the strength and direction of the linear relationship between two continuous variables. It provides a value between -1 and 1, where 1 indicates a perfect positive linear relationship, -1 indicates a perfect negative linear relationship, and 0 indicates no linear relationship.

Q2. Why Pearson correlation is used in research?

A. Pearson correlation is used in research to assess the degree of association between two continuous variables. It helps researchers understand how changes in one variable correspond to changes in another, facilitating insights into patterns, trends, and potential dependencies within the data.

Q3. What is the difference between Pearson and Spearman?

A. Pearson correlation measures the strength and direction of the linear relationship between two continuous variables, assuming that the relationship is linear and variables are normally distributed. Spearman correlation, on the other hand, measures the strength and direction of the monotonic relationship between two variables, making it suitable for non-linear relationships and ordinal data. While Pearson correlation assesses linear associations, Spearman correlation assesses monotonic associations.

Q4. What is a good Pearson R correlation?

A. The interpretation of the Pearson correlation coefficient (R) depends on the context and the field of study. Generally, an R value close to 1 or -1 indicates a strong linear relationship, while an R value close to 0 indicates a weak linear relationship or no linear relationship at all. However, what constitutes a “good” correlation can vary based on the specific research question, the nature of the variables being studied, and the domain-specific standards or guidelines.

The media shown in this article is not owned by Analytics Vidhya and is used at the Author’s discretion.

Apurva
Apurva

Login to continue reading and enjoy expert-curated content.

Free Courses

Generative AI 4.7

Generative AI - A Way of Life

Explore Generative AI for beginners: create text and images, use top AI tools, learn practical skills, and ethics.
Large Language Models 4.5

Getting Started with Large Language Models

Master Large Language Models (LLMs) with this course, offering clear guidance in NLP and model training made simple.
Prompt Engineering 4.6

Building LLM Applications using Prompt Engineering

This free course guides you on building LLM apps, mastering prompt engineering, and developing chatbots with enterprise data.
LlamaIndex 4.8

Improving Real World RAG Systems: Key Challenges & Practical Solutions

Explore practical solutions, advanced retrieval strategies, and agentic RAG systems to improve context, relevance, and accuracy in AI-driven applications.
RAG systems using LlamaIndex 4.7

Microsoft Excel: Formulas & Functions

Master MS Excel for data analysis with key formulas, functions, and LookUp tools in this comprehensive course.

Recommended Articles

Responses From Readers

Clear

Write for us

Write, captivate, and earn accolades and rewards for your work
  • Reach a Global Audience
  • Get Expert Feedback
  • Build Your Brand & Audience
  • Cash In on Your Knowledge
  • Join a Thriving Community
  • Level Up Your Data Science Game
imag