Have you ever wondered how to calculate probabilities for random events with discrete outcomes? Meet Alice, a young student fascinated by the concept of probability. She has a project to model the probability of customers visiting a store in a day. She used the Poisson distribution, which accurately predicted the number of customers visiting the store on different days. Alice became passionate about using discrete probability distributions to model and predict the outcomes of random events. Let’s understand more about discrete probability distribution with this article!

*This article was published as a part of the Data Science Blogathon.*

Discrete probability distributions represent the likelihood of different outcomes in a discrete set, such as the results of rolling a dice or the number of successes in a fixed number of trials. Each outcome is associated with a probability, and when graphed, these probabilities create a distribution. Common examples include the binomial distribution for binary events and the Poisson distribution for rare events. Such distributions are essential in statistics and probability theory for modeling and analyzing discrete random variables.

Discrete probability distributions are graphs of the outcomes of test results, such as a value of 1, 2, 3, true, false, success, or failure. Investors use discrete probability distributions to estimate the chances that a particular investing outcome is more or less likely to happen.

Let X be a random variable that has more than one possible outcome. Plot the probability on the y-axis and the outcome on the x-axis. If we repeat the experiment many times and plot the probability of each possible outcome, we get a plot that represents the probabilities. This plot is called the probability distribution (PD). The height of the graph for X gives the probability of that outcome.

There are two types of distributions based on the type of data generated by the experiments.

These distributions model the probabilities of random variables that can have discrete values as outcomes. For example, the possible values for the random variable X that represents the number of heads that can occur when a coin is tossed twice are the set {0, 1, 2} and not any value from 0 to 2 like 0.1 or 1.6.

Examples: Bernoulli, Binomial, Negative Binomial, Hypergeometric, etc.,

These distributions model the probabilities of random variables that can have any possible outcome. For example, the possible values for the random variable X that represents weights of citizens in a town which can have any value like 34.5, 47.7, etc.,

Examples: Normal, Student’s T, Chi-square, Exponential, etc.,

*Also Read: Basics of Probability for Data Science explained with examples in R*

Each PD provides us extra information on the behavior of the data involved. Each PD is given by a probability function that generalizes the probabilities of the outcomes.

Using this, we can estimate the probability of a particular outcome(discrete) or the chance that it lies within a particular range of values for any given outcome(continuous). The function is called a Probability Mass function (PMF) for discrete distributions and a Probability Density function (PDF) for continuous distributions. The total value of PMF and PDF over the entire domain is always equal to one.

The PDF gives the probability of a particular outcome whereas the Cumulative Distribution Function gives the probability of seeing an outcome less than or equal to a particular value of the random variable. CDFs are used to check how the probability has added up to a certain point. For example, if P(X = 5) is the probability that the number of heads on flipping a coin is 5 then, P(X <= 5) denotes the cumulative probability of obtaining 1 to 5 heads.

Cumulative distribution functions are also used to calculate p-values as a part of performing hypothesis testing.

There are many discrete probability distributions to be used in different scenarios. We will discuss Discrete distributions in this post. Binomial and Poisson distributions are the most discussed ones in the following list.

__Bernoulli Distribution____Binomial Distribution____Hypergeometric Distribution____Negative Binomial Distribution____Geometric Distribution____Poisson Distribution____Multinomial Distribution__

Here are the list of types of Discrete probability distributions explained with examples.

This distribution is generated when we perform an experiment once and it has only two possible outcomes – success and failure. The trials of this type are called Bernoulli trials, which form the basis for many distributions discussed below. Let p be the probability of success and 1 – p is the probability of failure.

The PMF is given as

One example of this would be flipping a coin once. p is the probability of getting ahead and 1 – p is the probability of getting a tail. Please note down that success and failure are subjective and are defined by us depending on the context.

This is generated for random variables with only two possible outcomes. Let p denote the probability of an event is a success which implies 1 – p is the probability of the event being a failure. Performing the experiment repeatedly and plotting the probability each time gives us the Binomial distribution.

The most common example given for Binomial distribution is that of flipping a coin n number of times and calculating the probabilities of getting a particular number of heads. More real-world examples include the number of successful sales calls for a company or whether a drug works for a disease or not.

The PMF is given as,

where p is the probability of success, n is the number of trials and x is the number of times we obtain a success.

Consider an event of drawing a red marble from a box of marbles with different colors. The event of drawing a red ball is a success and not drawing it is a failure. But each time a marble is drawn it is not returned to the box and hence this affects the probability of drawing a ball in the next trial. The hypergeometric distribution models the probability of k successes over n trials where each trial is conducted without replacement. This is unlike the binomial distribution where the probability remains constant through the trials.

The PMF is given as,

where k is the number of possible successes, x is the desired number of successes, N is the size of the population and n is the number of trials.

Sometimes we want to check how many Bernoulli trials we need to make in order to get a particular outcome. The desired outcome is specified in advance and we continue the experiment until it is achieved. Let us consider the example of rolling a dice. Our desired outcome, defined as a success, is rolling a 4. We want to know the probability of getting this outcome thrice. This is interpreted as the number of failures (other numbers apart from 4) that will occur before we see the third success.

The PMF is given as,

where p is the probability of success, k is the number of failures observed and r is the desired number of successes until the experiment is stopped.

Like in Binomial distribution, the probability through the trials remains constant and each trial is independent of the other.

This is a special case of the negative binomial distribution where the desired number of successes is 1. It measures the number of failures we get before one success. Using the same example given in the previous section, we would like to know the number of failures we see before we get the first 4 on rolling the dice.

where p is the probability of success and k is the number of failures. Here, r = 1.

This distribution describes the events that occur in a fixed interval of time or space. An example might make this clear. Consider the case of the number of calls received by a customer care center per hour. We can estimate the average number of calls per hour but we cannot determine the exact number and the exact time at which there is a call. Each occurrence of an event is independent of the other occurrences.

The PMF is given as,

where λ is the average number of times the event has occurred in a certain period of time, x is the desired outcome and e is the Euler’s number.

In the above distributions, there are only two possible outcomes – success and failure. The multinomial distribution, however, describes the random variables with many possible outcomes. This is also sometimes referred to as categorical distribution as each possible outcome is treated as a separate category. Consider the scenario of playing a game n number of times. Multinomial distribution helps us to determine the combined probability that player 1 will win x_{1 }times, player 2 will win x_{2 }times and player k wins x_{k }times.

The PMF is given as,

where n is the number of trials, p_{1,}……p_{k} denote the probabilities of the outcomes x_{1}……x_{k} respectively.

Discrete Distribution | Continuous Distribution |
---|---|

Random variable can only take on a finite or countable number of values | Random variable can take on any value within a certain range or interval |

Probability function assigns probabilities to each possible outcome | Probability function assigns probabilities to each possible value within a range or interval |

Examples: binomial distribution, Poisson distribution, geometric distribution | Examples: normal distribution, exponential distribution, beta distribution |

Used to model events with discrete outcomes, such as number of successes in a fixed number of trials | Used to model events with continuous outcomes, such as the height of individuals in a population |

Probability of any single outcome is non-zero | Probability of any single value is zero |

Cumulative distribution function is stepwise | Cumulative distribution function is continuous |

*Also Read: Understanding Random Variables their Distributions*

If you want to master other statistical techniques and make a career in Data Science, then our exclusive BlackBelt program is the best option for you! Get to select which modules to study, pick your mentors and have expert guidance throughout the course. We offer a structured approach to problem-solving, emphasizing data-driven decision-making and continuous improvement. Upon completion of the program, you will possess the skills and knowledge needed to lead and manage complex projects, drive process improvements, and achieve measurable results. Sign-up today!

A. There are 5 types of discrete probability distributions binomial distribution, poisson distribution

geometric distribution, hypergeometric distribution and negative binomial distribution.

A. An example of a discrete probability is the probability of rolling a 3 on a fair six-sided die. Since the possible outcomes are limited to 1, 2, 3, 4, 5, and 6, and each outcome has an equal probability of occurring, the probability of rolling a 3 is 1/6.

A. Discrete distribution is a probability distribution where the random variable can only take on a finite or countable number of values. In contrast, continuous distribution refers to a probability distribution where the random variable can take on any value within a certain range or interval. Examples of discrete distributions include the binomial distribution and the Poisson distribution, while examples of continuous distributions include the normal and exponential distributions.

A. A distribution is discrete if its random variable can only take on a finite or countable number of values.

A. The two requirements for a discrete probability distribution are:

1. Probability of each possible outcome must be between 0 and 1.

2. Sum of the probabilities of all possible outcomes must be equal to 1.

*The media shown in this article are not owned by Analytics Vidhya and is used at the Author’s discretion.*

Lorem ipsum dolor sit amet, consectetur adipiscing elit,

Become a full stack data scientist
##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

##

Understanding Cost Function
Understanding Gradient Descent
Math Behind Gradient Descent
Assumptions of Linear Regression
Implement Linear Regression from Scratch
Train Linear Regression in Python
Implementing Linear Regression in R
Diagnosing Residual Plots in Linear Regression Models
Generalized Linear Models
Introduction to Logistic Regression
Odds Ratio
Implementing Logistic Regression from Scratch
Introduction to Scikit-learn in Python
Train Logistic Regression in python
Multiclass using Logistic Regression
How to use Multinomial and Ordinal Logistic Regression in R ?
Challenges with Linear Regression
Introduction to Regularisation
Implementing Regularisation
Ridge Regression
Lasso Regression

Introduction to Stacking
Implementing Stacking
Variants of Stacking
Implementing Variants of Stacking
Introduction to Blending
Bootstrap Sampling
Introduction to Random Sampling
Hyper-parameters of Random Forest
Implementing Random Forest
Out-of-Bag (OOB) Score in the Random Forest
IPL Team Win Prediction Project Using Machine Learning
Introduction to Boosting
Gradient Boosting Algorithm
Math behind GBM
Implementing GBM in python
Regularized Greedy Forests
Extreme Gradient Boosting
Implementing XGBM in python
Tuning Hyperparameters of XGBoost in Python
Implement XGBM in R/H2O
Adaptive Boosting
Implementing Adaptive Boosing
LightGBM
Implementing LightGBM in Python
Catboost
Implementing Catboost in Python

Introduction to Clustering
Applications of Clustering
Evaluation Metrics for Clustering
Understanding K-Means
Implementation of K-Means in Python
Implementation of K-Means in R
Choosing Right Value for K
Profiling Market Segments using K-Means Clustering
Hierarchical Clustering
Implementation of Hierarchial Clustering
DBSCAN
Defining Similarity between clusters
Build Better and Accurate Clusters with Gaussian Mixture Models

Introduction to Machine Learning Interpretability
Framework and Interpretable Models
model Agnostic Methods for Interpretability
Implementing Interpretable Model
Understanding SHAP
Out-of-Core ML
Introduction to Interpretable Machine Learning Models
Model Agnostic Methods for Interpretability
Game Theory & Shapley Values

Deploying Machine Learning Model using Streamlit
Deploying ML Models in Docker
Deploy Using Streamlit
Deploy on Heroku
Deploy Using Netlify
Introduction to Amazon Sagemaker
Setting up Amazon SageMaker
Using SageMaker Endpoint to Generate Inference
Deploy on Microsoft Azure Cloud
Introduction to Flask for Model
Deploying ML model using Flask