Foundational Statistical Mechanics
Common Probability Distributions
Interactive visual catalog of key continuous and discrete distributions in data science
Probability Density vs Mass
A probability distribution defines how likelihood is allocated over the possible outcomes of a random variable $X$. Continuous variables possess a Probability Density Function (PDF) $f(x)$ where probabilities correspond to integrals over intervals:
$$P(a \le X \le b) = \int_a^b f(x)\,dx, \quad F(x) = P(X \le x) = \int_{-\infty}^x f(t)\,dt$$
Discrete variables possess a Probability Mass Function (PMF) $p(k) = P(X = k)$ where probabilities sum directly: $\sum_k p(k) = 1$.
Distribution Workbench
Density / Mass Function (PDF / PMF)
Continuous
Cumulative Distribution Function (CDF)
P(X ≤ x)
Interval Probability P(x₁ ≤ X ≤ x₂)
0.9500
Expected Value E[X] (Mean)
0.000
Variance Var(X)
1.000
Standard Deviation (σ)
1.000
Mathematical Formula
Real-World Applications in Data Science
Distribution Decision Matrix
| Distribution | Type | Support | Primary Use Cases in Practice |
|---|---|---|---|
| Normal (Gaussian) | Continuous | $(-\infty, +\infty)$ | Central Limit Theorem, linear model residuals, baseline statistical inference ($z$-tests). |
| Student's $t$ | Continuous | $(-\infty, +\infty)$ | Small sample mean inference when population variance $\sigma$ is unknown ($t$-tests). |
| Binomial | Discrete | $\{0, 1, \dots, n\}$ | A/B testing click-through rates, binary conversion tracking, coin flips. |
| Poisson | Discrete | $\{0, 1, 2, \dots\}$ | Call arrivals, server request rates, rare defect counting per unit interval. |
| Exponential | Continuous | $[0, +\infty)$ | Time between events, customer churn duration, survival analysis, memoryless decay. |
| Chi-Square ($\chi^2$) | Continuous | $[0, +\infty)$ | Goodness-of-fit tests, contingency table independence, sample variance distribution. |
| Log-Normal | Continuous | $(0, +\infty)$ | Network latency, personal income / financial wealth, file size distributions. |