Probability
- Bayes' Theorem Updates the probability of a hypothesis after seeing evidence.
- Diagnostic Test: Predictive Values What a positive is worth, depending on how rare the disease is.
- Addition Rule (Union of Events) The chance of at least one of two events.
- Conditional Probability The chance of A when you already know B happened.
- Law of Total Probability Adds up the probability of B across every scenario of a partition.
- Simpson's Paradox When the winner in every group loses overall.
- Permutations and Arrangements Counting with or without order, with or without repetition.
- Binomial Coefficient How many ways there are to choose k items out of n, ignoring order.
- Birthday Problem The chance that two people in a group share a birthday.
- Coupon Collector's Problem How many stickers complete the album, on average.
- Monty Hall Problem Why switching doors doubles your chance of winning the car.
- Gambler's Ruin The chance of reaching a target before going broke.
- Benford's Law Why the first digit is so often 1.
- Expected Value The long-run average of a random variable.
- Shannon Entropy The average surprise of an outcome, in bits.
- Markov's Inequality A ceiling on high values, knowing only the mean.
- Chebyshev's Theorem A bound on the share of data far from the mean, for any distribution.
Distributions
- Bernoulli Distribution A single trial with two outcomes: success or failure.
- Binomial Distribution The number of successes in n independent trials.
- Geometric Distribution How many trials until the first success.
- Negative Binomial Distribution How many trials until the r-th success.
- Hypergeometric Distribution Successes in a sample drawn without replacement.
- Poisson Distribution The number of events in an interval, given a mean rate.
- Uniform Distribution Every value in an interval equally likely.
- Exponential Distribution The waiting time until the next event.
- Gamma Distribution The time until the k-th event.
- Weibull Distribution The service life of parts and equipment, and the failure rate.
- Normal (Gaussian) Distribution The bell curve defined by its mean and standard deviation.
- Lognormal Distribution Quantities that grow by multiplication, such as income and prices.
- Beta Distribution The uncertainty about a proportion, updated with the data.
- Law of Large Numbers The mean of many repetitions approaches the expected value.
- Central Limit Theorem Why the sample mean tends to a normal distribution as n grows.
Inference
- Z-Score How many standard deviations an observation is from the mean.
- P-Value What it measures, what it doesn't, and the tails of the normal.
- Student's t-Test Compares a sample mean with a hypothesized value when σ is unknown.
- Two-Sample t-Test Compares the means of two independent groups (Welch).
- Paired t-Test Compares before and after in the same people.
- Mann-Whitney Test Compares two groups by ranks, without assuming normality.
- One-Way ANOVA Compares the means of three or more groups.
- Two-Way ANOVA Two factors at once, and the interaction between them.
- Kruskal-Wallis Test ANOVA done on ranks, without assuming normality.
- Dunn's Test Which pairs differ, after Kruskal-Wallis.
- Friedman Test Repeated measures by ranks, within each block.
- Multiple Comparisons and Bonferroni Why many tests find effects that aren't there.
- Standard Error of the Mean How much the mean of a sample varies from one sample to the next.
- Confidence Interval A range of plausible values for the population mean.
- Confidence Interval for a Proportion The Wald and Wilson methods, and why the second is better.
- Confidence Interval for the Variance Between what values the population standard deviation lies.
- Bootstrap A confidence interval by resampling, with no standard-error formula.
- Statistical Power How many observations a t-test needs to detect an effect.
- Two Proportions How many people per group to detect a difference between two proportions.
- Chi-Square Test (χ²) Measures the gap between observed and expected frequencies.
- Chi-Square Test of Independence Whether two categorical variables are associated, in a contingency table.
- McNemar Test Proportions before and after, in the same people.
- Odds Ratio and Relative Risk How much an exposure raises the odds or the risk of an outcome.
Sampling
- Cochran's Formula Sample size to estimate a proportion with a given margin of error.
- Sample Size for a Mean How many observations to estimate a mean within a given margin of error.
- Margin of Error The "plus or minus" of a poll, from the sample size.
- Poll Simulator Draw thousands of polls and see how many intervals get it right.
- Finite Population Correction Shrinks the sample size when the population is small.
- Systematic Sampling Draw the start and take one every k.
- Proportional Allocation Each stratum gets its share of the sample.
- Neyman Allocation Splits the sample across strata by size and variability.
- Weighted Mean and Survey Weights Means with weights, correcting polls and the effective sample size.
Association and means
- Standard Deviation How far the values spread around the mean.
- Coefficient of Variation The spread relative to the mean, to compare different scales.
- Quartiles and Interquartile Range The middle half of the data, the boxplot and the outliers.
- Skewness and Kurtosis The shape of the data: which way it leans and how heavy its tails are.
- Shapiro-Wilk Test Do the data come from a normal? W and the quantile-quantile plot.
- Covariance Whether two variables move together, and in which direction.
- Pearson Correlation Coefficient (r) Strength and direction of a linear relationship, from −1 to 1.
- Spearman Correlation Correlation by ranks: catches increasing relationships that aren't straight.
- Partial Correlation The relationship between two variables, discounting a third.
- Cohen's Kappa The agreement between two raters, net of chance.
- Simple Linear Regression The line that predicts y from x.
- Regression Prediction Interval Where a new value should fall — and why the band is wide.
- Coefficient of Determination (R²) What share of the variation in y the line explains.
- Logistic Regression The fit for yes-or-no outcomes, and the odds ratio.
- Geometric Mean The right average for growth rates and factors that multiply.
- Harmonic Mean The right average for rates and ratios.
Time series
Algebra
- Rule of Three Direct and inverse proportion, and when it doesn't hold.
- Equation of a Line Through Two Points Slope and intercept: a fixed part and a proportional one.
- Absolute Value Inequalities Distance on the line: tolerances and margins of error.
- Distance Between Two Points Pythagoras on the plane, and the equation of a circle.
- 2×2 Linear System Cramer's rule and the two lines that cross.
- Vertex of a Parabola The maximum or minimum point, and the axis of symmetry.
- Quadratic Formula The roots of ax² + bx + c = 0.
- Binomial Theorem The expansion of (a + b)ⁿ and Pascal's triangle.
- Exponential and Logarithmic Functions Each undoes the other: the mirror in the line y = x.
- Logarithm and Change of Base How many times to multiply, in any base.
- Arithmetic Series Gauss's trick for adding 1 + 2 + … + 100.
- Second-Order Sequences Triangular numbers and the difference table.
- Geometric Series The sum of terms multiplied by a fixed ratio, finite or infinite.
- Repeating Decimals and Infinite Geometric Series The fraction behind it, and why 0.999… = 1.
- Compound Interest with Contributions What an initial amount plus regular deposits grows to.
- Loan Amortization (Price Table) The fixed payment, and how much of it is interest.
- Doubling Time and Half-Life The exact calculation and the rule of 70.
- Cumulative Inflation Why rates multiply instead of adding up.
- 2×2 Matrix Multiplication Composing transformations, and why AB ≠ BA.
- Inverse of a 2×2 Matrix The determinant, the inverse and the solution of a 2 × 2 system.
- Eigenvalues of a 2×2 Matrix The directions the matrix only stretches.
- Logistic Function and Odds The S-curve that turns any number into a probability.
Calculus
- The Limit That Defines e Ever more frequent compounding leads to the number e.
- Derivative from the Definition The slope of a curve as a limit of secants.
- Chain Rule The derivative of a function inside another.
- Newton's Method Finds roots by following tangents down to the x axis.
- Stirling's Approximation A formula for factorials too large to compute.
- L'Hôpital's Rule Resolves indeterminate limits of the form 0/0 or ∞/∞.
- Taylor Series Approximates a function with a polynomial.
- Riemann Sum The area under a curve, approximated by rectangles.
- Gaussian Integral The area under the bell, and where the √(2π) of the normal comes from.
No formula with that name.