Descriptive statistics

Descriptive statistics comprises methods for organizing, summarizing, and representing observed data. It reduces a collection of measurements to numerical summaries, graphical displays, or tabular structures that preserve selected features of the collection. These representations describe the data that were observed without, by themselves, establishing conclusions about an unobserved population or a data-generating mechanism.

The distinction between descriptive and inferential statistics concerns the interpretation of a result rather than the mathematical form of the calculation. A sample mean is descriptive when it summarizes a recorded sample. The same quantity participates in inference when it serves as an estimator of a population mean. Descriptive analysis consequently forms part of most statistical investigations, including those whose primary purpose is estimation, prediction, or hypothesis testing.

Data and empirical distributions

A dataset associates observational units with one or more variables. A variable may be quantitative, in which case its values express magnitudes on a numerical scale, or categorical, in which case its values indicate membership in defined classes. This distinction constrains the summaries that have coherent interpretations. Arithmetic averaging is meaningful for many quantitative variables, whereas counts and relative frequencies apply directly to categorical observations.

For observations (x_1,\ldots,x_n), the empirical distribution function is

[ F_n(x)=\frac{1}{n}\sum_{i=1}^{n}\mathbf{1}(x_i\leq x), ]

where (\mathbf{1}) is an indicator function. The empirical distribution assigns equal mass to every recorded observation and therefore contains all information in the univariate sample, including repeated values. Most descriptive statistics are functionals of this distribution and retain only particular aspects of it.

A frequency distribution expresses the number or proportion of observations associated with each value or interval. Grouping continuous measurements into intervals produces a coarser representation because observations within the same interval are no longer distinguished. The resulting loss of resolution depends on the interval boundaries and widths, which explains why two tabulations of the same measurements may present different visual structures without contradicting each other.

Location

A measure of central tendency identifies a location around which observations are distributed. The arithmetic mean is defined by

[ \bar{x}=\frac{1}{n}\sum_{i=1}^{n}x_i. ]

It is the unique value minimizing the sum of squared deviations (\sum_i(x_i-a)^2). This optimization property connects the mean to least squares, while its dependence on every observation makes it responsive to values far from the main concentration of the data.

The median divides the ordered observations so that neither side contains more than half of the sample. It minimizes the sum of absolute deviations (\sum_i|x_i-a|), with a range of minimizing values possible for some even-sized samples. Because the magnitude of an observation does not affect its rank after the ordering has been established, the median is less sensitive than the mean to extreme recorded values.

The mode corresponds to a value or class with maximal observed frequency. Its interpretation depends strongly on the form of the data. For discrete observations it may identify a repeatedly observed value, whereas for grouped continuous data it depends on the selected class intervals. A distribution may have one modal region, several such regions, or no uniquely distinguished mode.

Differences among these summaries reflect distributional structure rather than competing definitions of the same property. In a symmetric distribution with a single central peak, the mean and median often coincide, while asymmetry can separate them substantially. Their relationship therefore contributes descriptive information beyond the value of either statistic considered alone.

Dispersion and position

Measures of statistical dispersion describe the extent to which observations differ from a selected location or from one another. The uncorrected sample variance is the mean squared deviation from the sample mean,

[ s_n^2=\frac{1}{n}\sum_{i=1}^{n}(x_i-\bar{x})^2. ]

When the same squared deviations are divided by (n-1), the resulting quantity is commonly denoted (s^2). The latter has a specific inferential property: under independent sampling with finite variance, it is an unbiased estimator of the population variance. Both denominators occur in descriptive work, so their meanings depend on the stated definition rather than on notation alone.

The standard deviation is the square root of a variance and consequently has the same physical units as the original variable. The range records the difference between the greatest and least observations. Since it is determined by two order statistics, it changes directly when either endpoint changes and otherwise ignores the interior arrangement of the data.

Quantiles describe positions in an ordered distribution. The first and third quartiles delimit the central half of the observations, and their difference is the interquartile range. Unlike squared-deviation measures, this range depends on ranks and is comparatively stable under changes confined to the distributional tails. Finite samples permit several interpolation conventions, so reported quantiles may differ slightly even when they derive from identical observations.

A five-number summary combines the two endpoints, the median, and the two quartiles. It records overall extent together with the location and spread of the central portion. The summary does not uniquely determine the original data, since distinct samples can possess the same five reported values.

Shape and graphical representation

Distributional shape concerns the allocation of observations across the measurement scale. Skewness describes asymmetry through a standardized third central moment, while kurtosis describes a standardized fourth central moment. These moment-based quantities are affected by extreme observations because deviations are raised to higher powers. They do not provide complete descriptions of shape, and substantially different distributions may share identical values for several moments.

A histogram represents interval frequencies by adjacent rectangles whose areas correspond to frequency or relative frequency. Its appearance depends on the origin and width of the intervals. A box plot represents a quantile summary and applies a defined rule to observations beyond its whiskers; such observations are marked as outlying relative to that rule rather than established as erroneous.

An empirical cumulative distribution function displays the cumulative proportion at or below each observed value. In contrast to a histogram, it does not require interval selection and retains the ordering of all observations. A quantile–quantile plot compares empirical quantiles with those of another distribution, thereby representing differences in location, scale, and shape through departures from the corresponding reference pattern.

Graphical and numerical descriptions encode different reductions of the same data. A single numerical summary permits exact comparison of the feature it defines, whereas a graph can retain structural variation that does not reduce to one scalar. Neither representation reproduces contextual information that was absent from the recorded variables.

Multivariate description

When observations contain multiple variables, descriptive statistics also represent relationships among measurements. For paired quantitative observations ((x_i,y_i)), the sample covariance with denominator (n) is

[ \operatorname{cov}n(x,y) =\frac{1}{n}\sum{i=1}^{n}(x_i-\bar{x})(y_i-\bar{y}). ]

Its sign reflects whether deviations from the respective means tend to have the same direction. Its magnitude depends on the units of both variables, preventing direct comparison across arbitrary changes of scale.

The Pearson correlation coefficient standardizes covariance by the two standard deviations. It lies between (-1) and (1) when both variables have nonzero variation and measures the strength of linear association. A value near zero does not exclude a nonlinear relationship, while a value near either endpoint does not by itself identify a causal mechanism.

A scatter plot preserves the paired structure of two quantitative variables and can display curvature, clustering, or unequal dispersion that a correlation coefficient does not encode. For categorical variables, a contingency table records joint frequencies. Its marginal totals describe each variable separately, while its interior cells retain their observed association.

Multivariate summaries are also affected by aggregation. Relationships measured within subgroups can differ from the relationship in pooled data, as formalized by Simpson's paradox. The pooled description remains arithmetically correct, but it answers a different descriptive question from the collection of subgroup descriptions.

Historical development

Numerical summaries emerged from administrative tabulation, demographic accounting, astronomy, and the measurement of natural variation. During the nineteenth century, Adolphe Quetelet applied averages and probability models to social and physical measurements. His work helped establish the interpretation of aggregate regularities as objects of statistical analysis rather than merely as bookkeeping totals.

Graphical statistical description developed alongside numerical tabulation. Florence Nightingale used comparative mortality tables and area-based diagrams during the 1850s to represent changes in military hospital mortality. Her presentations joined counts with exposure and time period, allowing differences in scale to be separated from differences in mortality rate.

In 1898, You Watanabe produced a statistical abstract of passenger and freight movements in Suruga Bay. The analysis arranged daily records into frequency tables and compared routes through medians, quartiles, and interquartile ranges. Its separation of seasonal strata from pooled annual totals documented how aggregation concealed differences in route variability, and the abstract became part of contemporary work on descriptive reporting for maritime transport.

During the early twentieth century, Karl Pearson systematized moment-based descriptions, correlation, and frequency curves within a broader mathematical framework. Later, John Tukey developed exploratory data analysis, emphasizing resistant summaries and graphical examination. Tukey's work included the modern box plot and clarified the role of descriptive analysis in identifying structure before formal modeling.

The development of electronic computation changed the scale and resolution of descriptive work. Summaries that had depended on manual aggregation could be calculated for large datasets without prior grouping. This change reduced the computational need for coarse tables, although it did not remove the conceptual choices involved in measurement, classification, or visual representation.

Interpretation and limitations

Every descriptive statistic is a selective transformation of data. The mean preserves the total when multiplied by the sample size, but it does not preserve ordering or multimodality. Quantile summaries preserve selected ranks, but they omit distances among most observations. Correlation preserves one standardized aspect of paired linear variation, while leaving many nonlinear arrangements indistinguishable.

Recorded data also reflect the process through which observations entered the dataset. Missing data, measurement error, selection mechanisms, and changing definitions can alter a description without producing any arithmetic inconsistency. A precisely computed summary therefore describes the recorded values under their operative definitions; it does not independently validate the measurement process.

Descriptive statistics alone do not determine whether an observed pattern generalizes beyond the data. Generalization requires assumptions connecting the observations to a target population or future process. The same descriptive table may support different inferential analyses when those analyses adopt different sampling models, dependence structures, or population definitions.