Probable error

Probable errorMain

Community hub

Probable error

7 pages, 0 posts

0 subscribers

Recent from talks

Be the first to start a discussion here.

Recent from talks

Be the first to start a discussion here.

Contribute something

About hubMembersContent overviewUpdatesRules

Main reference articles

Probable error

View on Wikipedia

from Wikipedia

In statistics, probable error defines the half-range of an interval about a central point for the distribution, such that half of the values from the distribution will lie within the interval and half outside.^[1] Thus for a symmetric distribution it is equivalent to half the interquartile range, or the median absolute deviation. One such use of the term probable error in this sense is as the name for the scale parameter of the Cauchy distribution, which does not have a standard deviation.

The probable error can also be expressed as a multiple of the standard deviation σ,^[1]^[2] which requires that at least the second statistical moment of the distribution should exist, whereas the other definition does not. For a normal distribution this is $\gamma =0.6745\times \sigma$ (see details).

References

[edit]

^ ^a ^b Dodge, Y. (2006) The Oxford Dictionary of Statistical Terms, OUP. ISBN 0-19-920613-9
^ Zwillinger, D.; Kokosa, S. (2000) CRC Standard Probability and Statistics Tables and Formulae, Chapman & Hall/CRC. ISBN 1584880597 (Section 2.2.13)

Revisions and contributors Edit on Wikipedia Read on Wikipedia

View on Grokipedia

from Grokipedia

In statistics, the probable error (PE) of an estimate is defined as the value such that there is a 50% probability the true value lies within that distance from the estimate, representing the half-range of the central 50% interval in the error distribution.^[1] For errors following a Gaussian (normal) distribution, the probable error equals approximately 0.6745 times the standard deviation σ, derived from the inverse cumulative distribution function where the probability of the absolute error exceeding PE is 50%.^[1]^[2] This measure provides a probabilistic assessment of precision in measurements or estimates, particularly useful for quantifying the reliability of repeated observations under the assumption of symmetric random errors. The concept of probable error emerged in the early 19th century as part of the developing theory of errors in astronomy and geodesy, where it served as a median-based indicator of variability before the widespread adoption of the standard deviation.^[3] It was formalized in the context of least squares methods and gained significant attention through the work of Karl Pearson and others in the late 19th century, who applied it to the analysis of measurement dispersions.^[4] A landmark contribution came in 1908 when William Sealy Gosset, publishing under the pseudonym "Student," introduced the probable error of the mean in small samples, laying foundational groundwork for the t-distribution and inference in finite datasets.^[5]^[6] Historically prominent in experimental sciences, the probable error offered an intuitive way to express uncertainty at the 50% confidence level, contrasting with the more conservative 95% intervals based on roughly 1.96σ.^[7] However, by the mid-20th century, it was increasingly supplanted by the standard deviation and standard error, which provide more flexible and theoretically robust frameworks for hypothesis testing and confidence intervals, especially in large-sample asymptotics.^[8] Despite this, the probable error retains niche applications in fields like surveying, geodesy, and certain physics experiments, where its simplicity aids in communicating median precision without requiring full distributional assumptions.^[7]^[2]

Definition

Basic Definition

The probable error (PE) is a measure of dispersion in statistics that defines the half-range interval around a central estimate, such as the mean or median of a set of observations, within which the true value is expected to lie with a 50% probability.^[7] This interval represents the value by which the estimate might typically deviate, providing a probabilistic bound on the accuracy of the estimate.^[9] PE quantifies the "most probable" deviation, such that the likelihood of observing a deviation larger than PE is exactly 50%.^[10] For a single measurement, PE specifically denotes the value δ* for which the probability of an error magnitude at least as large as δ* is 1/2, capturing the median extent of potential error in that observation.^[11] In the context of repeated measurements, for example, PE indicates the typical error magnitude that occurs in half of the cases, offering a practical gauge of reliability without implying certainty.^[7] In distributions like the normal, PE aligns with the central 50% of the error spread around the mean.^[9]

Mathematical Formulation

The probable error (PE) of a random variable

X

following a normal distribution

N(\mu, \sigma^2)

is defined as the positive value

\delta^*

satisfying

\int_{-\delta^*}^{\delta^*} \frac{1}{\sqrt{2\pi\sigma^2}} \exp\left( -\frac{(x - \mu)^2}{2\sigma^2} \right) \, dx = 0.5.

∫−δ∗δ∗2πσ2

1exp(−2σ2(x−μ)2)dx=0.5. This equation specifies that the probability mass within one probable error on either side of the mean is 50%, or equivalently, $P(|\ X - \mu\ | < \mathrm{PE}) = 0.5$ .^[12] Standardizing by the scale parameter $\sigma$ reduces the problem to the standard normal distribution with cumulative distribution function $\Phi(z) = P(Z \leq z)$ where $Z \sim N(0, 1)$ . The equation becomes $2\Phi(\delta^*/\sigma) - 1 = 0.5$ , or $\Phi(\delta^*/\sigma) = 0.75$ . Thus, $\delta^*/\sigma = \Phi^{-1}(0.75)$ , the 75th percentile of the standard normal distribution (corresponding to the 25th percentile deviation from the mean in each tail). The numerical solution is $\Phi^{-1}(0.75) \approx 0.67449$ , so the probable error is $\mathrm{PE} = 0.67449 \sigma$ , often approximated as $0.675\sigma$ .^[13] For the probable error of the sample mean $\bar{X}$ based on $n$ independent observations from $N(\mu, \sigma^2)$ , the sampling distribution is $N(\mu, \sigma^2/n)$ . Applying the single-observation formula to this distribution yields $\mathrm{PE}_{\bar{X}} = 0.67449 \cdot (\sigma / \sqrt{n})$

), or equivalently $\mathrm{PE}_{\bar{X}} = \mathrm{PE} / \sqrt{n}$

.^[13]

Historical Development

Early Origins

The concept of probable error emerged in the late 18th and early 19th centuries as part of the developing theory of errors in scientific measurements, particularly within astronomy and physics, where precise observations of celestial bodies demanded reliable assessments of uncertainty. Pierre-Simon Laplace made foundational contributions to the probabilistic analysis of observational errors during this period, framing errors as random deviations that could be modeled probabilistically; his work in the 1780s and 1790s, culminating in the 1812 Théorie Analytique des Probabilités, emphasized the application of probability to quantify the likelihood of errors in repeated measurements, influencing subsequent developments in error theory.^[14] Carl Friedrich Gauss advanced this framework significantly in his 1809 publication Theoria Motus Corporum Coelestium in Sectionibus Conicis Solem Ambientium, where he introduced measures of error in the context of least squares estimation for determining planetary orbits from astronomical data. Gauss posited that measurement errors follow a Gaussian distribution and developed the idea of a probable deviation as a way to gauge the typical magnitude of these errors, providing the groundwork for probable error as a practical metric of precision in scientific inference.^[14] This approach assumed errors were symmetrically distributed around the true value, enabling astronomers to weight observations based on their reliability. The term "probable error" first appeared in astronomical literature around 1812, referring to the error magnitude within which half of the observations were expected to lie under a Gaussian error model, and was formalized by Friedrich Wilhelm Bessel in his 1815 analysis of stellar positions. Bessel applied it to evaluate the reliability of repeated measurements in astronomy, such as determining the fixed positions of stars relative to one another, where it served as a concise indicator of observational accuracy assuming normally distributed errors.^[14]^[15]

Key Advancements

In the late 19th century, Karl Pearson formalized the concept of probable error within biometric statistics, particularly through his collaborative work with Louis Napoleon George Filon on the probable errors of frequency constants, which extended its application to variation and correlation in biological data.^[16] This 1898 memoir in the Philosophical Transactions of the Royal Society provided rigorous derivations for probable errors in estimated statistical parameters, establishing a foundation for error assessment in empirical studies of heredity and evolution.^[16] Building on these developments, William Sealy Gosset, publishing under the pseudonym "Student," advanced the probable error for small sample sizes in his seminal 1908 paper "The Probable Error of a Mean" in Biometrika. Gosset derived distribution-based adjustments to the probable error of the sample mean, accounting for the variability in small datasets from normally distributed populations, which laid groundwork for the Student's t-distribution and improved reliability in experimental settings like those in brewing and agriculture. In the early 20th century, Ronald A. Fisher further integrated probable error into modern statistical inference, as seen in his 1922 paper "On the Mathematical Foundations of Theoretical Statistics," where he emphasized its role in evaluating the precision of estimators alongside concepts like maximum likelihood. However, as confidence interval methods gained prominence through Neyman-Pearson theory, probable error began to wane in favor of standard errors for hypothesis testing. By 1925, in his influential book Statistical Methods for Research Workers, Fisher referenced probable error but advocated prioritizing standard deviations for critical tests, signaling a shift toward more versatile error measures in research practice.^[17]

Applications

In Measurement Error Analysis

In measurement systems, the probable error (PE) is defined as 0.675 times the standard deviation of repeated measurements of the same quantity, representing the deviation range within which 50% of the errors are expected to fall.^[18] This measure provides a practical indicator of precision in experimental data, particularly in fields like physics and engineering where variability arises from instrumental limitations or observational inconsistencies. By focusing on the median deviation rather than the full spread, PE offers a conservative estimate of uncertainty that aligns with the intuitive expectation that roughly half of measurements will lie within this interval. A key application of PE occurs in gage repeatability and reproducibility (R&R) studies, which evaluate the reliability of measurement tools and operators in manufacturing and quality control. Here, PE quantifies the combined effects of repeatability (variation under identical conditions) and reproducibility (variation across operators), helping to assess system capability; for instance, if PE exceeds 10% of the process tolerance, the system is typically deemed inadequate for reliable discrimination of parts.^[19] In such analyses, PE is calculated from the standard deviation of equipment variation, often denoted as

\sigma_e

, using the formula

PE = 0.675 \sigma_e

, and it guides decisions on measurement resolution and process specifications.^[20] This approach ensures that measurement errors do not obscure true process differences, as demonstrated in studies of dimensional inspections where PE helps tighten specifications by accounting for 96% of expected variation.^[19] For reporting uncertainty in experimental results, the probable error of the mean from a set of

n

measurements of a quantity, such as length, is given by

PE_m = PE / \sqrt{n}

PEm=PE/n

, which decreases with more observations and provides a scaled estimate of the mean's reliability.^[21] Historically, PE has been widely used in engineering and physics for propagating errors in derived quantities, such as sums or products of measurements; for a sum $V = x + y$ , the propagated PE follows $\sqrt{PE_x^2 + PE_y^2}$

, while for a product $V = xy$ , it approximates the relative error $\sqrt{(PE_x / x)^2 + (PE_y / y)^2}$

.^[18] These methods, rooted in mid-20th-century error theory, remain relevant for ensuring the accuracy of physical computations despite the shift toward standard deviation in modern practice.^[22]

In Statistical Estimation

In statistical estimation, the probable error of the mean (PE_m) serves as a measure of the precision with which a sample mean estimates the population mean from a random sample drawn from a normally distributed population. Specifically, PE_m defines the interval around the sample mean such that there is a 50% probability that the true population mean falls within ±PE_m of the observed sample mean, providing a probabilistic assessment of estimation reliability.^[13] This concept, introduced by William Sealy Gosset in his seminal work, emphasizes practical inference for finite samples where the population standard deviation may be unknown. For large sample sizes, where the central limit theorem applies and the population standard deviation σ is known or well-estimated, PE_m is calculated as approximately 0.6745 times the standard error of the mean:

\mathrm{PE}_m \approx 0.6745 \frac{\sigma}{\sqrt{n}}

PEm≈0.6745n

σ Here, n denotes the sample size, and the constant 0.6745 arises from the inverse of the normal distribution's cumulative probability at 0.75, marking the point where half the distribution lies within the symmetric interval. When σ is unknown, it is replaced by the sample standard deviation s, yielding a similar approximation under large n. For small samples, however, this normal-based formula underestimates uncertainty due to variability in s; Gosset addressed this in his 1908 paper by deriving adjustments via the t-distribution, which scales the standard error by a factor dependent on n and provides tabulated values for the ratio z = (sample mean - population mean) / (s / √n) to compute more accurate probable errors (e.g., for n=6, z=1 corresponds to a probability of 0.9622).^[13] In quality control applications, such as evaluating batch consistency in industrial processes like brewing, PE_m assesses whether a sample mean reliably indicates the overall batch quality by quantifying the likelihood that the population mean deviates significantly from the sample estimate. For instance, if PE_m is small relative to the observed mean, the sample provides high confidence in inferring batch characteristics.^[23] Additionally, PE_m facilitates significance testing for differences between means: the observed difference is compared to the combined PE of the two means (e.g., PE_{m1} + PE_{m2}), with differences exceeding 2-3 times the combined value indicating low probability of chance occurrence and thus meaningful distinctions between populations, as illustrated in Gosset's examples of comparative experiments.

In Correlation and Regression

In the context of correlation analysis, the probable error serves as a measure to evaluate the reliability and significance of the estimated correlation coefficient

r

, particularly in assessing whether an observed association between two variables is likely due to chance or reflects a true relationship. This application allows researchers to determine the precision of

r

based on sample size and the magnitude of the correlation itself.^[24] The probable error of the correlation coefficient

r

, introduced by Karl Pearson, is approximated for large sample sizes

n

by the formula

\text{PE}_r = 0.6745 \times \frac{1 - r^2}{\sqrt{n}}.

PEr=0.6745×n

1−r2. This value indicates the interval around $r$ within which the true population correlation is expected to lie with 50% probability. To test significance, if the absolute value of $r$ exceeds twice its probable error ( $|r| > 2 \times \text{PE}_r$ ), the correlation is considered likely real and not attributable to random sampling variation, serving as an early method for inference in bivariate relationships.^[25]^[16] In biometric studies, the probable error of the correlation coefficient is applied to verify the statistical reliability of associations between biological traits, such as height and weight in human populations. For instance, if an observed $r = 0.5$ based on $n = 100$ pairs yields a $\text{PE}_r \approx 0.05$ , and since $0.5 > 2 \times 0.05$ , the association is deemed significant, supporting conclusions about underlying genetic or environmental links.^[25] The concept extends to regression analysis, where the probable error aids in evaluating the precision of the slope parameter in linear models, thereby assessing overall model fit and the stability of predicted relationships between variables. This adaptation, also rooted in Pearson's framework, enables judgments on whether deviations from the regression line are meaningfully informative or merely sampling artifacts.^[24]

Comparisons and Modern Usage

With Standard Deviation and Variance

The probable error (PE) of a distribution is directly related to its standard deviation (σ) under the assumption of normality, where PE = 0.6745σ, allowing conversion via σ = PE / 0.6745.^[7]^[26] This constant arises from the inverse cumulative distribution function of the standard normal distribution at the 75th percentile, ensuring that half the probability mass lies within ±PE.^[27] In contrast, variance (σ²) quantifies the average squared deviation from the mean, emphasizing the overall spread through second-moment calculations, whereas PE centers on the median absolute deviation, providing a first-moment measure of typical error magnitude.^[28] Under a normal distribution, the standard deviation defines an interval ±σ that encompasses approximately 68% of the probability density (the 1σ rule), reflecting a broader measure of dispersion compared to the ±PE interval, which covers exactly 50% and thus offers a narrower, more conservative estimate of likely deviations.^[7] This difference in probabilistic coverage highlights PE's focus on the "most probable" central tendency, where outcomes beyond ±PE are equally likely on either side. For non-normal distributions, PE—often computed as the median absolute deviation scaled appropriately—exhibits lower sensitivity to outliers than σ, as the median resists extreme values more effectively than the mean-based standard deviation.^[27]^[28] In practical reporting for a dataset, such as Galton's 1889 analysis of 787 estimates of an ox's weight (median guess 1207 lb, actual 1198 lb), expressing results with PE (approximately 37 lb) conveys a "probable" range where half the estimates fall within ±37 lb of the median, emphasizing intuitive typicality; σ, by comparison, would yield a wider spread (around 55 lb for normality), capturing more of the data's variability but less directly interpretable as a median-centered bound.^[28] Both measures assume underlying normality for precise relations, yet PE gained historical preference in 19th-century statistics for its accessible "50-50 chance" phrasing—described by Fourier in 1826 as a balanced bet on error exceedance—making it more intuitive for practitioners before the widespread adoption of σ in the early 20th century.^[26]^[28]

With Standard Error and Confidence Intervals

The standard error of the mean (SE) measures the precision of a sample mean as an estimate of the population mean and is calculated as

\text{SE} = \frac{\sigma}{\sqrt{n}}

SE=n

σ, where $\sigma$ is the population standard deviation and $n$ is the sample size.^[29] This quantity provides a scale for the variability of the sampling distribution of the mean under normality assumptions, corresponding to approximately 68% coverage probability within $\pm$ SE of the true mean.^[7] The probable error of the mean (PE $_m$ ), by contrast, defines the half-range of a 50% probability interval around the mean estimate, and for normal distributions, PE $_m \approx 0.6745 \times \text{SE}$ , reflecting its tighter scaling relative to the full standard error.^[7] Confidence intervals (CIs) extend this framework by constructing intervals with explicit, user-specified coverage probabilities, such as the approximate 95% CI given by $\bar{x} \pm 1.96 \times \text{SE}$ , where $\bar{x}$ is the sample mean; this interval contains the true population mean with 95% confidence in repeated sampling.^[30] In contrast to the probable error's fixed association with 50% probability coverage, CIs offer flexibility in choosing confidence levels (e.g., 90%, 99%), enabling tailored assessments of estimation uncertainty.^[30] The probable error, tied rigidly to its 50% threshold, lacks this adaptability for varying inferential needs.^[7] For instance, in estimating a population mean, a 95% CI spans roughly $\pm 3$ PE $_m$ (since $3 \times 0.6745 \approx 2.02$ , near the 1.96 multiplier for SE), resulting in wider, more conservative bounds than the narrower 50% interval implied by PE $_m$ .^[7] This conservatism in CIs better supports decision-making under higher certainty requirements, such as in hypothesis testing or parameter estimation. The widespread adoption of SE and CIs as standard tools traces to R. A. Fisher's foundational work in the 1920s, including his development of significance testing and fiducial inference, which emphasized precise probability statements over the probable error's less flexible approach.^[29]^[30] By the mid-20th century, the probable error had become largely obsolete in favor of these methods for inferential statistics.^[31]

Current Relevance and Limitations

The probable error (PE) continues to find niche applications in engineering contexts, particularly within measurement systems analysis where it helps define effective resolution increments for instruments. For instance, in gage repeatability and reproducibility (Gage R&R) studies, PE is calculated as 0.675 times the measurement system's standard deviation to ensure that the smallest increment aligns with practical precision limits, preventing over-interpretation of data.^[32] It also appears in human reliability analysis methods like HEART and CREAM, where it quantifies error probabilities in system design.^[11] However, PE has been largely supplanted in mainstream statistics since the mid-20th century, replaced by more flexible inferential tools such as the standard error and t-tests that better handle small-sample inference.^[33] A key limitation of PE is its reliance on the assumption of a normal distribution for errors, which enables the use of established tables but can lead to significant inaccuracies if the data deviates substantially from normality.^[34] Additionally, PE provides a fixed 50% coverage interval around the estimate, focusing on the median deviation while overlooking tail risks in distributions; in contrast, confidence intervals (CIs) offer adjustable confidence levels, such as 95%, to better quantify uncertainty magnitude.^[11] This rigidity, combined with the absence of integration with Bayesian or robust statistical frameworks, renders PE less suitable for modern analyses requiring prior incorporation or outlier resistance.^[35] Despite these drawbacks, PE retains educational value in historical statistics curricula, where it illustrates early small-sample theory and the origins of the t-distribution.^[33] It remains useful for rapid assessments in scenarios where the standard deviation is unknown but the median error can be estimated from limited replicates. In 2025, PE persists in legacy metrology texts and older software for uncertainty propagation, though it is often critiqued for not aligning with contemporary standards like the Guide to the Expression of Uncertainty in Measurement (GUM), which favor expanded uncertainty over probable error.^[36]^[11]

Info Pages

Talk Pages

Special Pages

Probable error

Recent from talks

Recent from talks

Contribute something

Contribute something

Media Pages

Timelines

Articles

Notes collections

Notes

Notes

Days in Chronicle

Probable error

See also

References

Probable error

Definition

Basic Definition

Mathematical Formulation

Historical Development

Early Origins

Key Advancements

Applications

In Measurement Error Analysis

In Statistical Estimation

In Correlation and Regression

Comparisons and Modern Usage

With Standard Deviation and Variance

With Standard Error and Confidence Intervals

Current Relevance and Limitations

References

Add your contribution

Related Hubs

Contribute something

History

Probable error

Recent from talks

Recent from talks

Contribute something

Contribute something

Media Pages

Timelines

Articles

Notes collections

Notes

Notes

Days in Chronicle

Probable error

See also

References

Probable error

Definition

Basic Definition

Mathematical Formulation

Historical Development

Early Origins

Key Advancements

Applications

In Measurement Error Analysis

In Correlation and Regression

Comparisons and Modern Usage

With Standard Deviation and Variance

With Standard Error and Confidence Intervals

Current Relevance and Limitations

References

Add your contribution

Related Hubs

Contribute something