Quasi-maximum likelihood estimate

Quasi-maximum likelihood estimateMain

Community hub

7 pages, 0 posts

0 subscribers

Recent from talks

Be the first to start a discussion here.

Recent from talks

Be the first to start a discussion here.

Contribute something

About hubMembersContent overviewUpdatesRules

Main reference articles

Quasi-maximum likelihood estimate

View on Wikipedia

from Wikipedia

In statistics a quasi-maximum likelihood estimate (QMLE), also known as a pseudo-likelihood estimate or a composite likelihood estimate, is an estimate of a parameter θ in a statistical model that is formed by maximizing a function that is related to the logarithm of the likelihood function, but in discussing the consistency and (asymptotic) variance-covariance matrix, we assume some parts of the distribution may be mis-specified.^[1]^[2] In contrast, the maximum likelihood estimate maximizes the actual log likelihood function for the data and model. The function that is maximized to form a QMLE is often a simplified form of the actual log likelihood function. A common way to form such a simplified function is to use the log-likelihood function of a misspecified model that treats certain data values as being independent, even when in actuality they may not be. This removes any parameters from the model that are used to characterize these dependencies. Doing this only makes sense if the dependency structure is a nuisance parameter with respect to the goals of the analysis. ^[3] As long as the quasi-likelihood function that is maximized is not oversimplified, the QMLE (or composite likelihood estimate) is consistent and asymptotically normal. It is less efficient than the maximum likelihood estimate, but may only be slightly less efficient if the quasi-likelihood is constructed so as to minimize the loss of information relative to the actual likelihood.^[4] Standard approaches to statistical inference that are used with maximum likelihood estimates, such as the formation of confidence intervals, and statistics for model comparison,^[5] can be generalized to the quasi-maximum likelihood setting.

References

[edit]

^ Lindsay, Bruce G. (1988). "Composite likelihood methods". Statistical inference from stochastic processes (Ithaca, NY, 1987). Contemporary Mathematics. Vol. 80. Providence, RI: American Mathematical Society. pp. 221–239. doi:10.1090/conm/080/999014. MR 0999014.
^ Davidson, Russel; MacKinnon, James (2004). Econometric Theory and Methods. New York, New York: Oxford University Press. ISBN 978-0-19-512372-2.
^ Gourieroux, Christian; Monfort, Alain; Trognon, Alain (1984). "Pseudo Maximum Likelihood Methods: Theory" (PDF). Econometrica. 52 (3): 681–700. doi:10.2307/1913471. JSTOR 1913471. S2CID 122981013.
^ Cox, D.R.; Reid, Nancy (2004). "A note on pseudo-likelihood constructed from marginal densities". Biometrika. 91 (3): 729–737. CiteSeerX 10.1.1.136.7476. doi:10.1093/biomet/91.3.729.
^ Varin, Cristiano; Vidoni, Paolo (2005). "A note on composite likelihood inference and model selection" (PDF). Biometrika. 92 (3): 519–528. doi:10.1093/biomet/92.3.519.

Revisions and contributors Edit on Wikipedia Read on Wikipedia

Quasi-maximum likelihood estimate

View on Grokipedia

from Grokipedia

In statistics, the quasi-maximum likelihood estimate (QMLE), also referred to as a pseudo-maximum likelihood estimate, is an estimation method that maximizes a log-likelihood function constructed from an assumed probability density, even when this density does not match the true underlying distribution of the data.^[1] This approach yields consistent parameter estimates for the value that minimizes the Kullback-Leibler divergence between the true and assumed distributions, making it robust to model misspecification under suitable conditions.^[1] QMLE is particularly valuable in scenarios where the full likelihood is intractable or unknown, allowing researchers to leverage familiar maximum likelihood machinery while ensuring reliable inference.^[2] The concept of QMLE emerged in the early 1980s within econometrics, building on foundational work examining the behavior of maximum likelihood under misspecification. Halbert White's 1982 paper formalized the properties of such estimators, demonstrating their consistency and deriving their asymptotic distribution in a general framework.^[1] Shortly thereafter, Christian Gourieroux, Alain Monfort, and Alain Trognon extended this theory in 1984, introducing "pseudo maximum likelihood methods" and classifying families of densities (such as certain exponential families) that guarantee strong consistency and asymptotic normality for estimators of interest parameters like means and variances.^[2] These developments addressed limitations in traditional maximum likelihood estimation, which assumes correct model specification, and provided tools for robust estimation in nonlinear and dynamic models.^[2] Key properties of QMLE include weak or strong consistency for the pseudo-true parameter, provided the parameter space is compact and a uniform law of large numbers holds for the quasi-log-likelihood.^[1] Asymptotically, the estimator is normally distributed, but unlike standard maximum likelihood—where the information matrix equality simplifies the variance—the QMLE variance takes a "sandwich" form:

A^{-1} B A^{-1}

, where

A

is the expected Hessian of the quasi-log-likelihood and

B

is its score covariance, reflecting heteroskedasticity or misspecification.^[1] This robust covariance estimator enables valid hypothesis testing and confidence intervals without assuming correct specification.^[1] QMLE has broad applications in econometrics, time series analysis, and generalized linear models, such as estimating autoregressive conditional heteroskedasticity (ARCH) models or discrete choice systems where the true distribution is complex.^[3] For instance, ordinary least squares can be viewed as a QMLE under Gaussian assumptions for linear regression, remaining consistent even with non-normal errors.^[3] Its flexibility has made it a cornerstone for robust inference in empirical research, influencing subsequent methods like generalized method of moments.^[2]

Background Concepts

Maximum Likelihood Estimation

Maximum likelihood estimation (MLE) is a fundamental statistical method for estimating the parameters of a probabilistic model from observed data. Given a sample of independent and identically distributed (i.i.d.) observations

y = (y_1, \dots, y_n)

drawn from a probability density function

f(y_i \mid \theta)

, where

\theta

is the unknown parameter vector, the likelihood function is defined as

L(\theta; y) = \prod_{i=1}^n f(y_i \mid \theta)

. The MLE, denoted

\hat{\theta}

, is the value of

\theta

that maximizes this likelihood, assuming the model is correctly specified.^[4] To facilitate computation, the maximization is typically performed on the log-likelihood:

\hat{\theta} = \arg\max_\theta \log L(\theta; y) = \arg\max_\theta \sum_{i=1}^n \log f(y_i \mid \theta)

. The first derivative of the log-likelihood with respect to

\theta

, known as the score function

s(\theta) = \frac{\partial}{\partial \theta} \log L(\theta; y)

, plays a central role; at the maximum,

s(\hat{\theta}) = 0

. Under standard regularity conditions, such as differentiability of the log-likelihood and the existence of finite moments, the expected value of the score is zero:

E[s(\theta)] = 0

, ensuring that the true parameter satisfies the first-order condition in expectation. The method was developed by Ronald A. Fisher in the early 1920s, with its formal introduction in his 1922 paper, where he presented MLE as an optimal estimation procedure under correct model specification, offering desirable properties like efficiency relative to other estimators. A key result in this framework is the information matrix equality, which states that the variance of the score function equals the negative expected value of the second derivative of the log-likelihood:

\operatorname{Var}(s(\theta)) = -E\left[ \frac{\partial^2}{\partial \theta^2} \log L(\theta; y) \right] = I(\theta)

, where

I(\theta)

is the Fisher information matrix measuring the amount of information the sample carries about

\theta

. This equality underpins the asymptotic efficiency of the MLE. Under the same regularity conditions, the MLE exhibits asymptotic normality, converging in distribution to a normal random variable centered at the true parameter with covariance given by the inverse Fisher information.^[4]

Likelihood Misspecification

Likelihood misspecification arises when the parametric family of probability distributions specified for maximum likelihood estimation does not encompass the true data-generating process, such that the assumed density

f(y \mid \theta)

deviates from the true density

g(y \mid \theta)

.^[1] In this scenario, the maximum likelihood estimator fails to converge to the true parameter values, resulting in inconsistency.^[1] The consequences of such misspecification are profound, including biased parameter estimates that do not recover the underlying true values, invalid standard errors that undermine hypothesis testing and confidence intervals, and the violation of the information matrix equality, where the expected outer product of the score differs from the negative expected Hessian.^[1] A prevalent form of misspecification in regression analysis involves assuming normally distributed residuals when the true error distribution exhibits heavier tails, such as the Student-t distribution; this can severely distort inferences about random effects and variance components. Despite these issues, misspecification does not necessarily destroy all structural properties of the likelihood; in particular, the score function may retain a zero expected value and finite variance at a pseudo-true parameter value, laying the groundwork for quasi-maximum likelihood approaches that exploit these moments for robust estimation.^[1]

Formal Definition

Quasi-Likelihood Function

The quasi-likelihood function in the context of quasi-maximum likelihood estimation is the log-likelihood constructed from an assumed parametric probability density

f(y \mid \theta)

, which may not match the true data-generating distribution

g(y \mid \theta_0)

. It is defined as

Q(\theta; y) = \frac{1}{n} \sum_{i=1}^n \log f(y_i \mid \theta),

where the average is over

n

independent observations. This function is maximized to obtain parameter estimates that approximate the data under the assumed model, even under misspecification. The resulting estimator converges to the pseudo-true parameter

\theta^*

that minimizes the expected Kullback-Leibler divergence

\mathbb{E}_g [\log g(y \mid \theta_0) - \log f(y \mid \theta)]

.^[1] A key property is that the expected score under the true distribution vanishes at

\theta^*

\mathbb{E}_g \left[ \frac{\partial}{\partial \theta} \log f(y \mid \theta) \right]_{\theta = \theta^*} = 0

, provided suitable regularity conditions hold, such as compactness of the parameter space and identifiability. This ensures consistency of the estimator without requiring correct specification of

f

. The score function is generally

s_i(\theta) = \frac{\partial}{\partial \theta} \log f(y_i \mid \theta)

, and for specific assumed densities (e.g., Gaussian in linear regression), it simplifies to forms like weighted least squares, but the framework applies broadly to nonlinear models.^[3] In contrast to full maximum likelihood, which requires the assumed density

f

to be correctly specified for optimal efficiency, the quasi-likelihood approach yields consistent estimates as long as the pseudo-true parameter is well-defined, making it robust to distributional misspecification while retaining the computational advantages of likelihood optimization.

Quasi-Maximum Likelihood Estimator

The quasi-maximum likelihood estimator (QMLE), denoted

\hat{\theta}_{\mathrm{QML}}

, is defined as

\hat{\theta}_{\mathrm{QML}} = [\arg\max](/page/Arg_max)_{\theta} Q(\theta; y)

, where

Q(\theta; y)

is the quasi-likelihood function based on an assumed but potentially misspecified density

f(y_i \mid \theta)

. This estimator, introduced by White (1982) in the context of misspecified parametric models, seeks to find the parameter values that best approximate the data under the chosen quasi-likelihood, even when the true data-generating process differs from the assumed one.^[1] To obtain the QMLE, the optimization problem is typically solved by setting the score equations to zero:

\sum_{i=1}^n s_i(\theta) = 0

, where

s_i(\theta) = \frac{\partial}{\partial \theta} \log f(y_i \mid \theta)

represents the individual score contributions. When a closed-form solution is unavailable—which is common for nonlinear models—numerical methods such as the Newton-Raphson algorithm are applied iteratively to converge to the maximum, relying on approximations of the Hessian matrix for updates. These procedures ensure computational feasibility while maintaining the estimator's properties under misspecification.^[3] For inference, standard errors are computed using the sandwich variance estimator, which accounts for potential misspecification in the assumed density:

\hat{V}(\hat{\theta}_{\mathrm{QML}}) = \hat{A}^{-1} \hat{B} \hat{A}^{-1},

where

\hat{A} = -\frac{1}{n} \sum_{i=1}^n \frac{\partial^2 \log f(y_i \mid \hat{\theta}_{\mathrm{QML}})}{\partial \theta \partial \theta^T}

is the average negative Hessian (approximating the expected information matrix), and

\hat{B} = \frac{1}{n} \sum_{i=1}^n s_i(\hat{\theta}_{\mathrm{QML}}) s_i(\hat{\theta}_{\mathrm{QML}})^T

is the score outer-product matrix. This robust form, derived from the asymptotic covariance structure under misspecification, provides consistent estimates of the variability without assuming the quasi-likelihood is correctly specified.^[3] In practice, QMLE is frequently implemented in statistical software such as R and Stata, often assuming a Gaussian quasi-likelihood for its analytical simplicity and ease of optimization in models like conditional heteroskedasticity or panel data regressions. For instance, R's sandwich package computes the corresponding robust covariance matrices, while Stata's ml command with the vce(robust) option facilitates quasi-maximum likelihood fitting.

Asymptotic Properties

Consistency

The consistency of the quasi-maximum likelihood estimator (QMLE), denoted

\hat{\theta}_{QML}

, refers to its convergence in probability to a pseudo-true parameter

\theta_0

as the sample size

n \to \infty

, even when the assumed likelihood function is misspecified relative to the true data-generating process. Under the general framework of maximum likelihood estimation under misspecification,

\theta_0

is defined as the value that minimizes the Kullback-Leibler (KL) divergence between the true density

g(y|x)

and the assumed quasi-density

f(y|x; \theta)

, ensuring the estimator targets the parameter best approximating the true model in an information-theoretic sense.^[1] A key theorem establishes that if the conditional mean is correctly specified, i.e.,

E[y|x; \theta] = \mu(\theta)

holds for the true parameter, then

\hat{\theta}_{QML} \to_p \theta_0

n \to \infty

, where

\theta_0

coincides with the true parameter value that achieves this mean specification. This result holds because the KL minimizer

\theta_0

aligns with the true parameter when the mean function is well-specified, regardless of misspecification in higher-order moments such as the conditional variance. The proof sketch relies on the uniform law of large numbers (ULLN) applied to the average quasi-log-likelihood

(1/n) \sum_{i=1}^n \log f(y_i | x_i; \theta)

, which converges almost surely to its expectation

E_g[\log f(y|x; \theta)]

, where the expectation is taken under the true density

g

. This expected quasi-log-likelihood is maximized uniquely at

\theta_0

, and under standard regularity conditions, the maximizer of the sample average

\hat{\theta}_{QML}

thus converges in probability to

\theta_0

. Necessary conditions for this ULLN include i.i.d. observations (or ergodicity for dependent data), bounded moments to ensure integrability of the log-quasi-likelihood, and identifiability of the mean function, meaning

\theta_0

is the unique minimizer of the KL divergence within the parameter space.^[1]^[5] This consistency property is particularly robust in contexts like generalized linear models (GLMs), where the QMLE remains consistent for the parameters governing the conditional mean even if the variance structure is misspecified, provided the link function correctly captures the mean relationship. For instance, assuming a Gaussian quasi-likelihood in a Poisson regression setting yields consistent estimates of the mean parameters despite variance misspecification.

Asymptotic Normality

Under misspecification, the quasi-maximum likelihood estimator (QMLE)

\hat{\theta}_n

converges at rate

\sqrt{n}

to a normal distribution, enabling valid statistical inference through confidence intervals and hypothesis tests that account for model errors. Specifically, assuming consistency of $\hat{\theta}_n$ for the pseudo-true parameter $\theta_0$ that minimizes the Kullback-Leibler divergence between the true and assumed distributions, the central limit theorem applies to the normalized estimation error.^[1] The asymptotic normality is formally stated in Theorem 3.2 of White (1982): under suitable regularity conditions, $\sqrt{n}(\hat{\theta}_n - \theta_0) \xrightarrow{d} N(0, A(\theta_0)^{-1} B(\theta_0) A(\theta_0)^{-1})$

(θ^n−θ0)d

N(0,A(θ0)−1B(θ0)A(θ0)−1), where $A(\theta_0) = E\left[-\frac{\partial^2 \log f(U; \theta_0)}{\partial \theta \partial \theta'}\right]$ is the expected negative Hessian of the quasi-log-likelihood evaluated at $\theta_0$ under the true data-generating process, and $B(\theta_0) = E\left[\frac{\partial \log f(U; \theta_0)}{\partial \theta} \left(\frac{\partial \log f(U; \theta_0)}{\partial \theta}\right)'\right]$ is the covariance matrix of the score vector (or outer product of gradients). This "sandwich" form of the asymptotic variance $V = A^{-1} B A^{-1}$ robustly captures the misspecification by separating the curvature of the objective function (via $A$ ) from the actual variability in the scores (via $B$ ). An equivalent information-matrix notation, as in Gourieroux, Monfort, and Trognon (1984), expresses $V = I_f^{-1} I_g I_f^{-1}$ , where $I_f$ is the expected information under the fitted (assumed) model and $I_g$ under the true process.^[1]^[2] Beyond the conditions for consistency—such as identifiability of $\theta_0$ and a weak law of large numbers for the quasi-likelihood—the normality result requires additional assumptions to ensure the central limit theorem holds for the score sums. These include twice continuous differentiability of the quasi-log-likelihood on a compact parameter space, uniform integrability of the score and Hessian terms to justify stochastic equicontinuity, and a Lindeberg condition on the score increments to control the impact of large deviations. Moreover, $A(\theta_0)$ must be positive definite and nonsingular to guarantee the invertibility of the sandwich components.^[1]^[2] This robust asymptotic variance improves upon the naive maximum likelihood estimator (MLE) variance $A^{-1}$ , which assumes correct specification and typically underestimates the true variability when the model is misspecified, leading to overly narrow confidence intervals and inflated test rejection rates. By incorporating $B$ , which may exceed $A$ under misspecification due to inflated score variances, the sandwich estimator provides consistent standard errors for inference even when the likelihood is only pseudo-true.^[1]

Applications

Time Series Models

In time series models, quasi-maximum likelihood estimation (QMLE) is particularly valuable for dynamic structures exhibiting conditional heteroskedasticity and autocorrelation, where full distributional assumptions may be unrealistic. For autoregressive moving average (ARMA) models, assuming a Gaussian likelihood for the innovations provides consistent estimates of the model parameters, including the innovation variance as a measure of volatility, even when the errors deviate from normality, provided the mean equation is correctly specified. This approach leverages the quasi-likelihood to focus on the conditional mean dynamics while delivering robust parameter recovery under misspecified error distributions.^[6] A prominent extension arises in generalized autoregressive conditional heteroskedasticity (GARCH) models, which capture time-varying volatility clustering common in financial time series. The standard GARCH(1,1) specification posits that the conditional variance follows

\sigma_t^2 = \omega + \alpha \varepsilon_{t-1}^2 + \beta \sigma_{t-1}^2,

where

\omega > 0

\alpha \geq 0

\beta \geq 0

, and

\alpha + \beta < 1

for stationarity, with

\varepsilon_t = \sigma_t z_t

and

z_t

being the standardized innovations. Gaussian QMLE for this model yields consistent estimates of the variance parameters as long as the conditional mean equation is correctly modeled, remaining robust to fat-tailed or non-Gaussian innovations that often characterize real data. Bollerslev (1986) popularized this Gaussian QMLE framework for GARCH, establishing it as a cornerstone for volatility modeling without requiring precise knowledge of the innovation distribution.^[7] A key advantage of QMLE in these time series contexts is its ability to handle evolving conditional variances through a simplified Gaussian pseudo-likelihood, avoiding the computational burden of fully specified distributions while maintaining estimation reliability. For inference, robust standard errors are essential to account for serial correlation in the score function arising from temporal dependencies; these can be computed using sandwich estimators that ensure valid hypothesis testing under misspecification. This draws on the asymptotic normality of the QMLE, enabling reliable confidence intervals and tests in the presence of heteroskedasticity and autocorrelation.^[6]

Econometric Models

In ordinary least squares (OLS) regression, the quasi-maximum likelihood estimator (QMLE) under a Gaussian assumption coincides with the standard least squares estimator, providing consistent estimates of the regression coefficients even when the errors exhibit heteroskedasticity, though inference requires adjustment via robust standard errors to account for the misspecification.^[1] This approach, pioneered by White, ensures valid hypothesis testing and confidence intervals by employing a heteroskedasticity-consistent covariance matrix estimator, often referred to as the sandwich estimator, which remains asymptotically valid under mild regularity conditions.^[1] In generalized linear models (GLMs), QMLE leverages a quasi-likelihood function derived from the exponential family, focusing on the correct specification of the mean structure and link function rather than the full distributional assumption, yielding consistent parameter estimates as long as the conditional mean is accurately modeled.^[8] McCullagh formalized this framework, demonstrating that the estimating equations align with those of full maximum likelihood when the variance is proportional to the mean's variance function, making QMLE particularly robust for overdispersed or heteroskedastic count data and binary outcomes common in econometric applications.^[8] For panel data models, fixed effects QMLE addresses unobserved individual-specific heterogeneity by conditioning on within-unit variation, assuming conditional independence of errors given the fixed effects and covariates, which allows consistent estimation without parametric distributional assumptions on the errors.^[9] This method, as analyzed in spatial and dynamic panel contexts, extends to non-spatial settings by differencing out fixed effects, providing robustness to arbitrary forms of unobserved heterogeneity while maintaining asymptotic efficiency under correct mean specification.^[10] QMLE has become a cornerstone in empirical economics for policy evaluation, where clustered standard errors are incorporated to handle correlation within groups such as households or regions, ensuring reliable inference amid dependence.

Examples

Linear Regression under Heteroskedasticity

In the linear regression model, the response vector

\mathbf{y}

is related to the design matrix

\mathbf{X}

and parameter vector

\beta

\mathbf{y} = \mathbf{X}\beta + \varepsilon

, where the errors satisfy

E[\varepsilon \mid \mathbf{X}] = \mathbf{0}

but exhibit conditional heteroskedasticity,

\Var(\varepsilon_i \mid \mathbf{X}) = \sigma^2 h(\mathbf{x}_i)

with unknown form for the scaling function

h(\mathbf{x}_i)

.^[11] Assuming a Gaussian quasi-likelihood, the quasi-maximum likelihood estimator (QMLE) for

\beta

reduces to the ordinary least squares (OLS) estimator

\hat{\beta} = (\mathbf{X}^T \mathbf{X})^{-1} \mathbf{X}^T \mathbf{y}

, which remains consistent under the correct specification of the conditional mean despite the misspecified variance.^[11] For valid inference, the covariance matrix of

\hat{\beta}

is estimated using the heteroskedasticity-consistent estimator, often termed the sandwich estimator in the QMLE framework:

\widehat{\Var}(\hat{\beta}) = \left( \frac{\mathbf{X}^T \mathbf{X}}{n} \right)^{-1} \left( \frac{1}{n} \sum_{i=1}^n \hat{u}_i^2 \mathbf{x}_i \mathbf{x}_i^T \right) \left( \frac{\mathbf{X}^T \mathbf{X}}{n} \right)^{-1},

\Var

(β^)=(nXTX)−1(n1i=1∑nu^i2xixiT)(nXTX)−1, where $\hat{u}_i = y_i - \mathbf{x}_i^T \hat{\beta}$ are the OLS residuals. The robust standard errors are the square roots of the diagonal elements of this matrix, ensuring asymptotic normality of $\sqrt{n}(\hat{\beta} - \beta)$

(β^−β) even under heteroskedasticity.^[11] This approach yields the same point estimates as OLS but provides corrected standard errors for hypothesis testing and confidence intervals, addressing the invalidity of homoskedasticity-based inference. Under heteroskedasticity, the naive OLS standard errors underestimate the true variability, inflating t-statistics and leading to excessive type I errors; simulations demonstrate that this underestimation can result in nominal 5% tests rejecting up to 50% or more of the time in small samples with strong heteroskedasticity.^[12]^[13] A hypothetical example illustrates this in a wage regression context, where log hourly wage is regressed on years of education and labor market experience using cross-sectional data from U.S. workers across states. Heteroskedasticity may arise due to state-level economic variations; applying Gaussian QMLE produces OLS coefficients but uses robust standard errors to confirm statistical significance, avoiding the overly precise inference from naive OLS.

GARCH Model Estimation

The GARCH(1,1) model, introduced by Bollerslev, extends the ARCH framework to capture volatility clustering in financial time series through a conditional variance equation that depends on both past squared returns and past variances. In this setup, the return process is specified as

r_t = \sigma_t z_t

, where

z_t

are independent and identically distributed errors with mean zero and unit variance, and the conditional variance follows

\sigma_t^2 = \omega + \alpha r_{t-1}^2 + \beta \sigma_{t-1}^2

, with parameters

\theta = (\omega, \alpha, \beta)^\top

satisfying

\omega > 0

\alpha \geq 0

\beta \geq 0

. Although the true distribution of

z_t

is often misspecified—typically exhibiting leptokurtosis in asset returns—the quasi-maximum likelihood estimator (QMLE) assumes

z_t \sim N(0,1)

for estimation, which provides consistent parameter estimates under mild moment conditions.^[14] Estimation proceeds by maximizing the quasi-log-likelihood function

Q(\theta) = -\frac{1}{T} \sum_{t=1}^T \left( \frac{1}{2} \log \sigma_t^2 + \frac{r_t^2}{2 \sigma_t^2} \right)

, where

\sigma_t^2

is recursively computed from the model equation.^[14] To initialize the recursion,

\sigma_1^2

is commonly set to the unconditional sample variance of the returns, ensuring numerical stability in optimization routines such as the Berndt-Hall-Hall-Hausman algorithm. The resulting QMLE

\hat{\theta}

converges at rate

\sqrt{T}

to the true parameter value that minimizes the Kullback-Leibler distance to the data-generating process, even under non-normality.^[14] Interpreting the estimates involves assessing model adequacy and stationarity. The sum $\hat{\alpha} + \hat{\beta} < 1$ indicates covariance stationarity, implying that shocks to volatility decay over time, with higher values signaling greater persistence in volatility clustering. Standard errors for inference must account for misspecification using the robust sandwich form, specifically the outer product of gradients estimator, which sandwiches the information matrix with the covariance of score contributions to yield asymptotically valid hypothesis tests. This adjustment is crucial in empirical settings where the Gaussian assumption fails, as it prevents underestimation of uncertainty in parameter estimates. A practical illustration arises in estimating volatility for daily S&P 500 returns during turbulent periods such as the 2000s, which exhibit pronounced volatility clustering and leptokurtosis. Applying QMLE under the Gaussian assumption typically yields parameter estimates indicating high persistence (with $\alpha + \beta$ close to but less than 1). Despite heavy-tailed innovations, the QMLE accurately recovers the conditional volatility dynamics, underscoring its robustness under misspecification. Robust standard errors from the outer product estimator ensure reliable confidence intervals.

Info Pages

Talk Pages

Special Pages

Quasi-maximum likelihood estimate

Recent from talks

Recent from talks

Contribute something

Contribute something

Media Pages

Timelines

Articles

Notes collections

Notes

Notes

Days in Chronicle

Quasi-maximum likelihood estimate

See also

References

Quasi-maximum likelihood estimate

Background Concepts

Maximum Likelihood Estimation

Likelihood Misspecification

Formal Definition

Quasi-Likelihood Function

Quasi-Maximum Likelihood Estimator

Asymptotic Properties

Consistency

Asymptotic Normality

Applications

Time Series Models

Econometric Models

Examples

Linear Regression under Heteroskedasticity

GARCH Model Estimation

References

Add your contribution

Related Hubs

Contribute something

History

Quasi-maximum likelihood estimate

Recent from talks

Recent from talks

Contribute something

Contribute something

Media Pages

Timelines

Articles

Notes collections

Notes

Notes

Days in Chronicle

Quasi-maximum likelihood estimate

See also

References

Quasi-maximum likelihood estimate

Background Concepts

Maximum Likelihood Estimation

Likelihood Misspecification

Formal Definition

Quasi-Likelihood Function

Quasi-Maximum Likelihood Estimator

Asymptotic Properties

Consistency

Asymptotic Normality

Add your contribution

Related Hubs

Contribute something