Generalized normal distribution
Probability distribution
The generalized normal distribution (GND) or generalized Gaussian distribution (GGD) is either of two parametric families of continuous probability distributions on the real line. Both families add a shape parameter to the normal distribution. To distinguish the two families, they are referred to below as "symmetric" and "asymmetric"; however, this is not a standard nomenclature.
01Symmetric version
The symmetric generalized normal distribution, also known as the Subbotin distribution, exponential power distribution or the generalized error distribution, is a parametric family of symmetric distributions. It includes all normal and Laplace distributions, and as limiting cases it includes all continuous uniform distributions on bounded intervals of the real line.
This family includes the normal distribution when (with mean
and variance
) and it includes the Laplace distribution when
. As
, the density converges pointwise to a uniform density on
.
This family allows for tails that are either heavier than normal (when ) or lighter than normal (when
). It is a useful way to parametrize a continuum of symmetric, platykurtic densities spanning from the normal (
) to the uniform density (
), and a continuum of symmetric, leptokurtic densities spanning from the Laplace (
) to the normal density (
).
The shape parameter
also controls the peakedness in addition to the tails.
Parameter estimation
Parameter estimation via maximum likelihood and the method of moments has been studied. The estimates do not have a closed form and must be obtained numerically. Estimators that do not require numerical calculation have also been proposed.
The generalized normal log-likelihood function has infinitely many continuous derivates (i.e. it belongs to the class of smooth functions) only if
is a positive, even integer. Otherwise, the function has
continuous derivatives. As a result, the standard results for consistency and asymptotic normality of maximum likelihood estimates of
only apply when
.
Maximum likelihood estimator
It is possible to fit the generalized normal distribution adopting an approximate maximum likelihood method. With initially set to the sample first moment
,
is estimated by using a Newton-Raphson iterative procedure, starting from an initial guess of
,
where
is the first statistical moment of the absolute values and is the second statistical moment. The iteration is
where
and
and
are the digamma function and trigamma function respectively.
Given a value for , it is possible to estimate
by finding the minimum of:
Finally is evaluated as
For , median is a more appropriate estimator of
. Once
is estimated,
and
can be estimated as described above.
Applications
The symmetric generalized normal distribution has been used in modeling when the concentration of values around the mean and the tail behavior are of particular interest. Other families of distributions can be used if the focus is on other deviations from normality. If the symmetry of the distribution is the main interest, the skew normal family or asymmetric version of the generalized normal family discussed below can be used. If the tail behavior is the main interest, the student t family can be used, which approximates the normal distribution as the degrees of freedom grows to infinity. The t distribution, unlike this generalized normal distribution, obtains heavier than normal tails without acquiring a cusp at the origin. It finds uses in plasma physics under the name of Langdon Distribution resulting from inverse bremsstrahlung.
In a linear regression problem modeled as , the MLE will be the
where the p-norm is used.
Properties
Moments
Let be zero mean generalized Gaussian distribution of shape
and scaling parameter
. The moments of
exist and are finite for any
greater than
. For any non-negative integer
, the plain central moments are
Connection to positive-definite functions
The probability density function of the symmetric generalized normal distribution is a positive-definite function for .
Infinite divisibility
The symmetric generalized Gaussian distribution is an infinitely divisible distribution if and only if .
Generalizations
The multivariate generalized normal distribution, i.e. the product of exponential power distributions with the same
and
parameters, is the only probability density that can be written in the form
and has independent marginals. The results for the special case of the Multivariate normal distribution is originally attributed to Maxwell.
02Asymmetric version
| Asymmetric generalized normal | |||
|---|---|---|---|
| Probability density function | |||
| Cumulative distribution function | |||
| Parameters |
| ||
| Support |
| ||
|
| |||
| CDF |
| ||
| Mean |
| ||
| Median |
| ||
| Variance |
| ||
| Skewness |
| ||
| Excess kurtosis |
| ||
The asymmetric generalized normal distribution is a family of continuous probability distributions in which the shape parameter can be used to introduce asymmetry or skewness. When the shape parameter is zero, the normal distribution results. Positive values of the shape parameter yield left-skewed distributions bounded to the right, and negative values of the shape parameter yield right-skewed distributions bounded to the left. Only when the shape parameter is zero is the density function for this distribution positive over the whole real line: in this case the distribution is a normal distribution, otherwise the distributions are shifted and possibly reversed log-normal distributions.
Parameter estimation
Parameters can be estimated via maximum likelihood estimation or the method of moments. The parameter estimates do not have a closed form, so numerical calculations must be used to compute the estimates. Since the sample space (the set of real numbers where the density is non-zero) depends on the true value of the parameter, some standard results about the performance of parameter estimates will not automatically apply when working with this family.
Applications
The asymmetric generalized normal distribution can be used to model values that may be normally distributed, or that may be either right-skewed or left-skewed relative to the normal distribution. The skew normal distribution is another distribution that is useful for modeling deviations from normality due to skew. Other distributions used to model skewed data include the gamma, lognormal, and Weibull distributions, but these do not include the normal distributions as special cases.
03Kullback-Leibler divergence between two PDFs
Kullback-Leibler divergence (KLD) is a method using for compute the divergence or similarity between two probability density functions.
Let and
two generalized Gaussian distributions with parameters
and
subject to the constraint
. Then this divergence is given by:
Sources and credits
This article is adapted from the Wikipedia article “Generalized normal distribution”, written by its contributors and licensed under CC BY-SA 4.0. Fathomly has changed the layout, removed citation markers, navigation and maintenance notices, and adjusted punctuation. This adapted version is shared under the same license. For references, see the original article.
Fathomly is not affiliated with or endorsed by the Wikimedia Foundation. Spotted a problem? Tell us.