The exponential power family and the γ-order generalized normal
The γ-order generalized normal has the same univariate shape as the exponential power family known since 1923. It differs in the origin of that shape and, in several dimensions, in the type of dependence between components. A translator between the two parametrisations is included.
When I first studied the γ-order generalized normal distribution (γGN), introduced in the γ-order generalized normal distribution, an obvious question arose: whether it is simply the exponential power distribution under a different name.
In one dimension the curves coincide exactly. The two families, however, have different origins, and the extension to several variables involves a modelling choice that matters far more than the name. This article sets out the correspondence between the two parametrisations and explains where the real difference lies.
The family has been rediscovered and renamed several times over a century.
- Subbotin (1923), an astronomer, generalised Gauss's law of errors to densities proportional to .
- Box and Tiao (1973) called it the exponential power distribution and used it to test how robust Bayesian conclusions are to the normal assumption.
- Nelson (1991) used it, as the generalized error distribution, for the shocks in his EGARCH volatility model. Signal processing calls it the generalized Gaussian, and uses it to model the coefficients of image and audio transforms, which are sharply peaked at zero with heavy tails.
- Gómez, Gómez-Villegas and Marín (1998) studied its elliptical multivariate version.
- Nadarajah (2005) published a "generalized normal distribution" of the same shape, and Mineo and Ruggieri (2005) the R package
normalp. Python's SciPy implements it asgennorm. - Kitsos and Tavoularis (2009) obtained the γGN from a generalized logarithmic Sobolev inequality, and Kitsos and Stamatiou (2025) reviewed the family and made the correspondence with the exponential power distribution explicit.
The γGN in the same coordinates
The univariate γGN with location , scale and shape has density
Set and absorb the factor into the scale, and this is Subbotin's density. The dictionary:
| γGN shape | Exponent | Member |
|---|---|---|
| uniform | ||
| lighter tails than normal | ||
| normal | ||
| heavier tails than normal | ||
| Laplace | ||
| heavier tails than Laplace |
The γGN parameter space is the real line without , and it covers every . The negative values of are simply the very heavy-tailed members. Kitsos and Stamatiou show how extreme they get: for the standardised member with , the probability below −3 is about 0.17, against 0.0013 for the normal.
This is useful for software. Anything written for the exponential power distribution works for the γGN after converting and the scale .
Difference in origin
Subbotin's family is a natural generalisation: replace the square in Gauss's exponent by any power. The γGN has a different origin. Kitsos and Tavoularis obtained it as the family of extremal functions of a generalized, γ-order logarithmic Sobolev inequality, the inequality that in its classical form singles out the normal. Read that way, the exponent is not a free choice but the conjugate exponent the inequality produces, and the constant follows from the same calculation. A later note in this series covers the inequality itself.
Kitsos and Stamatiou argue that this grounding is what separates the γGN from generalisations "obtained by trial and error". The significance of this is partly a matter of judgement, but it has a practical consequence: entropy, Fisher information and the Kullback-Leibler divergence take simple forms on the γGN, because the family was built from them.
Difference in the multivariate case
There are two natural ways to make a vector out of a univariate shape:
- Product: multiply univariate densities, so the components are independent by construction.
- Elliptical: let the density depend on the data only through the Mahalanobis distance.
The γGN takes the elliptical route by construction, because its inequality lives directly in several dimensions:
Up to parametrisation this is the elliptical power exponential of Gómez and colleagues; both belong to the Kotz family. The two constructions agree only for the normal. Otherwise they describe different dependence structures: in one, a large shock in one coordinate says nothing about the others; in the other, large shocks tend to occur together.
Sensors give a concrete case of each. Two thermometers in different rooms have independent electronic noise, and the product form describes them. Two accelerometers on the same vehicle both register the same pothole, so a large reading on one makes a large reading on the other more likely, even if their readings are uncorrelated on average; the elliptical form describes them. The name of the family does not settle which applies: the physical situation does.
The translator below illustrates three properties: every exponent corresponds to exactly one γ outside ; the map runs off to infinity at the Laplace member; and tails get heavier as β falls.
The top panel draws ; the bottom panel draws the density with unit variance so that only the shape changes.
Suggested settings:
- Presets. Uniform-ish, normal, γ = 4, Laplace, γ = −1. Note the probability of landing beyond three standard deviations: about 0.27% for the normal, 0.90% for γ = 4, 1.44% for the Laplace and 2.18% for γ = −1.
- Crossing β = 1. Move β slowly from 1.2 down to 0.8. The dot on the top panel rises to and comes back from , while the density below changes smoothly. The curve changes little while the label changes greatly; this is why estimating γ directly near the Laplace member is unstable.
- Correspondence. Find the β that gives γ = 3. The slider lands at β ≈ 1.5, and confirms it: .
Properties of the map. From it follows that , so : γ and β are Hölder conjugates, . The map is strictly increasing from onto ; taking reciprocals sends to and to , and the value (γ infinite) corresponds to β = 1. So every β > 0 has exactly one γ in , plus the Laplace limit. The tail readout uses the closed form , with the regularised upper incomplete gamma function.
Practical implications:
- Use the existing tools. In one dimension, decades of work on the exponential power family, its estimation and its software transfer to the γGN.
- Mind the parametrisation. The same curve can be indexed by γ or by β, and near the Laplace member only β is well behaved. That matters for estimation, as a later note shows.
- The multivariate choice is a modelling decision. Independent components or elliptical dependence is a statement about the data, whatever name the family carries.
References
- M. T. Subbotin, "On the law of frequency of error", Matematicheskii Sbornik, 31(2), 296-301, 1923.
- G. E. P. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis, Addison-Wesley, 1973.
- D. B. Nelson, "Conditional heteroskedasticity in asset returns: a new approach", Econometrica, 59(2), 347-370, 1991.
- E. Gómez, M. A. Gómez-Villegas and J. M. Marín, "A multivariate generalization of the power exponential family of distributions", Communications in Statistics to Theory and Methods, 27(3), 589-600, 1998.
- S. Nadarajah, "A generalized normal distribution", Journal of Applied Statistics, 32(7), 685-694, 2005.
- A. M. Mineo and M. Ruggieri, "A software tool for the exponential power distribution: the normalp package", Journal of Statistical Software, 12(4), 1-24, 2005.
- C. P. Kitsos and N. K. Tavoularis, "Logarithmic Sobolev inequalities for information measures", IEEE Transactions on Information Theory, 55(6), 2554-2561, 2009.
- C. P. Kitsos and I. S. Stamatiou, "On the emerged from LSI γ-order generalized normal distribution", Journal of the Indian Society for Probability and Statistics, 26(2), 737-762, 2025.