Expected shortfall
Risk measure estimating the average loss in the worst tail of the distribution
Expected shortfall (ES) is a risk measure, a concept used in the field of financial risk measurement to evaluate the market risk or credit risk of a portfolio. The "expected shortfall at q% level" is the expected return on the portfolio in the worst of cases. ES is an alternative to value at risk that is more sensitive to the shape of the tail of the loss distribution.
Expected shortfall is also called conditional value at risk (CVaR), average value at risk (AVaR), tail value at risk (TVaR), conditional tail expectation (CTE), expected tail loss (ETL), and superquantile. These names are often used interchangeably, although several definitions exist in the literature. These definitions coincide in many cases, but may differ for certain types of loss distributions.
01Background
Risk measures are used both in mathematical finance and in actuarial science, and the value-at-risk and expected shortfall measures are often expressed using different sign conventions and tail conventions in these disciplines. The discussion that follows takes the mathematical finance point of view.
In mathematical finance, risk measures arise when considering the profit/loss distribution, i.e., payoff, for a financial portfolio, modeled as a random variable . This can take positive or negative values, and downside risk corresponds to quantiles with
close to 0. A risk threshold
is selected, and
is defined to be the absolute value of the
quantile of
(ignoring some technicalities). This is also the
quantile of
. The expected shortfall at level
is then defined as the average value of
for
in the interval
, i.e., it is the average VaR over all levels below
.
Expected shortfall is often considered preferable to VaR because it accounts for the severity of the failure, not only the chance of failure. Further, it is a coherent spectral measure of financial portfolio risk, while VaR is not. This is a collection of mathematical properties, one of which ensures that diversification of a portfolio never leads to a higher measure of risk. Viewing the value produced by a risk measure as a capital reserve requirement, ES at level is always more conservative than VaR at the same level, i.e., ES is always at least as big as VaR at the same level.
02Formal definition
If is an integrable random variable representing the payoff of a portfolio at some future time and
then the expected shortfall of
at level
is
where is the value at risk.
Several other definitions appear in the literature under the names ES, TVaR, AVaR, CTE, and CVaR. The formulation above as an integral of VaR values is coherent and well-defined in the general case. Other definitions typically coincide under common assumptions such as continuity of the loss distribution, but may differ for distributions with atoms.
The above definition is equivalent to
where is the lower
-quantile and
is the indicator function.
Some authors define expected shortfall, tail conditional expectation, or related quantities directly as a conditional expectation beyond the relevant quantile,
This formulation agrees with the general definition above when the distribution is continuous at , but may differ for distributions having atoms at the quantile. Indeed, the second term in the formula just preceding this one vanishes for random variables with continuous distribution functions, and this conditional expectation formula follows.
Some variation in definitions arise from the differing conventions used between, say, financial mathematics and actuarial science, where things written with one set of conventions can be translated into a context with different ones. But there is further inconsistency, with some cases of substantively different definitions used for the same term. For instance, Sweeting defines TVaR as the tail conditional expectation, whereas he defines expected shortfall as the scaled version .
There are a number of related, but subtly different, formulations for TVaR in the literature. A common case in literature is to define TVaR and average value at risk as the same measure. Under some formulations, it is only equivalent to expected shortfall when the underlying distribution function is continuous at , the value at risk of level
.
The canonical tail value at risk is the left-tail (large negative values) in some disciplines and the right-tail (large positive values) in other, such as actuarial science. This is usually due to the differing conventions of treating losses as large negative or positive values. Using the negative value convention, Artzner and others define the tail value at risk as:
Given a random variable which is the payoff of a portfolio at some future time and given a parameter
then the tail value at risk is defined by
where
is the upper
-quantile given by
. Typically the payoff random variable
is in some Lp-space where
to guarantee the existence of the expectation. The typical values for
are 5% and 1%.
The dual representation is
where is the set of probability measures which are absolutely continuous to the physical measure
such that
almost surely. Note that
is the Radon-Nikodym derivative of
with respect to
.
Expected shortfall can be generalized to a general class of coherent risk measures on spaces (Lp space) with a corresponding dual characterization in the corresponding
dual space. The domain can be extended for more general Orlicz Hearts.
If the underlying distribution for is a continuous distribution then the expected shortfall is equivalent to the tail conditional expectation defined by
.
Informally, and non-rigorously, this equation amounts to saying "in case of losses so severe that they occur only alpha percent of the time, what is our average loss".
Expected shortfall can also be written as a distortion risk measure given by the distortion function
03Examples
Example 1. If we believe our average loss on the worst 5% of the possible outcomes for our portfolio is EUR 1000, then we could say our expected shortfall is EUR 1000 for the 5% tail.
Example 2. Consider a portfolio that will have the following possible values at the end of the period:
| probability of event |
ending value of the portfolio |
|---|---|
| 10% | 0 |
| 30% | 80 |
| 40% | 100 |
| 20% | 150 |
Now assume that we paid 100 at the beginning of the period for this portfolio. Then the profit in each case is (ending value−100) or:
| probability of event |
profit |
|---|---|
| 10% | −100 |
| 30% | −20 |
| 40% | 0 |
| 20% | 50 |
From this table let us calculate the expected shortfall for a few values of
:
| expected shortfall | |
|---|---|
| 5% | 100 |
| 10% | 100 |
| 20% | 60 |
| 30% | 46.6 |
| 40% | 40 |
| 50% | 32 |
| 60% | 26.6 |
| 80% | 20 |
| 90% | 12.2 |
| 100% | 6 |
To see how these values were calculated, consider the calculation of , the expectation in the worst 5% of cases. These cases belong to (are a subset of) row 1 in the profit table, which have a profit of −100 (total loss of the 100 invested). The expected profit for these cases is −100.
Now consider the calculation of , the expectation in the worst 20 out of 100 cases. These cases are as follows: 10 cases from row one, and 10 cases from row two (note that 10+10 equals the desired 20 cases). For row 1 there is a profit of −100, while for row 2 a profit of −20. Using the expected value formula we get
Similarly for any value of . We select as many rows starting from the top as are necessary to give a cumulative probability of
and then calculate an expectation over those cases. In general, the last row selected may not be fully used (for example in calculating
we used only 10 of the 30 cases per 100 provided by row 2).
As a final example, calculate . This is the expectation over all cases, or
The value at risk (VaR) is given below for comparison.
| 100 | |
| 20 | |
| 0 | |
| -50 |
04Properties
The expected shortfall increases as
decreases.
The 100%-quantile expected shortfall equals negative of the expected value of the portfolio.
For a given portfolio, the expected shortfall is greater than or equal to the Value at Risk
at the same
level.
05Optimization of expected shortfall
Expected shortfall, in its standard form, is known to lead to a generally non-convex optimization problem. However, it is possible to transform the problem into a linear program and find the global solution. This property makes expected shortfall a cornerstone of alternatives to mean-variance portfolio optimization, which account for the higher moments (e.g., skewness and kurtosis) of a return distribution.
Suppose that we want to minimize the expected shortfall of a portfolio. The key contribution of Rockafellar and Uryasev in their 2000 paper is to introduce the auxiliary function for the expected shortfall:
Where
and
is a loss function for a set of portfolio weights
to be applied to the returns. Rockafellar/Uryasev proved that
is convex with respect to
and is equivalent to the expected shortfall at the minimum point. To numerically compute the expected shortfall for a set of portfolio returns, it is necessary to generate
simulations of the portfolio constituents; this is often done using copulas. With these simulations in hand, the auxiliary function may be approximated by:
This is equivalent to the formulation:
Finally, choosing a linear loss function
turns the optimization problem into a linear program. Using standard methods, it is then easy to find the portfolio that minimizes expected shortfall.
06Formulas for continuous probability distributions
Closed-form formulas exist for calculating the expected shortfall when the payoff of a portfolio or a corresponding loss
follows a specific continuous distribution. In the former case, the expected shortfall corresponds to the opposite number of the left-tail conditional expectation below
:
Typical values of in this case are 5% and 1%.
For engineering or actuarial applications it is more common to consider the distribution of losses , the expected shortfall in this case corresponds to the right-tail conditional expectation above
and the typical values of
are 95% and 99%:
Since some formulas below were derived for the left-tail case and some for the right-tail case, the following reconciliations can be useful:
Normal distribution
If the payoff of a portfolio follows the normal (Gaussian) distribution with p.d.f.
then the expected shortfall is equal to
, where
is the standard normal p.d.f.,
is the standard normal c.d.f., so
is the standard normal quantile.
If the loss of a portfolio follows the normal distribution, the expected shortfall is equal to
.
Generalized Student's t-distribution
If the payoff of a portfolio follows the generalized Student's t-distribution with p.d.f.
then the expected shortfall is equal to
, where
is the standard t-distribution p.d.f.,
is the standard t-distribution c.d.f., so
is the standard t-distribution quantile.
If the loss of a portfolio follows generalized Student's t-distribution, the expected shortfall is equal to
.
Laplace distribution
If the payoff of a portfolio follows the Laplace distribution with the p.d.f.
and the c.d.f.
then the expected shortfall is equal to for
.
If the loss of a portfolio follows the Laplace distribution, the expected shortfall is equal to
Logistic distribution
If the payoff of a portfolio follows the logistic distribution with p.d.f.
and the c.d.f.
then the expected shortfall is equal to
.
If the loss of a portfolio follows the logistic distribution, the expected shortfall is equal to
.
Exponential distribution
If the loss of a portfolio follows the exponential distribution with p.d.f.
and the c.d.f.
then the expected shortfall is equal to
.
Pareto distribution
If the loss of a portfolio follows the Pareto distribution with p.d.f.
and the c.d.f.
then the expected shortfall is equal to
.
Generalized Pareto distribution (GPD)
If the loss of a portfolio follows the GPD with p.d.f.
and the c.d.f.
then the expected shortfall is equal to
and the VaR is equal to
Weibull distribution
If the loss of a portfolio follows the Weibull distribution with p.d.f.
and the c.d.f.
then the expected shortfall is equal to
, where
is the upper incomplete gamma function.
Generalized extreme value distribution (GEV)
If the payoff of a portfolio follows the GEV with p.d.f.
and c.d.f.
then the expected shortfall is equal to
and the VaR is equal to
, where
is the upper incomplete gamma function,
is the logarithmic integral function.
If the loss of a portfolio follows the GEV, then the expected shortfall is equal to
, where
is the lower incomplete gamma function,
is the Euler-Mascheroni constant.
Generalized hyperbolic secant (GHS) distribution
If the payoff of a portfolio follows the GHS distribution with p.d.f.
and the c.d.f.
then the expected shortfall is equal to
, where
is the dilogarithm and
is the imaginary unit.
Johnson's SU-distribution
If the payoff of a portfolio follows Johnson's SU-distribution with the c.d.f.
then the expected shortfall is equal to
, where
is the c.d.f. of the standard normal distribution.
Burr type XII distribution
If the payoff of a portfolio follows the Burr type XII distribution the p.d.f.
and the c.d.f.
, the expected shortfall is equal to
, where
is the hypergeometric function. Alternatively,
.
Dagum distribution
If the payoff of a portfolio follows the Dagum distribution with p.d.f.
and the c.d.f.
, the expected shortfall is equal to
, where
is the hypergeometric function.
Lognormal distribution
If the payoff of a portfolio follows lognormal distribution, i.e. the random variable
follows the normal distribution with p.d.f.
, then the expected shortfall is equal to
, where
is the standard normal c.d.f., so
is the standard normal quantile.
Log-logistic distribution
If the payoff of a portfolio follows log-logistic distribution, i.e. the random variable
follows the logistic distribution with p.d.f.
, then the expected shortfall is equal to
, where
is the regularized incomplete beta function,
.
As the incomplete beta function is defined only for positive arguments, for a more generic case the expected shortfall can be expressed with the hypergeometric function: .
If the loss of a portfolio follows log-logistic distribution with p.d.f.
and c.d.f.
, then the expected shortfall is equal to
, where
is the incomplete beta function.
Log-Laplace distribution
If the payoff of a portfolio follows log-Laplace distribution, i.e. the random variable
follows the Laplace distribution the p.d.f.
, then the expected shortfall is equal to
Log-generalized hyperbolic secant (log-GHS) distribution
If the payoff of a portfolio follows log-GHS distribution, i.e. the random variable
follows the GHS distribution with p.d.f.
, then the expected shortfall is equal to
where is the hypergeometric function.
07Dynamic expected shortfall
The conditional version of the expected shortfall at the time t is defined by
where .
This is not a time-consistent risk measure. The time-consistent version is given by
such that
Sources and credits
This article is adapted from the Wikipedia article “Expected shortfall”, written by its contributors and licensed under CC BY-SA 4.0. Fathomly has changed the layout, removed citation markers, navigation and maintenance notices, and adjusted punctuation. This adapted version is shared under the same license. For references, see the original article.
Fathomly is not affiliated with or endorsed by the Wikimedia Foundation. Spotted a problem? Tell us.