Memorylessness
Waiting time property of certain probability distributions
In probability and statistics, memorylessness is a property of probability distributions. It describes situations where previous failures or elapsed time does not affect future trials or further wait time. Only the geometric and exponential distributions are memoryless.
01Definition
A random variable is memoryless if
where
is its probability mass function or probability density function when
is discrete or continuous respectively and
and
are nonnegative numbers. In discrete cases, the definition describes the first success in an infinite sequence of independent and identically distributed Bernoulli trials, like the number of coin flips until landing heads. In continuous situations, memorylessness models random phenomena, like the time between two earthquakes. The memorylessness property asserts that the number of previously failed trials or the elapsed time is independent, or has no effect, on the future trials or lead time.
The equality characterizes the geometric and exponential distributions in discrete and continuous contexts respectively. In other words, the geometric random variable is the only discrete memoryless distribution and the exponential random variable is the only continuous memoryless distribution.
In discrete contexts, the definition is altered to when the geometric distribution starts at
instead of
so the equality is still satisfied.
02Characterization of exponential distribution
If a continuous probability distribution is memoryless, then it must be the exponential distribution.
From the memorylessness property,The definition of conditional probability reveals that
Rearranging the equality with the survival function,
, gives
This implies that for any natural number
Similarly, by dividing the input of the survival function and taking the
-th root,
In general, the equality is true for any rational number in place of
. Since the survival function is continuous and rational numbers are dense in the real numbers (in other words, there is always a rational number arbitrarily close to any real number), the equality also holds for the reals. As a result,
where
. This is the survival function of the exponential distribution.
03Characterization of geometric distribution
If a discrete probability distribution is memoryless, then it must be the geometric distribution.
From the memorylessness property,
The definition of conditional probability reveals that
From this it can be proven by induction that
Then it follows that
and if we let
we can easily see that
is geometrically distributed with some parameter
; in other words
Sources and credits
This article is adapted from the Wikipedia article “Memorylessness”, written by its contributors and licensed under CC BY-SA 4.0. Fathomly has changed the layout, removed citation markers, navigation and maintenance notices, and adjusted punctuation. This adapted version is shared under the same license. For references, see the original article.
Fathomly is not affiliated with or endorsed by the Wikimedia Foundation. Spotted a problem? Tell us.