Morningstar Magazine - August/September 2018 - 48
Strategies
Filling in the Gaps
How smoothed discrete distributions
combine the advantages of discrete and
continuous models of returns.
QUANT U
Paul D. Kaplan
Quantitative investment models, such as optimization and simulation, embody specific
assumptions about the probability distribution
of returns. While the most common approach is to
assume that returns follow a normal or a lognormal distribution, that approach has important
limitations. Specifically, there is no flexibility
in the shape of the distribution. One way
of overcoming that limitation is to take a discrete
scenario-based approach. However, discrete
distributions have other limitations.
When Sam Savage and I developed the Markowitz
2.0 optimization framework, we introduced a
smoothed discrete distribution model that combines
the advantages of continuous distributions
with the advantages of scenario-based models.
(See the December/January 2015 issue of Quant
U.) In this issue of Quant U, I present the
smoothed discrete model in detail and illustrate
its advantages. But before I do, I present
a classification scheme for distributions to show
where the smoothed discrete model fits into
the grand scheme of things.
Types of Distributions
Discrete vs. Continuous
The main distinction between different distributions
is whether they are discrete or continuous. If a
random variable has a discrete distribution,
it can only take on specific values. For example, if
you toss a coin n times, the number of heads
follows a binomial distribution. The only values
that this random variable can take are 0, 1, 2,..., n.
48
Morningstar August/September 2018
In this case, the number of possible values is
finite. But there are discrete distributions where
the number of possible values is infinite,
but at discrete intervals. For example, a random
variable that follows a Poisson distribution
can take on any non-negative integer. (Poisson
distributions are used for modeling the number of
occurrences of something per unit of time,
length, volume, etc.)
Random variables that follow continuous
distributions can take on any value, possibly
limited to a range. For example, a random variable
that follows a normal distribution can take
any value, while a random variable following
a standard uniform distribution can take any value
between 0 and 1. The limit can be one-sided.
For example, the return on a long-only investment
can take on any value above negative 100%.
Parametric vs. Nonparametric
All of the distributions that I have discussed so
far are parametric: Each can be described
by a few parameters. For example, a binomial
distribution is described by two parameters: the
probability of getting heads on each coin toss
and the number of tosses. A Poisson distribution is
fully described by its mean. Both normal and
lognormal distributions can be described by their
means and standard deviations.
A limitation of normal and lognormal distributions
is that they do not model fat tails. In the
June/July 2014 issue of Quant U, I introduced a set
of parametric distributions, the Johnson family,
that generalizes both normal and lognormal
distributions by having skewness and kurtosis
as parameters.
While parametric distributions can be quite
useful in modeling investment returns and other
phenomena, they impose limitations on
distribution shape. Nonparametric distributions
do not have this limitation because they
can take on any shape. To form a nonparametric
distribution, the model builder creates a list
of scenarios and assigns a value and probability
to each. In investment analysis, the most
common way of creating a nonparametric
distribution is to take a historical return series,
treat each observation as a scenario,
and assign equal probabilities to them. (If the
application is forward-looking, the historical
returns should be adjusted to reflect forecasts.)
Four Types of Distributions
Because, on one hand, a distribution can be either
discrete or continuous and, on the other hand,
it can be either parametric or nonparametric,
there are four types of distributions. Here are the
distributions that I have discussed, plus the
smoothed discrete distribution that Savage and
I developed for Markowitz 2.0:
Classification of Probability Distributions
Parametric
Nonparametric
Discrete
Binomial,
Poisson
Scenario-Based
Continuous
Standard
Uniform,
Normal,
Lognormal,
Johnson
Smoothed
Discrete
I will now discuss the motivation for creating the
smoothed discrete distribution and the details of
how it works.
Smoothed Discrete Distributions
The Problem of Gaps
The limitation of the scenario approach is that
the distributions it creates have large gaps
between values, especially in the tails.
This is because the returns in the tails are rare.
Because one of the goals of Markowitz 2.0
is to effectively model return distributions
with fat tails, Savage and I needed a method for
filling in these gaps.
Table of Contents for the Digital Edition of Morningstar Magazine - August/September 2018
Contents
Morningstar Magazine - August/September 2018 - Cover1
Morningstar Magazine - August/September 2018 - Cover2
Morningstar Magazine - August/September 2018 - 1
Morningstar Magazine - August/September 2018 - 2
Morningstar Magazine - August/September 2018 - Contents
Morningstar Magazine - August/September 2018 - 4
Morningstar Magazine - August/September 2018 - 5
Morningstar Magazine - August/September 2018 - 6
Morningstar Magazine - August/September 2018 - 7
Morningstar Magazine - August/September 2018 - 8
Morningstar Magazine - August/September 2018 - 9
Morningstar Magazine - August/September 2018 - 10
Morningstar Magazine - August/September 2018 - 11
Morningstar Magazine - August/September 2018 - 12
Morningstar Magazine - August/September 2018 - 13
Morningstar Magazine - August/September 2018 - 14
Morningstar Magazine - August/September 2018 - 15
Morningstar Magazine - August/September 2018 - 16
Morningstar Magazine - August/September 2018 - 17
Morningstar Magazine - August/September 2018 - 18
Morningstar Magazine - August/September 2018 - 19
Morningstar Magazine - August/September 2018 - 20
Morningstar Magazine - August/September 2018 - 21
Morningstar Magazine - August/September 2018 - 22
Morningstar Magazine - August/September 2018 - 23
Morningstar Magazine - August/September 2018 - 24
Morningstar Magazine - August/September 2018 - 25
Morningstar Magazine - August/September 2018 - 26
Morningstar Magazine - August/September 2018 - 27
Morningstar Magazine - August/September 2018 - 28
Morningstar Magazine - August/September 2018 - 29
Morningstar Magazine - August/September 2018 - 30
Morningstar Magazine - August/September 2018 - 31
Morningstar Magazine - August/September 2018 - 32
Morningstar Magazine - August/September 2018 - 33
Morningstar Magazine - August/September 2018 - 34
Morningstar Magazine - August/September 2018 - 35
Morningstar Magazine - August/September 2018 - 36
Morningstar Magazine - August/September 2018 - 37
Morningstar Magazine - August/September 2018 - 38
Morningstar Magazine - August/September 2018 - 39
Morningstar Magazine - August/September 2018 - 40
Morningstar Magazine - August/September 2018 - 41
Morningstar Magazine - August/September 2018 - 42
Morningstar Magazine - August/September 2018 - 43
Morningstar Magazine - August/September 2018 - 44
Morningstar Magazine - August/September 2018 - 45
Morningstar Magazine - August/September 2018 - 46
Morningstar Magazine - August/September 2018 - 47
Morningstar Magazine - August/September 2018 - 48
Morningstar Magazine - August/September 2018 - 49
Morningstar Magazine - August/September 2018 - 50
Morningstar Magazine - August/September 2018 - 51
Morningstar Magazine - August/September 2018 - 52
Morningstar Magazine - August/September 2018 - 53
Morningstar Magazine - August/September 2018 - 54
Morningstar Magazine - August/September 2018 - 55
Morningstar Magazine - August/September 2018 - 56
Morningstar Magazine - August/September 2018 - 57
Morningstar Magazine - August/September 2018 - 58
Morningstar Magazine - August/September 2018 - 59
Morningstar Magazine - August/September 2018 - 60
Morningstar Magazine - August/September 2018 - 61
Morningstar Magazine - August/September 2018 - 62
Morningstar Magazine - August/September 2018 - 63
Morningstar Magazine - August/September 2018 - 64
Morningstar Magazine - August/September 2018 - 65
Morningstar Magazine - August/September 2018 - 66
Morningstar Magazine - August/September 2018 - 67
Morningstar Magazine - August/September 2018 - 68
Morningstar Magazine - August/September 2018 - 69
Morningstar Magazine - August/September 2018 - 70
Morningstar Magazine - August/September 2018 - 71
Morningstar Magazine - August/September 2018 - 72
Morningstar Magazine - August/September 2018 - 73
Morningstar Magazine - August/September 2018 - 74
Morningstar Magazine - August/September 2018 - 75
Morningstar Magazine - August/September 2018 - 76
Morningstar Magazine - August/September 2018 - 77
Morningstar Magazine - August/September 2018 - 78
Morningstar Magazine - August/September 2018 - 79
Morningstar Magazine - August/September 2018 - 80
Morningstar Magazine - August/September 2018 - Cover3
Morningstar Magazine - August/September 2018 - Cover4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2024q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2024q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2024q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2024q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019winter
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019fall
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019summer
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019spring
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20191201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20181011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20181201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20171011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20171201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20161011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20161201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20151011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20151201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20141011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20141201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20131011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20131201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20121011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120405
https://www.nxtbook.com/nxtbooks/morningstar/investorconference2012
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20121201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20111011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20111201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20101011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20101201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20091011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008fall
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008summer
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2007spring
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2007fall
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2007summer
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008spring
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008catalog
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008winter
https://www.nxtbookmedia.com