Signal Processing - May 2017 - 26

with the information-processing process as shown in Figure 6(a). They know that it often takes time (however short)
for market participants to process complex information,
whether it comes from human behaviors or trading/communication systems. Such transition processes are not well studied
quantitatively in finance literature, posing opportunities for SP
researchers. It is possible to use SP models and methodologies
to find impulse response to certain events, exploring the
microstructure of trading systems, especially in HFT systems.
Without ground-truth models and controlled experiments/
studies in modeling economic systems, the validity of SP models relies on data as well as economic explanations. We note
several traps in dealing with the model and data as follows.
■ Traps in data. First, survivorship bias: only data from successful companies or funds are used in analysis. For example,
stock data downloaded from popular websites like Yahoo
Finance do not include historical delisted companies. Second,
forward-looking bias: future (test) data are used to estimate
the model or inform the model construction. Third, selection
bias: data are selectively reported in a database, e.g., only
mutual funds/hedge funds performing well report results.
■ Solution: use unbiased data sets, e.g., Center for Research
in Security Prices (CRSP) data set, a gold standard in academic research on U.S. market daily stock returns. See [43]
for more details.
When evaluating and interpreting empirical results,
researchers need to be careful to select meaningful criteria and
statistical test methodology.
■ Test against alternative models, e.g., can you beat the FF
three-factor or the random-walk model?
■ Minimum mean-squared errors are not enough. Note that
asset-pricing model residuals are often considered idiosyncratic risks or the unknown risks that are not captured by
known factors. The important thing may be whether a model
properly attributes different types of risks rather than minimizes the residual. The explanatory power of a model should
be given more consideration depending on the applications.
■ Conduct extensive out-of-sample tests, and prove with statistical significance that your results are not due to chance.
Again, we caution that out-of-sample backtesting is helpful
as much as out-of-sample testing in SP and machine-learning
applications to check model fitness and robustness for known
data over multiple time periods. However, multiple models may
have similar fit into a set of data, and the past data may not perfectly represent the future in an open economic system. There
is generally no gold criterion to know the ground-truth model
without controlled experiments. Indeed, we do not even know
whether there exists a ground-truth model. The joint hypothesis problem always exists in discovering a model or a theory.
Therefore, economic justifications are always an integral part
of economic and business studies.

communities. Understanding basic concepts in econometrics
will help propel SP researchers in their work and allow them to
appreciate application issues in economics and business.

ARMA
In time-series econometrics [14], [44], the definitions of models have similar forms to those in SP. An autoregressive (AR)
process with the first-order, AR(1) process, is defined as
Yt = c + zYt -1 + f t,
AR( p) processes are defined as
p

Yt = c + / z i Yt -i + f t,
i =1

and ARMA( p, q) processes are defined as
q

i =1

i =1

where f t is white noise with zero mean and variance v 2 and
E [f t f x] = 0 when t ! x. Note that f t are indeed unpredictable innovations (shocks).
In econometrics, in place of the Z transform used in SP, a lag
operator L is used to represent time shift. Thus, the ARMA(p, q)
process can be represented by lag operator polynomials as
p

q

i =1

i =1

e 1 - / z i Li o Yt = c + e 1 + / i i Li o f t .
When observing an economic system, researchers do not
have control of the innovation or the unexpected shock, f t, which
can be various events, such as a sudden decrease of crude oil
prices. Meanwhile, there may be other exogenous variables that
are not uncorrelated white noise, such as the advertising investment of a company or interest rates set by central banks. Thus, to
analyze an economic system, the ARMA model needs to be generalized to the ARMA processes with the exogenous variables
(ARMAX) model. ARMAX(p, q, r) can be defined as
p

q

r

i =1

i =1

i =1

Yt = c + / z i Yt -i + f t + / i i f t -i + / h i X t -i ,
where X t represents exogenous variables. A special case of
the ARMAX model is AR distributed lag models (ARDL). An
ARDL( p, r) model is defined as
p

r

i =1

i =1

Yt = c + / z i Yt -i + / h i X t -i + f t .
A vector AR (VAR) model can be used to examine the interaction of a set of n economic variables. VAR(p) is specified as
p

y t = c + / U i y t - i + f t,

Basic econometric models,
time-series analysis, HFT, and SP

i =1

SP shares many similar terms and mathematics with econometrics, even though there are few interactions between the two
26

p

Yt = c + / z i Yt -i + f t + / i i f t -i,

where y t, c, and f t are n # 1 vectors and U i is an n # n
matrix.

IEEE Signal Processing Magazine

|

May 2017

|



Table of Contents for the Digital Edition of Signal Processing - May 2017

Signal Processing - May 2017 - Cover1
Signal Processing - May 2017 - Cover2
Signal Processing - May 2017 - 1
Signal Processing - May 2017 - 2
Signal Processing - May 2017 - 3
Signal Processing - May 2017 - 4
Signal Processing - May 2017 - 5
Signal Processing - May 2017 - 6
Signal Processing - May 2017 - 7
Signal Processing - May 2017 - 8
Signal Processing - May 2017 - 9
Signal Processing - May 2017 - 10
Signal Processing - May 2017 - 11
Signal Processing - May 2017 - 12
Signal Processing - May 2017 - 13
Signal Processing - May 2017 - 14
Signal Processing - May 2017 - 15
Signal Processing - May 2017 - 16
Signal Processing - May 2017 - 17
Signal Processing - May 2017 - 18
Signal Processing - May 2017 - 19
Signal Processing - May 2017 - 20
Signal Processing - May 2017 - 21
Signal Processing - May 2017 - 22
Signal Processing - May 2017 - 23
Signal Processing - May 2017 - 24
Signal Processing - May 2017 - 25
Signal Processing - May 2017 - 26
Signal Processing - May 2017 - 27
Signal Processing - May 2017 - 28
Signal Processing - May 2017 - 29
Signal Processing - May 2017 - 30
Signal Processing - May 2017 - 31
Signal Processing - May 2017 - 32
Signal Processing - May 2017 - 33
Signal Processing - May 2017 - 34
Signal Processing - May 2017 - 35
Signal Processing - May 2017 - 36
Signal Processing - May 2017 - 37
Signal Processing - May 2017 - 38
Signal Processing - May 2017 - 39
Signal Processing - May 2017 - 40
Signal Processing - May 2017 - 41
Signal Processing - May 2017 - 42
Signal Processing - May 2017 - 43
Signal Processing - May 2017 - 44
Signal Processing - May 2017 - 45
Signal Processing - May 2017 - 46
Signal Processing - May 2017 - 47
Signal Processing - May 2017 - 48
Signal Processing - May 2017 - 49
Signal Processing - May 2017 - 50
Signal Processing - May 2017 - 51
Signal Processing - May 2017 - 52
Signal Processing - May 2017 - 53
Signal Processing - May 2017 - 54
Signal Processing - May 2017 - 55
Signal Processing - May 2017 - 56
Signal Processing - May 2017 - 57
Signal Processing - May 2017 - 58
Signal Processing - May 2017 - 59
Signal Processing - May 2017 - 60
Signal Processing - May 2017 - 61
Signal Processing - May 2017 - 62
Signal Processing - May 2017 - 63
Signal Processing - May 2017 - 64
Signal Processing - May 2017 - 65
Signal Processing - May 2017 - 66
Signal Processing - May 2017 - 67
Signal Processing - May 2017 - 68
Signal Processing - May 2017 - 69
Signal Processing - May 2017 - 70
Signal Processing - May 2017 - 71
Signal Processing - May 2017 - 72
Signal Processing - May 2017 - 73
Signal Processing - May 2017 - 74
Signal Processing - May 2017 - 75
Signal Processing - May 2017 - 76
Signal Processing - May 2017 - 77
Signal Processing - May 2017 - 78
Signal Processing - May 2017 - 79
Signal Processing - May 2017 - 80
Signal Processing - May 2017 - 81
Signal Processing - May 2017 - 82
Signal Processing - May 2017 - 83
Signal Processing - May 2017 - 84
Signal Processing - May 2017 - 85
Signal Processing - May 2017 - 86
Signal Processing - May 2017 - 87
Signal Processing - May 2017 - 88
Signal Processing - May 2017 - 89
Signal Processing - May 2017 - 90
Signal Processing - May 2017 - 91
Signal Processing - May 2017 - 92
Signal Processing - May 2017 - 93
Signal Processing - May 2017 - 94
Signal Processing - May 2017 - 95
Signal Processing - May 2017 - 96
Signal Processing - May 2017 - 97
Signal Processing - May 2017 - 98
Signal Processing - May 2017 - 99
Signal Processing - May 2017 - 100
Signal Processing - May 2017 - 101
Signal Processing - May 2017 - 102
Signal Processing - May 2017 - 103
Signal Processing - May 2017 - 104
Signal Processing - May 2017 - 105
Signal Processing - May 2017 - 106
Signal Processing - May 2017 - 107
Signal Processing - May 2017 - 108
Signal Processing - May 2017 - 109
Signal Processing - May 2017 - 110
Signal Processing - May 2017 - 111
Signal Processing - May 2017 - 112
Signal Processing - May 2017 - Cover3
Signal Processing - May 2017 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201809
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201807
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201805
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201803
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_201801
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0917
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0717
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0517
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0317
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0117
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0916
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0716
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0516
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0316
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0116
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0915
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0715
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0515
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0315
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0115
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0914
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0714
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0514
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0314
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0114
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0913
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0713
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0513
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0313
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0113
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0912
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0712
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0512
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0312
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0112
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0911
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0711
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0511
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0311
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0111
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0910
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0710
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0510
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0310
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0110
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0909
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0709
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0509
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0309
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0109
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_1108
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0908
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0708
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0508
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0308
https://www.nxtbook.com/nxtbooks/ieee/signalprocessing_0108
https://www.nxtbookmedia.com