Computational Intelligence - May 2014 - 44

t

x ( t)

dE of error function with respect to i using the directly-learning style [34], the optimal identified parameters i * are
i

)

= D @ x,

It is worth noting here that Kalman filter with forgetting
factor for predicting muscular torque has to be with a properly-chosen fixed forgetting factor, which usually distributes
within the range [0.9, 1] [32]. Otherwise, Kalman filter may
encounter instability and unsatisfactory output results since the
forgetting factor may sensitively affect its stability. Compared
with Kalman filter with forgetting factor, the proposed
NARX-RNN model with its directly-learning estimator, may
be regarded as a more robust alternative.

where notation D @ is the pseudoinverse of matrix D . This estimation equation provides a more straightforward way to obtain
the accurate parameters for identifying NARX-RNN models.
In the procedures above, we can observe that many zeros
appear in the aforementioned matrices and vectors, which
implies that computational time consumption for solving pseudoinverse of matrix D could be rather low. That is to say, the
time cost for identifying the parameters of NARX-RNN
model (1) describing the relationship between FES-induced
torque and eEMG can be low. This is important for online predictive FES control of muscle to establish the predictive model
instantly after the identification phase.
As the torque sensors may not be available in practice for
patient's daily life, so as to perform better predictive control of
muscle activity, we need to predict the muscle torque based
only on eEMG. In this case, real-time identification of muscle
dynamics is switched off after time instant t id and thus muscle
model updating is stopped. We use the latest identified parameters i * till t = t id to predict the muscle torque, and measured
torque is never considered afterwards. According to equation
(1), the predicted torque is as follows.

by RNN Update
Normalized Torque
Parameters
by Kalman Filtering
Normalized Torque

V. Verification Based on Experimental Data

In this section, we focus on the verification of the proposed
NARX-RNN model with data from five SCI subjects. For
the purposes of comparison, Kalman filter with forgetting
factor [32] is also applied for the muscular torque identification and prediction, based on the NARX-type muscle model
used in [32].
As in Fig. 5, identification is terminated at time instant t id
and then prediction is started afterwards with the latest estimated
parameters from time instant t id and ended at time instant t pr .
The process cycle is repeated periodically. During the first time
period [t id, t pr ], the NARX-RNN model shows similar prediction results as those of Kalman filter. However, as observed from

Identification Off

Identification Off

3

= i *T [xt (t - 1), g, xt (t - l ), u (t - 1), g,
u n (t - m), u (t - m) xt (t - 1), u (t - 1) xt (t - l )] T . (4)

Identification Off

2
1
0

v1(t)
w11(t)

-1
-2

0

10

20

30

40

50

60

70

80

90

a(t)
b(t)
100

Measured
Estimated
eEMG Based Prediction

1
0.8
0.6
0.4
0.2
0
0

10

20

30

40

50

60

70

80

90

100

Measured
Estimated
eEMG Based Prediction

1
0.8
0.6
0.4
0.2
0
0

10

20

30

40

50
Time (s)

60

70

80

90

100

Figure 5 Performance of NARX-RNN model and Kalman filter with forgetting factor with eEMG for periodic torque estimation. Identification was
switched off for 18s (with blue background color in middle and lower plots). From top to bottom: updated parameters v 1 (t), w 11 (t), a (t), and
b (t) of NARX-RNN model; identification and prediction synthesized by NARX-RNN; identification and prediction results synthesized by Kalman
filter with forgetting factor m = 0.965.

44

IEEE ComputatIonal IntEllIgEnCE magazInE | may 2014



Table of Contents for the Digital Edition of Computational Intelligence - May 2014

Computational Intelligence - May 2014 - Cover1
Computational Intelligence - May 2014 - Cover2
Computational Intelligence - May 2014 - 1
Computational Intelligence - May 2014 - 2
Computational Intelligence - May 2014 - 3
Computational Intelligence - May 2014 - 4
Computational Intelligence - May 2014 - 5
Computational Intelligence - May 2014 - 6
Computational Intelligence - May 2014 - 7
Computational Intelligence - May 2014 - 8
Computational Intelligence - May 2014 - 9
Computational Intelligence - May 2014 - 10
Computational Intelligence - May 2014 - 11
Computational Intelligence - May 2014 - 12
Computational Intelligence - May 2014 - 13
Computational Intelligence - May 2014 - 14
Computational Intelligence - May 2014 - 15
Computational Intelligence - May 2014 - 16
Computational Intelligence - May 2014 - 17
Computational Intelligence - May 2014 - 18
Computational Intelligence - May 2014 - 19
Computational Intelligence - May 2014 - 20
Computational Intelligence - May 2014 - 21
Computational Intelligence - May 2014 - 22
Computational Intelligence - May 2014 - 23
Computational Intelligence - May 2014 - 24
Computational Intelligence - May 2014 - 25
Computational Intelligence - May 2014 - 26
Computational Intelligence - May 2014 - 27
Computational Intelligence - May 2014 - 28
Computational Intelligence - May 2014 - 29
Computational Intelligence - May 2014 - 30
Computational Intelligence - May 2014 - 31
Computational Intelligence - May 2014 - 32
Computational Intelligence - May 2014 - 33
Computational Intelligence - May 2014 - 34
Computational Intelligence - May 2014 - 35
Computational Intelligence - May 2014 - 36
Computational Intelligence - May 2014 - 37
Computational Intelligence - May 2014 - 38
Computational Intelligence - May 2014 - 39
Computational Intelligence - May 2014 - 40
Computational Intelligence - May 2014 - 41
Computational Intelligence - May 2014 - 42
Computational Intelligence - May 2014 - 43
Computational Intelligence - May 2014 - 44
Computational Intelligence - May 2014 - 45
Computational Intelligence - May 2014 - 46
Computational Intelligence - May 2014 - 47
Computational Intelligence - May 2014 - 48
Computational Intelligence - May 2014 - 49
Computational Intelligence - May 2014 - 50
Computational Intelligence - May 2014 - 51
Computational Intelligence - May 2014 - 52
Computational Intelligence - May 2014 - 53
Computational Intelligence - May 2014 - 54
Computational Intelligence - May 2014 - 55
Computational Intelligence - May 2014 - 56
Computational Intelligence - May 2014 - 57
Computational Intelligence - May 2014 - 58
Computational Intelligence - May 2014 - 59
Computational Intelligence - May 2014 - 60
Computational Intelligence - May 2014 - 61
Computational Intelligence - May 2014 - 62
Computational Intelligence - May 2014 - 63
Computational Intelligence - May 2014 - 64
Computational Intelligence - May 2014 - 65
Computational Intelligence - May 2014 - 66
Computational Intelligence - May 2014 - 67
Computational Intelligence - May 2014 - 68
Computational Intelligence - May 2014 - 69
Computational Intelligence - May 2014 - 70
Computational Intelligence - May 2014 - 71
Computational Intelligence - May 2014 - 72
Computational Intelligence - May 2014 - Cover3
Computational Intelligence - May 2014 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com