IEEE Computational Intelligence Magazine - November 2021 - 31
and MTO-DRA) can generally outperform the base optimizer,
MMDE, in terms of the MSS values and the relative rankings,
which proves the necessity of resource allocation.
However, in some special cases, the resource allocation component
may adversely affect the original MMDE. To elaborate,
Table IV showcases that MTO-DRA is generally worse than
the original MMDE. Specifically, in the CILS problem and the
PIMS problem, the proposed GRA is also worse than the
original MMDE, even though GRA outperforms MMDE in
other benchmark problems. To explain, when encountering
only two tasks, the resource allocation component can merely
decide which task to invest computational resources into.
Generally, the task with better fitness improvement in the past
few generations is chosen to enjoy additional evaluations. In
this approach, it is possible that the problem with higher difficulty
that needs further evaluations to overcome local optima
is ignored. Conversely, the algorithm without resource allocation
can assign more evaluations to the difficult task, and can
effectively avoid local optima.5 In this case, the resource
allocation component such as GRA and MTO-DRA can be
detrimental to the overall performance. As for the comparison
of GRA and MTO-DRA, since GRA can capture a longterm
optimization performance due to the multi-step nonlinear
regression and can employ the transfer information during
evolution, it can generally outperform MTO-DRA in complex
problems in Table V. In Table IV, it seems like GRA is
comparable with MTO-DRA, since in this case the MOO
extension of MTO-DRA is based on our proposed method in
Section III.D, and the fixed allocation intensity, RAI, of MTODRA
is proper when encountering only two tasks. However,
the overall performance across all the problems and overall
rankings of GRA are still better.6
As for
the 50-task problems depicted in Table VI,
GRA can significantly outperform MTO-DRA and
MMDE due to the controllable resource allocation intensity,
RAI. Recall that in MTO-DRA, the value of RAI is
fixed as /,K11+^h which is as small as 0.0196 in 50-task
problems. Due to the fixed small resource allocation intensity
of MTO-DRA, its overall performance is similar to
that of MMDE. Differently, in GRA, users can predefine
the desired resource allocation intensity, and hence the
EMTO algorithm behavior can be controlled even when
encountered the many-task scenarios. Therefore, the superior
performance of GRA in 50-task problems in
Table VI indicates the advantage of the proposed generalized
allocation framework in Algorithm 2 that possesses
the adjustable resource allocation intensity.
3) Comparison with Adaptive Methods
To clarify the effectiveness of the proposevd GRA, two
additional adaptive multitasking MOO algorithms are
5 The preference towards the easy task or the difficult task can be viewed as an exploration-exploitation
trade-off.
6 Note that, the MOO extension of MTO-DRA is still based on the proposed component
in this paper, which is a major contribution.
involved for comparative studies. To be specific, MOMFEA-II
is a multitasking MOO algorithm that adaptively
adjusts the random mating probability matrix on the fly,
and EMTIL is also an adaptive multitasking MOO algorithm
that selects the individuals to transfer by incremental
learning and local search. In the benchmark problems
described in Table VII, the proposed GRA generally can
attain superior optimization performance compared with
the other two. The reason why EMTIL is generally worse
than MOMFEA-II is that in this paper the population size
is set to 65, and the overall performance of EMTIL may be
restricted. Moreover, the key component of EMTIL is a
local search component to better explore the task searching
space, so it cannot outperform GRA considering that
the base optimizer is also equipped with a local search
component as mentioned in Section III.E. However, GRA
TABLE VI Mean standard score comparison with state-ofthe-art
methods on multitasking MOO many-task problems
over 30 independent runs.
PROBLEMS
MATP1
MATP2
MATP3
MATP4
MATP5
MATP6
MATP7
MATP8
MATP9
MATP10
SUM
RANK
GRA
0.0000E+00
5.6507E-02
0.0000E+00
−2.1223E-01
−6.2413E-02
−1.3743E-01
−2.1591E-01
−1.4437E-01
−1.8843E-01
−4.4002E-02
−9.4828E-02
1.2
MTO-DRA
0.0000E+00
−4.6366E-02
0.0000E+00
8.9087E-02
8.9713E-02
2.0120E-01
1.8857E-01
1.7642E-02
2.9164E-02
5.5049E-02
6.2406E-02
2
MMDE
0.0000E+00
−1.0140E-02
0.0000E+00
1.2314E-01
−2.7299E-02
−6.3766E-02
2.7342E-02
1.2673E-01
1.5926E-01
−1.1048E-02
3.2422E-02
2.2
TABLE VII Mean standard score comparison with adaptive
methods on multitasking MOO benchmark problems over
30 independent runs.
PROBLEMS
CIHS
CIMS
CILS
PIHS
PIMS
PILS
NIHS
NIMS
NILS
SUM
RANK
GRA
−7.9929E-01
−1.3855E+00
−7.5674E-01
−7.3931E-01
−1.0265E+00
−7.5066E-01
−8.4271E-01
−6.8711E-01
−7.2152E-01
−7.7093E+00
1
MOMFEA-II
−6.0799E-01
4.8832E-01
−6.5550E-01
−6.7430E-01
−2.8095E-01
−6.6264E-01
−5.5930E-01
4.0459E-01
−6.9257E-01
−3.2403E+00
2.1
EMTIL
1.4073E+00
8.9717E-01
1.4122E+00
1.4136E+00
1.3075E+00
1.4133E+00
1.4020E+00
2.8252E-01
1.4141E+00
1.0950E+01
2.9
NOVEMBER 2021 | IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE 31
IEEE Computational Intelligence Magazine - November 2021
Table of Contents for the Digital Edition of IEEE Computational Intelligence Magazine - November 2021
IEEE Computational Intelligence Magazine - November 2021 - Cover1
IEEE Computational Intelligence Magazine - November 2021 - Cover2
IEEE Computational Intelligence Magazine - November 2021 - 1
IEEE Computational Intelligence Magazine - November 2021 - 2
IEEE Computational Intelligence Magazine - November 2021 - 3
IEEE Computational Intelligence Magazine - November 2021 - 4
IEEE Computational Intelligence Magazine - November 2021 - 5
IEEE Computational Intelligence Magazine - November 2021 - 6
IEEE Computational Intelligence Magazine - November 2021 - 7
IEEE Computational Intelligence Magazine - November 2021 - 8
IEEE Computational Intelligence Magazine - November 2021 - 9
IEEE Computational Intelligence Magazine - November 2021 - 10
IEEE Computational Intelligence Magazine - November 2021 - 11
IEEE Computational Intelligence Magazine - November 2021 - 12
IEEE Computational Intelligence Magazine - November 2021 - 13
IEEE Computational Intelligence Magazine - November 2021 - 14
IEEE Computational Intelligence Magazine - November 2021 - 15
IEEE Computational Intelligence Magazine - November 2021 - 16
IEEE Computational Intelligence Magazine - November 2021 - 17
IEEE Computational Intelligence Magazine - November 2021 - 18
IEEE Computational Intelligence Magazine - November 2021 - 19
IEEE Computational Intelligence Magazine - November 2021 - 20
IEEE Computational Intelligence Magazine - November 2021 - 21
IEEE Computational Intelligence Magazine - November 2021 - 22
IEEE Computational Intelligence Magazine - November 2021 - 23
IEEE Computational Intelligence Magazine - November 2021 - 24
IEEE Computational Intelligence Magazine - November 2021 - 25
IEEE Computational Intelligence Magazine - November 2021 - 26
IEEE Computational Intelligence Magazine - November 2021 - 27
IEEE Computational Intelligence Magazine - November 2021 - 28
IEEE Computational Intelligence Magazine - November 2021 - 29
IEEE Computational Intelligence Magazine - November 2021 - 30
IEEE Computational Intelligence Magazine - November 2021 - 31
IEEE Computational Intelligence Magazine - November 2021 - 32
IEEE Computational Intelligence Magazine - November 2021 - 33
IEEE Computational Intelligence Magazine - November 2021 - 34
IEEE Computational Intelligence Magazine - November 2021 - 35
IEEE Computational Intelligence Magazine - November 2021 - 36
IEEE Computational Intelligence Magazine - November 2021 - 37
IEEE Computational Intelligence Magazine - November 2021 - 38
IEEE Computational Intelligence Magazine - November 2021 - 39
IEEE Computational Intelligence Magazine - November 2021 - 40
IEEE Computational Intelligence Magazine - November 2021 - 41
IEEE Computational Intelligence Magazine - November 2021 - 42
IEEE Computational Intelligence Magazine - November 2021 - 43
IEEE Computational Intelligence Magazine - November 2021 - 44
IEEE Computational Intelligence Magazine - November 2021 - 45
IEEE Computational Intelligence Magazine - November 2021 - 46
IEEE Computational Intelligence Magazine - November 2021 - 47
IEEE Computational Intelligence Magazine - November 2021 - 48
IEEE Computational Intelligence Magazine - November 2021 - 49
IEEE Computational Intelligence Magazine - November 2021 - 50
IEEE Computational Intelligence Magazine - November 2021 - 51
IEEE Computational Intelligence Magazine - November 2021 - 52
IEEE Computational Intelligence Magazine - November 2021 - 53
IEEE Computational Intelligence Magazine - November 2021 - 54
IEEE Computational Intelligence Magazine - November 2021 - 55
IEEE Computational Intelligence Magazine - November 2021 - 56
IEEE Computational Intelligence Magazine - November 2021 - 57
IEEE Computational Intelligence Magazine - November 2021 - 58
IEEE Computational Intelligence Magazine - November 2021 - 59
IEEE Computational Intelligence Magazine - November 2021 - 60
IEEE Computational Intelligence Magazine - November 2021 - 61
IEEE Computational Intelligence Magazine - November 2021 - 62
IEEE Computational Intelligence Magazine - November 2021 - 63
IEEE Computational Intelligence Magazine - November 2021 - 64
IEEE Computational Intelligence Magazine - November 2021 - 65
IEEE Computational Intelligence Magazine - November 2021 - 66
IEEE Computational Intelligence Magazine - November 2021 - 67
IEEE Computational Intelligence Magazine - November 2021 - 68
IEEE Computational Intelligence Magazine - November 2021 - 69
IEEE Computational Intelligence Magazine - November 2021 - 70
IEEE Computational Intelligence Magazine - November 2021 - 71
IEEE Computational Intelligence Magazine - November 2021 - 72
IEEE Computational Intelligence Magazine - November 2021 - 73
IEEE Computational Intelligence Magazine - November 2021 - 74
IEEE Computational Intelligence Magazine - November 2021 - 75
IEEE Computational Intelligence Magazine - November 2021 - 76
IEEE Computational Intelligence Magazine - November 2021 - 77
IEEE Computational Intelligence Magazine - November 2021 - 78
IEEE Computational Intelligence Magazine - November 2021 - 79
IEEE Computational Intelligence Magazine - November 2021 - 80
IEEE Computational Intelligence Magazine - November 2021 - 81
IEEE Computational Intelligence Magazine - November 2021 - 82
IEEE Computational Intelligence Magazine - November 2021 - 83
IEEE Computational Intelligence Magazine - November 2021 - 84
IEEE Computational Intelligence Magazine - November 2021 - 85
IEEE Computational Intelligence Magazine - November 2021 - 86
IEEE Computational Intelligence Magazine - November 2021 - 87
IEEE Computational Intelligence Magazine - November 2021 - 88
IEEE Computational Intelligence Magazine - November 2021 - 89
IEEE Computational Intelligence Magazine - November 2021 - 90
IEEE Computational Intelligence Magazine - November 2021 - 91
IEEE Computational Intelligence Magazine - November 2021 - 92
IEEE Computational Intelligence Magazine - November 2021 - 93
IEEE Computational Intelligence Magazine - November 2021 - 94
IEEE Computational Intelligence Magazine - November 2021 - 95
IEEE Computational Intelligence Magazine - November 2021 - 96
IEEE Computational Intelligence Magazine - November 2021 - 97
IEEE Computational Intelligence Magazine - November 2021 - 98
IEEE Computational Intelligence Magazine - November 2021 - 99
IEEE Computational Intelligence Magazine - November 2021 - 100
IEEE Computational Intelligence Magazine - November 2021 - Cover3
IEEE Computational Intelligence Magazine - November 2021 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com