IEEE Computational Intelligence Magazine - August 2022 - 34
Frontier
Research
Yansen Su, Zhongxiang Jin,
Ye Tian, and Xingyi Zhang
Anhui University, CHINA
Kay Chen Tan
The Hong Kong Polytechnic
University, HONG KONG SAR
Comparing the Performance of Evolutionary Algorithms for Sparse
Multi-Objective Optimization via a Comprehensive Indicator
Abstract
M
any real-world multi-objective
optimization problems (MOPs)
are characterized by a large
number of decision variables, where
the decision variables are mostly set to
zero in the Pareto optimal solutions.
Although some multi-objective evolutionary
algorithms (MOEAs) have been
tailored for large-scale MOPs in recent
years, most of them do not consider the
sparse nature of Pareto optimal solutions,
and their effectiveness to sparse MOPs
has not been investigated. Therefore, this
work aims to compare the performance
of MOEAs on sparse MOPs by suggesting
a comprehensive performance
indicator. In comparison to existing
indicators assessing the convergence and
diversity of a solution set according to
predefined reference points, the proposed
indicator can assess the convergence,
diversity, and sparsity without
using any reference point. Based on the
proposed indicator, an experiment is
conducted to compare the performance
of 11 state-of-the-art MOEAs on 60 test
instances taken from benchmark suites
and real-world applications. The statistical
results show that some MOEAs are
significantly better than the others for
solving sparse MOPs, and the proposed
indicator is effective for the performance
assessment on sparse MOPs.
I. Introduction
Multi-objective optimization problems
(MOPs) widely exist in scientific and
engineering areas, which contain two or
Digital Object Identifier 10.1109/MCI.2022.3180913
Date of current version: 19 July 2022
optimize each group of variables alternately
[2], [4]. While the variable grouping
strategies
for single-objective
more objectives to be optimized simultaneously
[1]. In the absence of a single
solution making all the objectives optimal,
there exist multiple Pareto optimal
solutions for an MOP, which make
diverse trade-offs between the conflicting
objectives. Since multiple optimal
solutions rather than a single one need
to be provided, solving MOPs is much
more difficult than solving single-objective
optimization problems. More seriously,
with the curse of dimensionality
in large-scale optimization, it is extremely
difficult for conventional MOEAs to
find multiple optimal solutions for largescale
MOPs [2].
To improve the efficiency of approximating
Pareto optimal solutions from
high-dimensional decision spaces, a
number of MOEAs have been tailored
for solving large-scale MOPs since 2013
[2]. By adopting the divide-and-conquer
strategy for large-scale single-objective
optimization [3], some early MOEAs for
large-scale MOPs divide the decision
variables randomly or heuristically and
Corresponding author: Ye Tian (e-mail: field910921@
gmail.com).
optimization do not preserve the population
diversity in the objective space,
some MOEAs group the decision variables
according to their contributions to
the convergence and diversity of the
population, showing high performance
on large-scale MOPs with complicated
landscapes [5], [6]. On the other hand,
some MOEAs aim to facilitate the solving
of large-scale MOPs by converting
the original problem into a small-scale
one, where quasi-optimal solutions can
be obtained with a few function evaluations
[7], [8]. Similarly, some MOEAs
adopt the dimensionality reduction
strategies used in machine learning to
directly reduce the decision space for an
improvement of the convergence speed
[9], [10]. In addition to the variable
grouping and dimensionality reduction
based MOEAs, some others suggest
novel variation operators [11], [12] or
probability models [13], [14] to search
for optimal solutions directly, which are
versatile for solving large-scale MOPs
with different variable linkages.
In spite of the promising performance
of existing large-scale MOEAs
on a variety of benchmark problems,
only few of them have been employed
to tackle the large-scale MOPs in realworld
applications. In addition to the
high budget of evaluations required by
these MOEAs, they do not
take the
characteristics of real-world applications
into account, such as the sparse nature of
Pareto optimal solutions. For the largescale
MOPs in many fields including
machine learning [15], data mining [16],
34 IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE | AUGUST 2022
1556-603X/22©2022IEEE
©SHUTTERSTOCK.COM/WHITEMOCCA
http://www.SHUTTERSTOCK.COM/WHITEMOCCA
IEEE Computational Intelligence Magazine - August 2022
Table of Contents for the Digital Edition of IEEE Computational Intelligence Magazine - August 2022
Contents
IEEE Computational Intelligence Magazine - August 2022 - Cover1
IEEE Computational Intelligence Magazine - August 2022 - Cover2
IEEE Computational Intelligence Magazine - August 2022 - Contents
IEEE Computational Intelligence Magazine - August 2022 - 2
IEEE Computational Intelligence Magazine - August 2022 - 3
IEEE Computational Intelligence Magazine - August 2022 - 4
IEEE Computational Intelligence Magazine - August 2022 - 5
IEEE Computational Intelligence Magazine - August 2022 - 6
IEEE Computational Intelligence Magazine - August 2022 - 7
IEEE Computational Intelligence Magazine - August 2022 - 8
IEEE Computational Intelligence Magazine - August 2022 - 9
IEEE Computational Intelligence Magazine - August 2022 - 10
IEEE Computational Intelligence Magazine - August 2022 - 11
IEEE Computational Intelligence Magazine - August 2022 - 12
IEEE Computational Intelligence Magazine - August 2022 - 13
IEEE Computational Intelligence Magazine - August 2022 - 14
IEEE Computational Intelligence Magazine - August 2022 - 15
IEEE Computational Intelligence Magazine - August 2022 - 16
IEEE Computational Intelligence Magazine - August 2022 - 17
IEEE Computational Intelligence Magazine - August 2022 - 18
IEEE Computational Intelligence Magazine - August 2022 - 19
IEEE Computational Intelligence Magazine - August 2022 - 20
IEEE Computational Intelligence Magazine - August 2022 - 21
IEEE Computational Intelligence Magazine - August 2022 - 22
IEEE Computational Intelligence Magazine - August 2022 - 23
IEEE Computational Intelligence Magazine - August 2022 - 24
IEEE Computational Intelligence Magazine - August 2022 - 25
IEEE Computational Intelligence Magazine - August 2022 - 26
IEEE Computational Intelligence Magazine - August 2022 - 27
IEEE Computational Intelligence Magazine - August 2022 - 28
IEEE Computational Intelligence Magazine - August 2022 - 29
IEEE Computational Intelligence Magazine - August 2022 - 30
IEEE Computational Intelligence Magazine - August 2022 - 31
IEEE Computational Intelligence Magazine - August 2022 - 32
IEEE Computational Intelligence Magazine - August 2022 - 33
IEEE Computational Intelligence Magazine - August 2022 - 34
IEEE Computational Intelligence Magazine - August 2022 - 35
IEEE Computational Intelligence Magazine - August 2022 - 36
IEEE Computational Intelligence Magazine - August 2022 - 37
IEEE Computational Intelligence Magazine - August 2022 - 38
IEEE Computational Intelligence Magazine - August 2022 - 39
IEEE Computational Intelligence Magazine - August 2022 - 40
IEEE Computational Intelligence Magazine - August 2022 - 41
IEEE Computational Intelligence Magazine - August 2022 - 42
IEEE Computational Intelligence Magazine - August 2022 - 43
IEEE Computational Intelligence Magazine - August 2022 - 44
IEEE Computational Intelligence Magazine - August 2022 - 45
IEEE Computational Intelligence Magazine - August 2022 - 46
IEEE Computational Intelligence Magazine - August 2022 - 47
IEEE Computational Intelligence Magazine - August 2022 - 48
IEEE Computational Intelligence Magazine - August 2022 - 49
IEEE Computational Intelligence Magazine - August 2022 - 50
IEEE Computational Intelligence Magazine - August 2022 - 51
IEEE Computational Intelligence Magazine - August 2022 - 52
IEEE Computational Intelligence Magazine - August 2022 - 53
IEEE Computational Intelligence Magazine - August 2022 - 54
IEEE Computational Intelligence Magazine - August 2022 - 55
IEEE Computational Intelligence Magazine - August 2022 - 56
IEEE Computational Intelligence Magazine - August 2022 - 57
IEEE Computational Intelligence Magazine - August 2022 - 58
IEEE Computational Intelligence Magazine - August 2022 - 59
IEEE Computational Intelligence Magazine - August 2022 - 60
IEEE Computational Intelligence Magazine - August 2022 - 61
IEEE Computational Intelligence Magazine - August 2022 - 62
IEEE Computational Intelligence Magazine - August 2022 - 63
IEEE Computational Intelligence Magazine - August 2022 - 64
IEEE Computational Intelligence Magazine - August 2022 - 65
IEEE Computational Intelligence Magazine - August 2022 - 66
IEEE Computational Intelligence Magazine - August 2022 - 67
IEEE Computational Intelligence Magazine - August 2022 - 68
IEEE Computational Intelligence Magazine - August 2022 - Cover3
IEEE Computational Intelligence Magazine - August 2022 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com