IEEE Computational Intelligence Magazine - February 2021 - 86
GP has been successfully applied to classification.
GP can not only be used for feature selection and
feature construction, but also can be directly used to
construct classifiers.
When a classification task suffers
from both high dimensionality and class
imbalance issues, it is often very difficult to select good-quality features that
could improve the accuracies of the
majority class as well as the minority
class. If the selected features are biased
towards the majority class, the constructed classifiers using these selected
features are more likely to be biased
towards the majority class [15].
Liu et al. [16] develop a cost-sensitive
principal component analysis for feature extraction, and a variant of particle
swarm optimization (PSO), called chaos
PSO, is proposed for the parameter op--
timization. Zhang et al. [17] propose a
wrapper-based feature selection method,
based on an optimal F_Measure structural
support vector machine. Aydogan et al.
[18] propose a cost-based rough PSO for
classification with high-dimensional
unbalanced data, which simultaneously
performs feature selection and classification.Tran et al. [19] investigate how GP is
used for feature construction and feature
selection in classification with highdimensional data. In [20], feature clustering is used to group the similar features,
and then the best feature is chosen from
each feature cluster to significantly narrow the search space for GP-based feature construction in classification with
high-dimensional data. In [19], [20], GP
uses the balanced accuracy as a fitness
function to equally treat the majority
class and the minority class. However, in
many real-world a-pplications, the
-majority class and the minority class are
not equally important.
feature selection process, a GP tree as a
classifier does not need to use all features. However, learning from unbalanced data, classifiers evolved by GP
may encounter a performance bias.
Sampling methods, like undersampling [21] and oversampling [22], [23],
are used to re-balance unbalanced datasets. Undersampling methods remove
some instances from the majority class,
to enable the number of instances in the
majority class to be the same or roughly
the same as that of the minority class.
Opposite to undersampling methods,
oversampling methods replicate some
instances from the minority class, or create some new instances for the minority
class. In [24], a GP method is proposed,
where the synthetic minority oversampling technique (SMOTE) is used to
solve the problem of class imbalance.
In [1], [25]-[27], new fitness functions
are developed for GP to address the
problem of class imbalance. In [28], a subset of instances are uniformly selected
and used in the fitness evaluation, and an
area under a curve (AUC) approximation
metric is proposed as a fitness function of
GP. Bhowan et al. [29]-[31] systematically
investigate the use of evolutionary multiple-objective optimization to develop
multi-objective GP methods to address
the issue of class imbalance. However,
compared to single-objective methods,
multi-objective methods are usually
time-consuming, due mainly to the
acquisition of the complete Pareto front.
Accordingly, in this paper, we investigate
a new single-objective GP method by
using cost-sensitive learning.
B. Genetic Programming
C. Cost-Sensitive Learning
GP has been successfully applied to classification. GP can not only be used for
feature selection and feature construction, but also can be directly used to
construct classifiers. Due to its built-in
The standard classification algorithms
assume that all instances are equally
important. However, in unbalanced
-classification, this assumption may result
in a performance bias of constructed
86
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE | FEBRUARY 2021
classifiers [13]. Moreover, in many realworld applications, different mistakes
cause different losses. For example, in
medical diagnosis, a cancer patient is
mistakenly diagnosed as a healthy person, which is much more troublesome
than that of misdiagnosing a healthy
person as a cancer patient.
Cost-sensitive learning [32] has been
successfully applied to classification tasks
that are potentially associated with different costs. In cost-sensitive learning,
the costs (mainly misclassification costs,
i.e., the penalty of classifying an instance
from one class to another) are considered to treat the different mistakes
differently. The goal of cost-sensitive
learning is to minimize the total cost,
instead of only simply minimizing the
number of mistakes [33]. Note that the
misclassification costs are different from
the total cost. The misclassification costs
are often provided by the domain
experts, and later used by an algorithm
to develop cost-sensitive classifiers. The
total cost is calculated after predictions
of a cost-sensitive classifier on a classification task. A cost matrix is often used to
indicate the misclassification costs. Usually, the misclassification costs have two
types: class-dependent cost (i.e., different
classes have different costs) and instancedependent cost (i.e., every instance has its
own misclassification cost) [34].
Zhang and Zhou [35] develop costsensitive kernel logistic regression and
cost-sensitive k-nearest neighbor, and
apply them to face recognition. In [36],
a cost-sensitive decision tree algorithm is proposed, which incorporates
instance-dependent misclassification
costs into an impurity measure and
pruning criteria. Iranmehr et al. [37]
develop a new cost-sensitive version of
support vector machines (SVMs) with
an extension of a standard loss function
to optimize a classifier with respect to
class-dependent costs and instancedependent costs. Cost-sensitive learning
is frequently applied to binary classification, but it is less investigated for
multi-class classification. Zhou et al.
[34] investigate the use of cost-sensitive
learning for multi-class c- lassification,
and suggest examining the consistency
IEEE Computational Intelligence Magazine - February 2021
Table of Contents for the Digital Edition of IEEE Computational Intelligence Magazine - February 2021
IEEE Computational Intelligence Magazine - February 2021 - Cover1
IEEE Computational Intelligence Magazine - February 2021 - Cover2
IEEE Computational Intelligence Magazine - February 2021 - 1
IEEE Computational Intelligence Magazine - February 2021 - 2
IEEE Computational Intelligence Magazine - February 2021 - 3
IEEE Computational Intelligence Magazine - February 2021 - 4
IEEE Computational Intelligence Magazine - February 2021 - 5
IEEE Computational Intelligence Magazine - February 2021 - 6
IEEE Computational Intelligence Magazine - February 2021 - 7
IEEE Computational Intelligence Magazine - February 2021 - 8
IEEE Computational Intelligence Magazine - February 2021 - 9
IEEE Computational Intelligence Magazine - February 2021 - 10
IEEE Computational Intelligence Magazine - February 2021 - 11
IEEE Computational Intelligence Magazine - February 2021 - 12
IEEE Computational Intelligence Magazine - February 2021 - 13
IEEE Computational Intelligence Magazine - February 2021 - 14
IEEE Computational Intelligence Magazine - February 2021 - 15
IEEE Computational Intelligence Magazine - February 2021 - 16
IEEE Computational Intelligence Magazine - February 2021 - 17
IEEE Computational Intelligence Magazine - February 2021 - 18
IEEE Computational Intelligence Magazine - February 2021 - 19
IEEE Computational Intelligence Magazine - February 2021 - 20
IEEE Computational Intelligence Magazine - February 2021 - 21
IEEE Computational Intelligence Magazine - February 2021 - 22
IEEE Computational Intelligence Magazine - February 2021 - 23
IEEE Computational Intelligence Magazine - February 2021 - 24
IEEE Computational Intelligence Magazine - February 2021 - 25
IEEE Computational Intelligence Magazine - February 2021 - 26
IEEE Computational Intelligence Magazine - February 2021 - 27
IEEE Computational Intelligence Magazine - February 2021 - 28
IEEE Computational Intelligence Magazine - February 2021 - 29
IEEE Computational Intelligence Magazine - February 2021 - 30
IEEE Computational Intelligence Magazine - February 2021 - 31
IEEE Computational Intelligence Magazine - February 2021 - 32
IEEE Computational Intelligence Magazine - February 2021 - 33
IEEE Computational Intelligence Magazine - February 2021 - 34
IEEE Computational Intelligence Magazine - February 2021 - 35
IEEE Computational Intelligence Magazine - February 2021 - 36
IEEE Computational Intelligence Magazine - February 2021 - 37
IEEE Computational Intelligence Magazine - February 2021 - 38
IEEE Computational Intelligence Magazine - February 2021 - 39
IEEE Computational Intelligence Magazine - February 2021 - 40
IEEE Computational Intelligence Magazine - February 2021 - 41
IEEE Computational Intelligence Magazine - February 2021 - 42
IEEE Computational Intelligence Magazine - February 2021 - 43
IEEE Computational Intelligence Magazine - February 2021 - 44
IEEE Computational Intelligence Magazine - February 2021 - 45
IEEE Computational Intelligence Magazine - February 2021 - 46
IEEE Computational Intelligence Magazine - February 2021 - 47
IEEE Computational Intelligence Magazine - February 2021 - 48
IEEE Computational Intelligence Magazine - February 2021 - 49
IEEE Computational Intelligence Magazine - February 2021 - 50
IEEE Computational Intelligence Magazine - February 2021 - 51
IEEE Computational Intelligence Magazine - February 2021 - 52
IEEE Computational Intelligence Magazine - February 2021 - 53
IEEE Computational Intelligence Magazine - February 2021 - 54
IEEE Computational Intelligence Magazine - February 2021 - 55
IEEE Computational Intelligence Magazine - February 2021 - 56
IEEE Computational Intelligence Magazine - February 2021 - 57
IEEE Computational Intelligence Magazine - February 2021 - 58
IEEE Computational Intelligence Magazine - February 2021 - 59
IEEE Computational Intelligence Magazine - February 2021 - 60
IEEE Computational Intelligence Magazine - February 2021 - 61
IEEE Computational Intelligence Magazine - February 2021 - 62
IEEE Computational Intelligence Magazine - February 2021 - 63
IEEE Computational Intelligence Magazine - February 2021 - 64
IEEE Computational Intelligence Magazine - February 2021 - 65
IEEE Computational Intelligence Magazine - February 2021 - 66
IEEE Computational Intelligence Magazine - February 2021 - 67
IEEE Computational Intelligence Magazine - February 2021 - 68
IEEE Computational Intelligence Magazine - February 2021 - 69
IEEE Computational Intelligence Magazine - February 2021 - 70
IEEE Computational Intelligence Magazine - February 2021 - 71
IEEE Computational Intelligence Magazine - February 2021 - 72
IEEE Computational Intelligence Magazine - February 2021 - 73
IEEE Computational Intelligence Magazine - February 2021 - 74
IEEE Computational Intelligence Magazine - February 2021 - 75
IEEE Computational Intelligence Magazine - February 2021 - 76
IEEE Computational Intelligence Magazine - February 2021 - 77
IEEE Computational Intelligence Magazine - February 2021 - 78
IEEE Computational Intelligence Magazine - February 2021 - 79
IEEE Computational Intelligence Magazine - February 2021 - 80
IEEE Computational Intelligence Magazine - February 2021 - 81
IEEE Computational Intelligence Magazine - February 2021 - 82
IEEE Computational Intelligence Magazine - February 2021 - 83
IEEE Computational Intelligence Magazine - February 2021 - 84
IEEE Computational Intelligence Magazine - February 2021 - 85
IEEE Computational Intelligence Magazine - February 2021 - 86
IEEE Computational Intelligence Magazine - February 2021 - 87
IEEE Computational Intelligence Magazine - February 2021 - 88
IEEE Computational Intelligence Magazine - February 2021 - 89
IEEE Computational Intelligence Magazine - February 2021 - 90
IEEE Computational Intelligence Magazine - February 2021 - 91
IEEE Computational Intelligence Magazine - February 2021 - 92
IEEE Computational Intelligence Magazine - February 2021 - 93
IEEE Computational Intelligence Magazine - February 2021 - 94
IEEE Computational Intelligence Magazine - February 2021 - 95
IEEE Computational Intelligence Magazine - February 2021 - 96
IEEE Computational Intelligence Magazine - February 2021 - 97
IEEE Computational Intelligence Magazine - February 2021 - 98
IEEE Computational Intelligence Magazine - February 2021 - 99
IEEE Computational Intelligence Magazine - February 2021 - 100
IEEE Computational Intelligence Magazine - February 2021 - 101
IEEE Computational Intelligence Magazine - February 2021 - 102
IEEE Computational Intelligence Magazine - February 2021 - 103
IEEE Computational Intelligence Magazine - February 2021 - 104
IEEE Computational Intelligence Magazine - February 2021 - 105
IEEE Computational Intelligence Magazine - February 2021 - 106
IEEE Computational Intelligence Magazine - February 2021 - 107
IEEE Computational Intelligence Magazine - February 2021 - 108
IEEE Computational Intelligence Magazine - February 2021 - Cover3
IEEE Computational Intelligence Magazine - February 2021 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com