Computational Intelligence - November 2017 - 53
source task, where either the domains or the tasks differ [65]. One
suitable use case would be an optimization task of an aircraft
engine in which source information would originate from a
design effort to optimize a different engine configuration comprising several recurring parameters and outputs. Another potential use case would be to investigate the addition of new design
parameters or an altogether different set of design parameters relative to a prior (source) task.
B. Multi-Task Learning
multi-task regression model built from data originating from various related design efforts can be used to boost multiple optimization algorithms at the same time-in the spirit of multi-task
optimization [54], [69]-[71]. Approaching the problem in this
manner facilitates knowledge transfer and reduces the overall
computational cost of the design effort as the same regions of the
parameter space need not be searched repeatedly [54], thereby
resulting in the need for fewer expensive numerical (finite element
or finite volume) simulations. It is worth noting here that, although
the dimensionality for each of the subproblems is expected to be
significantly lower than for the entire design space, it could be the
case that the common set of input parameters defines a large space
for the multi-task regression. In such scenarios, while the arguments in favor of savings in simulations would still hold, the process of multitasking does not rule out the application of classic
approaches, such as space reduction techniques [72] (the beginning of Section IV elaborates more on this point).
In real-world aircraft designs, it is not uncommon for the total
number of design parameters throughout the entire system to
number in the thousands. Consider, for example, a generic turbofan engine used by most commercial airliners. Its functionality
depends on a host of interdependent systems such as the compressors, turbine, and combustion chamber-each of which is
itself reliant on thousands of design variables. Due to effects such
as the curse of dimensionality [66] coupled with the high computational cost of precision simulations, a monolithic optimizaC. Multi-View Learning
tion of the entire design space would be prohibitively expensive.
Due to the computationally expensive nature of disciplinary analAs such, a common practice is to analyze only a small subset
yses, a common strategy is to approximate the numerical simulaof these design parameters (which constitutes a subproblem).
tions using models of varying fidelity. In certain situations, physical
Consequently, there are often different variations of these subphenomena or structures of interest can be analyzed using either a
problems that are conditioned on the specific choice of all
full 3-D view or even a restricted 2-D/1-D view, depending on
remaining design parameters. A typical example in aircraft design
the types of statistics the engineer is looking for. For example,
of such a situation would be the optimization of an aircraft
while analyzing plate-like structures (which are common in airwing. In each variation, the design team may aim to optimize
craft), one may consider a 3-D discretization if through-thickness
performance parameters (e.g. lift, drag, and weight) as a function
effects are of interest, or may emphasize on the 2-D discretization
of the geometry of the wing [67], conditioned on certain fixed
if only the in-plane effects are of paramount importance [73].
variables (e.g. materials, and flight conditions) subsequently varThus, data that provides an understanding of the mechanics from
ied as part of distinct studies. To elaborate, one variation might
different perspectives is made available in situations where comstudy a wing utilizing composite material A while another,
putational budget is a prime limitation.
composite material B; each with its own
unique set of material properties.
The domain of multi-task learning
is uniquely suited for these types of
Project A
Project B
problems. In contrast to transfer learning which leverages on past experiences, multi-task learning assumes that
there are multiple related tasks that can
be simultaneously solved in order to
Initialization
Initialization
facilitate knowledge transfer [53], [54],
Find Optimal
Find Optimal
Solutions
Solutions
[68]. In the context of multi-task regression, the model aims to learn a mapping as follows: f : X " R N where X
Multitask
represents a common set of input paramSurrogate
eters and the N outputs are considered
Sample New
Sample New
Modeling
to belong to different tasks [53].
Candidate
Candidate
By learning related tasks together
Solution
Solution
using a shared representation, the generGeneric Surrogate-Assisted
Generic Surrogate-Assisted
alization performance is contended to
Optimization Algorithm
Optimization Algorithm
improve by exploiting the shared knowledge in the training signals of the related
FIGURE 2 Illustration of multi-task learning applied to generic optimization algorithms for two
task(s). As illustrated in Figure 2, from related projects. Both Projects A and B are assisted by a multi-task surrogate model constructed
an aircraft design perspective, a single from a combination of data from both projects.
NOVEMBER 2017 | IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE
53
Table of Contents for the Digital Edition of Computational Intelligence - November 2017
Computational Intelligence - November 2017 - Cover1
Computational Intelligence - November 2017 - Cover2
Computational Intelligence - November 2017 - 1
Computational Intelligence - November 2017 - 2
Computational Intelligence - November 2017 - 3
Computational Intelligence - November 2017 - 4
Computational Intelligence - November 2017 - 5
Computational Intelligence - November 2017 - 6
Computational Intelligence - November 2017 - 7
Computational Intelligence - November 2017 - 8
Computational Intelligence - November 2017 - 9
Computational Intelligence - November 2017 - 10
Computational Intelligence - November 2017 - 11
Computational Intelligence - November 2017 - 12
Computational Intelligence - November 2017 - 13
Computational Intelligence - November 2017 - 14
Computational Intelligence - November 2017 - 15
Computational Intelligence - November 2017 - 16
Computational Intelligence - November 2017 - 17
Computational Intelligence - November 2017 - 18
Computational Intelligence - November 2017 - 19
Computational Intelligence - November 2017 - 20
Computational Intelligence - November 2017 - 21
Computational Intelligence - November 2017 - 22
Computational Intelligence - November 2017 - 23
Computational Intelligence - November 2017 - 24
Computational Intelligence - November 2017 - 25
Computational Intelligence - November 2017 - 26
Computational Intelligence - November 2017 - 27
Computational Intelligence - November 2017 - 28
Computational Intelligence - November 2017 - 29
Computational Intelligence - November 2017 - 30
Computational Intelligence - November 2017 - 31
Computational Intelligence - November 2017 - 32
Computational Intelligence - November 2017 - 33
Computational Intelligence - November 2017 - 34
Computational Intelligence - November 2017 - 35
Computational Intelligence - November 2017 - 36
Computational Intelligence - November 2017 - 37
Computational Intelligence - November 2017 - 38
Computational Intelligence - November 2017 - 39
Computational Intelligence - November 2017 - 40
Computational Intelligence - November 2017 - 41
Computational Intelligence - November 2017 - 42
Computational Intelligence - November 2017 - 43
Computational Intelligence - November 2017 - 44
Computational Intelligence - November 2017 - 45
Computational Intelligence - November 2017 - 46
Computational Intelligence - November 2017 - 47
Computational Intelligence - November 2017 - 48
Computational Intelligence - November 2017 - 49
Computational Intelligence - November 2017 - 50
Computational Intelligence - November 2017 - 51
Computational Intelligence - November 2017 - 52
Computational Intelligence - November 2017 - 53
Computational Intelligence - November 2017 - 54
Computational Intelligence - November 2017 - 55
Computational Intelligence - November 2017 - 56
Computational Intelligence - November 2017 - 57
Computational Intelligence - November 2017 - 58
Computational Intelligence - November 2017 - 59
Computational Intelligence - November 2017 - 60
Computational Intelligence - November 2017 - 61
Computational Intelligence - November 2017 - 62
Computational Intelligence - November 2017 - 63
Computational Intelligence - November 2017 - 64
Computational Intelligence - November 2017 - 65
Computational Intelligence - November 2017 - 66
Computational Intelligence - November 2017 - 67
Computational Intelligence - November 2017 - 68
Computational Intelligence - November 2017 - 69
Computational Intelligence - November 2017 - 70
Computational Intelligence - November 2017 - 71
Computational Intelligence - November 2017 - 72
Computational Intelligence - November 2017 - 73
Computational Intelligence - November 2017 - 74
Computational Intelligence - November 2017 - 75
Computational Intelligence - November 2017 - 76
Computational Intelligence - November 2017 - 77
Computational Intelligence - November 2017 - 78
Computational Intelligence - November 2017 - 79
Computational Intelligence - November 2017 - 80
Computational Intelligence - November 2017 - 81
Computational Intelligence - November 2017 - 82
Computational Intelligence - November 2017 - 83
Computational Intelligence - November 2017 - 84
Computational Intelligence - November 2017 - 85
Computational Intelligence - November 2017 - 86
Computational Intelligence - November 2017 - 87
Computational Intelligence - November 2017 - 88
Computational Intelligence - November 2017 - 89
Computational Intelligence - November 2017 - 90
Computational Intelligence - November 2017 - 91
Computational Intelligence - November 2017 - 92
Computational Intelligence - November 2017 - 93
Computational Intelligence - November 2017 - 94
Computational Intelligence - November 2017 - 95
Computational Intelligence - November 2017 - 96
Computational Intelligence - November 2017 - 97
Computational Intelligence - November 2017 - 98
Computational Intelligence - November 2017 - 99
Computational Intelligence - November 2017 - 100
Computational Intelligence - November 2017 - 101
Computational Intelligence - November 2017 - 102
Computational Intelligence - November 2017 - 103
Computational Intelligence - November 2017 - 104
Computational Intelligence - November 2017 - Cover3
Computational Intelligence - November 2017 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com