IEEE Computational Intelligence Magazine - August 2021 - 78

VII. Acknowledgments
This work was partially supported by the National Natural Science
Foundation of China (61876089, 61876185, 61902281), the
Engineering Research Center of Digital Forensics, Ministry of
Education, the Priority Academic Program Development of Jiangsu
Higher Education Institutions, and the Postgraduate Research &
Practice Innovation Program of Jiangsu Province (KYCX21_1019).
References
[1] I. Al Ridhawi, S. Otoum, M. Aloqaily, and A. Boukerche, " Generalizing AI: Challenges
and opportunities for plug and play AI solutions, " IEEE Netw., 2020. doi: 10.1109/
MNET.011.2000371.
[2] G. Hinton et al., " Deep neural networks for acoustic modeling in speech recognition:
The shared views of four research groups, " IEEE Signal Process. Mag., vol. 29, no. 6, pp.
82-97, 2012.
[3] J. Long, E. Shelhamer, and T. Darrell, " Fully convolutional networks for semantic
segmentation, " in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 2015, pp. 3431-3440.
[4] L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, " Deeplab:
Semantic image segmentation with deep convolutional nets, atrous convolution, and fully
connected CRFs, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 4, pp. 834-848,
2017. doi: 10.1109/TPAMI.2017.2699184.
[5] K. He, X. Zhang, S. Ren, and J. Sun, " Deep residual learning for image recognition, "
in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 2016, pp. 770-778.
[6] X. Yao and Md M. Islam, " Evolving artificial neural network ensembles, " IEEE Comput.
Intelli. Mag., vol. 3, no. 1, pp. 31-42, 2008. doi: 10.1109/MCI.2007.913386.
[7] R. Collobert and J. Weston, " A unified architecture for natural language processing:
Deep neural networks with multitask learning. in Proc. 25th Int. Conf. Machine Learning,
2008, pp. 160-167.
[8] O. Vinyals, A. Toshev, S. Bengio, and D. Erhan, " Show and tell: A neural image caption
generator, " in Proc. IEEE Conf. Comput. Vision Pattern Recogn., 2015, pp. 3156-3164.
[9] A. Krizhevsky, I. Sutskever, and G. E. Hinton, " Imagenet classification with deep
convolutional neural networks, " in Proc. Adv. Neural Information Process. Syst., 2012, pp.
1097-1105.
[10] K. Simonyan and A. Zisserman, " Very deep convolutional networks for large-scale
image recognition, " 2014, arXiv:1409.1556.
[11] C. Szegedy et al., " Going deeper with convolutions, " in Proc. IEEE Conf. Comput.
Vision and Pattern Recogn., 2015, pp. 1-9.
[12] G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, " Densely connected
convolutional networks, " in Proc. IEEE Conf. Comput. Vision and Pattern Recogn., 2017,
pp. 4700-4708.
[13] M. Suganuma, S. Shirakawa, and T. Nagao, " A genetic programming approach to designing
convolutional neural network architectures, " in Proc. Genetic Evolutionary Comput.
Conf., 2017, pp. 497-504. doi: 10.1145/3071178.3071229.
[14] Y. Sun, B. Xue, M. Zhang, and G. G Yen, " Evolving deep convolutional neural
networks for image classification, " IEEE Trans. Evolutionary Comput., vol. 24, no. 2, pp.
394-407, 2019. doi: 10.1109/TEVC.2019.2916183.
[15] D. E. Rumelhart, G. E. Hinton, and R. J. Williams, " Learning representations
by back-propagating errors, " Nature, vol. 323, no. 6088, pp. 533-536, 1986. doi:
10.1038/323533a0.
[16] Y. Liu, Y. Sun, B. Xue, M. Zhang, and G. Yen, " A survey on evolutionary neural
architecture search, " 2020, arXiv:2008.10937.
[17] B. Zoph and Q. V. Le, " Neural architecture search with reinforcement learning, "
2016, arXiv:1611.01578.
[18] L. P. Kaelbling, M. L. Littman, and A. W. Moore, " Reinforcement learning: A survey, "
J. Artif. Intell. Res., vol. 4, pp. 237-285, 1996.
[19] H. Liu, K. Simonyan, and Y. Yang, " Darts: Differentiable architecture search, " 2018,
arXiv:1806.09055
[20] T. Bäck, D. B. Fogel, and Z. Michalewicz, " Handbook of evolutionary computation, "
Release, vol. 97, no. 1, p. B1, 1997.
[21] K. Deb, A. Pratap, S. Agarwal, and T. A. M. T. Meyarivan, " A fast and elitist multiobjective
genetic algorithm: NSGA-II, " IEEE Trans. Evolutionary Comput., vol. 6, no. 2,
pp. 182-197, 2002.
[22] J. Kennedy and R. Eberhart, " Particle swarm optimization, " in Proc. ICNN'95-Int.
Conf. Neural Netw., vol. 4, pp. 1942-1948, 1995.
[23] M. Dorigo, M. Birattari, and T. Stutzle, " Ant colony optimization, " IEEE Comput.
Intell. Mag., vol. 1, no. 4, pp. 28-39, 2006. doi: 10.1109/MCI.2006.329691.
[24] Y. Xue, B. Xue, and M. Zhang, " Self-adaptive particle swarm optimization for largescale
feature selection in classification, " ACM Trans. Knowl. Discovery Data (TKDD), vol.
13, no. 5, pp. 1-27, 2019. doi: 10.1145/3340848.
[25] D. Floreano, P. Dürr, and C. Mattiussi, " Neuroevolution: From architectures to
learning, " Evolution. Intell., vol. 1, no. 1, pp. 47-62, 2008.
[26] E. Real et al., " Large-scale evolution of image classifiers, " 2017, arXiv:1703.01041.
[27] A. Krizhevsky et al., " Learning multiple layers of features from tiny images, " 2009.
[28] L. Xie and A. Yuille, " Genetic CNN, " in Proc. IEEE Int. Conf. Comput. Vision, 2017,
pp. 1379-1388.
[29] Y. Sun, B. Xue, M. Zhang, and G. G Yen, " Completely automated CNN architecture
design based on blocks, " IEEE Trans. Neural Netw. Learning Syst., vol. 31, no. 4, pp.
1242-1254, 2019. doi: 10.1109/TNNLS.2019.2919608.
[30] L. Frachon, W. Pang, and G. M Coghill, " Immunecs: Neural committee search by an
artificial immune system, " 2019, arXiv:1911.07729.
[31] Z. Chen, Y. Zhou, and Z. Huang, " Auto-creation of effective neural network architecture
by evolutionary algorithm and ResNet for image classification, " in Proc. IEEE Int.
Conf. Systems, Man Cybernetics (SMC), 2019, pp. 3895-3900. doi: 10.1109/SMC.2019.8914267.
[32] D. Song, C. Xu, X. Jia, Y. Chen, C. Xu, and Y. Wang, " Efficient residual dense
block search for image super-resolution, " in Assoc. the Adv. Artif. Intell., 2020, pp. 12,007-
12,014. doi: 10.1609/aaai.v34i07.6877.
[33] P. R. Lorenzo and J. Nalepa, " Memetic evolution of deep neural networks, " in Proc.
Genetic Evolutionary Comput. Conf., 2018, pp. 505-512.
[34] Y. Xue, J. Jiang, B. Zhao, and T. Ma, " A self-adaptive artificial bee colony algorithm
based on global best for global optimization, " Soft Comput., vol. 22, no. 9, pp. 2935-2952,
2018. doi: 10.1007/s00500-017-2547-1.
[35] M. Suganuma, M. Kobayashi, S. Shirakawa, and T. Nagao, " Evolution of deep convolutional
neural networks using Cartesian genetic programming, " Evolut. Comput., vol.
28, no. 1, pp. 141-163, 2020. doi: 10.1162/evco_a_00253.
[36] K. Chen and W. Pang, " Immunetnas: An immune-network approach for searching
convolutional neural network architectures, " 2020, arXiv:2002.12704.
[37] A. Emin Orhan and X. Pitkow, " Skip connections eliminate singularities, " 2017,
arXiv:1701.09175.
[38] T. Elsken, J.-H. Metzen, and F. Hutter, " Simple and efficient architecture search for
convolutional neural networks, " 2017, arXiv:1711.04528.
[39] Y. Bengio, P. Simard, and P. Frasconi, " Learning long-term dependencies with gradient
descent is difficult, " IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 157-166, 1994. doi:
10.1109/72.279181.
[40] A. Kai Qin, V. L. Huang, and P. N. Suganthan, " Differential evolution algorithm
with strategy adaptation for global numerical optimization, " IEEE Trans. Evolut. Comput.,
vol. 13, no. 2, pp. 398-417, 2008. doi: 10.1109/TEVC.2008.927706.
[41] M. D. Zeiler, " ADADELTA: an adaptive learning rate method, " 2012, arXiv:1212.5701.
[42] J. Duchi, E. Hazan, and Y. Singer, " Adaptive subgradient methods for online learning
and stochastic optimization, " J. Machine Learning Res., vol. 12, no. 7, pp. 2121-2159, 2011.
[43] D. P. Kingma and J. Ba, " ADAM: A method for stochastic optimization, " 2014,
arXiv:1412.6980.
[44] K. O. Stanley, J. Clune, J. Lehman, and R. Miikkulainen, " Designing neural networks
through neuroevolution, " Nat. Mach. Intell., vol. 1, no. 1, pp. 24-35, 2019. doi:
10.1038/s42256-018-0006-z.
[45] G. C. Cawley and N. L. C. Talbot, " On over-fitting in model selection and subsequent
selection bias in performance evaluation, " J. Machine Learning Res., vol. 11, pp.
2079-2107, 2010.
[46] N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, " Dropout:
A simple way to prevent neural networks from overfitting, " J. Machine Learning Res.,
vol. 15, no. 1, pp. 1929-1958, 2014.
[47] B. L. Miller et al., " Genetic algorithms, tournament selection, and the effects of
noise, " Complex Syst., vol. 9, no. 3, pp. 193-212, 1995.
[48] Y. Leung, Y. Gao, and Z.-B. Xu, " Degree of population diversity-A perspective on
premature convergence in genetic algorithms and its Markov chain analysis, " IEEE Trans.
Neural Netw., vol. 8, no. 5, pp. 1165-1176, 1997. doi: 10.1109/72.623217.
[49] L. Davis, " Handbook of genetic algorithms, " 1991.
[50] E. Real, A. Aggarwal, Y. Huang, and Q. V Le, " Regularized evolution for image
classifier architecture search, " in Proc. AAAI Conf. Artif. Intell., vol. 33, pp. 4780-4789,
2019. doi: 10.1609/aaai.v33i01.33014780.
[51] H. Zhu, Z. An, C. Yang, K. Xu, E. Zhao, and Y. Xu, " EENA: Efficient evolution of
neural architecture, " in Proc. IEEE Int. Conf. Comput. Vision Workshops, 2019, pp. 1-13.
[52] J. A. Vasconcelos, J. A. Ramirez, R. H. C. Takahashi, and R. R. Saldanha, " Improvements
in genetic algorithms, " IEEE Trans. Magn., vol. 37, no. 5, pp. 3414-3417,
2001. doi: 10.1109/20.952626.
[53] M. Lin, Q. Chen, and S. Yan, " Network in network, " , 2013, arXiv:1312.4400.
[54] R. K. Srivastava, K. Greff, and J. Schmidhuber, " Highway networks, " 2015, arXiv:1505.00387.
[55]
I. Goodfellow, D. Warde-Farley, M. Mirza, A. Courville, and Y. Bengio, " Maxout
networks, " in Proc. Int. Conf. Machine Learning, 2013, pp. 1319-1327.
[56] J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller, " Striving for simplicity:
The all convolutional net, " 2014, arXiv:1412.6806.
[57] H. Liu, K. Simonyan, O. Vinyals, C. Fernando, and K. Kavukcuoglu, " Hierarchical
representations for efficient architecture search, " 2017. arXiv:1711.00436.
[58] H. Cai, T. Chen, W. Zhang, Y. Yu, and J. Wang, " Efficient architecture search by
network transformation, " 2017, arXiv:1707.04873.
[59] B. Baker, O. Gupta, N. Naik, and R. Raskar, " Designing neural network architectures
using reinforcement learning, " 2016, arXiv:1611.02167.
[60] A. I. Sharaf and E.-S. F. Radwan, " An automated approach for developing a convolutional
neural network using a modified firefly algorithm for image classification, " in
Applications of Firefly Algorithm and Its Variants. Springer-Verlag, 2020, pp. 99-118.
[61] B. Wang, B. Xue, and M. Zhang, " Particle swarm optimisation for evolving deep neural
networks for image classification by evolving and stacking transferable blocks, " in Proc. IEEE
Congr. Evolut. Comput. (CEC), 2020, pp. 1-8. doi: 10.1109/CEC48606.2020.9185541.
[62] Z. Lu, I. Whalen, V. Boddeti, Y. Dhebar, K. Deb, E. Goodman, and W. Banzhaf,
" NSGA-NET: Neural architecture search using multi-objective genetic algorithm, " in
Proc. Genetic Evolut. Comput. Conf., 2019, pp. 419-427.
[63] Y. Xue, Y. Tang, X. Xu, J. Liang, and F. Neri, " Multi-objective feature selection with
missing data in classification, " IEEE Trans. Emerg. Topics Comput. Intell. doi: 10.1109/
TETCI.2021.3074147.
78 IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE | AUGUST 2021
IEEE Computational Intelligence Magazine - August 2021

Table of Contents for the Digital Edition of IEEE Computational Intelligence Magazine - August 2021
