Computational Intelligence - February 2017 - 53

They cannot offer diagnostic capabilities for users; nor can they offer a reasoning chain to explain to the users
the implications of their actions. LCS
offer an opportunity for these simulations to diagnose and reason about
users' actions.
VIII. Conclusions

LCS are one of the earliest evolutionary
computing techniques and are a continuously growing field of research, providing a natural development platform for
computer games. In particular, due to
their roots in computational cognition
and symbolic representation, LCS are
ideal to facilitate interaction between a
game and a human, in addition to their
natural use as an adaptive learner.
This survey is the first to provide a
review of the extant LCS research in
games. By reviewing diverse LCS applications in a variety of games, this survey
brings to attention the potential of LCS
for this field. The survey has offered
insights into several future directions,
ranging from examining learning architectures and symbolic and non-symbolic
dilemmas, to reasoning and the use of
LCS to mediate adaptively in interactive
games. These directions offer significant
opportunities to researchers in both
LCS and games.
This survey is timely, in that both
computer games and LCS are growing
research areas with many advancements. These advancements have obvious implications for either field. It is
hoped that by presenting a consolidated review of the extant work, this
survey will prove to be a steppingstone in tr igger ing the required
research interest in leveraging on these
advancements and explor ing this
important area of research.
References

[1] E. A. Boyle, T. M. Connolly, T. Hainey, and J. M.
Boyle, "Engagement in digital entertainment games: A
systematic review," Comput. Human. Behav., vol. 28, no. 3,
pp. 771-780, May 2012.
[2] H. T. J. Smit and L. Trigeorgis, Strategic Investment:
Real Options and Games. Princeton, NJ: Princeton Univ.
Press, 2012.
[3] T. Ben-Zvi, "The efficacy of business simulation
games in creating decision support systems: An experimental investigation," Decis. Support Syst., vol. 49, no. 1,
pp. 61-69, Apr. 2010.

[4] S. A. Adams, "Use of "serious health games" in health
care: A review," Stud. Health Technol. Inform., vol. 157, pp.
160-166, June 2010.
[5] G. Fong, "Adapting COTS games for military experimentation," Simul. Gaming, vol. 37, no. 4, pp. 452-465,
Dec. 2006.
[6] D. R. Michael and S. L. Chen, Serious Games: Games
That Educate, Train, and Inform. Mason, OH: Course
Technology, Cengage Learning PTR, 2005.
[7] E. Bonabeau, "Agent-based modeling: Methods and
techniques for simulating human systems," Proc. Natl.
Acad. Sci., vol. 99, no. 3, pp. 7280-7287, May 2002.
[8] Entertainment Software Association (ESA) (2015, 20
Nov.). The 2015 essential facts about the computer and
video game industry [Online]. Available: http://www
.theesa.com/wp-content/uploads/2015/04/ESA-Essential-Facts-2015.pdf
[9] A. P. Engelbrecht, Computational Intelligence: An Introduction. West Sussex, U.K.: Wiley, 2007.
[10] S. M. Lucas, "Computational intelligence and AI in
games: A new IEEE transactions," IEEE Trans. Comput.
Intell. AI Games, vol. 1, no. 1, pp. 1-3, Mar. 2009.
[11] D. Loiacono, P. L. Lanzi, J. Togelius, E. Onieva, D.
A. Pelta, M. V. Butz, T. D. Lönneker, L. Cardamone, D.
Perez, Y. Sáez, M. Preuss, and J. Quadf lieg, "The 2009
simulated car racing championship," IEEE Trans. Comput. Intell. AI Games, vol. 2, no. 2, pp. 131-147, June 2010.
[12] A. Ghosh and S. Tsutsui, Advances in Evolutionary
Computing: Theory and Applications, Ser. Natural Computing. Berlin, Germany: Springer-Verlag, 2012.
[13] J. Schmidhuber, "Deep learning in neural networks:
An overview," Neural Netw., vol. 61, pp. 85-117, Jan.
2015.
[14] S. M. Lucas, "Computational intelligence and games:
Challenges and opportunities," Int. J. Automat. Comput.,
vol. 5, no. 1, pp. 45-57, Jan. 2008.
[15] G. Yannakakis and J. Togelius, "A panorama of artificial and computational intelligence in games," IEEE
Trans. Comput. Intell. AI Games, vol. 7, no. 4, pp. 317-335,
Dec. 2015.
[16] L. Bull, "Learning classifier systems: A brief introduction," in Applications of Learning Classifier Systems, L.
Bull, Ed. Berlin, Germany: Springer-Verlag, 2004, pp.
1-12.
[17] O. Sigaud and S. W. Wilson, "Learning classifier systems: A survey," Soft Comput., vol. 11, no. 11, pp. 1065-
1078, Sept. 2007.
[18] R. J. Urbanowicz and J. H. Moore, "Learning classifier systems: A complete introduction, review, and roadmap," J. Artif. Evol. Appl., vol. 2009, pp. 1-25, Jan. 2009.
[19] A. Fernández, S. García, J. Luengo, E. BernadóMansilla, and F. Herrera, "Genetics-based machine
learning for rule induction: Taxonomy, experimental
study and state of the art," IEEE Trans. Evol. Comput.,
vol. 14, no. 6, pp. 913-941, Dec. 2010.
[20] L. Bull, "A brief history of learning classifier systems:
from CS-1 to XCS and its variants," Evol. Intell., vol. 8,
no. 2/3, pp. 55-70, Sept. 2015.
[21] K. Shafi and H. A. Abbass, "Biologically-inspired
complex adaptive systems approaches to network intrusion detection," Inform. Sec. Tech. Rep., vol. 12, no. 4, pp.
209-217, Dec. 2007.
[22] R. Vilalta and Y. Drissi, "A perspective view and
survey of meta-learning," Artif. Intell. Rev., vol. 18, no. 2,
pp. 77-95, June 2002.
[23] S. W. Wilson, "ZCS: A zeroth level classifier system," Evol. Comput., vol. 2, no. 1, pp. 1-18, Mar. 1994.
[24] Z. Guessoum, L. Rejeb, and R. Durand, "Using
adaptive multi-agent systems to simulate economic models," in Proc. 3rd Int. Joint Conf. Autonomous Agents and
Multiagent Systems, Washington, DC, July 19-23, 2004,
pp. 68-75.
[25] L. A. Wehinger, M. D. Galus, and G. Andersson, "Agent-based simulator for the German electricity
wholesale market including wind power generation and
widescale PHEV adoption," in Proc. 7th Int. Conf. European Energy Market, Madrid, June 23-25, 2010, pp. 1-6.
[26] V. V. Pham, L. T. Bui, S. Alam, C. Lokan, and H.
A. Abbass, "A Pittsburgh multi-objective classifier for
user preferred trajectories and f light navigation," in Proc.
IEEE Congress Evolutionary Computation, Barcelona, July
18-23, 2010, pp. 608-615.

[27] J. Hurst and L. Bull, "A neural learning classifier
system with self-adaptive constructivism for mobile robot control," Artif. Life, vol. 12, no. 3, pp. 353-380, July
2006.
[28] R. E. Smith, A. El-Fallah, B. Ravichandran, R. K.
Mehra, and B. A. Dike, "The fighter aircraft LCS: A realWorld, machine innovation application," in Applications of
Learning Classifier Systems, L. Bull, Ed. Berlin, Germany:
Springer-Verlag, 2004, pp. 113-142.
[29] L. M. Hercog and T. C. Fogarty, "Co-evolutionary
classifier systems for multi-agent simulation," in Proc.
IEEE Congress Evolutionary Computation, Honolulu, May
12-17, 2002, vol. 2, pp. 1798-1803.
[30] J. H. Holland, Adaptation in Natural and Artificial
Systems. Ann Arbor: Univ. Michigan Press, 1975, republished by the MIT press, 1992.
[31] J. H. Holland, "Adaptation," in Progress in Theoretical Biology, R. Rosen and F. M. Snell, Eds. New York:
Plenum, 1976.
[32] J. H. Holland, K. J. Holyoak, R. E. Nisbett, and P.
R. Thagard, Induction: Processes of Inference, Learning, and
Discovery. Cambridge, MA: MIT Press, 1986.
[33] P. L. Lanzi, W. Stolzmann, and S. W. Wilson, Learning Classifier Systems: From Foundations to Applications. Berlin, Germany: Springer-Verlag, 2000.
[34] J. H. Holland, L. B. Booker, M. Colombetti, M.
Dorigo, D. E. Goldberg, S. Forrest, R. L. Riolo, R. E.
Smith, P. L. Lanzi, W. Stolzmann, and S. W. Wilson,
"What is a learning classifier system?," in LNCS 1813:
Learning Classifier Systems: From Foundations to Applications,
P. L. Lanzi, W. Stolzmann, and S. W. Wilson, Eds. Berlin, Germany: Springer-Verlag, 2000, pp. 3-32.
[35] J. H. Holland and J. S. Reitman, "Cognitive systems
based on adaptive algorithms," in Pattern-directed Inference
Systems, D. A. Waterman and F. Hayes-Roth, Eds. New
York: Academic Press, 1978, reprinted in: Evolutionary
Computation. The Fossil Record. David B. Fogel (Ed.)
IEEE Press, 1998.
[36] G. Tesauro, "Temporal difference learning and TDGammon," Commun. ACM, vol. 38, no. 3, pp. 58-68,
Mar. 1995.
[37] C. J. Watkins and P. Dayan, "Q-learning," Mach.
Learn., vol. 8, no. 3-4, pp. 279-292, May 1992.
[38] M. Dorigo and H. Bersini, "A comparison of Qlearning and classifier systems," in From Animals to Animats 3: Proc. of Third International Conference on Simulation
of Adaptive Behavior. Cambridge, MA: MIT Press, 1994,
pp. 248-255.
[39] P. L. Lanzi, "Learning classifier systems from a reinforcement learning perspective," Soft Comput., vol. 6, no.
3-4, pp. 162-170, June 2002.
[40] S. F. Smith, "A learning system based on genetic
adaptive algorithms," Ph.D. dissertation, Univ. Pittsburgh, Pittsburgh, 1980.
[41] K. De Jong, "Learning with genetic algorithms: An
overview," Mach. Learn., vol. 3, no. 2/3, pp. 121-138,
Oct. 1988.
[42] T. Kovacs, "Strength or accuracy? Fitness calculation in learning classifier systems," in Learning Classifier
Systems: From Foundations to Applications, P. L. Lanzi, W.
Stolzmann, and S. W. Wilson, Eds. Berlin, Germany:
Springer-Verlag, 2000, pp. 143-160.
[43] J. H. Holland, "Adaptive algorithms for discovering
and using general patterns in growing knowledge-bases,"
Int. J. Policy Anal. Inform. Syst., vol. 4, no. 3, pp. 245-268,
Sept. 1980.
[44] S. W. Wilson, "Classifier fitness based on accuracy,"
Evol. Comput., vol. 3, no. 2, pp. 149-175, June 1995.
[45] K. Shafi, H. A. Abbass, and W. Zhu, "The role of
early stopping and population size in XCS for intrusion
detection," in LNCS 4247: Proc. 6th Int. Conf. Simulated
Evolution and Learning: SEAL 2006, T.-D. Wang, X. Li,
S.-H. Chen, X. Wang, H. A. Abbass, H. Iba, G.-L. Chen,
and X. Yao, Eds. Berlin, Germany: Springer-Verlag,
2006, pp. 50-57.
[46] M. A. Franco, N. Krasnogor, and J. Bacardit, "GAssist vs. BioHEL: Critical assessment of two paradigms of
genetics-based machine learning," Soft Comput., vol. 17,
no. 6, pp. 953-981, June 2013.
[47] J. H. Smith, "The games economists play-implications of economic game theory for the study of computer
games," Game Stud., vol. 6, no. 1, pp. 1-15, Dec. 2006.

FEbruary 2017 | IEEE ComputatIonal IntEllIgEnCE magazInE

53
http://www http://www.theesa.com/wp-content/uploads/2015/04/ESA-Essen
Table of Contents for the Digital Edition of Computational Intelligence - February 2017
