Computational Intelligence - February 2017 - 54

[48] M. Müller, "Computer Go as a sum of local games:
An application of combinatorial game theory," Ph.D. dissertation, ETH, Zürich, 1995.
[49] A. Amory, K. Naicker, J. Vincent, and C. Adams,
"The use of computer games as an educational tool: Identification of appropriate game types and game elements,"
Br. J. Educat. Technol., vol. 30, no. 4, pp. 311-321, Oct.
1999.
[50] T. H. Apperley, "Genre and game studies: Toward a
critical approach to video game genres," Simul. Gaming,
vol. 37, no. 1, pp. 6-23, Mar. 2006.
[51] S. M. Iversen, "In the double grip of the game: Challenge and Fallout 3," Game Stud., vol. 12, no. 2, Dec.
2012.
[52] M. K. Schlickum, L. Hedman, L. Enochsson, A.
Kjellin, and L. Felländer-Tsai, "Systematic video game
training in surgical novices improves performance in
virtual reality endoscopic surgical simulators: A prospective randomized study," World J. Surg., vol. 33, no. 11, pp.
2360-2367, Nov. 2009.
[53] S. L. Wang, K. Shafi, C. Lokan, and H. A. Abbass,
"An agent-based model to simulate and analyse behaviour
under noisy and deceptive information," Adapt. Behav.,
vol. 21, no. 2, pp. 96-117, Apr. 2013.
[54] S. Alam, K. Shafi, H. A. Abbass, and M. Barlow,
"Evolving air traffic scenarios for the evaluation of conf lict detection models," in Proc. 6th Eurocontrol Innovative
Research Workshop, Paris, Dec. 4-6, 2007, pp. 237-245.
[55] C. Camerer, Behavioral Game Theory: Experiments in
Strategic Interaction. Princeton, NJ: Princeton Univ. Press,
2003.
[56] J. W. Weibull, Evolutionary Game Theory. Cambridge
MA: MIT Press, 1997.
[57] R. Axelrod, "The evolution of strategies in the Iterated Prisoners Dilemma," in Genetic Algorithms and
Simulated Annealing, L. Davis, Ed. Los Altos, CA: Morgan
Kaufman, 1987, pp. 32-41.
[58] F. Seredy nski,
´
P. Cichosz, and G. P. Klebus, "Learning classifier systems in multi-agent environments," in
Proc. 1st IEE/IEEE Conf. Genetic Algorithms Engineering
Systems: Innovations and Applications, Sheffield, Sept. 12-
14, 1995, pp. 287-292.
[59] S. F. Smith, "Flexible learning of problem solving
heuristics through adaptive search," in Proc. 8th Int. Joint
Conf. Artificial Intelligence, Karlsruhe, West Germany,
1983, pp. 422-425.
[60] G. Robert, P. Portier, and A. Guillot, "Classifier
systems as 'animat' architectures for action selection in
MMORPG," in Proc. 3rd Int. Conf. Intelligent Games and
Simulation, London, Nov. 29-30, 2002.
[61] G. Robert and A. Guillot, "MHiCS, A modular
and hierarchical classifier systems architecture for bots,"
in Proc. 4th Int. Conf. Intelligent Games and Simulation,
London, Nov. 19-21, 2003, pp. 140-144.
[62] G. Robert and A. Guillot, "MHiCS, A motivational
architecture of action selection for Non-player characters
in dynamic environments," Int. J. Intell. Games Simul.,
vol. 4, no. 1, pp. 5-16, June 2006.
[63] S. Sanchez, H. Luga, and Y. Duthen, "Learning
classifier systems and behavioural animation of virtual
characters," in LNCS 4133: Proc. 6th Int. Conf. Intelligent
Virtual Agents, J. Gratch, M. Young, R. Aylett, D. Ballin,
and P. Olivier, Eds., Aug. 21-23, 2006, p. 467.
[64] R. Kop, A. Toubman, M. Hoogendoorn, J. J. Roessingh, "Evolutionary dynamic scripting: Adaptation of
expert rule bases for serious games," in LNCS 9101: Current Approaches in Applied Artificial Intelligence: Proc. 28th
Int. Conf. Industrial, Engineering and Other Applications
of Applied Intelligent Systems, IEA/AIE 2015, M. Ali, S.
Y. Kwon, C.-H. Lee, J. Kim, and Y. Kim, Eds. Berlin,
Germany: Springer-Verlag, 2015, pp. 53-62.
[65] A. Bonarini and V. Trianni, "Learning fuzzy classifier systems for multi-agent coordination," Inform. Sci.,
vol. 136, no. 1, pp. 215-239, Aug. 2001.
[66] C. Castillo, M. Lurgi, and I. Martínez, "Chimps: An
evolutionary reinforcement learning approach for soccer
agents," in Proc. IEEE Int. Conf. Systems, Man and Cybernetics, Washington, D.C., Oct. 2003, vol. 1, pp. 60-65.
[67] S. Kinoshita and Y. Yamamoto, "11Monkeys description," in LNCS 1856: RoboCup-99: Robot Soccer
World Cup III, M. Veloso, E. Pagello, and H. Kitano, Eds.
Berlin, Germany: Springer-Verlag, 2000, pp. 550-553.

54

[68] Y. Sato and T. Kanno, "Event-driven hybrid learning
classifier systems for online soccer games", in Proc. IEEE
Congress Evolutionary Computation, Edinburgh, Sept. 2-5,
2005, vol. 3, pp. 2091-2098.
[69] Y. Sato, Y. Akatsuka, and T. Nishizono, "Reward
allotment in an event-driven hybrid learning classifier
system for online soccer games," in Proc. 8th Annu. Conf.
Genetic and Evolutionary Computation, Seattle, July 8-12,
2006, pp. 1753-1760.
[70] Y. Akatsuka and Y. Sato, "Reward allotment considered roles for learning classifier system for soccer video
games," in Proc. IEEE Symp. Computational Intelligence and
Games, Honolulu, HI, Apr. 1-5, 2007, pp. 288-295.
[71] Y. Sato, Y. Inoue, and Y. Akatsuka, "Applying GA
to self-allotment of rewards in event-driven hybrid
learning classifier systems," in Proc. IEEE Congress Evolutionary Computation, Singapore, Sept. 25-28, 2007, pp.
1800-1807.
[72] Y. Inoue and Y. Sato, "Applying GA for reward allotment in an event-driven hybrid learning classifier system
for soccer video games," in Proc. IEEE Symp. Computational Intelligence and Games, Florida, Dec. 15-18, 2008,
pp. 296-303.
[73] W. J. Falke, II and P. Ross, "Dynamic strategies in a
real-time strategy game," in Proc. 5th Annu. Conf. Genetic
and Evolutionary Computation. Berlin, Germany: SpringerVerlag, 2003, pp. 1920-1921.
[74] A. Lujan, R. Werner, and A. Boukerche, "Generation of rule-based adaptive strategies for a collaborative
virtual simulation environment," in Proc. IEEE Int.
Workshop Haptic Audio Visual Environments and Games,
Ottawa, Oct. 18-19, 2008, pp. 59-64.
[75] A. Lujan, "Generation of rule-based adaptive strategies for games," Ph.D. dissertation, Univ. Ottawa,
Ottawa, Canada, 2009.
[76] R. Small and C. B. Congdon, "Agent Smith: Towards an evolutionary rule-based agent for interactive
dynamic games," in Proc. IEEE Congress Evolutionary
Computation, Trondheim, Norway, May 18-21, 2009, pp.
660-666.
[77] D. G. Nidorf, L. Barone, and T. French, "A comparative study of NEAT and XCS in Robocode," in Proc.
IEEE Congress Evolutionary Computation, Barcelona, July
18-23, 2010, pp. 86-93.
[78] M. T. Tsapanos, K. C. Chatzidimitriou, and P. A.
Mitkas, "A zeroth-level classifier system for real time
strategy games," in Proc. IEEE/WIC/ACM Int. Conf. Web
Intelligence and Intelligent Agent Technology, vol. 2, Lyon,
France, Aug. 22-27, 2011, pp. 244-247.
[79] M. Buro, "ORTS: A hack-free RTS game environment," in LNCS 2883: Third Int. Conf. Computers and
Games, Revised Papers, J. Schaeffer, M. Müller, and Y.
Björnsson, Eds. Edmonton, Berlin: Springer-Verlag, July
25-27, 2003, pp. 280-291.
[80] L. Clementis, "Learning classifier system improvement based on probability driven and neural network
driven approaches," in Proc. 3rd Eastern European Regional
Conf. Engineering Computer Based Systems, Budapest, Aug.
29-30, 2013, pp. 143-148.
[81] M. Irvan, T. Yamada, and T. Terano, "Is XCS approach good for organizational-learning oriented classifier systems?" in Proc. 24th Annu. Conf. Japanese Society
Artificial Intelligence, Florida, June 9-11, 2010.
[82] W. Browne and D. Scott, "An abstraction algorithm
for genetics-based reinforcement learning," in Proc. 7th
Annu. Conf. Genetic and Evolutionary Computation, Washington DC, USA, June 25-29, 2005, pp. 1875-1882.
[83] W. Browne, D. Scott, and C. Ioannides, "Abstraction
for genetics-based reinforcement learning," in Reinforcement Learning: Theory and Applications, M. E. Cornelius
Weber and N. M. Mayer, Eds. Vienna, Austria: I-Tech
Education and Publishing, 2008, pp. 187-198.
[84] J. H. Holland, "Concerning the emergence of tagmediated lookahead in classifier systems," Phys. D, vol. 42,
no. 1, pp. 188-201, June 1990.
[85] K. Shafi, H. A. Abbass, and W. Zhu, "Real time signature extraction from a supervised classifier system," in
Proc. IEEE Congress Evolutionary Computation, Singapore,
Sept. 25-28, 2007, pp. 2509-2516.
[86] N. P. Sood, A. G. Williams, and K. A. D Jong,
"Evaluating the XCS learning classifier system in competitive simultaneous learning environments," in Proc.

IEEE ComputatIonal IntEllIgEnCE magazInE | FEbruary 2017

7th Annu. Workshop Genetic and Evolutionary Computation,
Washington, D.C., June 25-29, 2005, pp. 112-118.
[87] S. R. Beckman, "Cournot and Bertrand games," J.
Econ. Educ., vol. 34, no. 1, pp. 27-35, Mar. 2003.
[88] A. Knittel and T. Bossomaier, "Re-usable features
in a hierarchical concept network for autonomous learning in complex games," in Proc. IEEE Workshop Evolving
and Adaptive Intelligent Systems, Paris, Apr. 11-15, 2011,
pp. 155-162.
[89] A. Knittel, T. Bossomaier, and A. Snyder, "Concept accessibility as basis for evolutionary reinforcement
learning of dots and boxes," in Proc. IEEE Symp. Computational Intelligence and Games, Honolulu, HI, Apr. 1-5,
2007, pp. 140-145.
[90] M. Kobayashi and T. Terano, "Learning agents in a
business simulator," in Proc. IEEE Int. Symp. Computational Intelligence in Robotics and Automation, 2003, vol. 3,
pp. 1323-1327.
[91] C. Fernando, "Co-evolution of lexical and syntactic
classifiers during a language game," Evolut. Intell., vol. 4,
no. 3, pp. 165-182, Sept. 2011.
[92] Y. Li and S. Liu, "Agent-based modeling simulation
analysis on the regulation of institutional investor's encroachment behavior in stock market," J. Ind. Eng. Manage., vol. 7, no. 2, pp. 434-447, Mar. 2014.
[93] D. F. Yates and A. Fairley, "Evolutionary stability
in simple classifier systems," in LNCS 865: Evolutionary
Computing: AISB Workshop, Selected Papers, T. C. Fogarty,
Ed. Berlin, Germany: Springer-Verlag, 1994, pp. 28-37.
[94] F. Seredyn´ski, "Task scheduling with use of classifier systems," in LNCS 1305: Evolutionary Computing:
AISB Int. Workshop, Selected Papers, D. Corne and J. L.
Shapiro, Eds. Berlin, Germany: Springer-Verlag, 1997,
pp. 287-306.
[95] F. Seredyn´ski, "Distributed scheduling using simple
learning machines," Eur. J. Oper. Res., vol. 107, no. 2, pp.
401-413, June 1998.
[96] F. Seredynski and C. Z. Janikow, "Learning Nash
equilibria by coevolving distributed classifier systems," in
Proc. IEEE Congress Evolutionary Computation, July 6-9,
1999, vol. 3, pp. 1619-1626.
[97] A. J. Bagnall and G. D. Smith, "Game playing with
autonomous adaptive agents in a simplified economic
model of the UK market in electricity generation," in
Proc. IEEE-PES/CSEE Int. Conf. Power System Technology, Perth, Australia, Dec. 4-7, 2000, vol. 2, pp. 891-896.
[98] L. Hernandez, C. Baladron, J. M. Aguiar, B. Carro,
A. Sanchez-Esguevillas, J. Lloret, D. Chinarro, J. J. Gomez-Sanz, and D. Cook, "A multi-agent system architecture for smart grid management and forecasting of energy
demand in virtual power plants," IEEE Commun. Mag.,
vol. 51, no. 1, pp. 106-113, Jan. 2013.
[99] C. L. Meng, and R. Pakath, "The Iterated Prisoner's
Dilemma: Early experiences with learning classifier system-based simple agents," Decis. Support Syst., vol. 31, no. 4,
pp. 379-403, Oct. 2001.
[100] D. A. Gaines and R. Pakath, "Alternate adaptive
agent architectures and behavioral consequences," in
Proc. 10th Americas Conf. Information Systems, New York,
Aug. 6-8, 2004, pp. 25-28.
[101] D. A. Gaines and R. Pakath, "An examination of
evolved behavior in two reinforcement learning systems,"
Decis. Support Syst., vol. 55, no. 1, pp. 194-205, Apr. 2013.
[102] G. Kendall, X. Yao, and S. Y. Chong, The Iterated
Prisoners' Dilemma: 20 Years On. River Edge, NJ: World
Scientific, 2007.
[103] D. Challet, M. Marsili, and Y. C. Zhang, Minority Games: Interacting Agents in Financial Markets. Oxford,
U.K.: Oxford Univ. Press, 2013.
[104] L. M. Hercog, "Better manufacturing process organization using multi-agent self-organization and co-evolutionary classifier systems: The multibar problem," Appl.
Soft Comput., vol. 13, no. 3, pp. 1407-1418, Mar. 2013.
[105] K. Takadama, Y. L. Suematsu, N. Sugimoto, N. E.
Nawa, and K. Shimohara, "Cross-element validation in
multiagent-based simulation: Switching learning mechanisms in agents," J. Artif. Soc. Soc. Simulat., vol. 6, no. 4,
Oct. 2003.
[106] M. Mailliard, F. Amblard, C. Sibertin-Blanc, and P.
Roggero, "Cooperation is not always so simple to learn,"
in Agent-Based Approaches in Economic and Social Complex
Systems IV, ser. Springer Series on Agent Based Social Systems,



Table of Contents for the Digital Edition of Computational Intelligence - February 2017

Computational Intelligence - February 2017 - Cover1
Computational Intelligence - February 2017 - Cover2
Computational Intelligence - February 2017 - 1
Computational Intelligence - February 2017 - 2
Computational Intelligence - February 2017 - 3
Computational Intelligence - February 2017 - 4
Computational Intelligence - February 2017 - 5
Computational Intelligence - February 2017 - 6
Computational Intelligence - February 2017 - 7
Computational Intelligence - February 2017 - 8
Computational Intelligence - February 2017 - 9
Computational Intelligence - February 2017 - 10
Computational Intelligence - February 2017 - 11
Computational Intelligence - February 2017 - 12
Computational Intelligence - February 2017 - 13
Computational Intelligence - February 2017 - 14
Computational Intelligence - February 2017 - 15
Computational Intelligence - February 2017 - 16
Computational Intelligence - February 2017 - 17
Computational Intelligence - February 2017 - 18
Computational Intelligence - February 2017 - 19
Computational Intelligence - February 2017 - 20
Computational Intelligence - February 2017 - 21
Computational Intelligence - February 2017 - 22
Computational Intelligence - February 2017 - 23
Computational Intelligence - February 2017 - 24
Computational Intelligence - February 2017 - 25
Computational Intelligence - February 2017 - 26
Computational Intelligence - February 2017 - 27
Computational Intelligence - February 2017 - 28
Computational Intelligence - February 2017 - 29
Computational Intelligence - February 2017 - 30
Computational Intelligence - February 2017 - 31
Computational Intelligence - February 2017 - 32
Computational Intelligence - February 2017 - 33
Computational Intelligence - February 2017 - 34
Computational Intelligence - February 2017 - 35
Computational Intelligence - February 2017 - 36
Computational Intelligence - February 2017 - 37
Computational Intelligence - February 2017 - 38
Computational Intelligence - February 2017 - 39
Computational Intelligence - February 2017 - 40
Computational Intelligence - February 2017 - 41
Computational Intelligence - February 2017 - 42
Computational Intelligence - February 2017 - 43
Computational Intelligence - February 2017 - 44
Computational Intelligence - February 2017 - 45
Computational Intelligence - February 2017 - 46
Computational Intelligence - February 2017 - 47
Computational Intelligence - February 2017 - 48
Computational Intelligence - February 2017 - 49
Computational Intelligence - February 2017 - 50
Computational Intelligence - February 2017 - 51
Computational Intelligence - February 2017 - 52
Computational Intelligence - February 2017 - 53
Computational Intelligence - February 2017 - 54
Computational Intelligence - February 2017 - 55
Computational Intelligence - February 2017 - 56
Computational Intelligence - February 2017 - Cover3
Computational Intelligence - February 2017 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com