IEEE Technology and Society Magazine - June 2018 - 87

system of societal apparatuses to protect the individual
citizen against the running code and/or against potentially malicious use by individuals of the data that is collected and produced by that code.
In this article, we have explored five avenues. 1)
First, there is the obvious attention to data access control. Beside traditional privacy and security concerns,
the notion of behavioral privacy will be equally important, as it will be the possibility for understanding how
the exploitation of our personal data affects algorithms'
behavior. 2) Part of the solution may be to proactively
chaperone the ongoing activities of the algocracy with
"algorithmic guardians" that can represent and defend
us in the algorithmic world. 3) A less trivial challenge
lies in making citizens aware of the code that runs their
algocracy, and empowering them in novel democratic
procedures that will be used to manage that code. 4)
We should never give up the possibility for humans to
"pull the plug" or to insist on the wisdom of a crowd of
(preferably independent) algorithms. 5) Finally, context
awareness could be used to "sandbox" the power of certain algorithms in certain contexts and to provide the
meta technology to activate and deactivate the sandboxing based on a citizen's expression of discomfort.
We agree with [30] that ethical considerations must
be central to new algorithms we will create in the future.

Author Information
Franco Zambonelli is with the Università di Modena e Reggio Emilia, Italy. Email: franco.zambonelli@unimore.it.
Flora Salim is with RMIT University, Australia. Email:
flora.salim@rmit.edu.au.
Seng W. Loke is with Deakin University, Australia.
Email: seng.loke@deakin.edu.au.
Wolfgang De Meuter is with Vrije Universiteit, Brussels,
Belgium. Email: wdmeuter@vub.ac.be.
Salil Kanhere is with the University of New South
Wales, Australia. Email: salil.kanhere@unsw.edu.au.

References
[1] F. Zambonelli, "Toward sociotechnical urban superorganisms,"
Computer, vol. 45, no. 8, pp. 76-78, Aug. 2012.
[2] A. Schmidt, M. Langheinrich, and K. Kersting, "Perception beyond
the Here and Now," Computer, vol. 44, no. 2, pp. 86-88, Feb. 2011.
[3] S.R. Arnstein, "A ladder of citizen participation," J. American Planning Assoc., vol. 35, no. 4, pp. 216-224, July 1969.
[4] N. Rodrigues, "Algorithmic governmentality, Smart Cities and
spatial justice," justice spatiale - spatial justice, Université Paris Ouest
Nanterre La Défense, UMR LAVUE 7218, Laboratoire Mosaïques, Liberty,
Equality, IT, 10, 2016; http://www.jssj.org/article/gouvernementalitealgorithmique-smartcities-et-justice-spatiale/.
[5] N. Just and M. Latzer, "Governance by algorithms: Reality construction by algorithmic selection on the Internet," Media, Culture & Society, vol, 39, no. 2, pp. 238 - 258, Apr. 2016.
[6] D. Doneda and V.A.F. Almeida, "What is algorithm governance?,"
IEEE Internet Computing, vol. 20 no. 4, pp. 60-63, 2016.
[7] L. DeNardis and A.M. Hackl, "Internet governance by social media
platforms," Telecommunication Policies, vol. 38, no. 9, pp. 761-770,
Oct. 2015.

JUNE 2018

∕

[8] C. Borean, R. Giannantonio, M. Mamei, D. Mana, A. Sassi, and F.
Zambonelli, "Urban crowd steering: An overview," in Proc. Int. Conf.
Internet and Distributed Computing Systems, Lecture Notes in
Computer Science, no. 9258, 2015, pp. 143-154.
[9] Maslow, "Higher and lower needs," J. Psychology: Interdisciplinary and Applied, vol. 25, no. 2, 1948.
[10] S. Hajian, F. Bonchi, and C. Castillo, "Algorithmic bias: From discrimination discovery to fairness-aware data mining," in Proc. 22nd
ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining
(KDD '16). New York, NY: ACM, 2016, pp. 2125-2126.
[11] S. Wachter-Boettcher, Technically Wrong: Sexist Apps, Biased
Algorithms, and Other Threats of Toxic Tech.Norton, 2017, p. 10.
[12] Rouvroy and B. Stiegler. "The digital regime of truth: From the
algorithmic governmentality to a new rule of law," La Deleuziana -
On Line J. Philosophy, no. 3, pp. 6-29, 2016.
[13] A. Lee, "Geoffrey Hinton, the 'Godfather' of Deep Learning, on
AlphaGo," MacLeans, Mar. 18, 2016; http://www.macleans.ca/society/
science/the-meaning-of-alphago-the-ai-program-that-beat-a-go-champ/.
[14] K. Crawford, "Can an algorithm be agonistic? Ten scenes from
life in calculated publics," Science Technology Human Values, p.
162243915589635, Jun. 2015.
[15] "Open letter on autonomous weapons," FLI - Future of Life Institute, Jul. 28, 2015; http://futureoflife.org/open-letter-autonomousweapons/, accessed Jul. 18, 2016.
[16] J.F. Bonnefon, A. Shariff, and I. Rahwan, "The social dilemma of
autonomous vehicles," Science, vol. 352, no. 6293, pp. 1573-1576,
Jun. 2016.
[17] H. Choi, S. Chakraborty, and M. Srivastava, "Design and evaluation
of SensorSafe: A framework for achieving behavioral privacy in sharing personal sensory information," in Proc. TrustCom (Liverpool, U.K.),
Jun. 2012.
[18] P. McDaniel and S. McLaughlin, "Security and privacy challenges in
Smart Grid," IEEE Security and Privacy, vol. 7, no. 3, pp. 75-77, MayJun. 2009.
[19] J-P. Briot, R.Guerraoui, and K-P. Lohr, "Concurrency and distribution in object-oriented programming," ACM Computing Surveys, vol.
30, no. 3, pp. 291-329, Sept. 1998.
[20] T.V. Cutsem, S. Mostinckx, and W.D. Meuter, "Linguistic symbiosis
between event loop actors and threads," Computer Languages, Systems and Structures, vol. 35, no. 1, pp. 80-98, 2009.
[21] F.P. Brooks, "No silver bullet: Essence and accidents of software
engineering," Computer, vol. 20, no. 4, pp. 10-19, Apr. 1987.
[22] I. Rahwan, "Society-in-the-loop: Programming the algorithmic
social contract," Ethics and Information Technology, vol. 2, no. 2, pp.
1572-8439, 2017.
[23] U. Gasser and V.A.F. Almeida, "A layered model for AI governance,"
IEEE Internet Computing, vol. 21, no. 6, pp. 58-62, Nov./Dec. 2017.
[24] J.L. Seminara, W.R. Gonzalez, and S.O. Parsons, "Human factors
review of nuclear power plant control room design," Report no. EPRI
NP-309, Electric Power Research Inst., Palo Alto, CA, 1977.
[25] B. Schilit, N. Adams, and R. Want, "Context-aware computing
applications," in Proc. Workshop on Mobile Computing Systems and
Applications, 1994, pp. 85-90.
[26] G.D. Abowd, A.K. Dey, P.J. Brown, N. Davies, M. Smith, and P. Steggles, "Towards a better understanding of context and context-awareness," in Handheld and Ubiquitous Computing, H.-W. Gellersen, Ed.
Berlin-Heidelberg, Germany: Springer, 1999, pp. 304-307.
[27] G. Schirner, D. Erdogmus, K. Chowdhury, and T. Padir, "The future
of human-in-the-loop cyberphysical systems," Computer, vol. 46, no. 1,
pp. 36-45, Jan. 2013.
[28] S. Krug, Don't Make Me Think: A Common Sense Approach to
Web Usability. India: Pearson, 2005.
[29] F. Salim and U. Haque, "Urban computing in the wild: A survey on
large scale participation and citizen engagement with ubiquitous computing, cyber physical systems, and Internet of Things," Int. J. HumanComputer Studies, vol. 81, pp. 31-48, Sept. 2015.
[30] D. Bianchini and I. Avila, "Smart Cities and their smart decisions:
Ethical considerations," IEEE Technology and Society Mag., vol. 33,
no. 1, pp. 34-40, Spr. 2014.
[31] R.N. Charette "Automated to death," IEEE Spectrum, Dec. 15, 2009;
https://spectrum.ieee.org/computing/software/automated-to-death.

IEEE Technology and Society Magazine

87
http://www.macleans.ca/society/science/the-meaning-of-alphago-the-ai-program-that-beat-a-go-champ http://www.macleans.ca/society/science/the-meaning-of-alphago-the-ai-program-that-beat-a-go-champ http://www.futureoflife.org/open-letter-autonomous-weapons/ http://www.futureoflife.org/open-letter-autonomous-weapons/ http://www.jssj.org/article/gouvernementalite-algorithmique-smartcities-et-justice-spatiale http://www.jssj.org/article/gouvernementalite-algorithmique-smartcities-et-justice-spatiale https://spectrum.ieee.org/computing/software/automated-to-death
Table of Contents for the Digital Edition of IEEE Technology and Society Magazine - June 2018
