IEEE Robotics & Automation Magazine - September 2019 - 87

To mitigate this problem, we have also added a complete set
of instructions with the various packages to install on a native
Linux system to enable reproducibility even without the VirtualBox image. Nevertheless, because of continuous updates
in software packages, as well as discontinuations, this second
approach may not be stable in the long run. To the best of our
knowledge, this is the first example of a fully reproducible
study of exploration algorithms.
Conclusions and Future Work
In this article, we studied an exploration task with temporal
constraints. The objective for the robot is to enter an unexplored area and reach a target location within a given temporal deadline. Our system incrementally builds a spatial
model called a semantic topological-oriented map. The
model enhances classic topological maps by adding semantic labels (corridor/room) and relationships of the type "to
the right of " and "to the left of." Key to our approach is the
assumption that walls in the environment are aligned along
orthogonal directions. This assumption is very common in
most buildings.
The proposed spatial model has been coupled with our
recently proposed planner based on CMDPs; in addition to
this, we proposed and analyzed five different exploration
techniques that exploit the proposed model. Through thousands of simulated runs, it appears that our method, dubbed
topological frontier with normalized distances, works best. In
their current formulation, methods on semantic information
are slightly less competitive, although it should be acknowledged that only very limited semantic information was used.
Finally, we have provided all of the resources to ensure that a
third party can fully reproduce our results-a first in the area
of reproducible robotics. With respect to this aspect, we
believe it will be important for the robotics community to
reach a consensus on the tools and infrastructure needed to
disseminate reproducible research.
References
[1] B. Yamauchi, "A frontier-based approach for autonomous exploration," in Proc. IEEE Int. Symp. Computational Intelligence Robotics and
Automation, Monterey, CA, 1997, pp. 146-151.
[2] B. Kuipers, "The spatial semantic hierarchy," Artif. Intell., vol. 119,
no. 1-2, pp. 191-233, 2000.
[3] E. Vidal, J. D. Hern and K. Isteniˇ, "Optimized environment exploration for autonomous underwater vehicles," in Proc. IEEE Int. Conf.
Robotics and Automation, 2018, pp. 6409-6416.
[4] T. Dang, C. Papachristos and A. Kostas, "Visual saliency-aware receding horizon autonomous exploration with application to aerial robotics,"
in Proc. IEEE Int. Conf. Robotics and Automation, 2018, pp. 2526-2533.
[5] D. Zhu, T. Li, D. Ho, C. Wang and M. Q. Meng, "Deep reinforcement
learning supervised autonomous exploration in office environments,"
in Proc. IEEE Int. Conf. Robotics and Automation, 2018, pp. 7548-7555.
[6] K. Antonios and G. Ioannis, "Semantic mapping for mobile robotics
tasks: A survey," Robot. Auton. Syst., no. 66, pp. 86-103, Apr. 2015.
[7] S. Garg, N. Suenderhauf and M. Milford, "Don't look back: Robustifying place categorization for viewpoint- and condition-invariant

place recognition," in Proc. IEEE Int. Conf. Robotics and Automation,
2018, pp. 3645-3652.
[8] M. Durner, M. Brucker, A. Wendt, P. Jensfelt, K. O. Arras and R.
Triebel, "Semantic labeling of indoor environments from 3D RGB
maps," in Proc. IEEE Int. Conf. Robotics and Automation, 2018,
pp. 1871-1878.
[9] L. F. Posada, A. Velasquez-Lopez, F. Hoffmann, and T. Bertram,
"Semantic mapping with omnidirectional vision," in Proc. IEEE Int.
Conf. Robotics and Automation, 2018, pp. 1901-1907.
[10] A. Quattrini Li, R. Cipolleschi, M. Giusto, and F. Amigoni, "A
semantically-informed multirobot system for exploration of relevant
areas in search and rescue settings," Auton. Robots, vol. 40, no. 4,
pp. 581-597, 2016.
[11] M. C. Gombolay, R. J. Wilcox, and J. A. Shah, "Fast scheduling of
robot teams performing tasks with temporospatial constraints," IEEE
Trans. Robot., vol. 1, no. 34, pp. 220-239, 2018.
[12] J. Guerrero and G. Oliver, "Swarm-like methodologies for executing tasks with deadlines," J. Intell. Robot. Syst., vol. 68, no. 1, pp. 3-19,
2012.
[13] Y.-L. Chow, M. Pavone, B. Sadler, and S. Carpin, "Trading safety
versus performance: Rapid deployment of robotic swarms with robust
performance constraints," ASME J. Dynam. Syst., Measurement Control, vol. 3, no. 137, pp. 031005-031005-11, 2015. doi: 10.1115/1.4028117.
[14] S. Carpin and S. Feyzabadi, "Planning using hierarchical constrained Markov decision processes," Auton. Robots, vol. 8, no. 41,
pp. 1589-1607, 2017.
[15] J. L. Susa Rincon, P. Tokekar, V. Kumar, and S. Carpin, "Rapid
deployment of mobile robots under temporal, performance, perception, and resource constraints," IEEE Robot. Autom. Lett., vol. 4, no. 2,
pp. 2016-2023, 2017.
[16] E. Garcia-Fidalgo and A. Ortiz, "Vision-based topological mapping
and localization methods: A survey," Robot. Auton. Syst., vol. 64,
pp. 1-20, Feb. 2015.
[17] E. Altman, "Constrained Markov decision processes with total
cost criteria: Occupation measures and primal LP," Math. Methods
Oper. Res., vol. 43, no. 1, pp. 45-72, 1996.
[18] D. P. Bertsekas, Dynamic Programming and Optimal Control,
vol. 1-2. Belmont, MA: Athena Scientific, 2005.
[19] S. Carpin, N. Basilico, D. Burch, T. Chung, and M. Kölsch, "Variable
resolution search with quadrotors: Theory and practice," J. Field
Robot., vol. 5, no. 301, pp. 685-701, 2013.
[20] R. Peng, "A simple explanation for the replication crisis in science,"
Simply Statistics, 2016. [Online]. Available: https://simplystatistics
.org/2016/08/24/replication-crisis/
[21] F. Bonsignorio, J. Hallam, and A. del Pobil, "GEM guidelines," Euron
GEM SIG, Genova, Italy, 2008. [Online]. Available: http://www.heron
robots.com/EuronGEMSig/downloads/GemSigGuidelinesBeta.pdf

Jose Luis Susa Rincon, Department of Computer Science and
Engineering, University of California, Merced. Email: jsusa
rincon@ucmerced.edu.
Stefano Carpin, Department of Computer Science and
Engineering, University of California, Merced. Email:
carpin@ieee.org.

SEPTEMBER 2019

*

IEEE ROBOTICS & AUTOMATION MAGAZINE

*

87


https://simplystatistics.org/2016/08/24/replication-crisis/ https://simplystatistics.org/2016/08/24/replication-crisis/ http://www.heronrobots.com/EuronGEMSig/downloads/GemSigGuidelinesBeta.pdf http://www.heronrobots.com/EuronGEMSig/downloads/GemSigGuidelinesBeta.pdf

IEEE Robotics & Automation Magazine - September 2019

Table of Contents for the Digital Edition of IEEE Robotics & Automation Magazine - September 2019

Contents
IEEE Robotics & Automation Magazine - September 2019 - Cover1
IEEE Robotics & Automation Magazine - September 2019 - Cover2
IEEE Robotics & Automation Magazine - September 2019 - Contents
IEEE Robotics & Automation Magazine - September 2019 - 2
IEEE Robotics & Automation Magazine - September 2019 - 3
IEEE Robotics & Automation Magazine - September 2019 - 4
IEEE Robotics & Automation Magazine - September 2019 - 5
IEEE Robotics & Automation Magazine - September 2019 - 6
IEEE Robotics & Automation Magazine - September 2019 - 7
IEEE Robotics & Automation Magazine - September 2019 - 8
IEEE Robotics & Automation Magazine - September 2019 - 9
IEEE Robotics & Automation Magazine - September 2019 - 10
IEEE Robotics & Automation Magazine - September 2019 - 11
IEEE Robotics & Automation Magazine - September 2019 - 12
IEEE Robotics & Automation Magazine - September 2019 - 13
IEEE Robotics & Automation Magazine - September 2019 - 14
IEEE Robotics & Automation Magazine - September 2019 - 15
IEEE Robotics & Automation Magazine - September 2019 - 16
IEEE Robotics & Automation Magazine - September 2019 - 17
IEEE Robotics & Automation Magazine - September 2019 - 18
IEEE Robotics & Automation Magazine - September 2019 - 19
IEEE Robotics & Automation Magazine - September 2019 - 20
IEEE Robotics & Automation Magazine - September 2019 - 21
IEEE Robotics & Automation Magazine - September 2019 - 22
IEEE Robotics & Automation Magazine - September 2019 - 23
IEEE Robotics & Automation Magazine - September 2019 - 24
IEEE Robotics & Automation Magazine - September 2019 - 25
IEEE Robotics & Automation Magazine - September 2019 - 26
IEEE Robotics & Automation Magazine - September 2019 - 27
IEEE Robotics & Automation Magazine - September 2019 - 28
IEEE Robotics & Automation Magazine - September 2019 - 29
IEEE Robotics & Automation Magazine - September 2019 - 30
IEEE Robotics & Automation Magazine - September 2019 - 31
IEEE Robotics & Automation Magazine - September 2019 - 32
IEEE Robotics & Automation Magazine - September 2019 - 33
IEEE Robotics & Automation Magazine - September 2019 - 34
IEEE Robotics & Automation Magazine - September 2019 - 35
IEEE Robotics & Automation Magazine - September 2019 - 36
IEEE Robotics & Automation Magazine - September 2019 - 37
IEEE Robotics & Automation Magazine - September 2019 - 38
IEEE Robotics & Automation Magazine - September 2019 - 39
IEEE Robotics & Automation Magazine - September 2019 - 40
IEEE Robotics & Automation Magazine - September 2019 - 41
IEEE Robotics & Automation Magazine - September 2019 - 42
IEEE Robotics & Automation Magazine - September 2019 - 43
IEEE Robotics & Automation Magazine - September 2019 - 44
IEEE Robotics & Automation Magazine - September 2019 - 45
IEEE Robotics & Automation Magazine - September 2019 - 46
IEEE Robotics & Automation Magazine - September 2019 - 47
IEEE Robotics & Automation Magazine - September 2019 - 48
IEEE Robotics & Automation Magazine - September 2019 - 49
IEEE Robotics & Automation Magazine - September 2019 - 50
IEEE Robotics & Automation Magazine - September 2019 - 51
IEEE Robotics & Automation Magazine - September 2019 - 52
IEEE Robotics & Automation Magazine - September 2019 - 53
IEEE Robotics & Automation Magazine - September 2019 - 54
IEEE Robotics & Automation Magazine - September 2019 - 55
IEEE Robotics & Automation Magazine - September 2019 - 56
IEEE Robotics & Automation Magazine - September 2019 - 57
IEEE Robotics & Automation Magazine - September 2019 - 58
IEEE Robotics & Automation Magazine - September 2019 - 59
IEEE Robotics & Automation Magazine - September 2019 - 60
IEEE Robotics & Automation Magazine - September 2019 - 61
IEEE Robotics & Automation Magazine - September 2019 - 62
IEEE Robotics & Automation Magazine - September 2019 - 63
IEEE Robotics & Automation Magazine - September 2019 - 64
IEEE Robotics & Automation Magazine - September 2019 - 65
IEEE Robotics & Automation Magazine - September 2019 - 66
IEEE Robotics & Automation Magazine - September 2019 - 67
IEEE Robotics & Automation Magazine - September 2019 - 68
IEEE Robotics & Automation Magazine - September 2019 - 69
IEEE Robotics & Automation Magazine - September 2019 - 70
IEEE Robotics & Automation Magazine - September 2019 - 71
IEEE Robotics & Automation Magazine - September 2019 - 72
IEEE Robotics & Automation Magazine - September 2019 - 73
IEEE Robotics & Automation Magazine - September 2019 - 74
IEEE Robotics & Automation Magazine - September 2019 - 75
IEEE Robotics & Automation Magazine - September 2019 - 76
IEEE Robotics & Automation Magazine - September 2019 - 77
IEEE Robotics & Automation Magazine - September 2019 - 78
IEEE Robotics & Automation Magazine - September 2019 - 79
IEEE Robotics & Automation Magazine - September 2019 - 80
IEEE Robotics & Automation Magazine - September 2019 - 81
IEEE Robotics & Automation Magazine - September 2019 - 82
IEEE Robotics & Automation Magazine - September 2019 - 83
IEEE Robotics & Automation Magazine - September 2019 - 84
IEEE Robotics & Automation Magazine - September 2019 - 85
IEEE Robotics & Automation Magazine - September 2019 - 86
IEEE Robotics & Automation Magazine - September 2019 - 87
IEEE Robotics & Automation Magazine - September 2019 - 88
IEEE Robotics & Automation Magazine - September 2019 - 89
IEEE Robotics & Automation Magazine - September 2019 - 90
IEEE Robotics & Automation Magazine - September 2019 - 91
IEEE Robotics & Automation Magazine - September 2019 - 92
IEEE Robotics & Automation Magazine - September 2019 - 93
IEEE Robotics & Automation Magazine - September 2019 - 94
IEEE Robotics & Automation Magazine - September 2019 - 95
IEEE Robotics & Automation Magazine - September 2019 - 96
IEEE Robotics & Automation Magazine - September 2019 - 97
IEEE Robotics & Automation Magazine - September 2019 - 98
IEEE Robotics & Automation Magazine - September 2019 - 99
IEEE Robotics & Automation Magazine - September 2019 - 100
IEEE Robotics & Automation Magazine - September 2019 - 101
IEEE Robotics & Automation Magazine - September 2019 - 102
IEEE Robotics & Automation Magazine - September 2019 - 103
IEEE Robotics & Automation Magazine - September 2019 - 104
IEEE Robotics & Automation Magazine - September 2019 - 105
IEEE Robotics & Automation Magazine - September 2019 - 106
IEEE Robotics & Automation Magazine - September 2019 - 107
IEEE Robotics & Automation Magazine - September 2019 - 108
IEEE Robotics & Automation Magazine - September 2019 - 109
IEEE Robotics & Automation Magazine - September 2019 - 110
IEEE Robotics & Automation Magazine - September 2019 - 111
IEEE Robotics & Automation Magazine - September 2019 - 112
IEEE Robotics & Automation Magazine - September 2019 - Cover3
IEEE Robotics & Automation Magazine - September 2019 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2010
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2010
https://www.nxtbookmedia.com