IEEE Robotics & Automation Magazine - June 2018 - 59

I

n this article, we present a communication paradigm using a context-aware mixed-reality approach
for instructing human workers when collaborating with robots. The main objective is to utilize the
physical work environment as a canvas to communicate task-related instructions and robot
intentions in the form of visual cues. A vision-based object-tracking algorithm is used to precisely
determine the pose and state of physical objects in and around the workspace. A projection-mapping
technique is employed to overlay visual cues on the tracked objects and the workspace. Simultaneous
tracking and projection onto objects enable the system to provide just-in-time instructions for carrying
out a procedural task.
Additionally, the system can inform and warn humans about the intentions of the robot and the safety of the workspace. We hypothesized that using this system for executing a human-robot collaborative
task will improve the overall performance of the team and provide a positive experience for the human
partners. To test this hypothesis, we conducted an experiment involving human subjects and compared
the performance (both objective and subjective) of the presented system with conventional forms of
communication, namely, printed and mobile display instructions. We found that projecting visual cues

By Ramsundar Kalpagam Ganesan, Yash K. Rathore,
Heather M. Ross, and Heni Ben Amor

Better Teaming
Through Visual Cues

©istockphoto.com/NicoElNiNo

How Projecting
Imagery in a
Workspace
Can Improve
Human-Robot
Collaboration

Digital Object Identifier 10.1109/MRA.2018.2815655
Date of publication: 15 May 2018

1070-9932/18©2018IEEE

june 2018

*

IEEE ROBOTICS & AUTOMATION MAGAZINE

*

59


http://www.istockphoto.com/NicoElNiNo

IEEE Robotics & Automation Magazine - June 2018

Table of Contents for the Digital Edition of IEEE Robotics & Automation Magazine - June 2018

Contents
IEEE Robotics & Automation Magazine - June 2018 - Cover1
IEEE Robotics & Automation Magazine - June 2018 - Cover2
IEEE Robotics & Automation Magazine - June 2018 - Contents
IEEE Robotics & Automation Magazine - June 2018 - 2
IEEE Robotics & Automation Magazine - June 2018 - 3
IEEE Robotics & Automation Magazine - June 2018 - 4
IEEE Robotics & Automation Magazine - June 2018 - 5
IEEE Robotics & Automation Magazine - June 2018 - 6
IEEE Robotics & Automation Magazine - June 2018 - 7
IEEE Robotics & Automation Magazine - June 2018 - 8
IEEE Robotics & Automation Magazine - June 2018 - 9
IEEE Robotics & Automation Magazine - June 2018 - 10
IEEE Robotics & Automation Magazine - June 2018 - 11
IEEE Robotics & Automation Magazine - June 2018 - 12
IEEE Robotics & Automation Magazine - June 2018 - 13
IEEE Robotics & Automation Magazine - June 2018 - 14
IEEE Robotics & Automation Magazine - June 2018 - 15
IEEE Robotics & Automation Magazine - June 2018 - 16
IEEE Robotics & Automation Magazine - June 2018 - 17
IEEE Robotics & Automation Magazine - June 2018 - 18
IEEE Robotics & Automation Magazine - June 2018 - 19
IEEE Robotics & Automation Magazine - June 2018 - 20
IEEE Robotics & Automation Magazine - June 2018 - 21
IEEE Robotics & Automation Magazine - June 2018 - 22
IEEE Robotics & Automation Magazine - June 2018 - 23
IEEE Robotics & Automation Magazine - June 2018 - 24
IEEE Robotics & Automation Magazine - June 2018 - 25
IEEE Robotics & Automation Magazine - June 2018 - 26
IEEE Robotics & Automation Magazine - June 2018 - 27
IEEE Robotics & Automation Magazine - June 2018 - 28
IEEE Robotics & Automation Magazine - June 2018 - 29
IEEE Robotics & Automation Magazine - June 2018 - 30
IEEE Robotics & Automation Magazine - June 2018 - 31
IEEE Robotics & Automation Magazine - June 2018 - 32
IEEE Robotics & Automation Magazine - June 2018 - 33
IEEE Robotics & Automation Magazine - June 2018 - 34
IEEE Robotics & Automation Magazine - June 2018 - 35
IEEE Robotics & Automation Magazine - June 2018 - 36
IEEE Robotics & Automation Magazine - June 2018 - 37
IEEE Robotics & Automation Magazine - June 2018 - 38
IEEE Robotics & Automation Magazine - June 2018 - 39
IEEE Robotics & Automation Magazine - June 2018 - 40
IEEE Robotics & Automation Magazine - June 2018 - 41
IEEE Robotics & Automation Magazine - June 2018 - 42
IEEE Robotics & Automation Magazine - June 2018 - 43
IEEE Robotics & Automation Magazine - June 2018 - 44
IEEE Robotics & Automation Magazine - June 2018 - 45
IEEE Robotics & Automation Magazine - June 2018 - 46
IEEE Robotics & Automation Magazine - June 2018 - 47
IEEE Robotics & Automation Magazine - June 2018 - 48
IEEE Robotics & Automation Magazine - June 2018 - 49
IEEE Robotics & Automation Magazine - June 2018 - 50
IEEE Robotics & Automation Magazine - June 2018 - 51
IEEE Robotics & Automation Magazine - June 2018 - 52
IEEE Robotics & Automation Magazine - June 2018 - 53
IEEE Robotics & Automation Magazine - June 2018 - 54
IEEE Robotics & Automation Magazine - June 2018 - 55
IEEE Robotics & Automation Magazine - June 2018 - 56
IEEE Robotics & Automation Magazine - June 2018 - 57
IEEE Robotics & Automation Magazine - June 2018 - 58
IEEE Robotics & Automation Magazine - June 2018 - 59
IEEE Robotics & Automation Magazine - June 2018 - 60
IEEE Robotics & Automation Magazine - June 2018 - 61
IEEE Robotics & Automation Magazine - June 2018 - 62
IEEE Robotics & Automation Magazine - June 2018 - 63
IEEE Robotics & Automation Magazine - June 2018 - 64
IEEE Robotics & Automation Magazine - June 2018 - 65
IEEE Robotics & Automation Magazine - June 2018 - 66
IEEE Robotics & Automation Magazine - June 2018 - 67
IEEE Robotics & Automation Magazine - June 2018 - 68
IEEE Robotics & Automation Magazine - June 2018 - 69
IEEE Robotics & Automation Magazine - June 2018 - 70
IEEE Robotics & Automation Magazine - June 2018 - 71
IEEE Robotics & Automation Magazine - June 2018 - 72
IEEE Robotics & Automation Magazine - June 2018 - 73
IEEE Robotics & Automation Magazine - June 2018 - 74
IEEE Robotics & Automation Magazine - June 2018 - 75
IEEE Robotics & Automation Magazine - June 2018 - 76
IEEE Robotics & Automation Magazine - June 2018 - 77
IEEE Robotics & Automation Magazine - June 2018 - 78
IEEE Robotics & Automation Magazine - June 2018 - 79
IEEE Robotics & Automation Magazine - June 2018 - 80
IEEE Robotics & Automation Magazine - June 2018 - 81
IEEE Robotics & Automation Magazine - June 2018 - 82
IEEE Robotics & Automation Magazine - June 2018 - 83
IEEE Robotics & Automation Magazine - June 2018 - 84
IEEE Robotics & Automation Magazine - June 2018 - 85
IEEE Robotics & Automation Magazine - June 2018 - 86
IEEE Robotics & Automation Magazine - June 2018 - 87
IEEE Robotics & Automation Magazine - June 2018 - 88
IEEE Robotics & Automation Magazine - June 2018 - 89
IEEE Robotics & Automation Magazine - June 2018 - 90
IEEE Robotics & Automation Magazine - June 2018 - 91
IEEE Robotics & Automation Magazine - June 2018 - 92
IEEE Robotics & Automation Magazine - June 2018 - 93
IEEE Robotics & Automation Magazine - June 2018 - 94
IEEE Robotics & Automation Magazine - June 2018 - 95
IEEE Robotics & Automation Magazine - June 2018 - 96
IEEE Robotics & Automation Magazine - June 2018 - 97
IEEE Robotics & Automation Magazine - June 2018 - 98
IEEE Robotics & Automation Magazine - June 2018 - 99
IEEE Robotics & Automation Magazine - June 2018 - 100
IEEE Robotics & Automation Magazine - June 2018 - 101
IEEE Robotics & Automation Magazine - June 2018 - 102
IEEE Robotics & Automation Magazine - June 2018 - 103
IEEE Robotics & Automation Magazine - June 2018 - 104
IEEE Robotics & Automation Magazine - June 2018 - 105
IEEE Robotics & Automation Magazine - June 2018 - 106
IEEE Robotics & Automation Magazine - June 2018 - 107
IEEE Robotics & Automation Magazine - June 2018 - 108
IEEE Robotics & Automation Magazine - June 2018 - 109
IEEE Robotics & Automation Magazine - June 2018 - 110
IEEE Robotics & Automation Magazine - June 2018 - 111
IEEE Robotics & Automation Magazine - June 2018 - 112
IEEE Robotics & Automation Magazine - June 2018 - 113
IEEE Robotics & Automation Magazine - June 2018 - 114
IEEE Robotics & Automation Magazine - June 2018 - 115
IEEE Robotics & Automation Magazine - June 2018 - 116
IEEE Robotics & Automation Magazine - June 2018 - 117
IEEE Robotics & Automation Magazine - June 2018 - 118
IEEE Robotics & Automation Magazine - June 2018 - 119
IEEE Robotics & Automation Magazine - June 2018 - 120
IEEE Robotics & Automation Magazine - June 2018 - 121
IEEE Robotics & Automation Magazine - June 2018 - 122
IEEE Robotics & Automation Magazine - June 2018 - 123
IEEE Robotics & Automation Magazine - June 2018 - 124
IEEE Robotics & Automation Magazine - June 2018 - 125
IEEE Robotics & Automation Magazine - June 2018 - 126
IEEE Robotics & Automation Magazine - June 2018 - 127
IEEE Robotics & Automation Magazine - June 2018 - 128
IEEE Robotics & Automation Magazine - June 2018 - 129
IEEE Robotics & Automation Magazine - June 2018 - 130
IEEE Robotics & Automation Magazine - June 2018 - 131
IEEE Robotics & Automation Magazine - June 2018 - 132
IEEE Robotics & Automation Magazine - June 2018 - Cover3
IEEE Robotics & Automation Magazine - June 2018 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2010
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2010
https://www.nxtbookmedia.com