IEEE Robotics & Automation Magazine - March 2022 - 21

alignment system, and by implementing refinements in the
malleable robot's mechanism.
Acknowledgments
Alex Ranne and Angus B. Clark contributed equally to this
work. This article includes a supplementary video available at
https://youtu.be/HgHEnruNgeI.
References
[1] H. Al-Dois, A. Jha, and R. Mishra, " Task-based design optimization
of serial robot manipulators, " Eng. Optim., vol. 45, no. 6, pp. 647-658,
2013, doi: 10.1080/0305215X.2012.704027.
[2] A. Nagabandi, K. Konolige, S. Levine, and V. Kumar, " Deep dynamics
models for learning dexterous manipulation, " in Proc. Conf. Robot
Learn., PMLR, 2020, pp. 1101-1112.
[3] F. Sherwani, M. M. Asad, and B. Ibrahim, " Collaborative robots and
industrial revolution 4.0 (ir 4.0), " in Proc. 2020 Int. Conf. Emerging
Trends Smart Technol. (ICETST), pp. 1-5, doi: 10.1109/ICETST49965.
2020.9080724.
[4] R. Galin and R. Meshcheryakov, " Review on human-robot interaction
during collaboration in a shared workspace, " in Proc. Int. Conf.
Interactive Collaborative Robot., Springer-Verlag, 2019, pp. 63-74, doi:
10.1007/978-3-030-26118-4_7.
[5] Z. Zhou, R. Xiong, Y. Wang, and J. Zhang, " Advanced robot programming:
A review, " Current Robot. Rep., vol. 1, no. 4, pp. 1-8, 2020,
doi: 10.1007/s43154-020-00023-4.
[6] A. B. Clark and N. Rojas, " Design and workspace characterisation of
malleable robots, " in Proc. 2020 IEEE Int. Conf. Robot. Autom. (ICRA),
pp. 9021-9027, doi: 10.1109/ICRA40945.2020.9197439.
[7] A. B. Clark and N. Rojas, " Malleable robots: Reconfigurable
robotic arms with continuum links of variable stiffness, " submitted
for publication.
[8] A. E. Solyman, K. M. Ibrahem, M. R. Atia, H. I. Saleh, and M. R.
Roman, " Perceptive augmented reality-based interface for robot task
planning and visualization, " Int. J. Innov. Comput. Inf. Control, vol. 16,
no. 5, pp. 1769-1785, 2020.
[9] L. Ma, Z. Zhao, F. Chen, B. Zhang, L. Fu, and H. Liao, " Augmented
reality surgical navigation with ultrasound-assisted registration for
pedicle screw placement: A pilot study, " Int. J. Comput. Assisted Radiol.
Surg., vol. 12, no. 12, pp. 2205-2215, 2017, doi: 10.1007/s11548-017-1652-z.
[10] M. R. Mine, F. P. Brooks Jr., and C. H. Sequin, " Moving objects in
space: Exploiting proprioception in virtual-environment interaction, "
in Proc. 24th Annu. Conf. Comput. Graph. Interactive Techn., 1997, pp.
19-26, doi: 10.1145/258734.258747.
[11] J. I. Lipton, A. J. Fay, and D. Rus, " Baxter's homunculus: Virtual
reality spaces for teleoperation in manufacturing, " IEEE Robot. Autom.
Lett., vol. 3, no. 1, pp. 179-186, 2017, doi: 10.1109/LRA.2017.2737046.
[12] E. Rosen et al., " Communicating and controlling robot arm motion
intent through mixed-reality head-mounted displays, " Int. J. Robot. Res.,
vol. 38, nos. 12-13, pp. 1513-1526, 2019, doi: 10.1177/0278364919842925.
[13] M. Ostanin, R. Yagfarov, and A. Klimchik, " Interactive robots control
using mixed reality, " IFAC-PapersOnLine, vol. 52, no. 13, pp. 695-
700, 2019, doi: 10.1016/j.ifacol.2019.11.307.
[14] J. A. Frank, M. Moorhead, and V. Kapila, " Mobile mixed-reality
interfaces that enhance human-robot interaction in shared spaces, "
Frontiers Robot. AI, vol. 4, p. 20, Jun. 2017, doi: 10.3389/frobt.2017.00020.
[15] Z. Makhataeva and H. A. Varol, " Augmented reality for robotics: A
review, " Robotics, vol. 9, no. 2, p. 21, 2020, doi: 10.3390/robotics9020021.
[16] H. Hedayati, M. Walker, and D. Szafir, " Improving collocated robot
teleoperation with augmented reality, " in Proc. 2018 ACM/IEEE Int. Conf.
Human-Robot Interaction, pp. 78-86, doi: 10.1145/3171221.3171251.
[17] D. Guha, N. M. Alotaibi, N. Nguyen, S. Gupta, C. McFaul, and V. X.
Yang, " Augmented reality in neurosurgery: A review of current
concepts and emerging applications, " Can. J. Neurol. Sci., vol. 44, no. 3,
pp. 235-245, 2017, doi: 10.1017/cjn.2016.443.
[18] " Hololens 2-overview, features, and specs - Microsoft Hololens, "
Microsoft, Redmond, WA, USA, 2016. [Online]. Available: https://
www.microsoft.com/en-us/hololens/hardware
[19] G. Bolano, A. Roennau, and R. Dillmann, " Transparent robot behavior
by adding intuitive visual and acoustic feedback to motion replanning, "
in Proc. 2018 27th IEEE Int. Symp. Robot Human Interactive Commun.
(RO-MAN), pp. 1075-1080, doi: 10.1109/ROMAN.2018.8525671.
[20] N. Kousi, C. Stoubos, C. Gkournelos, G. Michalos, and S. Makris,
" Enabling human robot interaction in flexible robotic assembly lines:
An augmented reality based software suite, " Procedia CIRP, vol. 81,
pp. 1429-1434, Jun. 2019, doi: 10.1016/j.procir.2019.04.328.
[21] J. Fotouhi et al., " Reflective-AR display: An interaction methodology
for virtual-to-real alignment in medical robotics, " IEEE Robot.
Autom. Lett., vol. 5, no. 2, pp. 2722-2729, 2020, doi: 10.1109/LRA.2020.
2972831.
[22] F. X. Creighton, M. Unberath, T. Song, Z. Zhao, M. Armand, and J.
Carey, " Early feasibility studies of augmented reality navigation for lateral
skull base surgery, " Otol. Neurotol., vol. 41, no. 7, pp. 883-888, 2020,
doi: 10.1097/MAO.0000000000002724.
[23] S. G. Hart and L. E. Staveland, " Development of NASA-TLX (Task
Load Index): Results of empirical and theoretical research, " in Advances in
Psychology, vol. 52, New York, NY, USA: Elsevier, 1988, pp. 139-183.
[24] A. B. Clark and N. Rojas, " Stiffness-tuneable limb segment with
flexible spine for malleable robots, " in Proc. 2019 Int. Conf. Robot.
Autom. (ICRA), pp. 3969-3975, doi: 10.1109/ICRA.2019.8793713.
[25] A. Turner, H. Ferrone, D. Coulter, and S. Majumdar, " Hologram
stability, " Microsoft, Redmond, WA, USA, 2020. [Online]. Available: https://
docs.microsoft.com/en-us/windows/mixed-reality/develop/advanced
-concepts/hologram-stability
[26] S. Stadler, K. Kain, M. Giuliani, N. Mirnig, G. Stollnberger, and M.
Tscheligi, " Augmented reality for industrial robot programmers:
Workload analysis for task-based, augmented reality-supported robot
control, " in Proc. 2016 25th IEEE Int. Symp. Robot Human Interactive
Commun. (RO-MAN), pp. 179-184, doi: 10.1109/ROMAN.2016.7745108.
Alex Ranne is with the REDS Lab, Dyson School of Design
Engineering, Imperial College London, London, SW7 2DB,
U.K. Email: alex.ranne17@imperial.ac.uk.
Angus B. Clark is with the REDS Lab, Dyson School of Design
Engineering, Imperial College London, London, SW7 2DB,
U.K. Email: a.clark17@imperial.ac.uk.
Nicolas Rojas is with the REDS Lab, Dyson School of Design
Engineering, Imperial College London, London, SW7 2DB,
U.K. Email: n.rojas@imperial.ac.uk.
MARCH 2022 * IEEE ROBOTICS & AUTOMATION MAGAZINE *
21
https://www.youtube.com/watch?v=HgHEnruNgeI https://www.microsoft.com/en-us/hololens/hardware https://www.microsoft.com/en-us/hololens/hardware https://docs.microsoft.com/en-us/windows/mixed-reality/develop/advanced-concepts/hologram-stability https://docs.microsoft.com/en-us/windows/mixed-reality/develop/advanced-concepts/hologram-stability https://docs.microsoft.com/en-us/windows/mixed-reality/develop/advanced-concepts/hologram-stability
IEEE Robotics & Automation Magazine - March 2022

Table of Contents for the Digital Edition of IEEE Robotics & Automation Magazine - March 2022
