IEEE Robotics & Automation Magazine - March 2022 - 9

applications takes advantage of the
egocentric sensing on MR devices to
capture multimodal human inputs and
leverages their onboard spatial computing
capabilities to translate these
signals into robot commands that utilize
the spatial context. Their case
studies illustrate how mixed reality
offers promising new possibilities in
HRI, whether from a shared spatial
understanding between the robot and
the user or the embodied control that
immersive MR devices can provide
for teleoperation.
In the fifth article, Hoang et al. introduce
their versatile, extendable AR
visualization platform [developed in
the Robot Operating System (ROS)
framework] for robot applications.
They provide a universal visualization
platform with the capability of displaying
ROS message data types in AR as
well as a multimodal user interface for
interacting with robots. Their solution
offers a collection of plug-ins that
provides visualization and/or interaction
capabilities, with the option for
users to extend the platform to meet
specific needs by implementing their
own plug-ins.
In the sixth article, Danioni et al.
present a highly immersive virtual
environment with simulated surgical
tools with extended degrees of freedom
with respect to the standard ones.
The motion of the tools was teleoperated
by placing inertial sensors on the
user arms and hands. The novel interface
was tested by users with different
levels of expertise, performing tasks
at varying levels of complexity. The
majority of the users achieved better
results using the articulated tools, but
they required more physical and cognitive
loads.
In the final article, Triantafyllidis
et al. introduce new metrics for 3D
object pointing and manipulation in a
VR environment to assess human
motor performances. The metrics are
compared with others in the literature
under different experimental settings.
Additionally, the work presents
recommendations
for
the
design of pointing
and manipulation
tasks
in VR and teleoperation.
It
is a common
thought of
the guest editors
that this special
issue would be a
starting point for
further research
in the field of
XR to further ex -
tend the human
po ssibi l it ies
when interfacing
with robotic devices, offering
better controllability and safety of
the interactions.
The COVID-19
pandemic has
highlighted an
unprecedented
need for immersive
platforms that can
facilitate safer
working conditions
through telerobotic
control.
TAP.
CONNECT.
NETWORK.
SHARE.
Connect to IEEE-no matter where you are-with the IEEE App.
Stay up-to-date
with the latest news
Read and download
your IEEE magazines
Schedule, manage, or
join meetups virtually
Create a personalized
experience
Get geo and interest-based
recommendations
Locate IEEE members by location,
interests, and affiliations
MARCH 2022 * IEEE ROBOTICS & AUTOMATION MAGAZINE *
9
IEEE Robotics & Automation Magazine - March 2022

Table of Contents for the Digital Edition of IEEE Robotics & Automation Magazine - March 2022
