IEEE Robotics & Automation Magazine - September 2023 - 149

O P I NI ON
Autonomous Robotic Surgical Systems
Needing Common Sense to Achieve Higher Levels of Autonomy
By Eleonora Tagliabue , Marco Bombieri , Paolo Fiorini , and Diego Dall'Alba
While executing a surgical procedure,
surgeons not only rely on their specific
medical knowledge but also on a set of
skills that are " obvious " to them and
allow for intuitively evaluating and
reacting to the intervention evolution.
Such skills belong to what is usually
called common sense, which is essential
to carry out an intervention. Although
general common sense refers to all the
basic concepts about the world and
belongs to all human beings (e.g., the
fact that a needle must be inserted from
tip to eye), we believe that field-specific
common sense is developed depending
on individual experiences within a field
of expertise. In surgery, field-specific
common sense is the " glue " knowledge
that is not explicitly described in surgical
manuals, but it is acquired during
lengthy surgical training. For example,
a textbook does not explicitly describe
how the needle should be held nor how
it should be inserted in the human body,
but this information is known by the
domain experts. Understanding how to
describe, represent, and learn this
knowledge is paramount to developing
robust and reliable autonomous robotic
surgical systems (ARSSs). Developing
ARSSs is a research trend of great interest
for which taxonomies and paradigms
have already been proposed. For
more details, the reader is referred to [1]
and [2]. The importance and challenges
of common sense have been discussed
in other fields [3], [4], but to the best of
Digital Object Identifier 10.1109/MRA.2023.3281269
Date of current version: 11 September 2023
our knowledge, this aspect has not yet
been addressed in robotic surgery.
COMMON SENSE AND SURGERY
Our research on ARSSs has shown that
automatic extraction of surgical procedures
from surgical textbooks is a feasible
task [5], but also that the result does
not include the large amount of implicit
knowledge that humans use during the
surgical task. In the following, we refer
to the granularity classification of surgical
procedures in phases, steps, actions,
and motions proposed by Lalys and Jannin
[6]. In this classification, a procedure
(e.g., partial nephrectomy) is composed
of a sequence of main events, called
phases, occurring in the procedure (e.g.,
tumor excision or final suture). Each
phase is then composed of a set of steps,
i.e., sequences of activities to achieve a
surgical objective (e.g., the main steps of
the final suture phase are the removal of
the trocar, extraction of the specimen,
and closure of the skin). Each activity is
then composed of a sequence of motions,
i.e., single-hand trajectories (e.g., pulling
the needle to close the suture using the
right arm). Based on the aforementioned
definitions and in-depth discussions with
surgeons, we propose a preliminary classification
of surgical knowledge into the
following four levels:
1) Procedural knowledge: Description of
the sequence of phases required to
perform a procedure, as can be learned
from surgical manuals. It does provide
general information about the specific
steps, but it does not specify the
parameters of each step, i.e., the physThis
work is licensed under a Creative Commons Attribution-NonCommercialNoDerivatives
4.0 License. For more information, see https://creativecommons.org/
licenses/by-nc-nd/4.0/
ical quantities that instantiate individual
actions and motions, such as
motion velocity or force to be applied.
2) Surgical common sense: This is a
field-specific common sense that
encompasses all the skills surgeons
acquire while experiencing (assisting
and performing) a specific procedure
multiple times. It allows defining
the sequence of elementary actions
needed to perform the surgical task
and intuitively setting their parameters.
It also includes the capability
to interpret surgical situations and
thoroughly understand correlations,
causes, and consequences of actions
and thus to select the best surgical
technique for each specific situation.
3) Medical common sense: This is
another subset of field-specific common
sense that is not specific to
a single surgical procedure and is
acquired during medical studies. For
example, it includes knowledge of
basic anatomical concepts (positions
and functions of organs), a highlevel
understanding of how surgical
actions impact anatomy, and evolution
of the patient's prognosis after
surgery and medications.
4) General common sense: The common
sense that surgeons have as
human beings. It represents the basic
knowledge of the world, is acquired
while experiencing everyday situations,
and helps infer the meaning
and behavior of things.
This classification is not always crisp
because it depends on the context. The
same concept can refer to one or to
SEPTEMBER 2023 IEEE ROBOTICS & AUTOMATION MAGAZINE
149
https://orcid.org/0000-0003-1536-2293 https://orcid.org/0000-0002-8607-8495 https://orcid.org/0000-0002-0711-8605 https://orcid.org/0000-0002-7300-5975 https://creativecommons.org/

IEEE Robotics & Automation Magazine - September 2023

Table of Contents for the Digital Edition of IEEE Robotics & Automation Magazine - September 2023

Contents
IEEE Robotics & Automation Magazine - September 2023 - Cover1
IEEE Robotics & Automation Magazine - September 2023 - Cover2
IEEE Robotics & Automation Magazine - September 2023 - 1
IEEE Robotics & Automation Magazine - September 2023 - Contents
IEEE Robotics & Automation Magazine - September 2023 - 3
IEEE Robotics & Automation Magazine - September 2023 - 4
IEEE Robotics & Automation Magazine - September 2023 - 5
IEEE Robotics & Automation Magazine - September 2023 - 6
IEEE Robotics & Automation Magazine - September 2023 - 7
IEEE Robotics & Automation Magazine - September 2023 - 8
IEEE Robotics & Automation Magazine - September 2023 - 9
IEEE Robotics & Automation Magazine - September 2023 - 10
IEEE Robotics & Automation Magazine - September 2023 - 11
IEEE Robotics & Automation Magazine - September 2023 - 12
IEEE Robotics & Automation Magazine - September 2023 - 13
IEEE Robotics & Automation Magazine - September 2023 - 14
IEEE Robotics & Automation Magazine - September 2023 - 15
IEEE Robotics & Automation Magazine - September 2023 - 16
IEEE Robotics & Automation Magazine - September 2023 - 17
IEEE Robotics & Automation Magazine - September 2023 - 18
IEEE Robotics & Automation Magazine - September 2023 - 19
IEEE Robotics & Automation Magazine - September 2023 - 20
IEEE Robotics & Automation Magazine - September 2023 - 21
IEEE Robotics & Automation Magazine - September 2023 - 22
IEEE Robotics & Automation Magazine - September 2023 - 23
IEEE Robotics & Automation Magazine - September 2023 - 24
IEEE Robotics & Automation Magazine - September 2023 - 25
IEEE Robotics & Automation Magazine - September 2023 - 26
IEEE Robotics & Automation Magazine - September 2023 - 27
IEEE Robotics & Automation Magazine - September 2023 - 28
IEEE Robotics & Automation Magazine - September 2023 - 29
IEEE Robotics & Automation Magazine - September 2023 - 30
IEEE Robotics & Automation Magazine - September 2023 - 31
IEEE Robotics & Automation Magazine - September 2023 - 32
IEEE Robotics & Automation Magazine - September 2023 - 33
IEEE Robotics & Automation Magazine - September 2023 - 34
IEEE Robotics & Automation Magazine - September 2023 - 35
IEEE Robotics & Automation Magazine - September 2023 - 36
IEEE Robotics & Automation Magazine - September 2023 - 37
IEEE Robotics & Automation Magazine - September 2023 - 38
IEEE Robotics & Automation Magazine - September 2023 - 39
IEEE Robotics & Automation Magazine - September 2023 - 40
IEEE Robotics & Automation Magazine - September 2023 - 41
IEEE Robotics & Automation Magazine - September 2023 - 42
IEEE Robotics & Automation Magazine - September 2023 - 43
IEEE Robotics & Automation Magazine - September 2023 - 44
IEEE Robotics & Automation Magazine - September 2023 - 45
IEEE Robotics & Automation Magazine - September 2023 - 46
IEEE Robotics & Automation Magazine - September 2023 - 47
IEEE Robotics & Automation Magazine - September 2023 - 48
IEEE Robotics & Automation Magazine - September 2023 - 49
IEEE Robotics & Automation Magazine - September 2023 - 50
IEEE Robotics & Automation Magazine - September 2023 - 51
IEEE Robotics & Automation Magazine - September 2023 - 52
IEEE Robotics & Automation Magazine - September 2023 - 53
IEEE Robotics & Automation Magazine - September 2023 - 54
IEEE Robotics & Automation Magazine - September 2023 - 55
IEEE Robotics & Automation Magazine - September 2023 - 56
IEEE Robotics & Automation Magazine - September 2023 - 57
IEEE Robotics & Automation Magazine - September 2023 - 58
IEEE Robotics & Automation Magazine - September 2023 - 59
IEEE Robotics & Automation Magazine - September 2023 - 60
IEEE Robotics & Automation Magazine - September 2023 - 61
IEEE Robotics & Automation Magazine - September 2023 - 62
IEEE Robotics & Automation Magazine - September 2023 - 63
IEEE Robotics & Automation Magazine - September 2023 - 64
IEEE Robotics & Automation Magazine - September 2023 - 65
IEEE Robotics & Automation Magazine - September 2023 - 66
IEEE Robotics & Automation Magazine - September 2023 - 67
IEEE Robotics & Automation Magazine - September 2023 - 68
IEEE Robotics & Automation Magazine - September 2023 - 69
IEEE Robotics & Automation Magazine - September 2023 - 70
IEEE Robotics & Automation Magazine - September 2023 - 71
IEEE Robotics & Automation Magazine - September 2023 - 72
IEEE Robotics & Automation Magazine - September 2023 - 73
IEEE Robotics & Automation Magazine - September 2023 - 74
IEEE Robotics & Automation Magazine - September 2023 - 75
IEEE Robotics & Automation Magazine - September 2023 - 76
IEEE Robotics & Automation Magazine - September 2023 - 77
IEEE Robotics & Automation Magazine - September 2023 - 78
IEEE Robotics & Automation Magazine - September 2023 - 79
IEEE Robotics & Automation Magazine - September 2023 - 80
IEEE Robotics & Automation Magazine - September 2023 - 81
IEEE Robotics & Automation Magazine - September 2023 - 82
IEEE Robotics & Automation Magazine - September 2023 - 83
IEEE Robotics & Automation Magazine - September 2023 - 84
IEEE Robotics & Automation Magazine - September 2023 - 85
IEEE Robotics & Automation Magazine - September 2023 - 86
IEEE Robotics & Automation Magazine - September 2023 - 87
IEEE Robotics & Automation Magazine - September 2023 - 88
IEEE Robotics & Automation Magazine - September 2023 - 89
IEEE Robotics & Automation Magazine - September 2023 - 90
IEEE Robotics & Automation Magazine - September 2023 - 91
IEEE Robotics & Automation Magazine - September 2023 - 92
IEEE Robotics & Automation Magazine - September 2023 - 93
IEEE Robotics & Automation Magazine - September 2023 - 94
IEEE Robotics & Automation Magazine - September 2023 - 95
IEEE Robotics & Automation Magazine - September 2023 - 96
IEEE Robotics & Automation Magazine - September 2023 - 97
IEEE Robotics & Automation Magazine - September 2023 - 98
IEEE Robotics & Automation Magazine - September 2023 - 99
IEEE Robotics & Automation Magazine - September 2023 - 100
IEEE Robotics & Automation Magazine - September 2023 - 101
IEEE Robotics & Automation Magazine - September 2023 - 102
IEEE Robotics & Automation Magazine - September 2023 - 103
IEEE Robotics & Automation Magazine - September 2023 - 104
IEEE Robotics & Automation Magazine - September 2023 - 105
IEEE Robotics & Automation Magazine - September 2023 - 106
IEEE Robotics & Automation Magazine - September 2023 - 107
IEEE Robotics & Automation Magazine - September 2023 - 108
IEEE Robotics & Automation Magazine - September 2023 - 109
IEEE Robotics & Automation Magazine - September 2023 - 110
IEEE Robotics & Automation Magazine - September 2023 - 111
IEEE Robotics & Automation Magazine - September 2023 - 112
IEEE Robotics & Automation Magazine - September 2023 - 113
IEEE Robotics & Automation Magazine - September 2023 - 114
IEEE Robotics & Automation Magazine - September 2023 - 115
IEEE Robotics & Automation Magazine - September 2023 - 116
IEEE Robotics & Automation Magazine - September 2023 - 117
IEEE Robotics & Automation Magazine - September 2023 - 118
IEEE Robotics & Automation Magazine - September 2023 - 119
IEEE Robotics & Automation Magazine - September 2023 - 120
IEEE Robotics & Automation Magazine - September 2023 - 121
IEEE Robotics & Automation Magazine - September 2023 - 122
IEEE Robotics & Automation Magazine - September 2023 - 123
IEEE Robotics & Automation Magazine - September 2023 - 124
IEEE Robotics & Automation Magazine - September 2023 - 125
IEEE Robotics & Automation Magazine - September 2023 - 126
IEEE Robotics & Automation Magazine - September 2023 - 127
IEEE Robotics & Automation Magazine - September 2023 - 128
IEEE Robotics & Automation Magazine - September 2023 - 129
IEEE Robotics & Automation Magazine - September 2023 - 130
IEEE Robotics & Automation Magazine - September 2023 - 131
IEEE Robotics & Automation Magazine - September 2023 - 132
IEEE Robotics & Automation Magazine - September 2023 - 133
IEEE Robotics & Automation Magazine - September 2023 - 134
IEEE Robotics & Automation Magazine - September 2023 - 135
IEEE Robotics & Automation Magazine - September 2023 - 136
IEEE Robotics & Automation Magazine - September 2023 - 137
IEEE Robotics & Automation Magazine - September 2023 - 138
IEEE Robotics & Automation Magazine - September 2023 - 139
IEEE Robotics & Automation Magazine - September 2023 - 140
IEEE Robotics & Automation Magazine - September 2023 - 141
IEEE Robotics & Automation Magazine - September 2023 - 142
IEEE Robotics & Automation Magazine - September 2023 - 143
IEEE Robotics & Automation Magazine - September 2023 - 144
IEEE Robotics & Automation Magazine - September 2023 - 145
IEEE Robotics & Automation Magazine - September 2023 - 146
IEEE Robotics & Automation Magazine - September 2023 - 147
IEEE Robotics & Automation Magazine - September 2023 - 148
IEEE Robotics & Automation Magazine - September 2023 - 149
IEEE Robotics & Automation Magazine - September 2023 - 150
IEEE Robotics & Automation Magazine - September 2023 - 151
IEEE Robotics & Automation Magazine - September 2023 - 152
IEEE Robotics & Automation Magazine - September 2023 - 153
IEEE Robotics & Automation Magazine - September 2023 - 154
IEEE Robotics & Automation Magazine - September 2023 - 155
IEEE Robotics & Automation Magazine - September 2023 - 156
IEEE Robotics & Automation Magazine - September 2023 - 157
IEEE Robotics & Automation Magazine - September 2023 - 158
IEEE Robotics & Automation Magazine - September 2023 - 159
IEEE Robotics & Automation Magazine - September 2023 - 160
IEEE Robotics & Automation Magazine - September 2023 - 161
IEEE Robotics & Automation Magazine - September 2023 - 162
IEEE Robotics & Automation Magazine - September 2023 - 163
IEEE Robotics & Automation Magazine - September 2023 - 164
IEEE Robotics & Automation Magazine - September 2023 - 165
IEEE Robotics & Automation Magazine - September 2023 - 166
IEEE Robotics & Automation Magazine - September 2023 - 167
IEEE Robotics & Automation Magazine - September 2023 - 168
IEEE Robotics & Automation Magazine - September 2023 - Cover3
IEEE Robotics & Automation Magazine - September 2023 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2010
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2010
https://www.nxtbookmedia.com