By Florenz Graf , Jochen Lindermayr , Çag˘atay Odabas¸i and Marco F. Huber , T he long-term vision for robotics is to have fully autonomous mobile robots that perceive the environment as humans do or even better. This article transfers the core ideas from human scene perception onto robot scene perception to contribute toward a holistic scene understanding of robots. The first contribution is to extensively survey and compare state-of-the-art robot scene perception approaches with neuroscience theories and studies of human perception. A step-by-step transfer of the perceptual process reveals similarities and differences between robots and humans. The second contribution represents an analysis of the status quo of holistic robot perception approaches to extract to what extent the perceptual capabilities of humans have been reached. Building on this, the gaps and potentials of robot perception are illustrated to address future research directions. Toward Holistic Scene Understanding A Transfer of Human Scene Perception to Mobile Robots Digital Object Identifier 10.1109/MRA.2022.3210587 Date of current version: 13 October 2022 36 * IEEE ROBOTICS & AUTOMATION MAGAZINE * DECEMBER 2022 This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ ©SHUTTERSTOCK.COM/BLUE PLANET STUDIOhttps://orcid.org/0000-0002-6596-3807 https://orcid.org/0000-0003-4617-0294 https://orcid.org/0000-0001-5241-2419 https://orcid.org/0000-0002-8250-2092 http://www.SHUTTERSTOCK.COM/BLUE https://www.creativecommons.org/licenses/by/4.0/