IEEE Systems, Man and Cybernetics Magazine - January 2020 - 48

The hardware is simple, inexpensive, and mature [11], but
the system's immersion is not deep enough. It is an early
version of VR METS.

1) They are embedded in the traditional 2D MER simulators, and their 3D content is limited, so they cannot be
used to complete all of the training material in 3D.
2) They can be operated only in a fixed path and cannot
achieve panoramic roaming and all-around realisHead-Mounted Display IVR METS
tic operation.
The head-mounted display (HMD) IVR METS has a high
degree of immersion and interaction. Although handles
3) They are desktop versions that do not provide enough
are needed for the interaction, trainees must move their
immersion.
body to operate the virtual devices [12], which is similar
In other industrial fields, some researchers have
to natural interaction. Currently, the application of HMD
made attempts to use HMD-related applications as
IVR in the field of MET is in its
training tools. Zhang Hui proinfancy, although it is believed that
posed an HMD-based intuitive VR
the technology will become more
training system for mine safety
widely used in the future.
and production. Schnack et al.
Marine engineering
developed an IVR store to investiis
a
practical
gate the technology's telepresRelated Work
ence and usability compared with
VR technology is widely used in
specialty with high
convential desktop systems [14].
games [13]. In recent years, its
requirements for
Stone et al. integrated VR trainapplication has extended to milipractical experience.
ing into a real-world program for
tary, medical, industrial, educateaching welding [15]. Kaufmann
tional, and agricultural functions,
et al. used 3D dynamic geometry
although its use in maritime educato facilitate mathematics and
tion is relatively new. Unitest Marigeometry education using immersive collaborative
time Simulators, Gdynia, Poland, developed 3D visualization
learning [16]. Jez et al. proposed a shared immersive virsimulators, the MED3D and MED3DH, that combine 3D
tual environment for ship design based on the Oculus
and 2D diagram presentation and provide a complete picRift and Oculus Touch [17]. Kil et al. developed a vesselture of an engine-room structure. Kongsberg, Norway,
survey simulator based on a virtual ship environment
offers a 3D visualization engine-room simulator named
[18]. However, we are the first to develop the HMD IVR
K-Sim that provides instructor systems and can develop
METS in the field of marine-engineer training.
customized exercise modules for individuals, teams, and
In this article, we introduce the composition of the VR
combinations of both. Transas, Portsmouth, United KingMETS, which can be divided into several categories
dom, launched the ERS 5000 engine-room simulator whose
according to the differences of the input and output devicmachinery-space 3D visualization enables trainees to
es. An HMD-based IVR METS is developed, and future
move to an individual piece of equipment and operate it.
research is proposed based on our test results.
However, these products have limitations that can be summarized as follows:
Methodology
Of all the VR approaches, the HMD-based system has the highest level of immersion. Therefore, it is the most suitable for developing a VR
METS. At present, there are many HMD-based
VR hardware products in the market, including the Oculus Rift, HTC Vive, Sony Morpheus,
Samsung Gear VR, and Microsoft HoloLens.
We selected the HTC Vive Pro as the hardware
foundation of our HMD IVR METS.

Figure 2. A user roams through an HMD IVR METS scenario.
48

IEEE SYSTEMS, MAN, & CYBERNETICS MAGAZINE Janu ar y 2020

System Components
The HMD IVR METS includes the HTC Vive
Pro and simulation and application software
for a METS. The main purpose of this article
concerns the development of the application
software, which is primarily composed of
MER logical and simulation programs and
an automatic evaluation. The system can
track the HM equipment's position and angle

IEEE Systems, Man and Cybernetics Magazine - January 2020

Table of Contents for the Digital Edition of IEEE Systems, Man and Cybernetics Magazine - January 2020