Implementation in 3D on ultrasound images'mixed reality'Enhance screening efficiency'
Nov 28, 2024
A technology that implements ultrasound images in three dimensions in a mixed reality and displays them in three dimensions near the affected area was recently developed by domestic medical staff.
Park Sung-joon, a professor of radiology at Korea University Ansan Hospital, and Hwang In-tae, a research professor at the Medical Life Research Center, developed a mixed reality-based ultrasonic image display device and system and completed patent registration in Korea. Mixed reality refers to an environment in which virtual reality is grafted into the real world so that real physical and virtual objects can interact.
The technology developed this time is a system that outputs ultrasonic images in a new way by combining existing ultrasonic imaging devices and mixed reality devices, and the ultrasonic image can be displayed directly at the end of the ultrasonic device touching the affected area. Furthermore, it was developed with the aim of visually sharing the ultrasound image with medical staff, patients, and patient caregivers by reconstructing the ultrasound image in three dimensions directly from the site.
Existing ultrasound systems detect the outside of the body through ultrasound devices and recognize the results through external displays located at different viewing angles from the affected area. In the current ultrasound examination, the diagnosis and procedure results can vary greatly depending on the examiner's technical skills and spatial perception ability due to the mismatch between the examiner's hand's moving axis of motion and the visual axis looking at the screen. In addition, only the inspector who is conducting the inspection understands the three-dimensional structure, and it is difficult to express or reproduce it as visual information.
To solve this problem, the research team started to develop technology using HoloLens 2, a hybrid reality device from Microsoft. The video is implemented in 3D, so you can intuitively understand the depth, location, and structure of the affected area.
Professor Park Sung-jun said "I can judge immediately during an ultrasound examination without having to interpret a complicated structure in my head."Intuitive testing is possible and screening efficiency can be improved," he said.
Professor Hwang In-tae explained, "Using this patent technology, the internal ultrasound image of the affected area appears to be rising at the end of the ultrasound device. "When the ultrasound device is moved, the ultrasound image also changes in real time."
The research team plans to conduct a performance comparison evaluation with existing ultrasound systems through more samples and develop and commercialize technology to enable voice commands, gesture controls, and system operation of a single headset based on Apple's next-generation VR device, Vision Pro.
Park Sung-joon, a professor of radiology at Korea University Ansan Hospital, and Hwang In-tae, a research professor at the Medical Life Research Center, developed a mixed reality-based ultrasonic image display device and system and completed patent registration in Korea. Mixed reality refers to an environment in which virtual reality is grafted into the real world so that real physical and virtual objects can interact.
The technology developed this time is a system that outputs ultrasonic images in a new way by combining existing ultrasonic imaging devices and mixed reality devices, and the ultrasonic image can be displayed directly at the end of the ultrasonic device touching the affected area. Furthermore, it was developed with the aim of visually sharing the ultrasound image with medical staff, patients, and patient caregivers by reconstructing the ultrasound image in three dimensions directly from the site.
Existing ultrasound systems detect the outside of the body through ultrasound devices and recognize the results through external displays located at different viewing angles from the affected area. In the current ultrasound examination, the diagnosis and procedure results can vary greatly depending on the examiner's technical skills and spatial perception ability due to the mismatch between the examiner's hand's moving axis of motion and the visual axis looking at the screen. In addition, only the inspector who is conducting the inspection understands the three-dimensional structure, and it is difficult to express or reproduce it as visual information.
To solve this problem, the research team started to develop technology using HoloLens 2, a hybrid reality device from Microsoft. The video is implemented in 3D, so you can intuitively understand the depth, location, and structure of the affected area.
Professor Park Sung-jun said "I can judge immediately during an ultrasound examination without having to interpret a complicated structure in my head."Intuitive testing is possible and screening efficiency can be improved," he said.
Professor Hwang In-tae explained, "Using this patent technology, the internal ultrasound image of the affected area appears to be rising at the end of the ultrasound device. "When the ultrasound device is moved, the ultrasound image also changes in real time."
The research team plans to conduct a performance comparison evaluation with existing ultrasound systems through more samples and develop and commercialize technology to enable voice commands, gesture controls, and system operation of a single headset based on Apple's next-generation VR device, Vision Pro.
|
bellho@sportschosun.com
