Contactless Interface for Hospital IT Avoids Germ Transmission

By Fraunhofer HHI | 11.16.16

Proxemic Monitor optimizes the processes at ICUs while digital stereoscopy provides new insights.

In intensive care units, every second counts. In emergencies, right decisions have to be made quickly. Fraunhofer HHI has developed a smart Proxemic Monitor in order to optimize processes in hospital’s most sensitive areas. The system gathers information from all connected medical devices, provides the data in a clear and user-adapted interface, and prevents false alarms. Touchless interaction from a distance using head and hand gestures as well as voice commands reduce the risk of spreading pathogenic germs.
This monitor was developed in the “Leitwarte” (control room) joint project, funded by the Federal Ministry for Economic Affairs and Energy (BMWi). It quickly provides doctors and nurses with crucial information about vital signs of intensive care patients. The screen has interfaces with bedside medical devices, hospital information systems, and patient databases. A web-based user interface implementation ensures suitability for mobile monitors such as tablets.
The most important benefit of gesture control: Doctors and nursing staff do not have to touch the equipment to control it. Three different cameras and a microphone scan the area in front of the monitor. The integrated Fraunhofer HHI software analyses the video data to determine the presence and distance of a person and which movements and gestures they perform. Pre-programmed gestures allow touchless short-cuts; for example, to quickly initiate a video call with other physicians. Also, the displayed information and graphical user interface adapts to the distance from which they are viewed.
“From the door, the doctor sees the data in a correspondingly large size. As he gets closer, the screen displays detailed information,” explained Paul Chojecki, scientist from the Vision & Imaging Technology department at Fraunhofer HHI.
Digital Stereoscopy in Medical Applications
Fraunhofer HHI also presents first results of the project 3DinMed, which is funded by the German Federal Ministry of Economy and Energy. Digital stereo camera systems open new possibilities for obtaining information and improve work processes of the medical staff in the operating room. Shown are the latest research results for optical measuring tasks, medical instrument tracking, augmented reality applications (AR), and optimized 3D playback.
You can experience the medical monitor to improve hygiene and usability, as well as the project 3DInMed yourself from November 14 to 17 at Medica in Düsseldorf, Germany at the Fraunhofer joint exhibition booth in Hall 10, Booth G05.