KR20220097665A - XR-Based TRAUMA INJURY TREATMENT TRAINING SYSTEM - Google Patents

Abstract

The present invention relates to an extended reality (XR)-based severe trauma treatment training system, including: a training scenario information processing means that performs functions of registering and managing trainee information, registering and modifying training scenarios, and managing training evaluation reference information; a mannequin patient biometric information treatment means that performs the function of treating information on an electrocardiogram, a heart rate, a respiratory rate per minute, a body temperature, and blood pressure; a training device information treatment means that performs the function of treating information on a pulse band, a haptic glove, a holo-lens, a stethoscope, and CPR; a severe trauma treatment training platform that collects treatment results from the training scenario information treatment means, the mannequin patient biometric information treatment means and the training device information treatment means and analyzes the training data; a cloud infrastructure that is connected to the severe trauma treatment training platform to perform the functions of managing, storing and providing data received through a communication network from a remote place; a severe treatment training/evaluation UI/UX that is operably connected to the severe trauma treatment training platform (100) and includes a training information registration user interface (UI), a real-time training monitoring UI and a training evaluation management UI; a training evaluation information treatment unit that is connected to the severe trauma treatment training platform to manage, store and provide individual evaluation information, teamwork-specific evaluation information, and comprehensive training evaluation information; and an open platform that is connected to the severe trauma treatment training platform to provide the functions of sharing military hospital information, sharing training education data, and managing data security. The present invention enables trainees to become skilled in treating severe trauma.

Description

XR-based severe trauma treatment training system {XR-Based TRAUMA INJURY TREATMENT TRAINING SYSTEM}

The present invention relates to an XR-based severe trauma treatment training system, and more particularly, content related to severe trauma using VR (Virtual Reality) technology, AR (Augmented Reality) technology, and MR (Mixed) technology. It relates to an XR-based severe trauma treatment training system that helps nurses, doctors, and medical workers train for severe trauma treatment in the medical field by providing them to effectively perform treatment of severe patients.

VR (Virtual Reality) technology provides only CG (Computer Graphic) images of objects or backgrounds in the real world, AR (Augmented Reality) technology provides CG images created virtual on top of real objects, and MR (Mixed Reality) ) technology is a computer graphics technology that provides virtual objects by mixing and combining them in the real world. The aforementioned VR, AR, MR, and the like are all simply referred to as XR (extended reality) technology.

XR technology can be applied to HMD (Head-Mount Display), HUD (Head-Up Display), glasses-type glasses, mobile phones, tablet PCs, laptops, desktops, TVs, digital signage, etc. It may be referred to as a device (XR Device).

The XR device as described above is a display for displaying information, and a transparent display may be mounted thereon.

A user may view an object in the real world located on the other side of the transparent display through the transparent display, and may also view information provided by the XR device through the transparent display.

Various application technologies based on the above XR technology are being implemented.

Meanwhile, limitations of existing medical practice and simulator practice will be described.

Both the teaching staff and the learners have limited time and the skills to learn are many and varied. Patients' reluctance to observe medical care is increasing. Field practice can cause medical accidents. (Virtual reality surgical simulation in training, Patel et al, Expert Rev. Anticancer Ther, 2012).

Clinical practice is essential for nursing students, but sometimes clinical practice is performed only in a limited range for reasons of patient safety and privacy (Virtual simulation practice experience of nursing students, Yunjeong Kim et al., JKASNE, 2020).

The group that received surgical training using virtual reality showed 29% faster learning than the group that did not, showed a 9-fold higher success rate, and lowered the incidence of complications to 1/5 (Virtual Reality Training Improves Operating Room Performance, Seymour et al. , ANNALS OF SURGERY, 2002).

Knowledge and confidence were improved by using virtual reality simulation program in nursing education for prostate cancer patients, and in the case of child nursing skills development and effect study using virtual games, the satisfaction of nursing students learning child nursing skills through virtual games reported to be high. (Effect of virtual reality simulation and blended simulation education on nursing asthma children, Migang Kim et al., CHNR, 2019).

Meanwhile, various countries at home and abroad are introducing the XR-based training system to the national qualification examination evaluation.

In the US/Israel/Germany/Denmark/Australia, national qualification examinations using simulators are being implemented.

Texas Governor Abbott announced on March 21, 2020 that those who have trained more than 50% through simulation to secure nursing personnel due to the coronavirus will be recognized as achieving the clinical goal.

50 states and 30 states, including Washington, DC, have documented regulations for the use of medical simulations in nursing programs.

In 2021, a new subject will be added for the national dentistry exam, and the Korea National Examination Institute is reviewing whether to introduce virtual reality (VR) technology to the practical exam. In other words, it is possible to reduce the cost of equipment, standardized patient training, permanent reuse of production models, and quantitative scoring and saving labor costs by collecting behavioral data by conducting a part of the test in VR.

Meanwhile, in March 2018, the ministries announced “Measures to Improve the Severe Trauma Treatment System” and are pushing forward with 10 major tasks in three areas, including the expansion of trauma center treatment capabilities and training centers.

The Ministry of National Defense and the Ministry of Health and Welfare are planning to dispatch military doctors to regional trauma centers for specialized training of trauma center personnel and to expand training centers for trauma specialists. In order to train the specialized treatment process of trauma centers such as multidisciplinary treatment and trauma resuscitation zones through teams, regional trauma center training is required).

Also, a technology for generating a virtual human body based on actual clinical data and performing analysis through various simulations is currently being developed.

The Korea Institute of Science and Information Technology (KISTI) developed a simulation system for the development of spinal implants and the construction of a skeletal shape model with degenerative spinal diseases for the human spine through the e-Spine project.

In addition, KIST developed a software for diagnosing diseases and planning surgery with artificial intelligence by implementing MRI and CT images in 3D.

The Electronics and Telecommunications Research Institute developed a medical twin for diagnosing musculoskeletal disorders based on clinical data, and developed a 3D simulation-based diagnostic aid and disease prediction technology for knee arthritis, postural abnormalities, sarcopenia, and shoulder diseases.

As such, devices for presenting various physical haptic sensations in virtual reality to users are being developed.

In addition, domestic and foreign patents in the medical virtual 3D human body are expected to continue to increase in an attempt to graft ICT into the medical field.

In addition, there is no direct standardization activity in the medical simulation field, and standardization related to medical information has been mostly progressed.

Meanwhile, in relation to medical information, the National Institute of Technology and Standards is working to apply the international standard developed by ISO/TC215 as a KS standard, and is working on national standardization in consideration of the domestic industry revitalization conditions for international standards such as HL7, IEEE, and DICOM. .

HL7 (Health Level 7) is a standard that refers to the communication protocol of medical information and stipulates an application protocol for exchanging data in the medical field.

In addition, various services that perform training based on virtual medical simulation are being developed.

At Cedars-Sinai Hospital in Los Angeles, more than 300 doctors will use VR to assess a patient's symptoms or learn skills such as how to perform CPR while wearing protective gear.

In 2019, APN (School of Nursing) students will integrate skills throughout their curriculum and the previously mentioned training in early nursing as well as Objective Structural Clinical Examinations (OSCE), skills training, high-fidelity manikin training and standardized patient training. and hybrid training with mannequins.

The Johanniter Clinic-Waldkrankenhaus' Emergency Medical and Medical Simulation Training Center has attracted more than 250,000 people from more than 80 countries worldwide to reduce disability, disability and death from cardiovascular and neurological problems.

CAE of Canada, a company specializing in civil aviation simulators, has developed medical simulators and health care services by expanding its long-time simulator development experience to medical care.

Oxford Medical Simulation (OMS), UK, has partnered with the University of Oxford to provide students with a VR headset to practice patient care and receive feedback on actions taken to improve performance.

Meanwhile, efforts to commercialize a system that reproduces and trains a medical situation similar to the real one with XR are continuing.

In addition, due to the expansion of virtual reality devices and the specificity of the surgical environment, technologies related to anatomy and surgery have been developed and are being commercialized.

[Prior art literature]

Republic of Korea Patent Publication No. 10-2019-0098925 (published on August 23, 2019) (Title of the invention: XR device and its control method)

The present invention has been proposed in view of the above-described conventional situation, and provides contents related to severe trauma using VR (Virtual Reality) technology, AR (Augmented Reality) technology, and MR (Mixed) technology to provide nurses, The purpose of this is to provide an XR-based severe trauma treatment training system that helps doctors and medical workers train for severe trauma treatment to effectively treat severe patients.

Another object of the present invention is to develop a medical twin based on actual severe trauma data, produce realistic MR contents, and apply it to the severe trauma treatment training system platform, and military nursing training for severe trauma treatment through the military nursing training simulation center The goal is to provide an XR-based severe trauma treatment training system for dissemination and dissemination of a training system for nurturing trauma center personnel by region.

According to a preferred embodiment of the present invention for achieving the above object,

XR-based severe trauma treatment training system

In a severe trauma treatment training system for providing XR (eXtended Reality)-based content to train medical workers for treatment of severe trauma,

Training scenario information processing means to register and manage trainee information, register and modify training scenarios, and manage training evaluation standards information;

Mannequin patient biometric information processing means for processing electrocardiogram, heart rate, oxygen saturation, respiration rate, body temperature, and blood pressure information;

The training device information processing means for performing a function of processing pulse band, haptic glove, holo lens, stethoscope, and CPR information;

A severe trauma treatment training platform that collects processing results from the training scenario information processing means, the mannequin patient biometric information processing means, and the training device information processing means and performs a function of analyzing the training data;

A cloud infrastructure that is connected to the severe trauma treatment training platform to manage, store, and provide data received from a remote location through a communication network;

Severe trauma treatment training/evaluation UI/UX including a training information registration UI, a real-time training monitoring UI, and a training evaluation management UI (User Interface) that is connected to the severe trauma treatment training platform 100 and operates;

A training evaluation information processing unit that is connected to the severe trauma treatment training platform to manage, store, and provide personal evaluation information, teamwork evaluation information, and comprehensive training evaluation information;

It includes an open platform that is connected to the severe trauma treatment training platform to provide military hospital information sharing, training education data sharing, and data security management functions,

Severe trauma processing that receives training scenario and trainee information from the training scenario information processing means and provides a function of analyzing comprehensive training evaluation and evaluation information by linking monitoring (mannequin information, trainee motion tracking information) information for processing training It is characterized by providing a training platform.

In addition, the severe trauma treatment training platform performs a training-related information log collection function, but collects and analyzes mannequin patient biometric information (electrocardiogram, heart rate, oxygen saturation, respiration rate, body temperature, blood pressure) from the mannequin patient biometric information processing means do,

It is characterized in that the trainee motion tracking information collection and analysis process is performed through the information collected from the training device information processing means.

In addition, the training evaluation system of the severe trauma treatment training platform is a training information management unit that manages trainee information management, training scenarios, and training evaluation information, training monitoring, training motion tracking, training treatment management unit that manages training mannequin treatment information, individual / Includes a training evaluation management department that provides management by teamwork, training performance evaluation, and comprehensive analysis report,

It is characterized by including an OPEN API such as data collection, PHR information collection, and service data storage, and a training data collection system including a technical support portal such as DATA LAKE and DARA SANDBOX.

According to the XR-based severe trauma treatment training system according to the present invention, effective XR-based medical training is possible, and the patient's survival rate can be improved by responding quickly and accurately in the course of severe trauma treatment, The virtual training for XR severe trauma treatment has the effect of making it possible to master the body assessment ability and treatment ability for the treatment of severe trauma.

1 is an explanatory diagram illustrating a future medical platform.
2 is a schematic system configuration diagram of an open healthcare platform.
3 is a configuration diagram schematically showing an example of an XR-based severe trauma treatment training platform according to the present invention.
4 is a configuration diagram schematically showing an example of an XR-based severe trauma treatment training system according to the present invention.
FIG. 5 is a diagram illustrating an example of a medical standard HL7 communication structure in the system of FIG. 4 .
6 is a diagram showing the development process of the training device data link adapter in the XR-based severe trauma treatment training platform according to the present invention.
7 is a diagram showing the development process of the training device data link adapter in the XR-based severe trauma treatment training platform according to the present invention.
8 is a diagram showing the development process of the training device data link adapter in the XR-based severe trauma treatment training platform according to the present invention.
9 is a view showing a data security process in the XR-based severe trauma treatment training platform according to the present invention according to the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail.

However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In describing the present invention, in order to facilitate the overall understanding, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

Hereinafter, the XR-based severe trauma treatment training system according to the present invention will be described in detail with reference to the accompanying drawings, focusing on preferred embodiments.

1 is an explanatory diagram illustrating a future medical platform, FIG. 2 is a schematic system configuration diagram of an open healthcare platform, and FIG. 3 is an XR-based severe trauma treatment training platform according to the present invention. 4 is a configuration diagram schematically showing an example of an XR-based severe trauma treatment training system according to the present invention, and FIG. 5 is an example of a medical standard HL7 communication structure in the system of FIG. 6 is a diagram showing a training device data link adapter development process in an XR-based severe trauma treatment training platform according to the present invention, and FIG. 7 is an XR-based according to the present invention. It is a view showing the training device data link adapter development process in the severe trauma treatment training platform, and FIG. 8 is a diagram showing the training device data link adapter development process in the XR-based severe trauma treatment training platform according to the present invention. , Figure 9 is a view showing a data security process in the XR-based severe trauma treatment training platform according to the present invention according to the present invention.

Referring to FIG. 1 , future medical platform technology performs personalized health management using patient PHR data, application of medical platform technology based on HL7 FHIR standard, and health care service provision through 3D human body modeling.

The patient P's lifelog (1), medical treatment data (2), and health checkup data (3) are collected from the medical (medical) platform (4).

After performing human digital twin processing, the medical platform 4 stores and manages data in the cloud infrastructure, which is a remote information storage, through the health examination system, AI decision support system, PHR health management system, and hospital information system.

Personal information, health checkup information, bio information, EMR information, public medical information, cohort information, clinical information, and PHR information are stored and managed in the cloud infrastructure.

The human body digital twin processing result processed in the medical platform 4 can be viewed through a device capable of 3D/AR monitoring of the patient's condition.

In addition, the disease prediction simulation 6 is linked with the medical platform 4 to predict the disease.

Referring to FIG. 2 , looking at an example of an open healthcare platform, it supports HL7 FHIR-based international standards, provides scalability with a loud-based Micro Service Architecture structure, and predicts five types of chronic diseases using medical big data. It is equipped with a blockchain-based PHR data sharing function, and a precision medical service development environment using a data lake and data sandbox is provided. Acquired HL7 FHIR compatibility certification.

Open healthcare platform (aka Redwood platform) (10)

It is connected to communication with the PHR-based healthcare service (server) 20 to perform a data inquiry/control function.

The healthcare mobile app 30 of the user terminal transmits and receives healthcare related data to and from the PHR-based healthcare service (server) 20 .

The PHR supplier (server) 40 is connected to the open healthcare platform 10 to supply PHR through a standard interface.

The PHR device 50 is connected to the open healthcare platform 10 to supply the PHR through a standard interface.

The small and medium venture business support portal 70 is linked with the open healthcare platform 10 to support the developer (terminal) (small business, individual, and start-up terminal) 60 .

The PHR user organization (server) 80 is connected to the open healthcare platform 10 through a standard interface.

Referring to FIG. 3 , as an overall conceptual diagram related to the construction of an XR-based severe trauma treatment training system through an XR-based severe trauma treatment platform according to the present invention, a medical twin based on actual severe trauma data is developed and realistic By producing MR content and applying it to the severe trauma treatment training system platform, the military nursing training simulation center is used to demonstrate military nursing training for severe trauma treatment, and to spread the training system for nurturing trauma center personnel by region. to make the concept come true.

The severe trauma data 110 collected from the severe trauma center in each local area is collected through the medical twin production system 120, managed/stored through the severe trauma treatment training platform 130, and training evaluation is performed.

The severe trauma treatment training center Kangpyeong 140 at a remote location and the severe trauma treatment training center 150 are connected to the severe trauma treatment training platform 130 through a communication network to transmit and receive data.

On the other hand, if we briefly explain Medical Twin, it is one of the effects that can be expected when virtual fusion (XR) technology is applied to the existing industry, and some are already being used, like AR glasses. Preliminary medical staff can virtually receive treatment training in traumatic situations, and they can predict and manage future health conditions by using a 'medical twin (virtual body)' that is digitally copied by reflecting personal medical information.

On the other hand, if we look at the main process of physical assessment training, physical assessment is performed through the following actions: questionnaire (question/answer), inspection (observation), auscultation (listening), palpation (touching), and percussion (tapping). is the process of figuring out In XR severe trauma training, it is necessary to present patients with arbitrary symptoms based on MR devices and sensory content to determine appropriate treatment and present them so that they can acquire body assessment skills for various symptoms that are easy to misjudgment. It will provide a technical background for realistic training based on XT on the classification of large-scale emergency patients that may occur in wartime or mass disaster situations.

If we look at the technical analysis of XR body assessment training, we will analyze it through questionnaire (voice recognition-based interaction), inspection (presentation of real-virtual matching rendering), auscultation (reproduction of disease-related sound), palpation and percussion (haptic rendering, feedback). do.

Looking at the main process of trauma treatment training, it is the process of establishing a treatment plan and performing surgical treatment based on the results of diagnosis of physical assessment. It is a process of training appropriate treatment procedures through interaction.

The development of the XR severe trauma training course according to the present invention is briefly described.

For XR-based severe trauma training education, a virtual critically ill patient is presented to the simulator as a random patient designated by the professor, and training for rapid patient diagnosis and treatment improvement is performed and evaluation is performed.

Severe trauma case presentation: Based on actual severe trauma cases, realistic training contents are produced and provided to enable repeated training.

Diagnosis and treatment: Through simulation training, students acquire initial evaluation and treatment competency in an A-B-C-D-E sequence and experience for each trauma case. in other words,

A. Airway secures the patient's hiding place by fixing the cervical vertebrae so that they do not move and maintaining the airway.

B. Breathing has been secured, but appropriate assistance is provided by judging whether the person is resting comfortably, the sound is ok, and oxygen is not insufficient.

C. Circulation evaluates whether there is not enough blood in the body, stops bleeding where bleeding is visible, supplies fluid, and considers transfusion supply

D. Disability is assessed by other neurological tests including consciousness.

E. Exposure and Environment remove clothing and maintain body temperature

Evaluation: The student's treatment behaviors are stored, and evaluation is carried out by developing objective evaluation indicators.

The nursing education curriculum used in the Armed Forces Nursing Academy, which is a key consumer of the results, is generally composed of nursing information, nursing diagnosis, nursing planning, nursing intervention, and nursing evaluation.

According to the present invention, it is a system for breaking away from apprenticeship education, preserving and spreading digital-based medical cases, and introducing an education system.

Medical twin technology, which creates a virtual human body based on real patient cases, digitizes medical cases based on realistic content, thereby digitizing technologies and experiences that have been preserved by human capabilities.

On the other hand, there are many gaps in improving the capacity of medical staff due to the difference in the number of patients due to the regional population distribution imbalance. have. The XR Transformation-based medical training system according to the present invention is expected to be expanded as an online-based platform for sharing patient experiences, and it is expected that it will be able to lead a new medical education system used to resolve the regional medical staff’s competency imbalance and to strengthen overseas medical staff’s capabilities in the long term. do.

In addition, it will be possible to create a new market for medical content based on XR Transformation suitable for the post-corona era.

The demand for non-face-to-face telemedicine training triggered by infectious diseases, etc., is expected to steadily increase due to the expansion of compulsory first aid training subjects, strengthening patient human rights, and lack of cadavers.

In the present invention, development of a medical twin model capable of reproducing arbitrary symptoms is performed. In other words, we develop medical twin-based training content that reproduces actual severe trauma cases, and develop a differentiated training system that can reproduce mass disasters.

In addition, in the present invention, medical twin-based severe trauma treatment training simulator construction is performed. In other words, we develop a training platform for sharing patient cases and experiences through an online open platform, and build a training simulator environment that maximizes the sense of reality (helicopter, operating room, and field presentation).

In addition, in the present invention, a demonstration promotion process for advancing treatment training based on the military nursing simulation center is performed. In other words, we will promote the demonstration through the introduction of the National Armed Forces Nursing Academy curriculum and the use of the Armed Forces Capital Hospital and Ajou University Hospital, and a continuing education program for severe trauma treatment for approximately 2,800 surgeons and nursing officers nationwide, including specialists from the Armed Forces Capital Hospital Trauma Center*. develop and implement;

Referring to Figure 4, the severe trauma treatment training management system is a system that provides training management and evaluation tools for empirical linkage with the military nursing training center,

The severe trauma training platform 100 receives the training scenario and trainee information from the training scenario information processing means 300 and links the monitoring (mannequin information, trainee motion tracking information) information for the processing training to evaluate and evaluate comprehensive training Provides the ability to analyze information.

The severe trauma treatment training platform 100 performs a training-related information log collection function, that is, the mannequin patient biometric information (electrocardiogram, heart rate, oxygen saturation, respiration rate, body temperature, Blood pressure) is collected and analyzed. systolic and diastolic pressure)

In addition, the severe trauma treatment training platform 100 performs a trainee motion tracking information collection and analysis process through the information collected from the training device information processing means 500 (pulse band: mannequin's pulse information- haptic glove: trainee's Tracking of tactile-related treatment information- Holo Lens: Tracking of the trainee's vision-related treatment information- Stethoscope: Information on mannequin's respiration rate- CPR: Information on chest compression).

The training scenario information processing means 300 performs trainee information registration and management, training scenario registration and modification, and training evaluation standard information management functions.

The mannequin patient biometric information processing means 400 performs a function of processing electrocardiogram, heart rate, oxygen saturation, respiration rate per minute, body temperature, and blood pressure information.

The training device information processing means 500 performs a function of processing a pulse band, a haptic glove, a Holo lens, a stethoscope, and CPR information.

The severe trauma training platform 100 collects the processing results from the training scenario information processing means 300, the mannequin patient biometric information processing means 400, and the training device information processing means 500 and analyzes the training data. perform the function

That is, the training evaluation system of the severe trauma treatment training platform 100 includes a training information management unit that manages trainee information management, training scenarios, and training evaluation information, training monitoring, training motion tracking, training treatment management unit that manages training mannequin treatment information, It includes a training evaluation management unit that provides individual/teamwork management, training performance evaluation, and comprehensive analysis report.

In addition, the severe trauma training platform 100 includes an OPEN API such as data collection, PHR information collection, and service data storage, and a training data collection system including a technical support portal such as DATA LAKE and DARA SANDBOX.

The cloud infrastructure 900 performs the functions of managing, storing, and providing data received through a communication network in a remote location in connection with the severe trauma treatment training platform 100 .

The severe trauma treatment training/evaluation UI/UX 200 is connected to the severe trauma treatment training platform 100 and operates, and includes a training information registration UI, a real-time training monitoring UI, and a training evaluation management UI (User Interface).

The training evaluation information management unit 600 is connected to the severe trauma treatment training platform 100 to manage, store and provide individual evaluation information, teamwork evaluation information, and comprehensive training evaluation information.

The open platform 700 is connected to the severe trauma treatment training platform 100 to provide military hospital information sharing, training education data sharing, and data security management functions.

5 and 6, the severe trauma treatment training platform 100 designs and implements a severe clinical case medical institution data link system development training device (HL7-based) data link adapter and an external system (training MR server) link adapter, A medical data linkage system will be provided.

Referring to FIG. 5 , transmission and reception are performed with a data structure of 1 to N Bytes between transmission and reception. The Data Content has an HL7 message.

Referring to FIG. 6 , the severe trauma training platform 100 receives training device information through the training device 500 - 1 through the gateway (training system) 800 .

The severe trauma training platform 100 is

training device data collection (PHR-based) unit;

PHR Core (PHR-based);

Includes training common function and data processing unit.

The training device data (PHR-based) unit collects PHR-based data and performs data processing so that the collected data can be analyzed, but the training standard adapter, external training system interworking (API), wearable IoT adapter, training device HL7 FHIR adapter include

The PHR core includes a Core API, a manager API, a MASTER API, and a collection database, and transmits data from the training device data collection unit to a common training function and a data processing unit.

The training common function and data processing unit includes API GW, OPEN API, authentication security, training information management, and service database, and performs a function of processing data transmitted from the PHR core. In Figure 6, it is possible to develop a training device data interworking adapter. That is,

● Provides data collection function by linking training device (haptic rendering device, mannequin biometric information)

● Interworking structure design based on medical standard HL7 protocol

● Implementation of interworking adapter based on medical standard HL7 protocol

The process is carried out.

Referring to FIG. 7 , as a view similar to FIG. 6 , the training device 500-2 is an MR device, and the MR data collected through this is a severe trauma training platform through a gateway (training system) (Hospital Gateway) 800 . (100) to be processed. 7, an external system interworking adapter is developed. in other words,

● Interlocking training data that cannot be directly linked with HL7 unsupported training devices and severe trauma training platforms

● Analysis and design of various interlocking standards according to data characteristics

The process is carried out.

In FIG. 7 , HL7 unsupported external training data collection interworking implementation and testing may be performed.

Referring to FIG. 8, as a view similar to FIG. 7, the training device 500-3 is directly connected to the severe trauma training platform 100 without going through a gateway as mannequin biometric information, haptic rendering device, and MR training information. can also be sent. In the service database of the severe trauma training platform, training information history/log statistics, event logs, and device status information may be stored. in other words,

● Training device data processing

● Distributed processing of large-capacity data

● Data integration collection log analysis and processing

The process is carried out.

In addition, according to the present invention, it is possible to perform the following functions. That is,

training motion tracking system

Track training motion through motion tracking information to analyze the behavior of training targets

Bio-signal processing that collects and stores various logs that occur in MR-based severe trauma training (mannequin patient biometric information, etc.)

It will provide an overall training management environment that can classify training categories according to location and situation and manage scenario information currently being trained.

Management system such as training scenario update

UI and function to register training scenario information;

Trainer information and evaluation criteria registration, modification, and deletion functions;

Comprehensive monitoring UI and function to monitor training real-time information;

The ability to manage comprehensive data and evaluation scores for training evaluation becomes possible.

Training status monitoring

Monitoring function of the training status of individual and team trainees from the start of training to the end of training;

Monitoring of secondary training situations and indoor and confined space training situations

Information interlocking function according to each training scenario situation of the trainee

Video recording of training content and monitoring function to understand the training situation from various angles

The ability for the evaluator to monitor by adding an emergency emergency scenario becomes possible.

Mannequin biometric information monitoring

Provides an interface that can link training mannequin information,

The ability to monitor the data transmitted from the training mannequin for each biological function

Individual monitoring function for mannequin treatment information for each trainee

A comprehensive monitoring UI and function that allows the evaluator to view the trainee's first aid treatment in real time may be performed.

training data analysis

Evaluation criteria data for training scenarios can be linked,

After the start of training, it is possible to link the algorithm necessary for data analysis of the trainee in various situations,

Training mannequin, haptic rendering device, MR training information Comprehensive training data analysis becomes possible.

Training Assessment Tool

Training Assessment Process

● The treatment training procedure consists of airway security, breathing check, circulation maintenance, awareness check, and exposure environment control.

● The target of training evaluation is divided into physical assessment and first aid, and each evaluation method is applied by composing a training scenario.

● The training evaluation of physical assessment uses the function of MR, and the training evaluation of first aid uses the mannequin and MR at the same time to evaluate it.

Training Assessment Process

Development of a severe trauma evaluation system and analysis of learning effects

● Development of a severe trauma evaluation system and analysis of learning effects based on international standard trauma guidelines and textbooks

● Scenario management and evaluation system of treatment training apply international standards such as ATLS and PHTLS

● Development of evaluation indicators linked to haptics, motion recognition technology, and biosignal data

● Establish an automated training evaluation system based on objective training data

The process will be carried out

Referring to FIG. 9 , in the present invention, data security will be described.

Data and DB data security

Apply the security function of digitizing patient information by encrypting and decrypting data in the platform and DB data

● Data Security

● Target personal information and biometric information

● When collecting, it is transmitted as encrypted data and stored in encrypted form in DB and storage.

Referring to Figure 9, the severe trauma treatment platform 100 is

An encryption/decryption module ( 112) encrypts and stores personal information/biometric information, and encrypts the medical record/image information file and stores it in the database 114.

The severe trauma treatment platform 100 performs SSL-based data/file/image transmission/reception with the client 1000 terminal.

In the data security process, upon transmission, after checking the authority and authentication of the requestor, the decryption key and the transmitted encrypted data are decrypted and displayed on the client 1000 .

Data security is

● DB Security

● Identify encryption targets by examining the status of personal and biometric information

● Classify one-way and two-way encryption target data

● Encryption is performed on data stored in the DB to fundamentally prevent DB data leakage due to unauthorized access by users who do not have permission.

process will be performed.

According to the XR-based severe trauma treatment training system according to the present invention, effective XR-based medical training is possible, and the patient's survival rate can be improved by responding quickly and accurately in the course of severe trauma treatment, Through virtual training for XR severe trauma treatment, it is possible to master the body assessment and treatment skills for severe trauma treatment.

As described above, the best embodiment has been disclosed in the drawings and the specification. Although specific terms have been used herein, they are only used for the purpose of describing the present invention and are not used to limit the meaning or scope of the present invention described in the claims. Therefore, it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true technical protection scope of the present invention should be defined by the technical spirit of the appended claims.

100: Severe Trauma Treatment Platform
112: dark recovery module
114: database
116: Collected data/video/file
118: API GW
110: severe trauma data
120: medical twin production system
140: Severe trauma treatment training course
150: Severe Trauma Treatment Training Center
200: Severe trauma treatment training/evaluation UI/UX
300: training scenario information processing means
400: mannequin patient biometric information processing means
500: training device information processing means
500-1,500-2,500-3: training device
600: training evaluation information processing unit
700: open platform
800: gateway (training system)

Claims (3)

In a severe trauma treatment training system for providing XR (eXtended Reality)-based content to train medical workers for treatment of severe trauma,
Training scenario information processing means to perform training information registration and management, training scenario registration and modification, and training evaluation standard information management functions;
A mannequin patient biometric information processing means for processing electrocardiogram, heart rate, oxygen saturation, respiration rate, body temperature, and blood pressure information;
The training device information processing means for performing a function of processing pulse band, haptic glove, holo lens, stethoscope, and CPR information;
A severe trauma treatment training platform that collects the processing results from the training scenario information processing means, the mannequin patient biometric information processing means, and the training device information processing means and analyzes the training data;
Cloud infrastructure connected to the severe trauma treatment training platform to manage, store, and provide data received from a remote location through a communication network;
Severe trauma treatment training/evaluation UI/UX including a training information registration UI, a real-time training monitoring UI, and a training evaluation management UI (User Interface) that is connected to the severe trauma treatment training platform 100 and operates;
A training evaluation information processing unit that is connected to the severe trauma treatment training platform to manage, store and provide personal evaluation information, teamwork evaluation information, and comprehensive training evaluation information;
It includes an open platform that is connected to the severe trauma treatment training platform to provide military hospital information sharing, training education data sharing, and data security management functions.
Severe trauma processing that receives training scenario and trainee information from the training scenario information processing means and provides a function of analyzing comprehensive training evaluation and evaluation information by linking monitoring (mannequin information, trainee motion tracking information) information for processing training XR-based severe trauma treatment training system, characterized in that it provides a training platform. The method of claim 1,
The severe trauma treatment training platform performs a training-related information log collection function, but collects and analyzes mannequin patient biometric information (electrocardiogram, heart rate, oxygen saturation, respiration rate, body temperature, blood pressure) from the mannequin patient biometric information processing means. ,
XR-based severe trauma treatment training system, characterized in that the trainee motion tracking information collection and analysis process is performed through the information collected from the training device information processing means. The method of claim 1,
The training evaluation system of the severe trauma treatment training platform includes a training information management unit that manages trainee information management, training scenarios, and training evaluation information, a training management unit that manages training monitoring, training motion tracking, and training mannequin treatment information, by individual/teamwork Management, training performance evaluation, including a training evaluation management department that provides a comprehensive analysis report,
XR-based severe trauma treatment, characterized in that it includes an OPEN API such as data collection, PHR information collection, and service data storage, and a training data collection system that includes a technical support portal such as DATA LAKE and DARA SANDBOX training system.

Images