WO2015008935A1 - Cardio pulmonary resuscitation (cpr) training simulation system and method for operating same - Google Patents

Abstract

A CPR simulator according to an embodiment of the present invention includes a compression information receiver for receiving, from at least one pressure sensor, a compression intensity and a compression period input into the at least one pressure sensor, an airway information receiver for receiving whether an airway of a dummy is expanded from an on/off switch circuit, a flow rate information calculation unit for receiving bending degree data received from a bending sensor and calculating data on a flow rate flowing in the airway, and an AR output unit for comparing at least one piece of the received information with at least one piece of reference information and outputting a result through a first projector. A CPR training simulation system according to another embodiment of the present invention comprises a dummy including body parts required for CPR training, a sensor kit for sensing and collecting various types of first aid applied to the dummy during the CPR training given by a user, the sensor kit being attachable/detachable to/from the dummy, and a portable terminal for displaying various pieces of guide information according to an emergency situation on a screen, and receiving, displaying in real time, and analyzing information on the first aid given by the user sensed or collected by a sensor kit module during the CPR training according to the guide information. Accordingly, the present invention is effective in significantly improving efficiency of CPR training education through the performance of the CPR training, in which the sensor kit is installed in the dummy, a CPR training program of the portable terminal is executed, first aid action information transmitted from the sensor kit is received and analyzed, and then feedback is provided to a user.

Description

CPR training simulation system and its operation method

The present invention relates to a cardiopulmonary resuscitation training simulation system, and more particularly, to provide a feedback on the first aid behavior of the trainees using a sensor kit in real time CPR training simulation system and its method and augmentation to increase the educational effect A reality-based interactive CPR training simulator.

Cardio Pulmonary Resuscitation (CPR) is a first aid procedure when breathing stops due to a sudden stop of heart and lung activity. When cardiac arrest occurs and circulation stops, oxygen in brain tissue is depleted within 1 second. After 5 minutes, glucose and ATP (adenosine triphosphate) deficiency occurs. Since the process of biological death by irreversible damage of the nerve tissue, including the most important for the resuscitation of the patient is to maintain the circulation and breathing in a short time to supply oxygen to the tissue.

An important factor influencing the resuscitation of cardiac arrest patients is the proper treatment of the original detector. In other words, resuscitation of cardiac arrest patients depends on how quickly the first discoverer is performing appropriate CPR. Thus, with the emphasis on the effectiveness and importance of CPR for the first discoverers, it is encouraging and supporting CPR education at the national level.

However, conventional cardiopulmonary resuscitation training is a theory-based, it is difficult to determine the patient's response or the accuracy of the procedure is difficult situation 1: 1 educator's feedback. In addition, when an actual emergency occurs, even if the user is embarrassed and properly acquired CPR, in most cases, it may not be performed correctly.

Cardiopulmonary resuscitation requires precise pressure points, strength, and cycles. When practicing CPR using a general dummy, it is not easy to acquire it.

In addition, in the case of a conventional dummy for a CPR, a sensor and a program for detecting the execution of CPR are integrally formed, so that it is not easy to manage the sensor device, and the entire program is changed when the human body is changed. Program management, such as the need for new programming, was also difficult.

One embodiment of the present invention, by feeding back the exact compression point, intensity and period to the user through augmented reality in real time, by accurately taking a posture of the user's posture can be displayed intuitively, the actual emergency situation By providing augmented reality as it is, it is possible to provide an AR-based bidirectional CPR simulator device and system that allows the user to perform CPR without embarrassment even in a real emergency.

Another embodiment of the present invention can provide a cardiopulmonary resuscitation training simulation system that can increase the educational effect by providing a feedback on the behavior of the trainee in real time by interlocking the smart device to the human body model having a variety of sensors.

In addition, another embodiment of the present invention is easy to the simple model of the human body for feedback without the feedback of the most commonly used sensor kit with pressure and depth detection, ventilation detection, airway secured detection and communication function of chest compressions By attaching the cardiopulmonary resuscitation training program on the portable terminal and interlocking with the sensor kit, by providing a feedback function to the human body by attaching a sensor kit module to a conventional human body model without feedback. In addition, it is possible to provide a CPR training simulation system that improves the efficiency of using the human body model and CPR training.

In addition, another embodiment of the present invention by facilitating the update of the CPR training program of the sensor kit and the portable terminal, it is easy to change the CPR training without replacement of the human body model and easy management of the CPR training program CPR training simulation system can be provided.

In addition, another embodiment of the present invention may provide a cardiopulmonary resuscitation training simulation system for storing the cardiopulmonary resuscitation training information in a server via a communication network to check the CPR training result information in real time through a communication network, such as the Internet .

However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

One embodiment of the present invention, the compression information receiving unit for receiving the compression intensity and the compression period input from the at least one pressure sensor to the at least one pressure sensor, the dummy (Dummy) from the on / off switch circuit Airway information receiving unit for receiving whether or not the airway is expanded, flow rate information unit for receiving the bending degree data received from the bending sensor, and calculates the flow rate data introduced into the airway and at least one information received through the first projector It includes an AR output unit for comparing and outputting with at least one reference information.

Another embodiment of the present invention, a human body including each part of the human body required for cardiopulmonary resuscitation training, and can be universally removable to the human body model, various types of users to be performed on the human body model for CPR training Sensor kit for detecting and collecting first aid and various guide information according to the emergency situation on the screen, and according to the guide information regarding the first aid of the user detected and collected in the sensor kit during the CPR training It includes a portable terminal for receiving information to display and analyze in real time.

The human model includes a chest compression detector for measuring one or more of the compression strength, the number of compressions, and the compression time applied to the chest of the human body model, and the respiratory volume and respiratory strength when artificial ventilation is installed in the human model. Including a respiratory detector for measuring the number of breaths, breathing time, airway secured detector for detecting the airway of the human body, and compression position detector for detecting the position of the compression applied to the chest of the human model do.

The sensor kit includes a compression depth detection unit for detecting a depth of compression applied to the chest, a communication unit performing wireless communication with the portable terminal, the chest compression detection unit, a ventilation detection unit attached to the human body model, Including a control unit for controlling the communication unit to transmit one or more of the first aid information measured by the airway secured detection unit, the chest compression detection unit, the ventilation detection unit, the airway secured detection unit is wired or wirelessly connected.

The sensor kit further includes a wired or wireless communication module for changing a driving program of the controller.

The portable terminal reproduces and outputs an information receiver for receiving first aid information transmitted from the sensor kit and the CPR guide information, and analyzes the first aid information and outputs an analysis result for first aid information. And a display unit configured to display the cardiopulmonary resuscitation process guide information on the screen under the control of the processor and to display the received first aid information.

The cardiopulmonary resuscitation training simulation system further includes a server for receiving and storing information on the cardiopulmonary resuscitation training process from the portable terminal, and accessing a user connected through a communication network in real time.

Another embodiment of the present invention, the cardiopulmonary resuscitation training program is executed, the wireless communication setup process for setting up the wireless communication with the sensor kit, the scenario selection process for selecting one of the virtual emergency scenarios according to the user input And a scenario explanation process for outputting the description of the selected emergency situation and outputting image and sound effects, a consciousness confirmation process for outputting voice guidance for the consciousness check of the patient in the emergency situation, and chest compression on the patient. A chest compression process for receiving the first aid information from the sensor kit, and displaying the progress and results of the chest compression on the screen, and instructing the patient to perform ventilation according to the user. A resuscitation process for receiving first aid information from a sensor kit and displaying the progress and results of resuscitation on a screen; Group when the ventilation procedure is completed, including CPR after the processing after outputting the video and audio information relating to the processing procedure, and analyzed to display the analysis and assessment of the emergency of the user on the terminal screen, the evaluation process.

CPR training simulation operation method of the present invention, the portable terminal transmits the information on the cardiopulmonary resuscitation training process to the server via a communication network, the accessor connected via the communication network in real time to the user's cardiopulmonary resuscitation training process and results It further includes a server storage process to check.

An embodiment of the present invention is to feed back the exact compression point, intensity and period to the user in real time through augmented reality, and by displaying the user's posture in a depth image to display the exact posture intuitively, the actual emergency situation By providing augmented reality such as this, a user can perform CPR without being embarrassed even in an actual emergency situation.

Another embodiment of the present invention can increase the educational effect of the cardiopulmonary resuscitation training by providing feedback on the behavior of the trainees in real time by linking the smart device to the human body model for cardiopulmonary resuscitation training equipped with various sensors.

In addition, another embodiment of the present invention can be universally applied to various types of CPR educational human models without widely used feedback, thereby improving CPR training performance of the human model for CPR while minimizing costs This can improve the effectiveness of CPR training.

In addition, since another embodiment of the present invention displays the CPR guide and feedback on the user's behavior through an eyeglass display or a mobile device, the CPR is sequentially performed according to the CPR process guide without panic in practice. Make it work.

1 is a block diagram illustrating an AR-based bidirectional CPR simulation system according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining an AR-based bidirectional CPR simulator device shown in FIG. 1; FIG.

3 is a diagram illustrating an embodiment in which the pressure sensor, the on / off switch circuit, and the bending sensor shown in FIG. 1 are mounted in a dummy; FIG.

4 is a diagram illustrating an embodiment in which at least one depth RGB sensor illustrated in FIG. 1 is mounted to a user, and a depth RGB image photographing the same; FIG.

FIG. 5 illustrates one embodiment of augmented reality visualization results projected into the first project shown in FIG. 1;

FIG. 6 is a diagram illustrating an embodiment in which a user performs artificial respiration in the dummy shown in FIG. 1. FIG.

FIG. 7 illustrates an embodiment in which a user performs CPR on a dummy shown in FIG. 1. FIG.

FIG. 8 illustrates an embodiment in which the pressure sensor, the on / off switch circuit, and the bending sensor shown in FIG. 1 are mounted in a dummy. FIG.

9 is a block diagram showing a cardiopulmonary resuscitation training simulation system according to an embodiment of the present invention.

10 is a schematic diagram of a CPR training simulation system of the present invention.

11 is a block diagram of the sensor kit shown in FIG.

12 is a signal flow conceptual diagram of a sensor kit mounted on the human body model.

FIG. 13 is a block diagram of the portable terminal shown in FIG. 9; FIG.

14 is a flow chart showing the processing of the CPR training simulation operating method of the present invention.

15 is a diagram illustrating a virtual emergency scenario according to the present invention.

FIG. 16 illustrates the emergency scenario selected in FIG. 15. FIG.

17 is an exemplary view of a terminal screen showing a patient's consciousness confirmation procedure.

18 is an exemplary view of a terminal screen showing the help or emergency request procedures of the neighbors.

19 is an exemplary view showing a terminal screen showing a chest compression step.

20 is an exemplary view of a terminal screen showing a ventilation step.

21 is an exemplary view of a terminal screen showing a post-processing process after recovery.

Fig. 22 is an illustration of a terminal screen showing steps relating to evaluating first aid.

23 is a block diagram showing a cardiopulmonary resuscitation training simulation system according to another embodiment of the present invention.

24 is an exemplary view showing a screen displaying CPR training feedback according to another embodiment of the present invention.

25 is an exemplary diagram showing a CPR process using the CPR training simulation system shown in FIG. 23.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components, unless specifically stated otherwise, one or more other features It is to be understood that the present disclosure does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram for explaining an AR-based bidirectional cardiopulmonary resuscitation (CPR) simulation system according to an embodiment of the present invention. Referring to FIG. 1, the AR-based bidirectional CPR simulation system 110 includes at least one pressure sensor 110, an on / off switch 120, a bending sensor 130, at least one depth RGB sensor 140, and depth. The RGB camera may include an RGB-Depth Camera 150, a first projector 160, a second projector 170, and an AR-based bidirectional CPR simulator device 180. However, since the AR-based bidirectional CPR simulation system 100 of FIG. 1 is only one embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

In this case, each component of FIG. 1 is generally connected through a network 900. For example, as shown in FIG. 1, at least one pressure sensor 110, an on / off switch 120, a bending sensor 130, and an AR-based bidirectional CPR simulator device 180 via a network 190. Can be connected. In addition, the AR-based bidirectional CPR simulator device 180 may be connected to the at least one depth RGB sensor 140 and the depth RGB camera 150 through the network 190. The first projector 160 and the second projector 170 may be connected to the AR-based bidirectional CPR simulator device 180 through the network 190.

Here, the network 190 refers to a connection structure capable of exchanging information between each node, such as terminals and servers, one example of such a network 190 is Bluetooth, the Internet (Internet), Local Area Networks (WLANs), Wireless Local Area Networks (WLANs), Wide Area Networks (WANs), Personal Area Networks (PANs), 3G, 4G, LTE, Wi-Fi, and the like, are not limited thereto. At least one pressure sensor 110, the on / off switch 120, the bending sensor 130, at least one depth RGB sensor 140, a depth RGB camera (RGB-Depth Camera, 500) shown in FIG. The first projector 160, the second projector 170, and the AR-based bidirectional CPR simulator device 180 are not limited to those shown in FIG. 1.

The at least one pressure sensor 110 may be located at the chest of the dummy. The at least one pressure sensor 110 may detect a pressing intensity and a pressing period input to the at least one pressure sensor 110. In this case, the at least one pressure sensor 110 may be located, for example, at least two along the X coordinate and at least two along the Y coordinate. In addition, at least one pressure sensor 110 may be located at the rear of the chest of the dummy, and at least one spring may be located between the at least one pressure sensor 110 and the front of the dummy chest. Accordingly, the user may feel like a person because the spring moves up and down and provides elastic force when performing CPR using the dummy. In addition, at least one pressure sensor 100 may be positioned to correspond to the position of the spring so that the at least one pressure sensor 110 may receive pressure applied through the spring.

The on / off switch circuit 200 may determine whether the dummy airway is open or closed. That is, the on / off switch circuit 200 is located at the neck of the dummy, and when the neck of the dummy is folded back, the airway is opened, so the on / off switch circuit 200 is turned off, and the neck of the dummy is rolled forward to close the airway. The on / off switch circuit 200 may be turned on. Accordingly, the on / off switch circuit 200 can detect that the airway of the dummy is closed or opened.

The bending sensor 130 may be located in the lung or belly of the dummy. The bending sensor 130 may output the degree of bending as data. At this time, when the user performs artificial breathing through the mouth of the dummy, the air bag located in the lower portion of the bending sensor 130 is inflated. Accordingly, since the air bag is inflated as air is introduced into the air bag, the bending sensor 130 may gradually have a predetermined slope. Therefore, it is possible to measure whether the user inhales enough breath through the bending sensor 130.

The at least one depth RGB sensor 400 may be attached to a wrist, elbow, shoulder, waist, or the like of the user, and may be photographed by the depth RGB camera 150. In this case, when the at least one depth RGB sensor 140 is photographed by the depth RGB camera 150, a 3D image may be generated. In addition, when photographing the at least one depth RGB sensor 140, the angle of the cuffs, elbows, shoulders, waist, etc. can be known, so if you are taking a wrong posture, you can provide an input value that can inform the user in real time. Can provide. In this case, the at least one depth RGB sensor 140 may have a different color.

The first projector 160 is based on at least one information data received from at least one pressure sensor 110, on / off switch circuit 200, bending sensor 130, at least one depth RGB sensor 140. The augmented reality screen may be output to give feedback to the user in real time. In this case, the first projector 160 may project an augmented reality screen output from the AR-based bidirectional CPR simulator device 180, and the corresponding screen may be an area where a dummy is located.

The second projector 170 may project an augmented reality screen output from the AR-based bidirectional CPR simulator device 180 to reproduce an emergency situation in augmented reality, and the screen is an area perpendicular to the area where the dummy is located. Can be.

At this time, the augmented reality screen may be at least one image that reproduces the emergency situation, thereby allowing the user to calmly perform CPR and artificial breathing even in a real situation.

The AR-based bidirectional CPR simulator device 180 includes at least one pressure sensor 110, an on / off switch circuit 200, a bending sensor 130, at least one depth RGB sensor 140, and a depth RGB camera 150. It may be a device that collects and interprets data and images received from the user and provides feedback on resuscitation and CPR to the user in real time. Here, the AR-based bidirectional CPR simulator device 180 outputs data to give feedback to the user through the first projector 160 and outputs data to provide an augmented reality image to the user through the second projector 170. do.

In this case, the AR-based bidirectional CPR simulator device 180 may be implemented as a computer that can access a remote server or terminal through the network 190.

Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like equipped with a web browser. In addition, the AR-based bidirectional CPR simulator device 180 may be implemented as a terminal that can access a server or terminal in a remote place through the network 190. The user terminal 100 is, for example, a wireless communication device that ensures portability and mobility, and includes a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), and a personal handyphone system (PHS). , PDA (Personal Digital Assistant), International Mobile Telecommunication (IMT) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (WBRO) terminal, smartphone ( All types of handheld based wireless communication devices such as smartphones, smartpads, tablet PCs, and the like may be included.

Referring to the AR-based bidirectional simulation system according to an embodiment of the present invention described above as an example.

In recent years, cardiac arrest patients have exceeded 10,000 people a year, and in the case of witnessed cardiopulmonary resuscitation, the survival rate of cardiac arrest patients is extremely low compared to foreign countries. In other words, in Korea, only about 1% of eyewitnesses are capable of CPR.

At this time, the CPR education method is difficult to determine the response of the patient or the accuracy of the procedure due to the theory-based education, the 1: 1 feedback of the educator is difficult. In addition, CPR requires accurate pressure points, strength, and cycles, and when practicing CPR using a general dummy, it is not easy to acquire it. In addition, in the case of an actual emergency situation, even if the user is embarrassed and properly acquires CPR, in most cases, the user cannot correctly perform this.

Accordingly, the AR-based bidirectional CPR simulation system according to an embodiment of the present invention feeds back the exact compression point, intensity, and period to the user through augmented reality in real time, and intuitively captures the correct posture by capturing the user's posture as a depth image. Can be displayed as In addition, AR-based bidirectional CPR simulation system according to an embodiment of the present invention, by providing augmented reality, such as the actual emergency situation, so that the user can perform CPR without panic even in the actual emergency situation.

FIG. 2 is a diagram for describing an AR-based bidirectional CPR simulator device illustrated in FIG. 1. Referring to FIG. 2, the AR-based bidirectional CPR simulator device 180 includes a compression information receiver 182, an airway information receiver 184, a flow rate information calculator 186, an AR output unit 188, and an attitude information receiver 189. ) May be included.

In this case, the network 190 may be connected to at least one pressure sensor 110, an on / off switch 120, a bending sensor 130, at least one depth RGB sensor 140, a depth RGB camera (RGB-Depth Camera, 150, the first projector 160, the second projector 170, and the AR-based bidirectional CPR simulator device 180 generate a communication object at a communication contact point for communication with a terminal connected to the network 190. do. The AR-based bidirectional CPR simulator device 180 may exchange data with each other through a communication object.

Hereinafter, an AR-based bidirectional CPR simulator apparatus according to an embodiment of the present invention will be described.

Referring to FIG. 2, the compression information receiver 182 receives a compression intensity and a compression period input from the at least one pressure sensor 110 to the at least one pressure sensor 110. In this case, the compressive strength may be the strength of the user pressing the at least one pressure sensor 110 through the spring, and the pressing period may be based on the speed at which the user presses the at least one pressure sensor 110 through the spring. have. In this case, the at least one pressure sensor 110 may be mounted at at least one position of the chest of the dummy, and the at least one pressure sensor 110 mounted at the at least one position may identify the at least one position. It can have For example, the at least one pressure sensor 110 may have an identifier such as 1, 2, 3, 4 in the order of up, down, left, and right. In addition, the at least one pressure sensor 110 may be mounted at at least one position of the chest of the dummy, and at least one spring (not shown) may be mounted on an upper surface of the at least one pressure sensor 110. .

In addition, the AR output unit 188 compares and outputs the compression intensity and the reference compression intensity information to the at least one pressure sensor 110, and the compression rate from the compression period input to the at least one pressure sensor 110 (Pressure Rate) ) May be calculated, the compression speed may be output by comparing the reference compression speed information, and the reference compression position may be output based on the compression strength input to the at least one pressure sensor 110. In this case, the compression information receiver 182 or the AR output unit 188 may include an analog to digital converter (ADC) for converting analog data into digital data.

The airway information receiving unit 184 receives whether the dummy airway is expanded from the on / off switch circuit 200. In this case, the on / off switch circuit 200 may be a circuit that is turned off when the dummy airway is expanded, that is, when a hole is generated in the airway and is closed when the hole is closed in the airway. Accordingly, the AR output unit 188 outputs data indicating that the airway is expanded when the dummy airway is extended and the on / off switch circuit 200 outputs an off state, and the airway of the dummy is closed to turn on / off the switch circuit. When the 200 outputs the on state, the data indicating that the airway is closed may be output.

The flow rate information calculator 186 receives the bending degree data received from the bend sensor 130, and calculates the flow rate data introduced into the airway of the dummy. That is, the calculated flow rate data may be based on the tilt Tilt of the bending sensor 130 which is the bending degree data of the bending sensor 130, and the AR output unit 188 may calculate the calculated flow rate data and artificial breathing time. The required reference flow data can be compared and output.

The posture information receiver 189 may receive an image of the at least one depth RGB sensor 400 from the depth RGB camera 150. In this case, the AR output unit 188 may compare and output the position and the angle of the at least one depth RGB sensor 140 with the reference position and the reference angle. In addition, the at least one depth RGB sensor 140 may be attached to at least one position of the user, and the at least one position may be a waist, shoulder, elbow, and wrist of the user.

The AR output unit 188 outputs the at least one piece of information received through the first projector 160 by comparing it with at least one piece of reference information. Here, the AR output unit 188 may project the augmented reality-based emergency situation image for reproducing the emergency situation through the second projector 170. In this case, an area projected by the second projector 170 and an area projected by the first projector 160 may be perpendicular to each other.

2 that are not described with respect to the AR-based bidirectional simulation apparatus of FIG. 2 may be easily inferred from the same or described with respect to the AR-based bidirectional simulation system described above with reference to FIG. .

FIG. 3 is a view illustrating an embodiment in which the pressure sensor, the on / off switch circuit, and the bending sensor shown in FIG. 1 are mounted in a dummy, and FIG. 4 shows that at least one depth RGB sensor shown in FIG. FIG. 5 is a diagram illustrating one embodiment mounted and a depth RGB image photographed thereon, and FIG. 5 is a diagram illustrating one embodiment of an augmented reality visualization result projected by the first project illustrated in FIG. 1.

Referring to the left side of FIG. 3, the position where at least one pressure sensor 110 is mounted in the dummy is illustrated. In this case, when the user presses the chest portion of the dummy, the compression strength and the compression cycle are transmitted through the spring, and the pressure sensor 110 may detect this.

Referring to the middle of FIG. 3, a position where the on / off switch circuit 200 is mounted in a dummy is shown. At this time, when the user leans back or bows the neck of the dummy, the airway is opened or closed. Accordingly, an off signal may be output when the airway of the on / off switch circuit 200 is opened, and an on signal may be output when the airway is closed.

Referring to the right side of FIG. 3, the bending sensor 130 is mounted on the dummy. At this time, when the user inhales the breath through the mouth, the air bag of the bottom portion where the bending sensor 130 is mounted is inflated. Accordingly, since the bending sensor 130 is bent and outputs the degree of bending, the bending sensor 130 may be an input value for determining whether or not a flow rate flows.

Referring to FIG. 4A, at least one depth RGB sensor 140 is attached to a user. Referring to FIG. 4B, at least one depth RGB sensor 140 is a depth RGB camera. An RGB depth image photographed by 150 is shown. Since the RGB depth image can express the depth, it can produce the same effect as 3D, and accordingly, whether the user has taken the correct posture can be confirmed not only in 2D but also in 3D. In addition, by measuring the angle between the at least one depth RGB sensor 140 may serve as an input value that can determine whether the user is in the correct posture.

Referring to FIGS. 5A and 5B, a situation in which the dummy is actually lying on the street is displayed in augmented reality. At this time, the first projector 160 outputs in real time whether the compression strength of the CPR is compared with the reference compression strength, and how much the compression speed is compared with the reference compression speed in real time so that the user can perform CPR in real time. You can give feedback to correct your posture. In addition, the first projector 160 can display whether the pressing position is correct, in which direction the pressing should be performed, and whether the pressing posture is correct, and also indicates how much time has elapsed from the pressing start time. can do.

3 to 5 is not described about the AR-based bidirectional simulation device as described above with respect to the AR-based bidirectional simulation system through FIGS. 1 and 2 can be easily inferred from the contents described or described The description below will be omitted.

FIG. 6 is a diagram illustrating an embodiment in which a user performs artificial respiration on a dummy illustrated in FIG. 1, and FIG. 7 is a diagram illustrating an embodiment in which a user performs CPR on a dummy illustrated in FIG. 1. 8 is a diagram illustrating an embodiment in which the pressure sensor, the on / off switch circuit, and the bending sensor illustrated in FIG. 1 are mounted in a dummy.

Referring to (a) and (b) of FIG. 6, a situation such as an actual accident may be projected through the second projector 170. In this case, the second projector 170 may output not only an image but also a sound such as noise. In addition, the first projector 160 may output whether the user is breathing at the correct time, and whether the amount of air blown is sufficient compared to the reference amount.

Referring to FIGS. 7A and 7B, when a user performs CPR, that is, chest compression, the first projector 160 may output feedback compared to various reference information to the user. Can be.

Referring to FIG. 8A, at least one pressure sensor 110 is mounted, an embodiment in which a spring is attached to an upper portion thereof, and a dummy assembly process.

In this case, the at least one pressure sensor 110 may be arranged in a cross while forming up, down, left, and right angles. Referring to (b), a position where the on / off switch circuit 200 is mounted is shown. Referring to (c), the position where the bending sensor 130 is mounted is shown. In this case, the at least one pressure sensor 110, the on / off switch circuit 200, and the bending sensor 130 may be mounted in the dummy as embedded hardware.

6 to 8, the matters not described for the AR-based bidirectional simulation apparatus can be easily inferred from the same or described contents with respect to the AR-based bidirectional simulation system through FIGS. 1 to 5. The description below will be omitted.

9 is an exemplary view of a CPR simulation system according to another embodiment of the present invention, Figure 10 is a block diagram of a CPR training simulation system according to the present invention.

9 and 10, the CPR simulation system according to the present invention includes a human body model 900, a sensor kit 910, a portable terminal 1000, and a server 1200 connected to a communication network 1300. It is configured by.

The human model 900 includes each part of the human body necessary for CPR training and is a CPR training mannequin made similar to the actual human body, and a chest pressure detecting unit 920 made of a pressure sensor, an air pressure sensor, or a flow meter therein. Compression position detection consisting of a ventilator detection unit 930 provided, an airway acquisition detector 940 having an airway acquisition detector switched according to opening and closing of the airway, and a compression position detection pad for detecting a chest compression position of the trainer. The sensor kit 910 is provided with various sensors such as the unit 922 and is detachably configured therein.

Human body model 900 of the above-described configuration detects the first aid behavior of the user according to the CPR implementation.

The chest compression detection unit 920 is installed in the center of the chest of the human body 900. The chest compression detection unit 920 measures the intensity of compression, the number of compressions, and the compression time applied to the model 900 according to CPR through a pressure sensor installed at the center of the chest. Here, the number of compressions and the compression time are used to calculate the compression speed.

The artificial respiration detection unit 930 is installed at the head or neck of the human body 900. The ventilation detection unit 930 measures the respiratory strength and the number of breaths, the breathing time, and the like of the human model 900 when performing artificial respiration with the oral part or the nasal part of the human model 900.

The airway secured detection unit 940 is implemented as an on / off switch is installed on the head or neck of the human body 900 is on / off to detect whether or not the airway of the human body 900 is secured. The airway securement detecting unit 940 is installed at the head of the human body 900, and outputs an off signal '0' when the airway of the human body 900 is secured, and outputs an on signal '1' when the airway is not secured. It outputs whether the airway is secured by outputting different signals such as outputting the signal or vice versa. That is, the sensor kit 910 which will be described later may check whether the airway of the human body 900 is in an open state or a closed state through an output signal output from the airway security detecting unit 940.

The compression position detecting unit 922 is provided with a switch pad or a plurality of array of sensing sensors attached to the chest of the human model 900, and then detects the chest compression position when the user presses the sensor kit. To 910.

Examples of the server 1200 include a server communication unit, an Internet service unit, a CPR service unit, a control unit, and a storage unit therein. The CPR training of a user or CPR trainees transmitted from the portable terminal 1000 is performed. After receiving and storing the process and analysis results, it may be configured as a server system such as a web server that allows the administrator or user to access the CPR training process and analysis results in real time through the Internet.

FIG. 11 is a block diagram of the sensor kit 910 illustrated in FIG. 9, and FIG. 12 is a conceptual diagram illustrating a signal flow of the sensor kit 910 mounted on the human body model.

As shown in FIG. 11, the sensor kit 910 according to the present invention includes a compression depth detecting unit 921 for detecting a depth of chest compression when chest compression is performed after being mounted on the human body 900, and The communication unit 926 for performing wireless communication with the portable terminal 1000, a communication module 927 such as a USB or Bluetooth module for changing a program for cardiopulmonary resuscitation education, and a chest compression detector attached to the human body model. 920, a ventilation unit 930, and a control unit 928 for controlling the communication unit 926 and the communication module 927 to transmit first aid information measured by the airway acquisition detection unit 940. Is configured, when mounted on the human body 900, the chest compression detection unit 920, the ventilation detection unit 930, the airway secured detection unit 940 is wired or wirelessly connected, the chest compression detection unit 920, the ventilation detection unit 930, airway secured detection unit 940 detected After receiving the call is configured to transmit to the user portable terminal 1000. That is, the chest compression detection unit 920, the artificial respiration detection unit 930, the airway secured detection unit 940 attached to the human body is configured to be detached from the human body model, the sensor kit Consists of a set of kits that can be attached to and detached from a human body model for CPR training. The sensor kit 910 is configured to be universally inserted and installed in the conventional human body model without feedback, and measures the chest compression depth, as shown in Figure 12 chest compression detection unit 920, ventilation detection unit 930 , From the airway secured detection unit 940 detects chest compression strength, chest compression position, chest compression speed, ventilation volume, airway secured, whether the AED pad is attached to the correct position.

The communication unit 926 serves to communicate with the external user portable terminal 1000. The communication unit 926 is implemented as a communication module such as a Bluetooth module, a short range wireless communication module, or a wireless internet module.

The control unit 928 collects the first aid of the user detected through the chest compression detection unit 920, the ventilator detection unit 930, the airway secured detection unit 940, and collects the collected first aid information communication unit ( It transmits to the external portable terminal 1000 through 926.

The portable terminal 1000 is equipped with a program for cardiopulmonary resuscitation training receives the first aid information transmitted from the sensor kit 910, and feeds the received information back to the user in real time. When the user first aid is completed, the portable terminal 1000 analyzes the user's behavior based on the received first aid information and outputs the analysis result. The program for cardiopulmonary resuscitation education is changed, such as upgrade by a short-range wireless communication such as USB or wired communication such as USB.

That is, the program for cardiopulmonary resuscitation education of the portable terminal 1000 is implemented in a manner that can be easily updated without changing the human body model or sensor kit as the guidance of CPR is improved.

The program for cardiopulmonary resuscitation education provides a variety of virtual scenarios for cardiopulmonary resuscitation implementation (cardiac arrest during exercise, cardiac arrest during accident, cardiac arrest during marine accident). The program is implemented to output a virtual patient on the display and change the color, facial expression, etc. according to the user's behavior information to increase the sense of reality.

The program outputs voice instructions for guiding CPR implementation steps. And real-time audiovisual feedback is provided through the user's first aid behavior information received from the sensor kit 910. Analysis result of each trainee transmitted from the sensor kit 910 is provided on the student's portable terminal, electronic device.

In addition, the program for cardiopulmonary resuscitation training of the portable terminal 1000 is easy to analyze and read the cardiopulmonary resuscitation training results by storing the training data of the trainees, equipped with a server and viewer that can be viewed when the educator needs It can be implemented to.

In addition, the portable terminal 1000 transmits the analyzed user behavior information and first aid result information based on the received first aid information to the server 1200 through a communication network 1300 such as a wired or wireless Internet.

In addition, the program for cardiopulmonary resuscitation training of the portable terminal 1000 may be configured to further enhance the educational effect by providing a user interface such as a game.

FIG. 13 is a block diagram of the portable terminal 1000 shown in FIG. 9.

The portable terminal 1000 according to the present invention is a mobile phone, a smart phone, a tablet computer, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a portable multimedia player (PMP), or the like. It can be implemented with all kinds of wireless communication terminals.

As illustrated in FIG. 13, the portable terminal 1000 includes an information receiver 1010, a memory 1020, a processor 1050, a display 1030, and a speaker 1040.

The information receiver 1010 receives first aid information of a user transmitted through the communication unit 926 of the sensor kit 910. The memory 1020 stores first aid information and a CPR training program (cardiopulmonary resuscitation training program) of the user received through the information receiver 1010.

The processor 1050 guides each step according to the CPR process by executing a CPR training program, and acquires first aid information to be executed according to the guide. That is, the processor 1050 receives the user emergency treatment information according to each step of the CPR process through the information receiver 1010. The processor 1050 outputs first aid information received through the information receiver 1010 through the display 1030 and / or the speaker 1040 in real time. At this time, the processor 1050 calculates the compression speed by using the number of compression and the compression time applied to the chest of the human body 900. In addition, when the CPR is completed, the processor 1050 analyzes the user's behavior based on the first aid information of the user stored in the memory 1020 and outputs the analysis result.

The display unit 1030 displays CPR process guide information, first aid information, and first aid analysis results output from the processor 1050. The display unit 1030 may be implemented as a display device such as a touch screen, a liquid crystal display, a light emitter diode (LED) display, a head mounted display (HMD), or the like. In this case, when the display unit is implemented as the HMD, the data is received in real time, the received data is reproduced and displayed on the screen, thereby enabling interlocking use in actual situations. The display unit 1030 may be configured to use a mobile phone, a tablet PC, a smart TV, a monitor interlocked with a computer, or the like as an output device.

The speaker 1040 outputs the CPR process guide information, first aid information, and first aid analysis result converted by the processor 1050 into an audio signal to the outside.

In the above-described embodiment, the sensor kit 910 detects the user's first aid and transmits it to the portable terminal 1000 so that the user can check the feedback of the user's behavior according to the CPR through his portable terminal 1000. . In addition, the portable terminal 1000 is connected to the communication network and transmits the entire process and analysis result information of the user first aid in the cardiopulmonary resuscitation training process to the server 1200. However, the present invention is not limited thereto, but the sensor kit 910 directly transmits the measured first aid information to the manager terminal (not shown) or the server 1200, or via the portable terminal 1000, the manager terminal (not shown) or the server ( 1200 to transmit. By such a configuration, the administrator can monitor and manage individual CPR training data of users in real time through the server 1200 or the administrator terminal.

The training target of the CPR training system having the above-described configuration may be a general person, a related expert, an educator who is a subject providing CPR training, and the like.

Training is generally presented at the beginning of the training through a handheld terminal or a corresponding electronic device to present a virtual environment similar to a real accident environment, and to provide a tutorial to perform CPR. The trainee uses a human body model with a sensor kit and receives audio-visual feedback on the display of mobile computing devices such as portable terminals, tablets, smartphones, and laptops, or electronic devices such as HMDs (head-mounted displays) in real time. The student trains himself to correct his behavior.

The sensor kit detects the trainee's chest compression depth, chest compression strength, location of chest compression, chest compression speed, ventilation intensity, ventilation volume, airway security, and whether the AED pad is attached to the correct position. After completing all cardiopulmonary resuscitation, you will be provided with your results on the screen. The results are also sent from the electronic device to the server and stored for later viewing by the educator.

Figure 14 is a flow chart showing the processing of the CPR training simulation operating method of the present invention.

As shown in FIG. 14, the CPR training simulation operation method using the CPR training simulation system having the configuration of FIGS. 9 to 13 may include a wireless communication setting process (S1410), a scenario selection process (S1420), and a consciousness checking process. (S1430), chest compression process

(S1440), artificial respiration process (S1450), post-processing process (S1460), analysis and evaluation process (S1470), server transmission process (S1480).

Hereinafter, the procedure of the CPR training simulation operation method of FIG. 14 will be described.

FIG. 15 is a diagram illustrating a virtual emergency scenario according to the present invention, FIG. 16 is a diagram illustrating an emergency scenario selected in FIG. 15, FIG. 17 is an exemplary diagram of a terminal screen showing a patient's consciousness checking procedure, and FIG. An illustration of the terminal screen showing the help or emergency request procedure of Figure 19 is an illustration of the terminal screen showing the chest compression step, Figure 20 is an illustration of the terminal screen showing the ventilation phase, Figure 21 is a post-recovery process after recovery Exemplary terminal screen showing the, Figure 22 is an exemplary view of the terminal screen showing the step for the evaluation of first aid.

The cardiopulmonary resuscitation training course may be configured such that one set of chest compression stages and one set of resuscitation stages constitute one set of cardiopulmonary resuscitation stages and may be configured to perform a defined set of cardiopulmonary resuscitation stages within the program. In addition, the chest compression is set in a basic condition that the 'specific range' of the chest within the 'scheduled time' to a 'definite number of times' to a 'definite depth'. In addition, the reference determinations may be configured to be modified through an update of the cardiopulmonary resuscitation training program or to be calibrated in the program or changed through the test subject setting mode in the program. That is, the schedule set, the schedule time, the schedule number, etc. may be configured to be a program update, and the specific range and the appropriate depth may be modified by calibration in the program.

Prior to starting CPR training, the user first sets a human body model to a suitable position for training, and operates a portable terminal 1000 to start a wireless communication setup process for establishing wireless communication with the sensor kit 910. S1410 is performed.

Thereafter, according to the user's operation, the portable terminal 1000 executes the CPR training program, and a virtual scenario (eg, beach shore) provided by the system so that the user can select an emergency scenario (eg, three scenarios). Displays the accident situation, the movement-centered stop situation, and the traffic accident stop situation). This virtual scenario provision screen is shown in FIG. 15. When the user selects one of the virtual scenarios (eg, cardiac arrest in a coastal accident situation on the beach), the portable terminal 1000 outputs the selected virtual scenario screen as shown in FIG. 16 and then describes the virtual scenario. Start training with you. At this time, the portable terminal 1000 provides a description of what emergency situation the user is currently facing and provides a visual image and sound effect so that the user can be immersed in an emergency situation. The above-described processing is the scenario selection process (S1420) of FIG. 14.

When cardiopulmonary resuscitation training is performed according to an emergency according to the selected scenario, first, the portable terminal 1000 instructs a user's awareness procedure of the patient, as shown in FIG. 17. The portable terminal 1000 first voices a method of confirming consciousness. Accordingly, the user checks the patient's consciousness to determine whether the patient's heart is stationary. When the consciousness checking procedure step is completed, the terminal 1000 prepares the next step according to the user's touch input of the 'Next' button.

Secondly, the portable terminal 1000 outputs a screen of help or emergency request procedure of a nearby person, and voices a tutorial of a procedure of first requesting an emergency request or help of a neighbor. The portable terminal 1000 requests a user to report to 911 by pointing a person around through the voice guidance. 18 shows an example of a help or emergency request procedure screen of a neighbor.

The process of performing the above-described consciousness checking process and the help or emergency request procedure of the neighbors is the consciousness checking process of FIG. 14 (S1430).

Third, the chest compression process (S1440) of FIG. 14 is performed to output a result of chest compression by performing a substantial chest compression. First, the portable terminal 1000 instructs the user to compress the chest in time with the beat.

When the user performs chest compressions, as shown in FIG. 11, the pressure intensity displayed by the user through the display unit 1030 is displayed. A guide voice is provided in the background to indicate the compression speed, and the remaining time is displayed by a timer.

If chest compressions are still performed, indicate how many sets are currently in progress and how many compressions remain within the set. The number of counters is increased if the successive chest compressions are met. The red aura around the patient turns green with better cardiopulmonary compression and ventilation. Image feedback and voice feedback are provided at the same time to ensure that the chest compressions are in depth and position. Image feedback is a method in which the depth and position pressed by the operator are displayed on the screen in real time, and voice feedback is a method in which a positive voice feedback is provided for each round when the success is successful, and a negative voice feedback is provided if not.

Alternatively, a method of displaying the chest compression performed by the user in green when the intensity is appropriate, displaying the white color when the compression is insufficient, and displaying the red color when the strength of the compression is too strong may be applied.

Chest compressions are based on the ability to correctly perform a specific range of chests within a certain amount of time and at a suitable depth.A determination of the success of the first round of chest compressions is pressing the right position and the depth of compression within the appropriate standard range If the compression position is not satisfied, it is determined that the turn is not performed correctly even if the compression depth is appropriate. In addition, the number of successive times determined above is determined within a predetermined time, and the cycle for each compression cycle (time required) is determined. Apart from the success cycle, both the chest position and the depth of compression that the operator pressed are stored.

Next, the artificial respiration process S1450 of FIG. 14 is performed. Resuscitation is based on the 'opening of the airways normally' and the 'reference range' of air being 'scheduled' within a certain amount of time. A guide voice is provided in the background to indicate the rate of ventilation and the remaining time is indicated by a timer. The number of counters is incremented if the above-mentioned recurring ventilation success conditions are met. Image feedback and voice feedback are provided at the same time, indicating whether the airway has been opened and the amount of ventilation. Image feedback is a method in which the operator opens the airway and the amount of ventilation is displayed on the screen in real time, and voice feedback is a method in which positive voice feedback is provided for each successive event and negative voice feedback is provided for each successive event.

Specifically, the portable terminal 1000 displays a terminal screen showing the feedback of the chest compression step of FIG. 19 and instructs to perform artificial respiration in accordance with the beat. Together with the chest compressions, the strength of the respiratory pressure in the ventilation step is displayed on the screen 1040 as shown in FIG. 20. When the user leans the neck of the human body to secure the airway, the display unit 1030 indicates that the airway is secured as shown in FIG. 20. The portable terminal 1000 displays green when the respiration intensity is appropriate, white when insufficient, and red when too strong. Ventilation may, for example, be designated to perform a total of two sets, for a total of five sets. In this case, it is indicated in the upper right corner of the screen how many times out of a total of five sets. Since the user cannot see the indicators on the terminal screen 1040 while the ventilation is in progress, an indication of the breathing intensity is displayed around the head as shown in FIG. 20, and a portion of the intensity that should be reached is indicated by a white band. It is desirable to design so that the strength can be intuitively recognized.

The determination of the success of the first ventilation is whether the airway is open or the respiratory volume is within the proper reference range. If the airway is not open, the respiration is not performed correctly even if the respiratory volume is within the proper standard range. I do not think. Ventilation also determines how many successes are within a certain time, determines the cycle of respiratory cycles, and stores both the airway opening and closing and respiratory volume of the practitioner separately from the succession.

When the above chest compression process and the artificial respiration process are completed, the portable terminal 1000 performs the post-processing process (S1460) of FIG. 14, and as shown in FIG. 19, after the patient's consciousness confirmation and CPR completion are completed. Print voice prompts about things.

Next, the portable terminal 1000 performs an analysis and evaluation process (S1470) of FIG. 14 to provide assessment information regarding first aid. The portable terminal 1000 first displays an overall score and then displays a user's achievement for each set of stages. 22 is an exemplary diagram of a terminal screen showing steps relating to evaluating first aid. As shown in FIG. 22, the portable terminal 1000 performs several compressions and respirations by the user for each set, and the thoracic compression position, chest compression depth and cycle, ventilation volume, airway opening and closing, ventilation cycle, Detailed information on the success of ventilation according to the criteria and the number of successes performed by each ventilation set is shown in detail. The program then evaluates the pass if it meets the standard success round (correctable) specified by the program and fails if it does not.

In addition, the portable terminal may provide a user (eg, a trainee) or a third party with csv files or txt files that can be processed by an information management program such as Excel.

In addition, the portable terminal performs the server storage process (S1480) of FIG. 14 for transmitting the CPR training simulation information performed by the trainers to the server 1200 via the communication network 1300 and storing it in the server 1200.

After the server storage process (S1480) is performed, when the user or administrator accesses the server 1200 using his terminal device, the server 1200 is a cardiopulmonary resuscitation training information, including the cardiopulmonary resuscitation training process and results of the user You can check through the connected terminal. The cardiopulmonary resuscitation training information transmitted to the server 1200 is performed by the user several times of compression and breathing for each set of CPR, and each chest compression position, chest compression depth and frequency (time required), preset chest Success or failure of chest compressions based on compression criteria, number of successes performed by chest compression set, number of ventilations per cycle, opening / closing of airway per cycle, ventilation cycle (time required) for each cycle, and artificial Includes information on respiratory success, the number of successes performed by each ventilation set, and whether CPR training passes or fails.

23 is a block diagram showing a cardiopulmonary resuscitation training simulation system according to another embodiment of the present invention.

As shown in FIG. 23, the CPR training simulation system includes a sensor kit 910, a portable terminal 1000, and an eyeglass display 1100. Here, the portable terminal 1000 is connected to the sensor kit 910 and the spectacle display 1100 through wireless communication. In addition, the CPR training simulation system may include the server 1200 of FIG. 10.

The sensor kit 910 detects the first aid of the user applied to the human body 900, and detects (measures) the detected first aid information. Here, the first aid information is chest compression information (compression depth, compression position, compression strength, compression frequency, compression time, etc.), artificial respiration information (breathing strength, breathing frequency, breathing time), airway security (airway opening or airway) Closure), and the like.

The portable terminal 1000 executes a previously installed CPR training program and reproduces and outputs CPR process guide information provided by the CPR training program. In addition, the portable terminal 1000 receives the emergency treatment information for each step according to the CPR process guide information from the sensor kit 910 in real time. The portable terminal 1000 sequentially stores the received first aid information in the memory 1020.

The portable terminal 1000 transmits the CPR process guide information and the received first aid information to the spectacle display 1100 in real time. When the CPR is completed, the portable terminal 1000 analyzes the first aid of the user by using the first aid information stored in the memory 1020 and outputs the analysis result.

The spectacle display 1100 receives data in real time through wireless communication with the portable terminal 1000, reproduces the received data, and displays the received data on the screen.

The spectacle display 1100 is a head mounted display (HMD) that can be worn on the eyes.

The spectacle display 1100 may include an audio output module capable of outputting an audio signal. Therefore, the spectacle display 1100 may output the result of analyzing the CPR process guide information, the received first aid information, and the first aid information as an audio signal.

This embodiment discloses a CPR training system consisting of a sensor kit 910, a portable terminal 1000, and an eyeglass display 1100, where the sensor kit 910 and the portable terminal 1000 are combined or a portable terminal ( 1000 may be implemented by combining the spectacle display 1100.

24 is an exemplary view showing a screen displaying CPR training feedback according to another embodiment of the present invention. This embodiment is for explaining an image coming into the user's field of view when the user wears the spectacle display 1100.

First, the portable terminal 1000 connects the communication with the spectacle display 1100 and executes a CPR training program according to a user command. Thereafter, when the user selects the training mode, the portable terminal 1000 transmits the CPR guide information to the spectacle display 1100. The spectacle display 1100 reproduces the CPR guide information 1110 provided from the portable terminal 1000 and displays it on one side of the screen.

When the user performs the CPR according to the CPR guide information displayed on the screen, the sensor kit 910 measures the user first aid information and transmits it to the spectacle type display 1100 through the portable terminal 1000. The spectacles-type display 1100 receives the first aid information and displays it on the screen. The spectacles-type display 1100 displays the chest compression rate 1120 and the number of chest compressions 1130 included in the emergency treatment information at one end thereof so as not to overlap with the CPR guide information 1110.

18 is an exemplary diagram showing a CPR process using the CPR training simulation system shown in FIG. 17.

As shown in FIG. 18, when the user U finds the patient P, the user U wears the spectacle display 1100 and executes a CPR training program pre-installed on the portable terminal 1000. Then, the portable terminal 1000 executes the CPR training program in the actual mode according to the user command.

The portable terminal 1000 transmits the CPR process guide information (CPR order and method) to the spectacle display 1100, and the spectacle display 1100 receives the CPR process guide information 1110 and displays it on the screen. Accordingly, the user U performs CPR according to the CPR process guide information displayed on the spectacle display 1100.

Also, the spectacle display 1100 displays a user interface 1140. The spectacle display 1100 detects an operation of the user interface 1140 and transmits information corresponding to the operation to the portable terminal 1000 to control the operation of the portable terminal 1000.

The simulation system and apparatus according to one embodiment described with reference to FIGS. 1 to 25 may also be implemented in the form of a recording medium containing computer executable instructions, such as applications or modules executed by a computer. . Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

A module may mean hardware capable of performing functions and operations according to each name described in the specification, and may also mean computer program code capable of performing specific functions and operations. It may also mean an electronic recording medium, eg, a processor, on which computer program code capable of performing specific functions and operations is mounted.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Claims (23)

1. In the CPR simulator,

   A compression information receiver configured to receive a compression intensity and a compression period input from at least one pressure sensor to the at least one pressure sensor;

   An airway information receiver configured to receive whether or not the airway of the dummy is expanded from an on / off switch circuit;

   A flow rate information calculator which receives the bending degree data received from the bend sensor and calculates the flow rate data introduced into the airway; And

   An AR output unit for comparing the received at least one information with at least one reference information through a first projector and outputting the at least one reference information;

   AR-based bidirectional CPR simulator comprising a.
2. The method of claim 1,

   A posture information receiver configured to receive an image photographing at least one depth RGB sensor from a depth RGB camera;

   More,

   And the AR output unit compares the position and angle of the at least one depth RGB sensor with a reference position and a reference angle to output the AR-based bidirectional CPR simulator.
3. The method of claim 2,

   The at least one depth RGB sensor is attached to at least one location of the user,

   Wherein said at least one location is a waist, shoulder, elbow, wrist of said user.
4. The method of claim 1,

   The at least one pressure sensor is mounted at at least one position of the chest of the dummy,

   At least one spring is mounted on an upper surface of the at least one pressure sensor.
5. The method of claim 1,

   The at least one pressure sensor is mounted at at least one position of the chest of the dummy,

   And at least one pressure sensor mounted at the at least one position each has position data to identify the at least one position.
6. The method of claim 1,

   The AR output unit,

   Comparing and outputting the compression intensity input to the at least one pressure sensor and the reference compression intensity information,

   A pressure rate is calculated from a compression period input to the at least one pressure sensor, and the pressure is compared with reference pressure information and output;

   And output a reference compression position based on the compression intensity input to the at least one pressure sensor.
7. The method of claim 1,

   The calculated flow rate data is based on the inclination of the bending sensor which is the bending degree data of the bending sensor,

   The AR output unit,

   AR-based bidirectional CPR simulator to compare and output the calculated flow rate data and the reference flow data required during resuscitation.
8. The method of claim 1,

   The AR output unit,

   Outputting data indicating that the airway is expanded when the airway of the dummy is expanded to output the off state of the on / off switch circuit,

   And outputting data indicating that the airway is closed when the dummy airway is closed and the on / off switch circuit outputs an on state.
9. The method of claim 1,

   The AR output unit,

   AR based interactive CPR simulator for projecting an augmented reality based emergency image through a second projector to reproduce an emergency.
10. The method of claim 9,

    And an area projected by the second projector and an area projected by the first projector form a right angle.
11. In the CPR simulation system,

    At least one pressure sensor installed in the dummy and configured to sense a compression intensity and a compression cycle input thereto;

    An on / off switch circuit for measuring whether the airway of the dummy is expanded;

    A bending sensor for outputting bending degree data to measure flow rate data introduced into the airways of the dummy;

    An AR-based bidirectional CPR simulator for outputting at least one piece of information received from the pressure sensor, the on / off switch circuit and the bending sensor in comparison with reference information; And

    A first projector outputting comparison data received from the AR-based bidirectional CPR simulator device

    AR-based bidirectional CPR simulation system comprising a.
12. The method of claim 11,

    At least one depth RGB sensor;

    A depth RGB camera photographing the at least one depth RGB sensor and outputting a depth image;

    More,

    The AR-based bidirectional CPR simulator apparatus is to compare the output position and the reference position and the reference angle and the position and angle of the at least one depth RGB sensor, AR-based bidirectional CPR simulation system.
13. The method of claim 11,

    A second projector outputting an augmented reality image received from the AR-based bidirectional CPR simulator device;

    More,

    The augmented reality image is an image including an emergency, AR-based bidirectional CPR simulation system.
14. A human model including each part of the human body required for CPR training;

    Sensor kit for universally removable to the human body model, the sensor kit for detecting and collecting various first aid of the user to be performed on the human body for cardiopulmonary resuscitation training;

    Portable to display various guide information according to the emergency situation on the screen and receive and display information on the first aid of the user detected and collected in the sensor kit during CPR training according to the guide information in real time. Terminal

    CPR training simulation system comprising a.
15. The method of claim 14, wherein the human body model,

    Chest compression detection unit for measuring one or more of the intensity of compression, the number of compressions, the compression time applied to the chest of the human model,

    Installed in the human model and the artificial respiration detection unit for measuring the respiratory volume, respiratory strength, respiratory frequency, respiration time when the artificial respiration is performed,

    An airway acquisition detector for detecting whether the human body is secured;

    Compression position detecting unit for detecting the position of the compression applied to the chest of the human model

    CPR training simulation system comprising a.
16. The method of claim 14, wherein the sensor kit

    Compression depth sensing unit for detecting the depth of compression applied to the chest,

    A communication unit performing wireless communication with the portable terminal;

    Including a control unit for controlling the communication unit to transmit one or more of the first aid information measured by the chest compression detection unit, the ventilation detection unit, the airway secured detection unit attached to the human body model,

    CPR training simulation system, characterized in that connected to the chest compression detection unit, ventilation detection unit, airway secured detection unit by wire or wireless.
17. The portable terminal of claim 14, wherein the portable terminal comprises:

    An information receiver for receiving first aid information transmitted from the sensor kit;

    A processing unit for reproducing and outputting the CPR process guide information and analyzing the first aid information and outputting an analysis result of the first aid information;

    A display unit for displaying the CPR process guide information on the screen under the control of the processing unit, and displays the received first aid information

    CPR training simulation system comprising a.
18. The portable terminal of claim 14, wherein the portable terminal comprises:

    Run a CPR training program to establish wireless communication with the sensor kit,

    Select one of the hypothetical emergency scenarios based on user input,

    Outputs a description of the selected emergency and video and sound effects;

    Outputs voice guidance to confirm the consciousness of the patient in the emergency,

    Instructing the chest compression for the patient and receiving first aid information of the user to execute accordingly from the center kit module to display the progress and results of chest compression on the display,

    Instructs the patient about the ventilation and then receives the first aid information of the user to execute according to the sensor kit module to display the progress and results of the ventilation on the screen,

    Thereafter, when the resuscitation procedure is completed, CPR training simulation system, characterized in that to output the image and audio information about the CPR post-processing procedure, and to display the analysis and evaluation of the first aid of the user on the terminal screen.
19. The method of claim 18, wherein the display unit,

    CPR training simulation system, characterized in that implemented by any one of the display device, such as a touch screen, liquid crystal display, light emitter diode (LED) display, glasses display, mobile phone, tablet PC, smart TV, computer.
20. The method of claim 14,

    CPR training simulation system, characterized in that it further comprises a spectacle-type display for receiving the first aid information in real time through the wireless communication with the portable terminal to display on the screen.
21. The method of claim 14,

    Receiving and storing information on the CPR training process from the portable terminal, the server for the user connected via the communication network to check in real time

    CPR training simulation system, characterized in that further comprises.
22. In the portable terminal operating the CPR training simulation,

    Run a CPR training program and set up wireless communication with the sensor kit.

    Wireless communication setup process,

    A scenario selection process of selecting one of virtual emergency scenarios according to a user input;

    A description of the selected emergency situation and a scenario description process of outputting an image and sound effect;

    A consciousness confirmation process for outputting voice guidance for consciousness check of the patient in emergency;

    Chest compression process for instructing the chest compression for the patient, receiving the first aid information of the user to execute accordingly from the sensor kit to display the progress and results of chest compressions on the screen,

    An artificial respiration process for instructing the artificial respiration of the patient and receiving first aid information of the user to be executed accordingly from the sensor kit to display the progress and result of the artificial respiration on the screen;

    After the resuscitation procedure is completed, a post-processing step of outputting image and audio information about the CPR post-processing procedure,

    Analysis and evaluation process of displaying the analysis and evaluation of the user's first aid on the terminal screen

    CPR training simulation operating method characterized in that it comprises a.
23. The method of claim 22,

    The portable terminal transmits the information on the cardiopulmonary resuscitation training course to the server through the communication network, the server storage process for the accessor connected through the communication network to check the user's cardiopulmonary resuscitation training process and results in real time

    CPR training simulation operating method, characterized in that further comprises a.

Images