KR102001012B1 - Apparatus and method for preventing falling accidents of patients based on a Virtual Reality - Google Patents

Abstract

The present invention relates to a virtual reality-based patient fall prevention patient education apparatus and method, which is worn on the patient's head, and reproduces the fall prevention content in a VR (Virtual Reality) method and at the same time obtain and provide patient gaze information A head mounted display (HMD); And a controller configured to recognize a patient's behavior based on the patient's gaze information, to perform a comparative analysis with a behavior guide corresponding to a playback result of the fall prevention content, and to control contents provision in real time according to the comparison analysis result. have.

Description

Apparatus and method for preventing falling accidents of patients based on a Virtual Reality}

The present invention relates to a virtual reality-based patient fall prevention patient education apparatus and method for performing a patient education for the fall accident prevention using virtual reality technology.

As fall accidents frequently occur in hospitals, many hospitals in Korea have established regulations for the prevention of falls and educated patients.

For example, as shown in FIG. 1, efforts are made to prevent falling by continuing prevention education, announcements, patient caregiver monitoring, promotional video production, quarterly monitoring and performance management, information sharing, and departmental education.

In addition, as in Korean Patent Application Publication No. 10-2017-0084793, the fall prevention structure is additionally installed in various devices in the hospital, thereby minimizing the occurrence of a fall accident of the patient.

However, the fall prevention education has been continuously conducted for the purpose of improving the quality of the hospital, but there is a problem that requires much effort and time and cost of medical personnel and assistants in order to expect the educational effect.

1.Korean Patent Publication No. 10-2017-0084793 (published Jul. 21, 2017) 2. Domestic Patent No. 10-1645617 (registered July 29, 2016)

In order to solve the problems as described above, the present invention is a virtual reality-based patient training device for preventing the fall of patients using a virtual reality technology to perform the patient education for the prevention of falls without separate intervention and To provide a method.

In addition, to provide a patient education apparatus and method for preventing the fall of the patient based on virtual reality to enable the patient education in consideration of the training skill of the patient.

In addition, the present invention aims to provide a virtual reality-based patient training device and method for the medical staff to monitor the patient's training results more easily.

The object of the present invention is not limited to the above-mentioned object, and other objects which are not mentioned will be clearly understood by those skilled in the art from the following description.

As a means for solving the above problems, according to an embodiment of the present invention, the HMD (WMD) that is worn on the patient's head, reproduces the fall prevention content in a VR (Virtual Reality) method, and simultaneously acquires and provides patient gaze information in real time. Head Mounted Display); And a controller configured to recognize a patient's behavior based on the patient's gaze information, compare and analyze the action guide corresponding to the playback result of the fall prevention content, and control the contents provision in real time according to the comparison analysis result. Provide patient education device for prevention of reality-based fall accidents.

The fall prevention content may include at least one of a VR image, behavior guide information, body representation information, and difficulty information.

The controller may be configured to repeatedly play the fall prevention content corresponding to the detected situation when the situation in which the match between the behavior guideline and the patient's behavior is equal to or less than a preset value is detected.

The control unit may adjust training difficulty according to the degree of agreement between the behavior guideline and the patient behavior, and selectively reproduce only the fall prevention content corresponding to the adjusted training difficulty.

In addition, the control unit may further include a function of comparing and analyzing the behavior guideline and the patient behavior, and generating and providing the patient training result information to an external device according to the comparison analysis result.

And the apparatus further comprises a plurality of actuators distributed over the body of the patient and driven by the body representation information.

As a means for solving the above problems, according to another embodiment of the present invention, the step of detecting the patient's gaze while playing the fall prevention content through the head mounted display (HMD) worn on the patient's head; Recognizing the patient's behavior based on the patient's gaze; And comparing and analyzing the behavioral guidelines corresponding to the playback results of the fall prevention content and the patient's behavior, and controlling contents providing contents in real time according to the comparison analysis result. to provide.

The controlling of the content providing contents in real time may include replaying the fall prevention content corresponding to the detected situation when a situation in which a match degree between the behavior guideline and the patient behavior is detected is equal to or less than a preset value is detected.

In addition, the step of real-time control of the content providing content is characterized in that to adjust the training difficulty in accordance with the degree of agreement between the behavior guidelines and the patient behavior, and selectively reproduce only the fall prevention content corresponding to the adjusted training difficulty.

The method may further include comparing and analyzing the behavior guideline and the patient behavior, and generating and providing patient training result information to an external device according to the comparison analysis result.

The virtual reality-based patient fall prevention patient education apparatus and method to perform the patient education for the fall prevention prevention by using a virtual reality technology, so that the patient can have a sense of immersion as if in a real situation. This maximizes the patient's immersion and interest, thereby maximizing the effectiveness of training education. It also eliminates the need for medical intervention, minimizing staffing and costs for patient education.

In addition, by repeatedly training the specific fall prevention content in consideration of the training skill of the patient or varying the difficulty of providing the fall prevention content, the training effect and patient interest can be maximized.

In addition, by obtaining objective information on the patient's training results and providing it to the medical staff, the ease of patient management can be maximized.

1 is a view showing an example of the fall prevention patient training method according to the prior art.
2 is a diagram illustrating a virtual reality-based fall prevention patient education apparatus according to an embodiment of the present invention.
3 is a diagram showing an example of the configuration of the fall prevention content according to an embodiment of the present invention.
4 is a diagram illustrating an implementation example of a VR image according to an embodiment of the present invention.
5 is a view for explaining a virtual reality-based fall prevention patient training method according to an embodiment of the present invention.
6 is a view for explaining a virtual reality-based fall prevention patient training method according to another embodiment of the present invention.

The objects and effects of the present invention and the technical configurations for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. In describing the present invention, when it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

Terms to be described later are terms defined in consideration of functions in the present invention, and may vary according to the intention or custom of a patient or an operator.

However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. The present embodiments are merely provided to complete the disclosure of the present invention and to fully inform the scope of the invention to those skilled in the art, and the present invention is defined by the scope of the claims. It will be. Therefore, the definition should be made based on the contents throughout the specification.

2 is a diagram illustrating a virtual reality-based fall prevention patient education apparatus according to an embodiment of the present invention.

Referring to FIG. 2, an apparatus of the present invention may include a content storage unit 10, a head mounted display (HMD) 20, a control unit 30, a communication unit 40, and the like.

The content storage unit 10 stores at least one fall prevention content for fall prevention patient education.

Fall prevention content of the present invention may include a VR image and behavior guidance information. In this case, the VR image may be an image obtained by 3D modeling a place corresponding to a fall accident scenario and various articles, and programming such that an HMD such as an oculus lift or a vibe can be reproduced. Fall accident scenarios can consist of a number of situations, and behavioral guidance information defines a set of actions that a patient should take in each situation.

In addition, if necessary, it may further include difficulty information defining the difficulty of training each of the plurality of situations constituting the fall accident scenario, tactile sensation and force applied directly to the patient's body, and body reproducing information defined by each fall accident situation. have.

The HMD 20 is worn on the patient's head to reproduce the VR image of the fall prevention content in a VR (Virtual Reality) manner. In addition, the patient gaze detection and tracking to obtain and provide the patient gaze information.

The controller 30 may recognize and monitor patient behavior based on patient gaze information provided by the HMD 20 while reproducing the fall prevention content through the HMD 20. In addition, the behavior guidance corresponding to the playback result of the fall prevention content and the patient's behavior are compared and analyzed, and the content playback content is controlled in real time according to the comparison analysis result.

For example, if a situation in which a match between a behavioral guideline and a patient's behavior is detected is less than a preset value is detected, the fall prevention content corresponding to the situation is repeatedly played, so that the patient can fully understand how to cope with the situation.

In addition, the content difficulty is adjusted according to the degree of agreement between the behavior guideline and the patient's behavior, and the rehabilitation training according to the patient's ability can be performed by selecting and providing only the fall prevention content of the playback section corresponding to the adjusted content difficulty. .

In addition, the control unit 30 of the present invention collects and analyzes the degree of agreement between the behavior guideline and the patient's behavior to identify the patient training result, and provide the patient training result to an external device such as a medical staff terminal through the communication unit 40. do. In this case, the patient training result information, information on the situation in which the patient has completed training, may include information about the patient skill of each situation, the number of times of playing the content for each situation.

In addition, if necessary, the present invention further includes a plurality of actuators 50 distributed over the patient's body and driven by body representation information, as shown in FIG. It is also possible to apply force and movement to the patient's body. That is, by reproducing the situation corresponding to the fall accident scenario not only by the audiovisual method but also by the tactile method, the patient's immersion can be further improved.

4 is a diagram illustrating screen display examples of the HMD according to an embodiment of the present invention.

As described above, the fall prevention content of the present invention may include VR image and action guide information.

As shown in (a) to (e) of FIG. 4, the HMD 20 displays images, letters, and the like corresponding to the behavioral guidance information on the VR image (the sound is output through the speaker). Makes it easier to recognize information about action guidelines to be performed in the current situation and to perform corresponding actions.

For example, the fall accident scenario of the present invention may be as follows.

#One. Sickroom scenario

Situation 1:

"Hello, this virtual reality is a training program to prevent fall accidents, please follow the instructions of the patient. First, please check the fixed wheel on the bottom of the bed.

-> Action Instructions: Check the fixed wheel at the bottom of the bed

Situation 2:

"This time, let's go to bed. From which part of your body should you put on bed?"

-> Action Instructions: Ass Check

① Foot> "You have selected the wrong one. If you put your foot on the bed, you may slip and fall."

② Knee> "You have selected the wrong one. If you put your knees on the bed, you may slip and fall."

③ Ass> "You have selected correctly. When you go to bed, you can raise your ass to prevent falls."

Situation 3:

"Move to the inside of the bed to prevent it from falling out, stretch your legs and raise the bed railing. Check the red emergency call button on the wall on your head and press it by hand."

-> Action Guide: Check the red emergency call button on the head wall.

Situation 4: "Next, please lower the bed railing to get out of bed. When you get out of bed, do not stand up immediately and sit down from the feet to the ground. Do not step on the guardian's bed. Come down."

-> Behavioral Instructions: Showing Feet in the Ground

Situation 5: "Please be careful. Guardians can slip if they step on the bed. Toil prevention. To prevent the fall of the sickroom, make sure that the bed wheels are locked before going to bed, and then put on the bed from the buttocks to the bed. When you get out of bed, you have to lower the bed railing and lower your guardian's bed from the feet to the ground in case of an emergency.In case of emergency, press the red emergency call button located on the wall. Well done, and wish you a safe hospital life. "

#2. Toilet scenario

Situation 1: "Hi, this is a training program to prevent fall accidents. Please follow the instructions of the patient. First of all, check the floor of the toilet for water and make sure your shoes are tight."

-> Behavioral Instructions: Show Shoes

Situation 2: "Walk down to the toilet, lower your pants, grab the safety bar on the wall, and sit on the toilet."

-> Action Guidelines: View Safety Rods

Situation 3: "Check the red emergency call button on the wall and press it with your hand."

-> Instructions for Action: Red Emergency Call Button

Situation 4: "After a bowel movement or urination, rest for a while, then get up again with a safety stick."

-> Action Guidelines: View Safety Rods

Situation 5: "Raise your pants, check your shoes, take a break and come out to the door."

-> Action Guidelines: After seeing your shoes, see the door

Situation 6: "Good job. To prevent a toilet fall, you should check your floor for dryness and make sure your shoes are tight before entering the toilet. After checking, walk down to the toilet, lower your pants and grab the wall Sit slowly in the toilet, grab the safety bar on the wall and stand up, as if you were sitting after defecation or urination, raise your pants, check your shoes, rest for a while, and exit the door in case of an emergency. You have completed the Fall Prevention Program and wish you a safe hospital life. "

Hereinafter, with reference to FIGS. 5 and 6, the virtual reality-based fall prevention patient education methods will be described.

5 is a view for explaining a virtual reality-based fall prevention patient training method according to an embodiment of the present invention.

When the fall prevention patient education is requested by the patient or medical staff, the controller 30 starts playing the fall prevention content through the HMD 20 (S11).

In addition, the patient's gaze is identified through the HMD 20, and the user's current action is inferred therefrom (S12).

The degree of agreement between the patient's behavior and the action guide corresponding to the current situation is calculated (S13).

If the degree of coincidence calculated in step S13 is lower than the preset value, it is determined that the patient has not sufficiently understood the countermeasures for the situation (S14), and the patient repeatedly plays the fall prevention content corresponding to the current situation. To fully understand how to cope with the situation (S15).

On the other hand, if the coincidence calculated through the step S13 is higher than the preset value, it is determined that the patient has fully understood the countermeasures for the situation (S14), and by playing the fall prevention content corresponding to the next situation, the patient is prevented from falling In order to be able to sequentially understand all the ways to deal with the situation contained in the content (S16).

As such, the present invention does not unilaterally provide fall prevention contents, but monitors whether there is a situation in which the patient does not fully understand the countermeasures and adjusts the contents providing contents. The patient should be fully aware of all the countermeasures.

In addition, the present invention allows the patient to perform rehabilitation training according to his or her level by varying the contents provided in consideration of the training skill of the patient as shown in FIG. 6.

6 is a view for explaining a virtual reality-based fall prevention patient training method according to another embodiment of the present invention.

When the fall prevention patient education is requested, the controller 30 preferentially provides only the fall prevention content having the lowest training difficulty (S21).

In addition, the patient's gaze is inferred based on the patient's behavior (S22), and compared with the behavior guideline to determine the training skill of the patient (S23). For example, if the patient's behavior and behavior guidelines match more than a predetermined value, it may be determined that the patient's training proficiency is greater than or equal to the current difficulty level.

If it is confirmed through the step S23 that the training skill level is more than the current difficulty level (S24), after raising the training level by one level (S25), only fall prevention content corresponding to the adjusted training difficulty is selected and reproduced (S26).

On the other hand, if the training proficiency is lower than the current difficulty (S24), the fall prevention content corresponding to the current training difficulty to continue to play (S27).

In this case, the fall prevention content corresponding to the current training difficulty may be adjusted in a situational unit or in a scenario unit. That is, according to the patient skill, the situation experienced by the patient in the same scenario may be adjusted, or the scenario itself may be different.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

Claims (10)

A head mounted display (HMD) that is worn on a patient's head and simultaneously acquires and provides patient gaze information while playing fall prevention content in a VR (Virtual Reality) method; And
And a controller for recognizing patient behavior based on the patient gaze information, comparing and analyzing the behavioral instructions corresponding to the playback result of the fall prevention content, and controlling contents provision in real time according to the comparative analysis result.
The control unit
The behavioral guidance guides the object to be looked at by the patient in each situation, and then confirms whether the patient's behavior meets the behavioral guidance by checking the patient's eye information to see if the patient is looking at the guided object. Virtual reality-based fall accident patient education device characterized in that. The method of claim 1, wherein the fall prevention content
Virtual reality-based fall accident prevention patient education device comprising at least one of the VR image, behavior guidance information, body representation information, and difficulty information. The method of claim 1, wherein the control unit
And detecting a fall prevention content corresponding to the detected situation by repeatedly reproducing the fall prevention content corresponding to the detected situation when the situation in which the match between the behavior guide and the patient's behavior is equal to or less than a predetermined value is detected. The method of claim 1, wherein the control unit
Adjusting the training difficulty according to the behavioral guidance and the degree of matching the patient behavior, Virtual reality-based fall accident prevention patient education device, characterized in that for selectively playing only fall prevention content corresponding to the adjusted training difficulty. The method of claim 1, wherein the control unit
Comparing and analyzing the behavior guideline and the patient behavior, and further comprising the function of generating the patient training result information according to the result of the comparative analysis and providing to the external device, virtual reality-based fall accident prevention patient education Device. The method of claim 2,
The virtual reality-based fall accident prevention patient education apparatus further comprises a plurality of actuators distributed to the patient body driven by the body reproduction information. Detecting a patient's gaze at the same time as playing the fall prevention content through a head mounted display (HMD) worn on the patient's head;
Recognizing the patient's behavior based on the patient's gaze; And
Comparing and analyzing the behavior guidance and patient behavior corresponding to the playback result of the fall prevention content, and real-time control of the content providing content according to the comparison analysis result,
The step of controlling the content providing content in real time
Virtual reality characterized in that it is determined whether the patient's behavior meets the behavior guidelines by confirming that the object in the image guided by the behavior guide and the object in the image viewed by the patient identified through the patient's gaze information match. -Based patient training for fall accident prevention. The method of claim 7, wherein the controlling of the content providing content in real time
And detecting a fall prevention content corresponding to the detected situation by repeating playback of the fall prevention content corresponding to the detected situation when the situation in which the behavior guideline and the patient's behavior match the predetermined value is detected. The method of claim 7, wherein the controlling of the content providing content in real time
Adjusting the training difficulty according to the behavioral guidance and the patient's degree of agreement, and virtually based fall training prevention patient education method, characterized in that for playing only fall prevention content corresponding to the adjusted training difficulty. The method of claim 7, wherein
Comparing and analyzing the behavior guideline and the patient behavior, and generating the patient training result information according to the result of the comparative analysis and providing to the external device to the virtual reality-based fall accident prevention patient education Way.

Images