KR20220052590A - Mobile Assist Device Simulation Method For The Disabled/Elderly Using Virtual Reality - Google Patents

Abstract

One embodiment of the present invention relates to a simulation method performed in a system comprising a server, a head mounted display (HMD) and a motion simulator. The method comprises: a content execution step of providing at least one of safety education content, driving education content, and disaster response content stored in the server to the HMD and motion simulator to execute the content; a manipulation signal reception step of receiving a user manipulation signal provided, by the motion simulator, in correspondence with the provided content; a comparison step of comparing the content and the manipulation signal; a score conversion step of adding a score when a value requested at a specific time point of the content and the manipulation signal match, or subtracting a score when the value does not match the manipulation signal and converting the result into a result score; and a performance result providing step of providing the result score to the HMD. According to the present invention, the simulation method enables a user to learn a method to cope with various disaster situations so as to provide the user with capability to safely cope with a disaster situation.

Description

Mobile Assist Device Simulation Method For The Disabled/Elderly Using Virtual Reality

The present invention relates to a method of simulating a mobility aid device for the disabled/elderly using virtual reality, and the disabled/elderly using virtual reality can receive safety education and driving education through virtual reality using a server, HMD, and motion simulator. It relates to a method for simulating mobility aids.

Recently, in the case of the disabled or the elderly, an electric wheelchair, which is a mobility aid, is widely used. Electric wheelchairs are mainly used outdoors, and the control unit is attached to the armrest, so the user controls the speed and direction with his or her fingers.

Electric wheelchairs are pedestrians, not automobiles, according to the Road Traffic Act. However, there are many users with disabilities or elderly people, so there are many accidents due to lack of safety awareness.

In addition, in case of a fire or earthquake, it is difficult for the disabled or the elderly to respond quickly like the general public, so the fatality rate in disasters is higher than that of the general public.

The simulator for the disabled is disclosed in Korean Patent Registration No. 10-1487228 (driving simulator for the disabled). Korean Patent Registration No. 10-1487228 discloses a driving simulator for car driving practice, in which a panoramic display is installed in the front and a driving image is provided to help perform driving practice like a real vehicle.

However, Korea Patent Registration No. 10-1487228 is a very large and expensive equipment that is manufactured for operation. Therefore, there is a problem that it is difficult to spread. In addition, as the driving simulator is limited to automobiles, a simulation method different from that of the electric wheelchair is used.

The technical problem to be achieved by the present invention is to provide various safety and disaster response contents implemented in virtual reality to the disabled or the elderly user to provide safety education and driving education suitable for the situation. It is to provide a device simulation method.

In addition, another technical task to be achieved by the present invention is the movement of the disabled/elders using virtual reality to provide game-type content so that users can easily receive safety education and driving education for the use of mobility aids such as wheelchairs. It is to provide an assistive device simulation method.

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those of ordinary skill in the art to which the present invention belongs from the description below. There will be.

In order to achieve the above technical object, an embodiment of the present invention is a simulation method performed in a system consisting of a server, a head mounted display (HMD; hereinafter referred to as HMD) and a motion simulator, safety education contents stored in the server, driving education a content execution step of providing at least one of content and disaster response content to the HMD and the motion simulator to execute the content; a manipulation signal receiving step of receiving a user manipulation signal provided from the motion simulator in response to the provided content; A comparison step of comparing the content with the manipulation signal: a score conversion step of adding a score when the value requested at a specific point in time of the content and the manipulation signal match, and subtracting it when they do not match to convert the result into a result score; and providing a result of providing the result score to the HMD.

The method for simulating the mobility assistance device for the disabled/elderly using the virtual reality may further include storing the user's history information, score information, and user information before the step of providing the performance result.

The safety education content may include a selective question, and the server may calculate the score by comparing an answer selected in response to a manipulation signal input from the motion simulator with an answer to the question of the safety education content.

The driving education content may include at least one virtual reality among the classification of roads and sidewalks, uphill driving, downhill driving, and response when the battery is discharged.

The disaster response content may include content on how to respond in case of an earthquake or fire.

According to an embodiment of the present invention, the method of simulating a mobility aid device for the disabled/elderly using virtual reality may help the user during actual driving of the electric wheelchair by performing a simulation through virtual reality before the user drives the electric wheelchair.

In addition, the method for simulating a movement assistance device for the disabled/elderly using virtual reality according to an embodiment of the present invention can be easily recognized by a user by using the contents of a game environment and can improve educational performance.

In addition, the method for simulating mobility aids for the disabled/elderly using virtual reality according to an embodiment of the present invention learns in advance a coping method through contents of various situations such as disaster situations that can occur in real life, and can respond safely when a disaster situation occurs. capabilities can be provided.

It should be understood that the effects of the present invention are not limited to the above-described effects, and include all effects that can be inferred from the configuration of the invention described in the detailed description or claims of the present invention.

1 is a system diagram illustrating a mobile assistance device simulator system for the disabled/elderly using virtual reality according to an embodiment of the present invention.
Fig. 2 is a block diagram showing the configuration of the server shown in Fig. 1;
3 is a flowchart sequentially illustrating a method for simulating a mobility aid device for the disabled/elderly using virtual reality according to an embodiment of the present invention.
4 is a view showing an embodiment of driving education content.

Hereinafter, the present invention will be described with reference to the accompanying drawings. However, the present invention may be embodied in several different forms, and thus is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be “connected (connected, contacted, coupled)” with another part, it is not only “directly connected” but also “indirectly connected” with another member interposed therebetween. "Including cases where In addition, when a part "includes" a certain component, this means that other components may be further provided without excluding other components unless otherwise stated.

The terminology used herein is used only to describe specific embodiments, and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present specification, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a system diagram illustrating a mobility assistance device simulator system for the disabled/elderly using virtual reality according to an embodiment of the present invention, and FIG. 2 is a block diagram illustrating the configuration of the server shown in FIG. 1 .

1 and 2, the motion aid simulator system for the disabled/elderly using virtual reality according to an embodiment of the present invention includes a motion simulator 200, a head mounted display (HMD; hereinafter, HMD) 300 and The server 100 may be included.

Specifically, the motion simulator 200 has a form of an electric wheelchair. At this time, the motion simulator 200 is fixedly installed on the floor. At this time, the rotating body is mounted so that left and right rotation is possible in order to give the user a sense of reality. The motion simulator 200, like an electric wheelchair, is equipped with a manipulation unit so that the user can operate the driving with his or her fingers. The motion simulator 200 performs a left-right direction change in response to a user's driving operation.

The motion simulator 200 generates noise generated during operation when the operation unit is operated. The motion simulator 200 is inclined at an angle suitable for the inclination of the content through the rotatable body.

The motion simulator 200 may cause movement of a predetermined size backward or forward when starting or stopping.

As described above, since the user may feel dizziness when the user sees only the VR screen, the motion simulator 200 may operate the rotating body in a situation similar to the real situation as much as possible.

In this case, the operating range of the motion simulator 200 may be set to 8 degrees roll, 8 degrees pitch, and 30 degrees yaw. However, the operating range of the motion simulator 200 may be changed in consideration of safety.

Since the motion simulator 200 performs forward and backward tilting and left and right rotation in place, it is provided with a safety belt, etc., which is a safety device.

The motion simulator 200 may transmit signals operated by the user to the server 100 in real time.

The HMD 300 is a wearable display device that a user can wear like glasses or goggles. The HMD 300 displays virtual reality content such as AR or VR provided by the server 100 .

The HMD 300 is paired with the motion simulator 200 so that the next screen proceeds in response to a manipulation signal received from the motion simulator 200 while content is being executed.

The server 100 may store content such as safety education content, driving education content, fire action tips content, and evacuation content in case of an earthquake, and execute the selected content. In addition, the server 100 may compare the action input from the motion simulator 200 with the action set in the content and convert it into a score for evaluation. In addition, the server 100 may monitor a user's manipulation and the like when executing content in real time.

As shown in FIG. 2 , the server 100 may include a storage unit 120 , a display unit 130 , a content execution unit 140 , a determination unit 150 , a communication unit 160 , and a control unit 110 . can

The storage unit 120 stores VR content such as safety education content, driving education content, and disaster response content.

For example, safety education content provides video and audio information on check items before and after driving an electric wheelchair, storage methods, safe driving methods, lift boarding tips, response tips in case of an accident, and response tips when the battery is discharged.

In this case, the safety education content may be configured interactively with the user, and may be moved to the next screen according to the user's reaction. For example, after the contents of the battery remaining amount display confirmation are transmitted to the check items before and after driving of the electric wheelchair, it is checked whether the user is aware, and when a signal is received from the operation unit of the motion simulator 200, the next screen is moved. In this way, the user can check and recognize the content.

The driving education content may include guidance through sidewalks, driving requirements when there is no sidewalk, use of crosswalks, guidance on how to move uphill or downhill, and tips for handling in case of electric discharge.

The disaster response content includes content corresponding to a disaster situation, such as content on action tips for fire occurrence and content for evacuation in case of an earthquake.

The content of action tips in case of fire may include an evacuation method and action tips after evacuation.

The display unit 130 may be connected to the server 100 to monitor the situation. The display unit 130 outputs the content in progress by the user, but outputs the same image as the image in progress on the HMD 300 .

Although not shown in FIGS. 1 and 2 , an image captured by a camera (not shown) photographing the outside of the motion simulator 200 is output so that an administrator can monitor it.

The communication unit 160 communicates with the HMD 300 and the motion simulator 200 . For example, the communication unit 160 transmits content to the HMD 300 , and transmits rotation and inclination angle information to the motion simulator 200 .

The content execution unit 140 executes the content to be transmitted by the user. When one is selected from the list of contents stored in the storage unit 120 , the content execution unit 140 transmits it to the HMD 300 and the motion simulator 200 through the communication unit 160 .

The determination unit 150 compares the content being executed with the manipulation signal received from the motion simulator 200 . The determination unit 150 may calculate an evaluation score by scoring the comparison result.

The determination unit 150 compares the contents and the corresponding actions and execution results of various elements for each situation while the driving education contents are being executed. For example, the determination unit 150 compares the operation result for each situation, such as the operation result for using the crosswalk, the operation result when moving uphill, the operation result when moving downhill, and the response result when the battery is discharged, the same as the contents. decide whether to do it properly.

Specifically, when the driving education content execution is a driving situation, the determination unit 150 gives a set score when moving along a driving guideline as a result of a user manipulation. However, points are deducted when an operation result that deviates from the driving guideline is received.

The determination unit 150 may determine pass or fail based on the cumulative score of the driving education content. The determination unit 150 may notify a pass if the set score is obtained, and may terminate content execution after determining a failure if the set score is less than or equal to the set score. In this case, the determination unit 150 may give more weight to driving elements closely related to safety, such as crossing protection driving and driving off the sidewalk, or if an operation error occurs, immediately fail and end content execution.

Although the above example exemplifies the execution of the driving education content, the execution of other contents may also be performed in the same manner as above.

The control unit 110 manages the storage unit 120 , and may transmit content list information stored in the storage unit 120 to the display unit 130 to be displayed upon a user's request. The control unit 110 stores user information for performing the selected content in the storage unit 120 to enable continuous management of the user.

The controller 110 transmits an operation signal to the motion simulator 200 when the content is executed. In this case, the controller 110 may receive a result of performing a user manipulation of the motion simulator 200 to control the motion simulator 200 . Also, when the content is executed, the controller 110 may transmit a control signal for controlling the posture of the motion simulator 200 according to the driving environment information to be displayed on the image.

Meanwhile, the controller 110 may generate an emergency stop signal to stop the operation of the motion simulator 200 for user safety. In the case of the present invention, since it is a device for the disabled or the elderly, an emergency may occur at any time. Accordingly, the controller 110 may stop the motion simulator 200 when an emergency situation occurs and block a signal output to the HMD 300 .

3 is a flowchart sequentially illustrating a method for simulating a movement assistance device for the disabled/elderly using virtual reality according to an embodiment of the present invention, and FIG. 4 is a diagram illustrating an embodiment of driving education contents.

Before describing FIG. 3 , FIG. 3 performs signal transmission, processing, and processing results of respective components of the simulation system of FIG. 1 . Accordingly, the description of FIG. 3 will be mainly described with respect to the functions of the components described with reference to FIGS. 1 and 2 .

Referring to FIG. 3 , the method for simulating a movement assistance device for the disabled/elderly using virtual reality according to an embodiment of the present invention includes a content execution step (S100), a manipulation signal reception step (S200), a comparison step (S400), and score conversion. It may include a step (S500) and a step (S600) of providing an execution result.

Specifically, in the content execution step (S100), at least one of safety education content, driving education content, and disaster response content stored in the server 100 is provided to the HMD 300 and the motion simulator 200 to execute the content. do.

The safety education contents may include check items before and after driving of the electric wheelchair, storage methods, safe driving methods, lift boarding tips, response tips in case of an accident, and response tips when the battery is discharged.

Safety education content may include optional questions. For example, the safety education content may be provided in the form of an optional question along with an image, and when the user transmits an operation signal through the operation unit, it is connected to the next image and the question.

The driving education content may include at least one virtual reality among the classification of roads and sidewalks, uphill driving, downhill driving, and response when the battery is discharged. As shown in FIG. 4 , the driving education content displays a driving line for driving a crosswalk and displays a driving line for driving on a sidewalk.

Disaster response content may include content on how to respond in case of an earthquake or fire.

In case of an earthquake, response contents include: if you are using a wheelchair, move under a door frame or inside a corner, secure the wheelchair and wrap your head with your arms, remove all objects that are not securely fastened to the wheelchair, hide under a hard table or desk, Avoid getting close to exterior walls, windows, stoves and wall-mounted objects; Move to an open space that is not open and wait at that place. If you are stuck in rubble, you can use it in a situation-specific scenario, such as drawing other people’s attention to the confined space, turning on a battery-powered TV or radio, and checking information and instructions for emergencies. content may be included.

In case of fire, response contents are evacuated quickly when fire is recognized through fire warning sounds, announcements, emergency bells, etc., if horizontal movement is possible, evacuate along the evacuation route (in case of vertical movement, evacuate with the help of volunteers), never use an elevator If there is a lot of smoke, cover your nose and mouth with a wet towel, etc. and evacuate in a low position, check the handle with the back of your hand before opening the door, and if it is hot, do not open the door. It may include content according to each situational scenario, such as a rescue request.

In the operation signal receiving step (S200), an operation signal manipulated by the user while viewing the content image is received. For example, when driving the driving road shown in the right drawing of FIG. 4 , the user operates the manipulation unit along the driving line. As for the manipulation signal, all manipulation signals such as when driving along the driving line and when not driving are transmitted to the server 100 .

In addition, the signal transmitted from the operation unit is also transmitted to the HMD 300 to continuously output the next image. (S300)

In the comparison step (S400), the content and the manipulation signal are compared. In the comparison step (S400), an answer to a question provided by the content may be compared with an answer input through a manipulation signal. For example, the safety education content may include a selective question, and the server 100 may compare an answer to the question of the safety education content with an answer selected in response to a manipulation signal input from the motion simulator 200 .

In addition, in the comparison step S400 , as shown in FIG. 4 , it is compared whether the manipulation signal is correctly input in the area indicated by the driving line.

In the point conversion step (S500), if the value requested at a specific time point in the comparison step (S400) and the manipulation signal match, a score is added, and if they do not match, a score is subtracted and converted into a result score.

For example, when a manipulation signal is input to drive the region indicated by the driving line in FIG. 4 , additional points are obtained, and when the operation signal is out of the driving line, a deduction may be given.

In addition, as a result of comparing the answer to the question provided by the content and the answer input through the manipulation signal, if the answer is correct, additional points are obtained, and if the answer is incorrect, points may be given.

In addition, it is possible to give additional points when moving to an educated location in a disaster situation.

In the step of providing the performance result ( S600 ), the result simulated by the user may be provided to the HMD 300 by a method such as a score or other steps.

Meanwhile, in the present invention, data for each user may be stored. For example, it is possible to store history information such as the time, the number of times, and contents used by the user using the simulator, and transmit it to the user terminal as necessary.

Meanwhile, according to an embodiment of the present invention, the simulation can be stopped immediately when an emergency situation occurs at any stage during the simulation. Since the user performing the simulation is a disabled person or an elderly person, there is a high possibility that an emergency situation will occur. Therefore, it is possible to perform constant monitoring as a safety method and to automatically stop the simulation when an emergency situation occurs.

As described above, according to an embodiment of the present invention, the method for simulating a mobility aid device for the disabled/elderly using virtual reality is to perform a simulation through virtual reality before the user drives the electric wheelchair to provide assistance in actual electric wheelchair driving. can give

In addition, the method for simulating a movement assistance device for the disabled/elderly using virtual reality according to an embodiment of the present invention can be easily recognized by a user by using the contents of a game environment and can improve educational performance.

In addition, the method for simulating mobility aids for the disabled/elderly using virtual reality according to an embodiment of the present invention learns in advance a coping method through contents of various situations such as disaster situations that can occur in real life, and can respond safely when a disaster situation occurs. capabilities can be provided.

The description of the present invention described above is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention.

100: server
110: control unit
120: storage
130: display unit
140: content execution unit
150: judgment unit
160: communication department
200: motion simulator
300: HMD (Head Mounted Display)

Claims (5)

A simulation method performed in a system consisting of a server, a Head Mounted Display (hereinafter referred to as HMD) and a motion simulator,
a content execution step of providing at least one of safety education content, driving education content, and disaster response content stored in a server to the HMD and the motion simulator to execute the content;
a manipulation signal receiving step of receiving a user manipulation signal provided from the motion simulator according to the provided content;
A comparison step of comparing the content with the manipulation signal:
a score conversion step of adding a score when the value requested at a specific point in time of the content and the manipulation signal match, and subtracting a score when they do not match and converting the result into a result score; and
A method of simulating a movement assistance device for the disabled/elder using virtual reality, comprising the step of providing a result of providing the result score to the HMD.
The method of claim 1,
Before the step of providing the performance result
The method of simulating a movement assistance device for the disabled/elderly using virtual reality further comprising the step of storing the user's history information, score information, and user information.
The method of claim 1,
The safety education content includes optional questions,
The server compares the answer selected in response to the operation signal input from the motion simulator with the answer to the question of the safety education content, and calculates the score by using virtual reality.
The method of claim 1,
The driving education content is a method for simulating a movement assistance device for the disabled/elderly using virtual reality including at least one virtual reality of classification of roads and sidewalks, uphill driving, downhill driving, and response when the battery is discharged.
The method of claim 1,
The disaster situation response content is a method of simulating a movement assistance device for the disabled/elderly using virtual reality, including content on how to respond in case of an earthquake or fire.

Images