JP6531338B1 - Rehabilitation support device, rehabilitation support system, rehabilitation support method and rehabilitation support program - Google Patents

Abstract

To provide a comfortable rehabilitation for a user. According to one embodiment, a rehabilitation support apparatus includes: a detection unit that detects a head orientation of a user wearing a head mount display; and a target object for rehabilitation that the user visually recognizes in the virtual space. And a second display for displaying a notification image for notifying the position of the target object on the head mount display according to the orientation of the head of the user detected in And a control unit. [Selected figure] Figure 1

Description

  The present invention relates to a rehabilitation support device, a rehabilitation support system, a rehabilitation support method, and a rehabilitation support program.

  In the above technical field, Patent Document 1 discloses a system for supporting rehabilitation performed for hemiplegic patients due to stroke and the like.

JP, 2015-228957, A

Nichols S, Patel H: Health and safety implications of virtual reality: a review of empirical evidence. Appl Ergon 2002; 33: 251-271

  However, in the technique described in the above document, the display device mounted on the head narrows the field of view of the user. Specifically, the field of view, which was about 180 degrees before mounting the display device, narrows to about 110 degrees.

In that case, what was visible without having to turn the neck before wearing the display device can not be seen without having to turn the neck. As a result, a divergence may occur between visual information and inner ear information as an input stimulus of a sense of balance possessed by a person, and the user may feel sick like so-called car sickness. A phenomenon in which a difference between visual information and inner ear information occurs due to wearing a display device with a limited viewing angle as described above is medically called a sensory conflict.
For example, when a person encounters an earthquake in a situation where there is nothing around, there is no change in the ground or background as "visual information", and the input from vision becomes information "not moving". On the other hand, in "inner ear information", information for clearly detecting shaking is obtained, and the input from the inner ear is information that "moving". This is the mechanism by which sensory conflict makes you feel sick, and this phenomenon is well known as Post Earthquake Dizziness Syndrome (PEDS).

  Also because children and children are prone to motion sickness, although the input from the inner ear feels "movement", the information from the vision is erroneously input as "not moving" due to the narrow vision. It is presumed that the cause is a sensory conflict. In this case, it is well known that motion sickness can be prevented by looking out the window, but this is a device to ensure that the input information from the vision is correctly obtained, and as a result, the visual information matches the inner ear information Let's prevent the sensory conflict. Also, for example, seeing the next destination landscape from the top of the vehicle is a method often used as a method for preventing motion sickness. This is a device to prevent sensory conflict by predicting changes in inner ear information to be obtained next from visual information in advance, and furthermore, as in the case of getting used to seasickness etc., sensory conflict is repeatedly the same. It is thought that this is a phenomenon that can be learned and prevented by experiencing conditions.

  In other words, sensory conflict can be prevented by predicting (or learning) input information to be obtained in the future.

  In recent years, wearing a display device (HMD) with a limited field of view causes a discrepancy between visual information and inner ear information, which disturbs the sense of balance and causes a problem of feeling sick (VR sickness). Since the visual field is limited, it is known that the sensory information and the inner ear information obtained in the usual sense are input differently, resulting in the occurrence of sensory conflict (Non-patent Document 1).

  An object of the present invention is to provide a technique for solving the above-mentioned problems.

In order to achieve the above object, the rehabilitation support device according to the present invention is:
A detection unit that detects the direction of the head of the user wearing the head mounted display;
A first display control unit that generates a target object for rehabilitation to be visually recognized by the user in a virtual space, and displays the target object on the head mounted display according to the orientation of the head of the user detected by the detection unit;
A second display control unit configured to display a notification image for notifying the position of the target object on the head mount display;
Equipped.

In order to achieve the above object, the rehabilitation support system according to the present invention is
A head mounted display,
A sensor for detecting a user's movement;
A rehabilitation support device that exchanges information between the head mounted display and the sensor;
Rehabilitation support system equipped with
The rehabilitation support device is
A first display control unit that generates a target object to be visually recognized by the user in the virtual space and displays the target object on a head mounted display worn by the user;
A second display control unit configured to display a notification image for notifying the position of the target object on the head mount display;
An evaluation unit that evaluates the ability of the user by comparing the movement of the user captured by the sensor with the target position represented by the target object;
Equipped.

In order to achieve the above object, a rehabilitation support method according to the present invention is:
A detection step of detecting the direction of the head of the user wearing the head mounted display;
A first display control step of generating a target object for rehabilitation to be visually recognized by the user in a virtual space and displaying the target object on the head mounted display according to the orientation of the head of the user detected by the detection unit;
A second display control step of displaying a notification image for notifying the position of the target object on the head mounted display;
including.

In order to achieve the above object, a rehabilitation support program according to the present invention is:
A detection step of detecting the direction of the head of the user wearing the head mounted display;
A first display control step of generating a target object for rehabilitation to be visually recognized by the user in a virtual space and displaying the target object on the head mounted display according to the orientation of the head of the user detected by the detection unit;
A second display control step of displaying a notification image for notifying the position of the target object on the head mounted display;
On a computer.

  According to the present invention, it is possible to provide comfortable rehabilitation for the user.

It is a block diagram showing composition of a rehabilitation support system concerning a 1st embodiment of the present invention. It is a block diagram showing composition of a rehabilitation support system concerning a 2nd embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of a display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a flowchart which shows the flow of a process of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the example of another display screen of the rehabilitation assistance system which concerns on 2nd Embodiment. It is a figure which shows the operation screen example of the rehabilitation assistance system which concerns on 3rd Embodiment. It is a figure which shows the example of another operation screen of the rehabilitation assistance system which concerns on 3rd Embodiment. It is a figure which shows the example of another operation screen of the rehabilitation assistance system which concerns on 3rd Embodiment.

  Hereinafter, embodiments of the present invention will be exemplarily described in detail with reference to the drawings. However, the component described in the following embodiment is an illustration to the last, and it is not a thing of the meaning which limits the technical scope of this invention only to them.

First Embodiment
A rehabilitation support system 100 as a first embodiment of the present invention will be described using FIG. The rehabilitation support system 100 is a system that supports the rehabilitation performed for the user 110.

  As shown in FIG. 1, the rehabilitation support system 100 includes a detection unit 101 and display control units 102 and 103.

  The detection unit 101 detects the orientation of the head of the user 110 wearing the head mounted display 111.

  The display control unit 102 generates a target object 122 for rehabilitation to be visually recognized by the user 110 in the virtual space, and causes the head mount display 111 to display the target object 122 according to the head orientation of the user 110 detected by the detection unit 101. The display control unit 103 causes the head mounted display 111 to display a notification image 131 for notifying the position of the target object 122.

  According to the present embodiment, by displaying the notification image on the screen, it is possible to predict in advance the change of the inner ear information to be obtained next from the visual information and prevent the sensory conflict.

Second Embodiment
A rehabilitation support system 200 according to a second embodiment of the present invention will be described with reference to FIG. FIG. 2 is a diagram for explaining the configuration of the rehabilitation support system 200 according to the present embodiment.

  As shown in FIG. 2, the rehabilitation support system 200 includes a rehabilitation support apparatus 210, two base stations 231 and 232, a head mounted display 233, and two controllers 234 and 235. While sitting on the chair 221, the user 220 performs a rehabilitation operation by twisting or stretching the upper body in accordance with the display on the head mounted display 233. Although this embodiment is described on the premise of rehabilitation sitting on a chair, the present invention is not limited to this.

  The two base stations 231, 232 detect the movement of the head mounted display 233 and the movement of the controllers 234, 235 and send them to the rehabilitation support device 210. The rehabilitation support device 210 performs display control of the head mounted display 233 while evaluating the rehabilitation operation of the user 220.

  The head mounted display 233 may be a non-transmissive type, a video see-through type, or an optical see-through type.

  In the present embodiment, the controller 234, 235 held by the user 220 and the base stations 231, 232 are shown as an example of a sensor for detecting the position of the user's hand, but the present invention is limited to this. It is not a thing. Camera (including depth sensor) for detecting the position of the user's hand by image processing, sensor for detecting the position of the user's hand according to temperature, watch-like wearable terminal worn on the user's arm, etc., motion Capture and the like are also included in the sensor concept of the present invention.

  The rehabilitation support device 210 includes a motion detection unit 211, display control units 212 and 213, an evaluation unit 214, an update unit 215, a task set database 216, and an operation unit 217.

  The motion detection unit 211 acquires the positions of the controllers 234 and 235 held by the user 220 through the base stations 231 and 232, and detects a rehabilitation motion of the user 220 based on a change in the position of the hand of the user 220.

  The display control unit 212 generates an avatar object 241 that moves according to the detected rehabilitation operation and a target object 242 that indicates the target of the rehabilitation operation in the virtual space. Then, the images of the avatar object 241 and the target object 242 are displayed on the display screen 240 according to the direction and position of the head mounted display 233 detected by the operation detection unit 211. The images of the avatar object 241 and the target object 242 are superimposed and displayed on the background image 243. Here, the avatar object 241 has the same shape as the controllers 234 and 235, but is not limited thereto. The avatar object 241 moves in the display screen 240 in accordance with the movement of the controllers 234 and 235. As displayed in the avatar object 241, buttons are prepared in the controllers 234 and 235, and various setting operations can be performed. The background image 243 includes a horizon 244 and a ground surface image 245.

  The display control unit 212 gradually changes the display position and the size and displays the target object 242 as it descends from the overhead direction of the user 220 downward. The user 220 moves the controllers 234 and 235 to bring the avatar object 241 on the screen closer to the target object 242. When a sensor object (not shown here) included in the avatar object 241 collides with the target object 242, the target object 242 disappears.

  The display control unit 213 further causes the radar screen image 250 to be displayed on the display screen 240 of the head mounted display 233. The radar screen image 250 is relative to the target direction of the target object 242 with respect to the reference direction in the virtual space (here, it is initially set to be the front direction of the user sitting straight on a chair) Indicates the direction of

  The display control unit 213 displays the radar screen image 250 on the central portion (for example, within the range of −50 degrees to 50 degrees) of the display screen 240 of the head mounted display 233 regardless of the orientation of the head of the user 220.

  The radar screen image 250 includes a head image 251 representing the user's head as viewed from above, a block image 252 obtained by dividing the periphery of the head image 251 into a plurality of blocks, and a fan shape as a viewing area image showing the viewing area of the user. And an image 253. The target position image indicating the position of the target object is indicated by which block of the block image 252 is colored. This allows the user 220 to know whether there is a target object on the left side or a target object on the right side with respect to the direction in which the user is facing. In the present embodiment, the block image 252 is fixed and the fan-shaped image 253 moves, but the present invention is not limited to this, and the fan-shaped image 253 and the head image 251 are fixed. , Block image 252 may be moved according to the orientation of the head. Specifically, the block image 252 may rotate to the right if the head is directed to the left.

  The evaluation unit 214 evaluates the rehabilitation ability of the user 220 by comparing the rehabilitation operation detected by the operation detection unit 211 with the target position represented by the target object displayed by the display control unit 212. Specifically, whether or not the avatar object 241 moving in response to the rehabilitation operation detected by the operation detection unit 211 and the target object 242 overlap is determined by comparing the position in the three-dimensional virtual space.

  If these overlap, it is evaluated that one rehabilitation operation has been cleared, and points are added. The display control unit 212 can cause the target object 242 to appear at different positions (for example, three levels) in the depth direction. The evaluation units 214 respectively give different points (high points for distant objects, low points for near objects).

  The updating unit 215 updates the target task according to the accumulated points. For example, the target task may be updated using the task achievement rate (the number of goals achieved / the number of tasks) or the like.

  The task set database 216 stores a plurality of sets of tasks. The task indicates one rehabilitation operation to be performed by the user. Specifically, as information representing one task, at what position and at what speed, what size of target object appeared and at that time, what size of avatar object was, etc. It is stored. The task set database 216 stores a task set that determines in which order the plurality of tasks are provided to the user.

  For example, a task set may be stored as a template for each hospital, or a history of executed task sets may be stored for each user. The rehabilitation support device 210 may be configured to be able to communicate with other rehabilitation support devices via the Internet, in which case one task set can be performed by the same user at multiple locations, and so on. Templates can also be shared among multiple remote users.

  The operation unit 217 is provided to operate display control in the display control unit 212 and the display control unit 213. Specifically, the operation unit 217 displays the operation screen 300 for the operator as shown in FIGS. 3A to 3G. Here, the display for displaying the setting screen may be an external display connected to the rehabilitation support apparatus 210, or may be a display built in the rehabilitation support apparatus 210, regardless of the device. The operation screen 300 includes a user view screen 301, various parameter setting screens 302, a score display screen 303, a pause button 304, a recenter button 305, and an end button 307. Although FIGS. 3A to 3G include an area 306 representing the appearance of the actual user 220 for the sake of explanation, the operation screen 300 need not include the area 306.

  The user view screen 301 displays an image actually displayed on the head mounted display 233. In the user view screen 301, a reference direction 311 in the virtual space is displayed. As described in FIG. 2, the radar screen image 250 is displayed on the central portion (for example, a viewing angle range of −50 degrees to 50 degrees) of the user visual field screen 301. Then, the position of the target object 242 appearing next indicates which direction is relative to the reference direction in the virtual space. In this example, the colored position of the block image 252 indicates that the target object 242 appears at the farthest position in the left direction with respect to the reference direction 311 in the virtual space. Then, according to the position of the fan-shaped image 253 and the orientation of the head image 251, it can be known that the user has already turned to the left.

  The various parameter setting screen 302 is a screen for setting a plurality of parameters defining a task. The operation unit 217 receives an input to the various parameter setting screen 302 from an input device (not shown). The input device may be a mouse, a keyboard, or a touch panel, regardless of its technical configuration.

  In the various parameter setting screen 302, an input area 321 for determining the size of the left and right target objects, an input area 322 for determining the size of the avatar object 241, an input area 323 for determining the drop speed of the target object, and a target appearing next And an input area 324 for determining the position of the object. Further, there is a check box 325 for setting whether to accept the operation of the appearance position of the target object by the hot key.

  In each of the right and left, the input area 321 includes the radius of the visual object (visual size) for making the user easily see the position of the target object, and the radius of the target object that reacts with the avatar object 241 (evaluation size). It can be set. That is, in the example of FIG. 3A, the user sees a ball with a radius of 20 cm, but the task is not completed unless the ball with a radius of 10 cm located at the center of the ball is actually touched. The smaller the view size, the harder it is for the user to find the target object. Increasing the visual size makes it easier for the user to find the target object. If the evaluation size is increased, the allowable amount of displacement of the avatar object 241 is increased, and if the evaluation size is decreased, the allowable amount of displacement of the avatar object 241 is decreased, and the rehabilitation operation can be evaluated more severely. It is also possible to match these visual recognition sizes and evaluation sizes.

  In the input area 322, the sensor size (size of the sensor object) of the avatar object 241 can be set to the left and right separately. If the sensor size is large, even if the position of the hand is largely deviated from the target object, the degree of difficulty of the rehabilitation operation is lowered since the task is achieved. Conversely, if the sensor size is small, the hand of the user must move the center region of the target object (depending on the size for evaluation) correctly, which makes the rehabilitation operation more difficult. In the example of FIG. 3A, the sensor size is 1.75 cm on each side.

  In the input area 323, the speed at which the target object 242 moves in the virtual space can be defined for each of the left and right. In this example, the speed is set to 70 cm / s.

  That is, in the example of FIG. 3A, the user 220 grabs an avatar object (controller) including a sensor part of 1.75 cm in the virtual space, and falls at a speed of 70 cm / s at a distant place on the left side. The task is to touch the target object (ball).

  The input area 324 has an enlarged shape of the radar screen image 250. Since the check box 325 is checked, when an operation of clicking or tapping any of a plurality of blocks in the input area 324 is performed, a position in the virtual space corresponding to the position of the block where the operation is performed. , Target object 242 is generated.

  On the other hand, the score display screen 303 includes a radar screen enlarged image 331 and a score list 332. The radar screen magnified image 331 is a magnified image of the radar screen image 250 displayed on the head mounted display 233, and changes in real time according to the user's movement and the position where the target object 242 appears next.

  The score list 332 shows the total number of tasks at which position and a score indicating how many times the task has been achieved. The score may be expressed as a fraction, may be expressed as a percentage, or a combination thereof. The evaluation unit 214 derives a rehabilitation evaluation point using the value of the score list 332 after a series of rehabilitation operations determined in one task set.

  At this time, the evaluation unit 214 weights points by the appearance position of the target object, the touch accuracy by the avatar object 241, and the number of times of continuous achievement. In the present embodiment, the drop speed and the task interval are not included in the weighting material. This is based on the fact that the exercise intensity does not necessarily depend on the speed, and further excludes an element that causes the user to burn in terms of prevention of an accident and the like.

  The pause button 304 is a button for pausing a series of rehabilitation operations. The end button 307 is a button for ending a series of rehabilitation operations.

  The re-center button 305 is a button for receiving from the operator a rebuilding instruction for rebuilding the virtual space in accordance with the position of the user 220. When the re-center button 305 is operated, the display control unit 212 sets the position of the head mount display 233 at that moment as an origin, and reconstructs a virtual space with the direction of the head mount display 233 at that moment as a reference direction.

  FIG. 3B shows a state in which the target object 242 has appeared on the user view screen 301 of FIG. 3A. In this state, when the user 220 stretches the left arm as shown in the area 306, the avatar object 241 appears on the user view screen 301. Around the target object 242, a visual object 312 for improving the visibility of the target object 242 is displayed. Here, the visual object 312 has a donut shape, but the present invention is not limited to this, and a line or an arrow radially extending from the target object may be used. The visual recognition size set in the input area 321 indicates the radius of the donut-shaped visual recognition object 312.

  FIG. 3C shows the user view screen 301 at the moment when the target object 242 of FIG. 3B further descends and touches the avatar object 241. Although the avatar object 241 and the visual object 312 touch at this point, the target object 242 does not disappear at this point, and the task is not achieved (a certain score is entered and evaluated as good). Only when the avatar object 241 touches the target object 242 is the task achieved (perfect evaluation).

  FIG. 3D shows the user view screen 301 immediately after the target object 242 of FIG. 3C descends and touches the avatar object 241 and the target object 242 disappears.

  FIG. 3E shows that the user grabs an avatar object (controller) including a sensor part of 1.75 cm in the virtual space, and the target with a radius of 10 cm falls at a speed of 70 cm / s on the right side as seen from the user An operation screen 300 is shown where the task is to touch an object (ball).

  FIG. 3F shows the operation screen 300 in which the setting of the sensor size is changed to 10 cm while the setting of the size of the target object on the right side is changed to 3 cm. Since the sensor size is as large as 10 cm, the sensor object 313 can be viewed out of the avatar object 241. The user grabs an avatar object (controller) including a 10 cm sensor object 313 in a virtual space, and falls at a speed of 20 cm / s at a distant place on the right side to a target object (ball) of 3 cm radius The task is to bring them into contact.

  FIG. 3G shows the operation screen 300 in which the size of the target object on the right side is changed to 30 cm and the sensor size is changed to 10 cm. The user grabs an avatar object (controller) including a 10 cm sensor object 313 in a virtual space, and falls at a speed of 20 cm / s at a distant place on the right side to a target object (ball) with a radius of 30 cm. The task is to bring them into contact.

  As shown in FIG. 4, a landscape image (for example, a moving image obtained by shooting a town in New York) obtained by imaging an actual landscape may be displayed as a background image. As a landscape image, an image of a road around a rehabilitation facility may be used, or an image of a foreign country may be used. You can make it feel like you are taking a walk in a foreign country, or you can make it feel like you are taking a walk in a familiar place. By superimposing the landscape image, it is possible to realize training in a large amount of information while entertaining the patient.

  FIG. 5 is a flowchart showing the flow of processing in the rehabilitation support device 210.

  In step S501, as a calibration process, the target of the rehabilitation operation is initialized to the user. Specifically, each patient is first required to work in the actionable range as a calibration, and after setting it to an initial value, the target is initialized according to the user.

  Next, in step S503, the task is started. Specifically, in addition to a method in which the operator designates each task in real time, task sets called templates are read out from the task set database, and task requests are sequentially made from a plurality of tasks set in advance. That is, display of the target object by the display control unit 212 may be performed.

In step S505, it is determined whether the task has been cleared, and if cleared, the score is recorded according to the degree of clearing (perfect or good), or in step S507, all tasks in the task set have been completed or the operator Determines whether the end button 307 has been pressed.

  If not completed, the process returns to step S503 to start the next task. If the process is completed, the process proceeds to step S511, where the score for each task is weighted according to the condition, and then aggregated to calculate the accumulated points.

  In step S507, the degree of fatigue of the user may be calculated from a change in the score or the like, and the process may be automatically terminated as a “stop condition” if the degree of fatigue exceeds a predetermined threshold.

(About dual task)
Healthy people are doing two or more things at the same time, such as "walk while talking" in normal daily life. Such "the ability to do two things simultaneously" declines with age. For example, "if you talk while walking, you will stop your leg" and so on. It is thought that the cause of the fall of the elderly is not only "the decrease in motor function" but also "the decrease in ability to do two things at the same time". In fact, there are many elderly people who fall after returning home even though it is judged that rehabilitation sufficiently restores their motor function. One of the factors is that rehabilitation is being performed with the environment and conditions in which it is possible to concentrate on the rehabilitation operation. That is, in the living environment, it is often the operation under the condition that factors that can not concentrate on the operation such as poor visibility, the presence of an obstacle, and the conversational awareness.

  Therefore, it is considered important to carry out rehabilitation that disperses attention, and it is desirable to train specifically by giving dual tasks. Such dual task training is an effective program not only for the fall of elderly people but also for the prevention of dementia.

  Dual task training includes training that combines two types of exercise tasks, as well as training that combines cognitive tasks and exercise tasks.

  As described above, the task described in FIGS. 3A to 3G is to confirm the position of the next target object on the radar screen image (cognitive task) and direct the body to the position with good timing and reach out (exercise task) Because of the need, it has become a dual task of cognitive + exercise.

  Other cognitive tasks + exercise tasks include training such as reaching out while subtracting 1 from 100 each and training such as reaching out so as not to spill the water in the glass.

  The evaluation unit 214 notifies the display control unit 212 to repeat the dual task when the evaluation is lowered by about 20% in the dual task exercise test as compared with the simple exercise.

(Another dual task training example)
As shown in FIG. 6, a question image (for example, multiplication) is displayed superimposed on the background screen, or questions are given by voice, and among the plurality of target objects, the target object with the displayed answer is highly evaluated. You may The background screen may display one of Goo, Choi, and Pa, and may request collection of an object with a win mark. Such a selective task + exercise task is dual task training that requires more advanced cognitive function.

  Furthermore, the object may simply be displayed with numbers, and only the acquisition of objects with large numbers may be evaluated.

  The evaluation unit 214 may compare the score of the single task with the score of the dual task, and evaluate the cognitive function using the point difference.

  As dual task training that requires two motor functions simultaneously, for example, two foot pedals may be prepared, and the target object may be retrieved only when one of the foot pedals is depressed. Since the user has to extend the right hand while depressing the foot pedal with the right foot for the target object from the right, a dual motor function is required to interlock the limbs. In addition, it may be considered that the avatar object on the opposite side to the avatar object on the side of retrieving the object always needs to touch the designated place.

  As described above, according to the present embodiment, since the direction in which the user should turn his head can be recognized in advance by the radar screen image, confusion with the inner ear information can be prevented and VR sickness can be prevented even if the field of view is narrowed. That is, comfortable rehabilitation can be provided to the user during rehabilitation using the head mounted display.

  Note that the position of the next object may be notified using stereo sound.

  Note that the target object is not limited to vertical fall, and may be configured to touch a target facing horizontally.

Third Embodiment
Next, a rehabilitation support device according to a third embodiment of the present invention will be described using FIGS. 7 to 9. 7 to 9 show operation screens 700, 800, 900 of the rehabilitation support apparatus. The rehabilitation support apparatus according to the present embodiment differs from the second embodiment in the layout of the operation screen. The other configurations and operations are similar to those of the second embodiment, and therefore the same configurations and operations are denoted by the same reference numerals and the detailed description thereof is omitted.

  FIG. 7 is a diagram showing an operation screen 700 for generating a task based on a manual operation by the operator and providing the task to the user. The user view screen 301, the re-center button 305, and the like and the contents thereof are the same as the screen described in FIG. 3A.

  Operation screen 700 includes, on the left side, a score display area 732 indicating the position of the target object that has appeared in the past and the number of times it has been achieved (achievement rate), various parameter setting areas 721, and a task history display area 741. Furthermore, the operation screen 700 has an input area 724 for determining the position of the target object that will appear next, and a check box 725 for setting whether to accept the operation of the appearance position of the target object by the hot key.

  FIG. 8 is a diagram showing an operation screen 800 in the case where the user executes the task set read from the task set database 216. The user view screen 301, the re-center button 305, and the like and the contents thereof are the same as the screen described in FIG. 3A.

  The operation screen 800 does not have various parameter setting areas, and a task history display area 841, a score display area 832 showing the position of the target object made to appear in the past, and the number of achievements (achievement rate) And a task list display area 833.

  FIG. 9 is a view showing an example of the content display / edit screen 900 of the task set stored in the task set database 216. As shown in FIG. In the screen of FIG. 9, a task set 901 consisting of 38 tasks is displayed.

  Each task included in the task set 901 includes an occurrence time 911, a task interval 912, a task position 913, a task angle 914, a task distance 915, a speed 916, a perfect judgment reference 917, a good judgment reference 918, and a catch judgment reference 919. Has the parameters of

  FIG. It shows a state in which the parameters of task 2 are to be edited. After editing, if a save button 902 is selected, the task set in the task set database 216 is updated.

  The total data display area 903 displays the total play time and the total number of tasks of the left hand and the right hand.

In the new task registration area 904, a new task in which various parameters are set can be added to the task set 901. When all parameters such as the appearance position and the speed are set and the new registration button 941 is selected, one line is added to the upper task set 901. Here, no. Registered as 39 tasks.
As described above, in the present embodiment, it is possible to provide a user-friendly rehabilitation support device that is more easy to operate.

[Other embodiments]
Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. The configurations and details of the present invention can be modified in various ways that can be understood by those skilled in the art within the scope of the present invention. Also included within the scope of the present invention are systems or devices that combine the different features included in each embodiment.

  Furthermore, the present invention may be applied to a system configured of a plurality of devices or to a single device. Furthermore, the present invention is also applicable to the case where a rehabilitation support program for realizing the functions of the embodiments is supplied to a system or apparatus directly or remotely. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium storing the program, and a WWW (World Wide Web) server for downloading the program are also included in the scope of the present invention. . In particular, a non-transitory computer readable medium storing a program that causes a computer to execute at least the processing steps included in the above-described embodiment is included in the scope of the present invention.

Claims (13)

A detection unit that detects the direction of the head of the user wearing the head mounted display;
A first display control unit for causing a target object for rehabilitation to be visually recognized by the user to appear in a virtual space and displaying the head mount display according to the head orientation of the user detected by the detection unit;
A second display control unit for displaying a notification image for notifying the position of the target object in a central portion of the head mount display at a timing at which a change in inner ear information to be obtained next is predicted from visual information in advance ,
Rehabilitation support device equipped with A detection unit that detects the direction of the head of the user wearing the head mounted display;
A first display control unit for causing a target object for rehabilitation to be visually recognized by the user to appear in a virtual space and displaying the head mount display according to the head orientation of the user detected by the detection unit;
The notification image for notifying the position of the target object appearing outside the field of view of the user is predicted to prevent change in inner ear information to be obtained next from visual information to prevent sensor conflict. And a second display control unit configured to display on a head mounted display.   The rehabilitation support apparatus according to claim 1, wherein the notification image is a radar screen image indicating which direction the position of the target object is relative to a reference direction in the virtual space.   The rehabilitation support apparatus according to claim 1, wherein the notification image is a radar screen image indicating which direction the position of the target object is relative to the direction of the head of the user.   The rehabilitation support device according to claim 2, wherein the second display control unit displays the notification image on a central portion of a display screen of the head mounted display regardless of the orientation of the head of the user. The notification image is
The rehabilitation support device according to any one of claims 1 to 5, including a view field image indicating the view of the user and a target position image indicating the position of the target object. The notification image is
The rehabilitation support device according to any one of claims 1 to 6, including a head image indicating the direction of the head of the user viewed from above and a target position image indicating the position of the target object. The notification image is
The rehabilitation support device according to any one of claims 1 to 7, including a block image obtained by dividing the periphery of the user into a plurality of blocks. A detection unit that detects the direction of the head of the user wearing the head mounted display;
A first display control unit for causing a target object for rehabilitation to be visually recognized by the user to appear in a virtual space and displaying the head mount display according to the head orientation of the user detected by the detection unit;
An operation unit for displaying an operation image for instructing an operator to generate the target object with respect to a user's field of view displayed on the head mounted display in the virtual space, and receiving an operation;
Rehabilitation support device equipped with The operation unit receives, from the operator, a reconstruction instruction for reconstructing the virtual space in accordance with the position of the user.
10. The rehabilitation according to claim 9, wherein the first display control unit reconstructs the virtual space based on the position of the head mounted display at the time of receiving the reconstruction instruction in response to the reconstruction instruction. Support device. A head mounted display,
A sensor for detecting a user's movement;
The rehabilitation support device according to any one of claims 1 to 10.
Rehabilitation support system. A detection step of detecting the direction of the head of the user wearing the head mounted display;
A first display control step of causing a target object for rehabilitation to be visually recognized by the user to appear in a virtual space, and displaying the target object on the head mounted display according to the orientation of the head of the user detected in the detection step ;
A second display control step of displaying a notification image for notifying the position of the target object at the center of the head mounted display at a timing at which a change in inner ear information to be obtained next is predicted from visual information in advance; ,
Rehabilitation support methods including A detection step of detecting the direction of the head of the user wearing the head mounted display;
A first display control step of causing a target object for rehabilitation to be visually recognized by the user to appear in a virtual space, and displaying the target object on the head mounted display according to the orientation of the head of the user detected in the detection step ;
A second display control step of displaying a notification image for notifying the position of the target object at the center of the head mounted display at a timing at which a change in inner ear information to be obtained next is predicted from visual information in advance; ,
Rehabilitation support program to make a computer execute.

Images