TW202042872A - Virtual reality rehabilitation training system with replacement movement judgement - Google Patents

Abstract

A virtual reality rehabilitation training system is disclosed. The system includes a computer, a virtual reality display device, a virtual reality control device, a first positioning device and at least one second positioning device. The computer saves a plurality of rehabilitation training module and displays a plurality of operational scenario by the virtual reality display device. The virtual reality control device is provided for the user to control and conduct the plurality of rehabilitation training module. The first positioning device senses the action of the rehabilitation part to generate rehabilitation movement information. The at least one second positioning device senses the action of the other part to generate auxiliary movement information. The computer judges whether the rehabilitation movement is a replacement movement according to the auxiliary movement information.

Description

Virtual reality rehabilitation training system with compensatory action discrimination

The present invention relates to a virtual reality rehabilitation training system, in particular to a system for achieving rehabilitation training through virtual reality scenes and motion sensing.

According to statistics, the problem of population ageing is becoming more and more serious. For an aging society, the demand for long-term care and chronic disease care is increasing year by year. The elderly population accounts for a high proportion of medical resources, causing a burden on medical staff, and also seriously affecting medical quality and patient safety. Facing the shortage of medical manpower or nursing manpower, how to use technological development to improve the use of medical resources is a topic that needs urgent consideration.

Among them, for the elderly or patients with various limb diseases and strokes, various rehabilitation treatments are necessary and have a considerable influence on the treatment results. However, traditional rehabilitation treatment mostly relies on one-to-one companionship by physiotherapists, functional staff, nurses or patients’ family members. Various analysis, evaluation and records also require certain operating procedures, and various rehabilitation facilities are still required. Rely on physical equipment and field to implement. In other words, considerable human and material resources must be invested in order to achieve the desired effect. Under the current shortage of medical manpower and resources, it may be difficult to achieve the desired quality and effect of care.

In view of this, how to build a new type of rehabilitation training system, using smart networking technology and data transmission and other cloud computing technologies, so that various rehabilitation training can be carried out in a more effective and simple way, reducing the demand for manpower and material resources , So that medical resources can be used more effectively. Therefore, the inventor of the present invention thought about and designed a virtual reality rehabilitation training system to improve the lack of existing technology, thereby enhancing the industrial application.

In view of the above-mentioned problem of learning skills, the purpose of the present invention is to provide a virtual reality rehabilitation training system to solve the problem of the conventional rehabilitation training method that consumes too much manpower and material resources.

According to one objective of the present invention, a virtual reality rehabilitation training system is provided, which includes a computer host, a virtual reality display device, a virtual reality control device, a first mobile positioning device, and at least one second mobile positioning device. Among them, the computer host stores a plurality of rehabilitation training modules; the virtual reality display device is used to display a plurality of operation scenarios corresponding to the plurality of rehabilitation training modules, and provide a plurality of training topics to require the user to perform rehabilitation actions ; The virtual reality control device is for the user to control and execute one of the negative rehabilitation training modules; the first mobile positioning device is set on the user's rehabilitation part, when the user performs the rehabilitation action, It is used to sense the movement of the rehabilitation site and generate rehabilitation displacement information. At least one second mobile positioning device is respectively arranged on different parts of the user, and when the user performs a rehabilitation action, it is used to sense the actions of the different parts of the user and respectively generate auxiliary displacement information correspondingly. The virtual reality control device, the first mobile positioning device and at least one second mobile positioning device are connected to the computer host via the virtual reality display device, and the rehabilitation displacement information and auxiliary displacement information are stored in the computer host according to The auxiliary displacement information determines whether the rehabilitation action is a compensatory action.

Preferably, the auxiliary displacement information may include the moving time or moving distance of each at least one second mobile positioning device, or the distance or bending angle between each at least one second mobile positioning device and the virtual reality control device.

Preferably, when the moving time, moving distance, distance or bending angle is less than the threshold value, the computer host can determine that the user's rehabilitation action is not a compensatory action.

Preferably, the plurality of rehabilitation training modules may include upper limb functional movement modules. The upper limb functional movement modules display the kitchen scene through the virtual reality display device and provide the topic of vegetable cutting. The user performs the rehabilitation of the vegetable cutting action. For actions, the host computer generates training results based on rehabilitation displacement information.

Preferably, the plurality of rehabilitation training modules may include upper limb functional movement modules. The upper limb functional movement modules display the kitchen scene through the virtual reality display device and provide the theme of vegetable and fruit classification. The user can execute the selection of vegetable and fruit types and moving positions For active rehabilitation actions, the host computer generates training results based on the rehabilitation displacement information.

Preferably, the plurality of rehabilitation training modules may include upper limb functional movement modules. The upper limb functional movement modules display the kitchen scene through the virtual reality display device and provide the theme of placing the dishes, and the user performs the rehabilitation of the placement action For actions, the host computer generates training results based on rehabilitation displacement information.

Preferably, the plurality of rehabilitation training modules may include a multi-person interaction module. The multi-person interaction module displays an indoor sports field scene through a virtual reality display device, and provides gymnastics training themes, and the user performs physical exercise rehabilitation actions , The host computer generates training results based on rehabilitation displacement information.

Preferably, the plurality of rehabilitation training modules may include a mirror treatment module. The mirror treatment module displays a mirror scene through a virtual reality display device and provides a theme of piles of objects. The user performs the rehabilitation action of taking/dropping actions , The host computer generates training results based on rehabilitation displacement information.

Preferably, the plurality of rehabilitation training modules may include a mirror treatment module. The mirror treatment module displays a mirror scene via a virtual reality display device and provides a coin flipping theme. The user performs the rehabilitation action of the flip action, and the computer host It is based on rehabilitation displacement information to generate training results.

Preferably, when the moving time, moving distance, distance or bending angle is greater than or equal to the threshold value, the computer host can determine that the user's rehabilitation action is not a compensatory action.

In summary, according to the virtual reality rehabilitation training system of the present invention, it can have one or more of the following advantages:

(1) This virtual reality rehabilitation training system can judge the user's compensatory movement through the auxiliary displacement action, avoiding the use of uninjured parts to replace the injured parts for rehabilitation during remote rehabilitation, and therefore cannot achieve the actual rehabilitation effect problem.

(2) This virtual reality rehabilitation training system can carry out various rehabilitation training topics through virtual reality devices. It does not require physical rehabilitation equipment or medical personnel to record rehabilitation data, effectively saving and using medical resources and improving The quality of rehabilitation training.

(3) This virtual reality rehabilitation training system can simulate various body movements with virtual reality devices to avoid injuries caused by the actual operation of the equipment. It can also achieve home rehabilitation through Internet connection without going to a specific medical institution. Improve the safety and convenience of operation.

(4) This virtual reality rehabilitation training system can enhance the user’s motivation and willingness to perform rehabilitation treatment through different rehabilitation training themes, and can connect to the rehabilitation platform that restricts multiple people through multi-person interaction, increasing the rehabilitation The fun of fitness training allows rehabilitation therapy to be implemented more effectively.

In order to facilitate the reviewers to understand the technical features, content and advantages of the present invention and the effects that can be achieved, the present invention is combined with the accompanying drawings and described in detail in the form of embodiments as follows. The drawings used therein are as follows: The subject matter is only for the purpose of illustration and auxiliary description, and may not be the true proportions and precise configuration after the implementation of the invention. Therefore, it should not be interpreted in terms of the proportions and configuration relationships of the accompanying drawings, and should not limit the scope of rights of the invention in actual implementation. Hexian stated.

Please refer to Figure 1, which is a schematic diagram of a virtual reality rehabilitation training system according to an embodiment of the present invention. As shown in the figure, the virtual reality rehabilitation training system 1 includes a host computer 10, a virtual reality display device 20 worn by a user 90, a virtual reality control device 21, and a first mobile positioning device 22 (movement positioning of the rehabilitation arm)器)and the second mobile positioning device 23 (and the mobile locator of the healthy arm). In addition, the second mobile positioning device 23 can also include more than one mobile positioning device (such as waist movement locator 24 and foot movement locator 25 ). Among them, the virtual reality display device 20 is a head-mounted display device, such as a helmet, glasses, etc. The user 90 can present a three-dimensional image of the virtual environment through the virtual reality display device 20, so that the user 90 seems to be immersed in the environment. The sense of presence of a virtual environment is felt by vision, so it is called virtual reality (VR). The image displayed by the virtual reality display device 20 is connected to the host computer 10 via wired or wireless transmission. The host computer 10 transmits the selected virtual reality image to the virtual reality display device 20, and then uses a helmet or The display device in the glasses plays. The computer host 10 described here can be a desktop computer, a notebook computer, or a virtual reality simulation device, which includes a processor and a memory. The memory can be various storage devices or storage media to store virtual reality Application and various corresponding scene images. The processor may be a chip such as a central processing unit or a microprocessor, and receives instructions from the user 90 to access programs or data in the memory. In another embodiment, the computer host 10 may also be a cloud server, and the virtual reality display device 20 is connected to the cloud server via a network to access the virtual reality scene data in the cloud database.

In this embodiment, a plurality of rehabilitation training modules are stored in the host computer 10 to provide appropriate operating scenarios for the elderly or patients suffering from limb diseases, so that they can perform various limbs according to different training themes. Actions to achieve the effect of rehabilitation training. In order to achieve this goal, in addition to visually feeling the virtual reality scene, various sensing or control devices are further arranged on the rehabilitation site, so that the user 90 can use the sensor to sense the rehabilitation when performing various rehabilitation actions. The movements of the parts are then converted into training data, and the training results are judged. For example, when the user 90 has injured his hand and needs rehabilitation, he can set up a virtual reality control device 21 on his right hand, which can be a biological sensor that senses electronic pulses generated by the palm or the back of the hand. Surface EMG technology is converted into information such as rolling, tilt and deviation. In other words, the sensor can monitor the hand movement of the user 90 in a non-invasive manner, such as being worn on the hand. In addition, the user 90 can also sense the state of the displacement of the hands by installing a mobile positioning device. In this embodiment, the user 90 can wear the first mobile positioning device 22 on the elbow or arm of the rehabilitation site to detect the rehabilitation action of the site requiring rehabilitation. At the same time, the second mobile positioning device 23 is worn on the elbow or arm of the non-rehabilitation part to detect the movement of other parts.

Since the user 90 needs to perform rehabilitation with the right hand, when the virtual reality control device 21 is performed, the user 90 performing rehabilitation at the remote end may avoid the pain due to the absence of assistance from the therapist. The left hand of the non-affected part is used to operate the control device and the rehabilitation action has been performed, and the effectiveness of the rehabilitation is lost. In order to prevent the user 90 from generating a compensatory action that replaces the affected part with a non-affected part for rehabilitation, the first mobile positioning device 22 can detect the rehabilitation displacement information of the rehabilitation part, and at the same time use the second mobile positioning The device 23 detects the auxiliary displacement information of the non-rehabilitation part, and determines whether there is a compensatory action based on the information detected by the two. When the host computer 10 determines that the relative relationship between the rehabilitation displacement action and the auxiliary displacement action exceeds the set threshold, it is judged that a compensatory action has occurred. At this time, the computer host 10 can generate a control message, and the virtual reality display device 20 displays a warning message that a compensation action has occurred. The warning message may include a warning text or a warning image, so that the user 90 wearing the virtual reality display device 20 understands that the actual action is not a set rehabilitation action and needs to perform various rehabilitation actions again. Furthermore, it can also cooperate with pictures or video information for correct action guidance to guide the user 90 to correct rehabilitation actions.

The above judgment criteria mainly include the movement time or movement distance detected by the second mobile positioning device 23, or the distance or bending angle between the second mobile positioning device 23 and the first mobile positioning device 22 or the virtual reality control device 21 For example, the completion time of a rehabilitation exercise. When a hand injury requires rehabilitation, if the completion of a specific exercise is significantly faster than the preset time, it is obviously possible for the non-affected part to replace the exercise. Or the injured part often cannot reach the normal arm movement. If it exceeds the preset movement standard, it may be a compensatory movement. In addition, if the virtual reality control device 21 is worn on the palm and the second mobile positioning device 23 is worn on the arm, the distance or the angle between the two can be included in a certain range, that is, normal hand movement The distance or degree of curvature. When the hand is injured, the distance or the degree of bending should be smaller than the original range of movement due to the inability to move normally. Therefore, when it is detected that the distance between the actual motion and the displacement motion determination or the degree of bending is greater than the preset threshold value, it can also be determined as a compensatory motion.

In this embodiment, the user 90 also wears a foot movement locator 25 and a waist movement locator 24, which can help increase the effect of sensing and positioning among different rehabilitation training topics, and can also be compared with virtual reality. The environment control device 21 is integrated as a sensing device for judging the whole body motion and whether there is a compensatory motion. However, the present disclosure is not limited to this. The user 90 can determine the number of devices to wear through the theme of rehabilitation training, for example, only wear one-handed or one-legged mobile positioning device, or in the virtual reality control device 21 It also includes mobile positioning sensing devices. The actual movements and displacements sensed by the virtual reality control device 21, the first mobile positioning device 22, the second mobile positioning device 23 and other mobile positioning devices (waist movement positioner 24 and foot movement positioner 25) can be The virtual reality display device transmits the data to the host computer 10, stores training data corresponding to different rehabilitation training themes in the memory, and executes calculation instructions through the processor to calculate the training results. On the other hand, the processor also determines whether the rehabilitation action is a compensatory action based on the relative relationship between the rehabilitation displacement action and the auxiliary displacement action, and then generates a corresponding warning message.

Generally, rehabilitation training and treatment for the elderly or patients need to rely on the operation of physical rehabilitation equipment, and the status or data of the operation is recorded by the therapist, watchman or family member, and then the doctor judges the rehabilitation situation. For people undergoing rehabilitation, various operations are often repetitive and boring. In addition, they require too much manpower and are not affordable by limited medical resources. In contrast, with the virtual reality rehabilitation training system disclosed in the present disclosure, patients can perform rehabilitation training at home, without the transportation cost of the hospital, and the movements of rehabilitation training can also be directly recorded in the host computer. Medical staff can guide patients or evaluate patient status through remote connection, which is more efficient in the application of medical resources. In addition, the virtual reality scene can be designed to enhance its interest and increase the patient’s willingness to perform rehabilitation. Compared with the repetitive and uninteresting traditional rehabilitation exercises, the rehabilitation training theme disclosed in this disclosure can increase the user’s willingness and motivation Enhance the effectiveness of rehabilitation training. The different rehabilitation training modules will be described below.

Please refer to Fig. 2, which is a schematic diagram of a plurality of rehabilitation training modules according to an embodiment of the present invention. As shown in the figure, the computer host of the virtual reality rehabilitation training system includes a processor 11 and a memory 12, wherein the memory 12 stores a plurality of rehabilitation training modules. In this embodiment, the rehabilitation training module includes an upper limb functional movement module 120, a cognitive training module 121, a mirror treatment module 122, and a multi-person interaction module 123. Different operation scenarios can be provided for different rehabilitation training modules, or multiple training topics of multiple rehabilitation training modules can be included in one scene. Various training themes are mainly presented in daily life activities. In detail, the upper limb functional movement module 120 can include the topic of cutting vegetables 1201 and the topic of placing plates 1202, and the cognitive training module 121 can include the topic of vegetable and fruit classification 1211, mirror therapy The module 122 may include a stack of objects theme 1221 and a coin turning theme 1222, and the multi-person interaction module 123 may include a gymnastics training theme 1231 and a ball training theme 1232. The number of rehabilitation training modules and training topics disclosed in this disclosure is not limited to the number defined in this embodiment. According to different rehabilitation training types, corresponding rehabilitation training modules and corresponding training topics can be added. Similar to the above-mentioned embodiment, in these different training modules, judgment standards are set for compensatory actions. The processor 11 can judge whether to generate compensatory actions according to the rehabilitation displacement information and auxiliary displacement information of the user 90 in different training themes. The details are described in the following examples.

Please refer to FIG. 3, which is a schematic diagram of the upper limb function movement module according to the embodiment of the present invention. Parts (a) and (b) in the figure are the vegetable cutting theme 1201 of the upper limb functional action module 120 in this embodiment, and parts (c) and (d) in the figure are the upper limb functional action module 120 in this embodiment. The theme of putting plates 1202. As shown in the figure, the upper limb functional action module 120 can display the kitchen scene through the virtual reality display device 20. When the user 90 approaches the flow table or the desktop, the carrot 32 placed on the cutting board 31 and the adjacent knife holder can be seen A kitchen knife 34 is placed on 33, and the user can move his hand to the position of the knife handle according to the guided aperture 35, as shown in part (a). The user then holds the handle of the knife and moves the kitchen knife 34 to the radish 32, and also performs the cutting action according to the guiding position of the aperture 35, as shown in part (b). Since the user wears a virtual reality control device on the hand, the aforementioned vegetable cutting actions, including hand movement, holding the knife handle, and moving the knife until the vegetable is cut, can be sensed and integrated through surface electromyography technology. The data is recorded, including whether the movement is in place, the speed of the movement, or the accuracy of the alignment. Further, the measured or calculated data, such as the operating time or the score obtained, can be simultaneously displayed in the screen, as shown in the information display window 36 in the figure. On the other hand, since the user wears the mobile positioning device with left and right hands, when the distance between the right-hand mobile positioning device and the virtual reality control device is smaller than the distance between the left-hand mobile positioning device and the virtual reality control device, the computer host It is determined that the user is operating the virtual reality control device with the left hand instead of the right hand that needs to be reconstructed, and then the user is determined to be a compensatory action, not a qualified rehabilitation action. Conversely, if the moving distance or bending angle of the right-hand mobile positioning device during operation is large, and the moving distance or bending angle of the left-hand mobile positioning device is less than the preset threshold value, it is judged that the movement is performed by the right hand who needs rehabilitation, and it is qualified Rehabilitation action rather than compensatory action.

Similarly, in the same kitchen scene, when the user 90 approaches the tabletop, he can see the plate shelf 37 on the tabletop and the plate 38 on the right side. The empty space on the plate shelf 37 shows different color blocks, as shown in part (c) Shown. Next, the user is also guided by the aperture to the position of the plate 38, takes the plate 38 and moves to the empty position on the plate shelf 37. When the user places the plate 39 in the correct empty position, a different color block is displayed or moved Remove the color block to indicate the completion of the action, as shown in part (d). Placing the plate includes the actions of picking and placing, and also for training hand movements, and the sensing data can also be displayed in the information display window 36. Similar to the foregoing embodiment, when the rehabilitation displacement information, such as the movement distance or bending angle, sensed by the mobile positioning device worn by the right hand of the rehabilitation is in line with the rehabilitation action, it is not the movement positioning of the left hand worn by the rehabilitation. If the auxiliary displacement information sensed by the device is less than the threshold value of the moving distance or bending angle, it is judged that it is not a compensatory action, but a correct rehabilitation action.

The topic of cutting vegetables 1201 and the topic of placing plates 1202 described in this embodiment are all exercises for the user’s upper limb movement, which simulates hand movements through daily activities, and is measured by the user during these movements Data, provide records of rehabilitation training and interpretation of rehabilitation results. For patients who need to rehabilitate their upper limbs, there may be a risk of injury when using a kitchen knife or picking up a plate. Through virtual reality exercises, not only can the same hand movements be completed, but the training results can also be stored directly. Helps to judge whether rehabilitation training is effective. In other embodiments, the virtual reality can also display a scene such as a living room or a study room, and the effect of upper limb movement training can be achieved by the theme of tidying up objects or the theme of the environment.

Please refer to FIG. 4, which is a schematic diagram of the cognitive training module according to an embodiment of the present invention. Parts (a) and (b) in the figure are the vegetable and fruit classification theme 1211 of the cognitive training module 121 in this embodiment. For the elderly or stroke patients, there may be a tendency to dementia or forgetfulness. The classification of daily things can improve cognitive ability. As shown in the figure, the user can see various vegetables, fruits, meats and other foods on the desktop of the kitchen scene, such as mango 41, apple 42, radish 43, etc., which can be one or more different foods, such as (a ) Partly shown. The user can open the refrigerator 44 on the right and choose to move the fruit mango 41 and apple 42 to the fruit layer, as shown in part (b). By selecting the item category and moving the item category to the corresponding position, the cognitive ability of the user is improved.

Please refer to Figure 5, which is a schematic diagram of the mirror image treatment module according to the embodiment of the present invention. The parts (a) and (b) in the figure are the theme 1221 and the coin turning 1222 of the mirror image treatment module 122 in this embodiment. For patients with hand injuries, looking at the mirror to do rehabilitation helps to coordinate the left and right hands. As shown in the figure, the user can see the mirror 51 and the box 52 on the desktop. After moving the hand to the box through the guide, the user moves the box 52 by looking at the mirror image and stacks it on another box 53 Above, as shown in part (a), the user can use this to train the hand movements of taking and dropping. On the other hand, the user can also see the mirror 51 and the coin 54 on the desktop. The user turns the coin 54 over to achieve the training action. As shown in part (b), the hand movement is used to train the wrist for rehabilitation. . In this embodiment, the mirror treatment is to coordinate the movements of the left and right hands of the user. Therefore, whether the hands that need rehabilitation are used to perform the movements become more important. In view of this, the mobile positioning device of the affected part and the mobile positioning device of the non-affected part can respectively sense the rehabilitation displacement information and auxiliary displacement information of the user. Similar to the previous embodiment, when the distance of the auxiliary displacement information is When the movement angle is smaller than the distance and movement angle of the rehabilitation displacement information, it can be judged as a correct rehabilitation action instead of a compensatory action. In addition, in order to encourage the user to have a greater range of movements in the affected part, when the moving distance or angle of the rehabilitation displacement information exceeds a preset threshold, it is also judged that it is not a compensatory movement.

It is worth mentioning that in this embodiment, the affected part of the user can also be placed on the other side of the mirror (such as the left hand for rehabilitation), and the non-affected part of the user performs the above-mentioned moving and turning actions ( If the right hand for rehabilitation is not required), this situation is contrary to the case of the previous embodiment, and the distance and movement angle of the auxiliary displacement information will be greater than the distance and movement angle of the rehabilitation displacement information. It is a normal user rehabilitation exercise. To further explain, when the user’s affected part symptoms are extremely severe, they may not be able to perform simple movement and flipping actions. However, the mirror image treatment module 122 allows the user to reflect through the mirror image, causing the user’s brain to misunderstand It is thought that the affected area is moving and turning, and the nerves and muscles of the affected area are unconsciously driven to make a slight response, so as to achieve the effect of allowing the user to perform rehabilitation on the affected area.

Please refer to FIG. 6, which is a schematic diagram of a multi-person interaction module according to an embodiment of the present invention. The parts (a) and (b) in the figure are the gymnastics training theme 1231 and the ball training theme 1232 of the multi-person interactive module 123 in this embodiment. As described in the previous embodiment, the computer host can be a cloud server, providing users with connection to the cloud platform. Not only can medical staff log on to the platform to view the status of rehabilitation training, the user can also communicate with each other through the multi-person interaction module 123 Other users connect and interact to enhance the effect of rehabilitation training. As shown in the figure, the user can select various options through the user interface 61, including functional options such as multi-person interaction 62, training results 63, and settings 64. The corresponding information is displayed on the display window 65. When the multi-person interaction 62 mode is selected , Different users can connect to the indoor playground scene provided by the cloud platform, such as gymnastics classroom, as shown in part (a), the user can choose the gender, role, and set the virtual reality display worn on the body The device, the control device and the positioning device enable the actions performed at the remote end to be presented and positioned in the scene of the cloud platform by using the virtual portrait. The rehabilitator or therapist mentioned earlier can also join the training scene in the form of a trainer. When the trainer performs various stretching and gymnastics movements according to their training purposes, users in different places can then follow the virtual portraits in the scene. Perform various rehabilitation exercises by repeating movements. Rehabilitation therapists can also judge whether they have performed the correct actions and achieved the training effect based on the actions displayed by the virtual portraits of each user. In addition, each user and other users, or between users and rehabilitation therapy personnel can also interact through chat rooms and message transmission methods to increase mutual communication, thereby enhancing the fun and interactivity of use.

In this embodiment, in addition to the user's own rehabilitation, he can also interact with therapists or other rehabilitation personnel, but the user's own rehabilitation is still the most important observation item. If it is connected with a rehabilitation therapist, the therapist can judge whether the user has completed the rehabilitation based on the user's actions shown in the virtual portrait. The system also judges whether there is a compensatory movement based on the displacement information of each mobile positioning device . Since the part where multiple people interact is mostly whole-body actions, the user's mobile positioning device can also include two feet or waist mobile positioning devices in addition to both hands. When some movements require a larger range of movement or duration, the movement distance or movement time detected by each mobile positioning device can be used to determine whether the user has indeed completed the rehabilitation movement, not a compensatory movement.

In addition, users can also connect to outdoor sports field scenes, such as football stadiums. As shown in part (b), users in different regions can conduct team training, such as kicking training, and users can set virtual After the actual display device, the foot control device and the positioning device, according to the virtual portrait and kicking instructions established in the scene, the user performs the kicking action. The mobile positioning device determines the movement of the feet and trains the movement of the feet or Balance and present the simulated kicking state in the stadium scene. Users who belong to different regions can join and perform foot movement training through virtual reality display devices, and enhance the interaction and fun of training activities through team competition and scoring methods, allowing patients to perform foot training, etc. The willingness of rehabilitation activities has greatly increased. This embodiment takes a football field as an example, but the disclosure is not limited to this. Other ball activities, such as bowling, etc., can also be added as the subject of ball training.

Corresponding to each training theme, the data sensed by the virtual reality control device and the mobile positioning device are also recorded in the memory. The user can view the training history data or the score of the training result through the user interface 61. If an action is judged to be a compensatory action by comparing it with the original system preset threshold value, for example, the injured part is the left foot and the recorded kicking action is all the right foot, the user will be notified through the user interface 61 that a compensatory action has occurred. Complete the action again. In addition, in the setting 64 screen, you can adjust the system settings, such as volume, dominant hand, training hand, language, difficulty, etc., so that different users can adjust the content of rehabilitation training according to their own conditions.

The above description is only illustrative, and not restrictive. Any equivalent modifications or alterations that do not depart from the spirit and scope of the present invention should be included in the scope of the attached patent application.

1: Virtual reality rehabilitation training system 10: Computer host 11: Processor 12: Memory 20: Virtual reality display device 21: Virtual reality control device 22: First mobile positioning device 23: Second mobile positioning device 24 : Waist movement positioner 25: Foot movement positioner 31: Chopping board 32: Carrot 33: Knife holder 34: Kitchen knife 35: Aperture 36: Information display window 37: Plate holder 38, 39: Plate 41: Mango 42: Apple 43: Carrot 44: Refrigerator 51: Mirror 52, 53: Block 54: Coin 61: User Interface 62: Multiplayer Interaction 63: Training Results 64: Setting 65: Display Window 90: User 120: Upper Limb Functional Action Module 121: Cognition Training module 122: Mirror therapy module 123: Multiplayer interactive module 1201: Vegetable cutting theme 1202: Placing dishes theme 1211: Vegetable and fruit classification theme 1221: Stacking objects theme 1222: Coin flipping theme 1231: Gymnastics training theme 1232: Ball Training theme

Figure 1 is a schematic diagram of a virtual reality rehabilitation training system according to an embodiment of the present invention.

Figure 2 is a schematic diagram of a plurality of rehabilitation training modules according to an embodiment of the present invention.

Fig. 3 is a schematic diagram of the upper limb function movement module according to the embodiment of the present invention.

Figure 4 is a schematic diagram of a cognitive training module according to an embodiment of the present invention.

Figure 5 is a schematic diagram of a mirror image treatment module according to an embodiment of the present invention.

Figure 6 is a schematic diagram of a multi-person interaction module according to an embodiment of the present invention.

1: Virtual reality rehabilitation training system

10: Computer host

20: Virtual reality display device

21: Virtual reality control device

22: The first mobile positioning device

23: The second mobile positioning device

24: Waist movement locator

25: Foot movement locator

90: User

Claims (10)

A virtual reality rehabilitation training system, which includes: a computer host storing a plurality of rehabilitation training modules; a virtual reality display device for displaying a plurality of corresponding rehabilitation training modules Operate the scene, and provide a plurality of training topics to request a user to perform a rehabilitation exercise; a virtual reality control device for the user to control and execute one of the plurality of rehabilitation training modules; A mobile positioning device is arranged on a rehabilitation site of a user, and when the user performs the rehabilitation action, it is used to sense the movement of the rehabilitation site to generate rehabilitation displacement information; and at least one The second mobile positioning devices are respectively arranged on different parts of the user, and when the user performs the rehabilitation action, it is used to sense the actions of different parts of the user and respectively generate an auxiliary displacement information correspondingly Wherein, the virtual reality control device, the first mobile positioning device and the at least one second mobile positioning device are connected to the computer host via the virtual reality display device, and the rehabilitation displacement information and the The auxiliary displacement information is stored in the host computer, and the host computer judges whether the rehabilitation action belongs to a compensation action according to the auxiliary displacement information. For the virtual reality rehabilitation training system described in claim 1, wherein the auxiliary displacement information includes a movement time or a movement distance of each of the at least one second mobile positioning device, or each of the at least one A distance or a bending angle between the second mobile positioning device and the virtual reality control device. For example, in the virtual reality rehabilitation training system described in item 2 of the scope of patent application, when the moving time, the moving distance, the distance or the bending angle are less than a threshold value, the computer host determines the use The rehabilitation action of the person does not belong to the compensation action. For example, the virtual reality rehabilitation training system described in item 3 of the scope of patent application, wherein the plurality of rehabilitation training modules include an upper limb functional movement module, and the upper limb functional movement module displays a function through the virtual reality display device The kitchen scene and all the dishes are provided. The user executes the rehabilitation actions of all the dishes. The computer host generates a training result based on the rehabilitation displacement information. For example, the virtual reality rehabilitation training system described in item 3 of the scope of patent application, wherein the plurality of rehabilitation training modules include an upper limb functional movement module, and the upper limb functional movement module displays a function through the virtual reality display device The kitchen scene is provided with a vegetable and fruit classification theme. The user performs the rehabilitation action of selecting the type of vegetable and fruit and moving position, and the computer host generates a training result according to the rehabilitation displacement information. For example, the virtual reality rehabilitation training system described in item 3 of the scope of patent application, wherein the plurality of rehabilitation training modules include an upper limb functional movement module, and the upper limb functional movement module displays a function through the virtual reality display device The kitchen scene is provided with a theme of placing dishes, the user performs the rehabilitation action of a placing action, and the host computer generates a training result according to the rehabilitation displacement information. For example, in the virtual reality rehabilitation training system described in item 3 of the scope of patent application, the plurality of rehabilitation training modules include a multi-person interactive module, and the multi-person interactive module displays a An indoor sports field scene is provided with a gymnastic training theme. The user performs the rehabilitation action of an integrated operation, and the computer host generates a training result according to the rehabilitation displacement information. The virtual reality rehabilitation training system described in item 2 of the scope of patent application, wherein the plurality of rehabilitation training modules include a mirror treatment module, and the mirror treatment module displays a mirror scene via the virtual reality display device , And provide a pile of object themes, the user performs the rehabilitation action of a take/drop action, and the computer host generates a training result based on the rehabilitation displacement information. The virtual reality rehabilitation training system described in item 2 of the scope of patent application, wherein the plurality of rehabilitation training modules include a mirror treatment module, and the mirror treatment module displays a mirror scene via the virtual reality display device , And provide a coin flipping theme. The user performs the rehabilitation action of a flipping action, and the computer host generates a training result based on the rehabilitation displacement information. For example, in the virtual reality rehabilitation training system described in item 9 of the scope of patent application, when the moving time, the moving distance, the distance or the bending angle are greater than or equal to a threshold value, the host computer determines the The rehabilitation action of the user does not belong to the compensation action.

Images