TWM571760U - Rehabilitation game system - Google Patents

Abstract

A rehabilitation game system includes a skeleton tracking device and a computer host. The skeleton tracking device includes a photographing unit, a depth sensor, and a communication unit. The camera unit captures a motion image of a user, the depth sensor detecting the user to generate a depth information about a distance between the user and the skeleton tracking device, the skeleton tracking device according to the dynamic The image and the depth information generate a skeleton dynamic information about the user. The user performs limb movement according to the integrated game displayed by the host computer, and the computer host determines the correctness of the action corresponding to the user according to the skeleton dynamic information generated by the skeleton tracking device and the setting of an application.

Description

Rehabilitation game system

The present invention relates to a game system, and more particularly to a rehabilitation game system.

It is generally found that the implementation rate of limb rehabilitation in patients with stroke is low, because most of the patients report that the rehabilitation activities are monotonous and boring. In addition, for the disability caused by stroke diseases, including the severity of cognition, vision, color recognition, limb weakness, etc., how does the medical team provide rehabilitation activities suitable for the patient's upper limbs, lower limbs, pelvis and other whole body muscle activities, It becomes a problem to be solved.

Therefore, the object of the present invention is to provide a rehabilitation game system designed for a patient with a stroke.

Thus, the novel rehabilitation game system includes a skeleton tracking device and a computer host. The skeleton tracking device includes a photographing unit, a depth sensor, and a communication unit. The camera unit captures a motion picture of a user, and the depth sensor detects the user to generate a depth information about the distance between the user and the skeleton tracking device. The skeleton tracking device generates a skeleton dynamic information related to the user according to the motion image and the depth information.

The computer host includes a central processing unit, a memory, a display, a storage unit, and a communication unit that stores an application. The central processor executes the application in the memory to display a somatosensory game corresponding to the limb rehabilitation on the display.

The user performs limb movement according to the somatosensory game displayed on the display, so that the skeleton tracking device generates the skeleton dynamic information corresponding to the limb rehabilitation of the user. The central processing unit receives the skeleton dynamic information by the communication unit, and determines the correctness of the action corresponding to the user according to the setting of the application.

In some implementations, wherein the computer host further includes an input unit, the input unit is adapted to be operated by a manager to set system parameters of the application, a clinical data table, an interactive program data table, and an event. At least one of a data sheet and a set of information.

In some implementations, the rehabilitation game system further includes a server, wherein the server establishes a connection with the communication unit of the computer host through a network, and is applicable to an administrator operation to view A score corresponding to the user's somatosensory game, reviewing or modifying the clinical data sheet, viewing or modifying the interactive program data sheet, and viewing or modifying at least one of the kit data sheets.

In other embodiments, the somatosensory game includes a hi-hat activity corresponding to lower limb movement and balance, a fruit-picking activity corresponding to upper limb movement and balance, a ballooning activity corresponding to upper limb movement, a dancing activity corresponding to lower limb movement, And at least one of the egg-receiving activities corresponding to pelvic movement, upper limb movement and lower limb movement.

In other embodiments, the camera unit includes at least one of a color camera and an infrared camera.

In some implementations, the communication unit of the skeleton tracking device and the communication unit of the computer host support the universal serial bus (USB), WiFi wireless communication, and Bluetooth (Bluetooth). One of the standards such as communication is to collect information.

The function of the present invention is that the application is executed by the host computer to display the somatosensory game corresponding to the limb rehabilitation on the display, and the skeleton tracking device captures the limb made by the user according to the somatosensory game. The motion is generated to generate the skeleton dynamic information, so that the computer host determines the correctness of the motion of the user according to the skeleton dynamic information and the setting of the application. Furthermore, the manager can adjust the appropriate somatosensory game according to the correctness of the user's motion or for different users, thereby improving the medical effect and satisfaction of the user for physical rehabilitation.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to FIG. 1, an embodiment of the novel rehabilitation game system is applicable to a user and a manager operation, and includes a skeleton tracking device 1, a computer host 2, and a server 3. The user is, for example, a patient with a stroke, such as a caregiver or a physical therapist, but not limited thereto.

The skeleton tracking device 1 includes a photographing unit 11, a depth sensor 12, and a communication unit 13. The camera unit 11 captures a motion image of a user, and the depth sensor 12 detects the user to generate a depth information about the distance between the user and the skeleton tracking device 1. The skeleton tracking device 1 And generating, according to the motion image and the depth information, a skeleton dynamic information about the user, where the skeleton dynamic information is a position of the user in the motion, the head, the limbs, or the hand in the space. News. For example, the skeleton tracking device 1 is, for example, a Kinect manufactured by Microsoft Corporation, and the photographing unit 11 includes at least one of a color camera and an infrared camera, but is not limited thereto.

The computer main unit 2 includes a central processing unit (CPU) 21, a memory 22 electrically connected to the central processing unit 21, a display 23 electrically connected to the central processing unit 21, and an electrical connection to the central processing unit 21. The storage unit 25, an input unit 24 electrically connected to the central processing unit 21, and a communication unit 26 electrically connected to the central processing unit 21. The storage unit 25 stores an application program, and the central processing unit 21 executes the application program in the memory 22 to display a somatosensory game corresponding to the limb rehabilitation on the display 23. The computer host 2 is, for example, a desktop computer, a notebook computer, or a tablet computer. The display device 23 is, for example, a screen. The storage unit 25 is, for example, a hard disk (HDD). The input unit 24 is, for example, a keyboard or a mouse. Or a touch screen integrated with the display 23, but not limited thereto. In addition, the computer host 2 may further include a chip set and a display card. The chip set is electrically connected to the central processing unit 21 and the memory 22, the display 23, and the storage unit 25. The input unit 24 and the communication unit 26 are interposed. The display card has a function of supporting Direct X11, for example.

In more detail, the user performs a limb motion according to the somatosensory game displayed on the display 23, so that the photographing unit 11 of the skeleton tracking device 1 generates the motion image, thereby causing the skeleton tracking device 1 to generate corresponding The skeleton dynamic information of the user's limb rehabilitation. The central processing unit 21 receives the skeleton dynamic information by the communication units 13 and 26, and determines the correctness of the action corresponding to the user according to the setting of the application. The communication unit 13 of the skeleton tracking device 1 and the communication unit 26 of the computer host 2 are supported by a universal serial bus (USB), WiFi wireless communication, Bluetooth communication or other communication standard. One of them transmitted information.

The following describes how the rehabilitation game system provides a somatosensory game in which the user performs a physical rehabilitation. After the computer host 2 installs the correct driver, the host computer 2 is successfully paired with the skeleton tracking device 1 to establish a connection. Then, the administrator operates the computer host 2 to execute the application. At this time, the administrator can register the corresponding user information for the user who performs the somatosensory game for the first time, or The user of the game logs in to the corresponding user information. Then, the manager selects another somatosensory game to be executed by the user.

The somatosensory game includes a hi-hat activity corresponding to lower limb movement and balance, a fruit-picking activity corresponding to upper limb movement and balance, a ballooning activity corresponding to upper limb movement, a dancing activity corresponding to lower limb movement, and corresponding pelvic movement, upper limb movement and lower limb movement. At least one of the egg picking activities. The somatosensory game in the game screen displayed on the display 23, with a contrasting design, such as blue and yellow, and avoiding the use of the same color system, such as red and orange, to increase the user (such as a stroke patient) ) Identification of colors. In the background part of the game screen, a simple design screen is adopted to avoid the content being too rich and complicated, and it is difficult to identify the user game.

In more detail, the hi-hat activity causes the user to see the cockroach appear, lift the foot and step on it, and then practice pedaling with the right or left foot. The fruiting activity allows the user to stand straight, hands clenched and lifted to the chest, slowly extending forward and pulling back the hands, and the hands are as vertical as possible to the body. The ballooning activity allows the user to clench his hands and level horizontally. After aligning with a house, the body stands up. The hands stretch out to the balloon during the game. After hitting the balloon, it needs to be maintained for a short time, such as halfway. Removing it requires re-touching the balloon. The dancing activity makes the user stand up and face the device, judge the direction of the arrow and step on the pedal. For example, the green foot scorpion is a scoring area, and can score when stepping on it, and a blue foot scorpion will appear after scoring. In addition, the green ankle also indicates which foot to use for pedaling. The egg picking activity represents the center of the user's body with a duck. After the duck is aligned with a house, the user stands straight and moves the waist to the left and right to touch the egg.

After the somatosensory game to be executed is selected, the application determines whether the user performs the somatosensory game for the first time based on the user information. When it is determined that the somatosensory game is executed for the first time, the manager needs to set at least one of system parameters of the application, a clinical data table, an interactive program data table, an event data table, and a setting information. . The application's system parameters are used as system environment parameters, such as program path, file path, system initial parameters, and so on. The clinical data table is, for example, the number of operations, the frequency of the operation, the mode of operation, and the like. The interactive program data sheet serves as basic and background information, such as game objects, game music, game backgrounds, and the like. The event data table is used as an interactive game object collision parameter, such as the number of game characters, the frequency of the game action, and the like. The setting information is the result of storing the aforementioned information. In addition, the system parameters of the application, the clinical data table, the interactive program data table, the event data table, and the setting information can also be automatically set by the system.

When different users want to execute the selected somatosensory game, the manager (such as a medical team) first selects the appropriate difficulty level according to the patient's condition, that is, in different difficulty levels, the computer host 2 The correctness of the action will be judged by different posture ranges. For example, when the hi-hat activity is performed, the feet need to reach a certain height range, and the action is correct, and the score can be scored in the game. In addition, the computer main unit 2 can also display an image of a tumbler and the skeleton dynamic information of the user in the display 23. When the user's body is offset, such as being biased to the right side, the image of the tumbler is also offset at the same time. If the user is biased to the right side, the manager can know whether the user's posture is biased by observing the image of the tumbler. Move, and correct the user's correct rehabilitation posture.

In addition, the server 3 establishes a connection with the communication unit 26 of the computer host 2 via a network 9 and is suitable for the administrator to view a rating and view of the somatosensory game corresponding to the user. Or modify the clinical data sheet, view or modify the interactive program data sheet, and view or modify at least one of the kit data sheets.

In more detail, when the administrator wants to know the interactive state of the user performing the somatosensory game, or wants to review the clinical or interactive application parameters, the manager can view the somatosensory game performed by the user for the application. The rating, such as a score or result. The manager finds that the user performs the somatosensory game score or the result is long-term abnormality, such as when the score is very high or low, or the frequency of use is very high or low, the clinical data sheet can be viewed, and the clinical revision is timely Data sheet. When the clinical data sheet is changed, the manager can view the interactive program data sheet and modify the interactive program data sheet of the user in time. The kit data sheet is packaged or combined for each user's interactive game, so that users of the same usage conditions can apply the same interactive game parameters to each other. Therefore, the administrator can also view or modify the kit data sheet based on the user information, the clinical data sheet, and the interactive program data sheet.

In summary, the rehabilitation game system can achieve the following effects: (1) adding fun of rehabilitation activities to improve the performance rate of physical rehabilitation to achieve medical effects and satisfaction: the way to integrate rehabilitation activities into games, Increase rhythm with music, improve the problem of monotonous change without reciprocating health activities, increase hijab (lower limb movement and balance), pick up fruit (upper limb movement and balance), shoot balloon (upper limb movement), dance (lower limb movement), pick up eggs Activities such as pelvic exercise, upper limb movement and lower limb movement improve the rehabilitation rate to achieve medical results and patient satisfaction. (2) Providing objective tools and reducing working hours: In the past, only the human body was used to monitor the rehabilitation status of stroke patients and recorded in paper. There is no evaluation tool for limb displacement, and it takes more time to track and record in the long run. Time and manpower to organize the information. (3) Rehabilitation record data data and objectivity: In the past, there was no objective data-assisted record, and it was impossible to see the changes and progress of the patient's rehabilitation activities. When using the somatosensory game, the posture of the patient's activity was recorded. Objectively present data to document developments and changes during the patient's recovery. In addition, the content design of each somatosensory game can design games of various levels of simple, medium and difficult according to the degree of limb weakness of the patient with stroke, so it is indeed possible to achieve the purpose of the novel.

However, the above is only the embodiment of the present invention. When the scope of the novel implementation cannot be limited thereto, all simple equivalent changes and modifications according to the scope of the patent application and the contents of the patent specification are still This new patent covers the scope.

1‧‧‧ skeleton tracking equipment

11‧‧‧Photographic unit

12‧‧‧Deep sensor

13‧‧‧Communication unit

2‧‧‧Computer host

21‧‧‧Central Processing Unit

22‧‧‧ memory

23‧‧‧ Display

24‧‧‧ Input unit

25‧‧‧ storage unit

26‧‧‧Communication unit

3‧‧‧Server

9‧‧‧Network

Other features and advantages of the present invention will be apparent from the following description of the drawings, wherein: Figure 1 is a block diagram illustrating an embodiment of the novel rehabilitation game system.

Claims (6)

A rehabilitation game system comprising: a skeleton tracking device comprising a photographing unit, a depth sensor, and a communication unit, the photographing unit capturing a motion image of a user, the depth sensor detecting the use To generate a depth information about the distance between the user and the skeleton tracking device, the skeleton tracking device generates a skeleton dynamic information related to the user according to the dynamic image and the depth information; and a computer host. The system includes a central processing unit, a memory, a display, a storage unit, and a communication unit. The storage unit stores an application, and the central processor executes the application in the memory to display a corresponding display on the display. a body-rejuvenating somatosensory game, wherein the user performs a limb movement according to the somatosensory game displayed on the display, so that the skeleton tracking device generates the skeleton dynamic information corresponding to the limb rehabilitation of the user, The central processing unit receives the skeleton dynamic information by using the communication unit And then determines the correct operation of the user should be set according to the application. The rehabilitation game system of claim 1, wherein the computer host further comprises an input unit, wherein the input unit is adapted to be operated by a manager to set system parameters of the application, a clinical data table, and an interactive program. At least one of a data sheet, an event data sheet, and a setting information. The rehabilitation game system of claim 2, further comprising a server, wherein the server is connected to the communication unit of the computer host by a network, and is suitable for an administrator operation to view A score corresponding to the user's somatosensory game, reviewing or modifying the clinical data sheet, viewing or modifying the interactive program data sheet, and viewing or modifying at least one of the kit data sheets. The rehabilitation game system of claim 1, wherein the somatosensory game comprises a hi-hat activity corresponding to lower limb movement and balance, a fruit-picking activity corresponding to upper limb movement and balance, a ballooning activity corresponding to upper limb movement, and a corresponding lower limb movement. At least one of the dancing activities and the egg picking activities corresponding to pelvic movement, upper limb movement and lower limb movement. The rehabilitation game system of claim 1, wherein the photographing unit comprises at least one of a color camera and an infrared camera. The rehabilitation game system of claim 1, wherein the communication unit of the skeleton tracking device and the communication unit of the computer host are supported by a universal serial bus (USB), WiFi wireless communication, And one of the standards such as Bluetooth communication.