CN210302240U - Augmented reality AR wrist joint rehabilitation evaluation and training system - Google Patents
Augmented reality AR wrist joint rehabilitation evaluation and training system Download PDFInfo
- Publication number
- CN210302240U CN210302240U CN201920239309.4U CN201920239309U CN210302240U CN 210302240 U CN210302240 U CN 210302240U CN 201920239309 U CN201920239309 U CN 201920239309U CN 210302240 U CN210302240 U CN 210302240U
- Authority
- CN
- China
- Prior art keywords
- real
- training
- rehabilitation
- module
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn - After Issue
Links
- 238000012549 training Methods 0.000 title claims abstract description 97
- 210000003857 wrist joint Anatomy 0.000 title claims abstract description 59
- 238000011156 evaluation Methods 0.000 title claims abstract description 55
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 41
- 230000009471 action Effects 0.000 claims abstract description 42
- 238000012545 processing Methods 0.000 claims abstract description 39
- 238000013473 artificial intelligence Methods 0.000 claims abstract description 24
- 230000004927 fusion Effects 0.000 claims abstract description 24
- 230000033001 locomotion Effects 0.000 claims description 77
- 230000000694 effects Effects 0.000 claims description 28
- 230000009916 joint effect Effects 0.000 claims description 20
- 208000006358 Hand Deformities Diseases 0.000 claims description 15
- 210000003414 extremity Anatomy 0.000 claims description 10
- 238000010276 construction Methods 0.000 claims description 7
- 238000009877 rendering Methods 0.000 claims description 7
- 210000000707 wrist Anatomy 0.000 claims description 6
- 201000010099 disease Diseases 0.000 abstract description 10
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 abstract description 10
- 230000006378 damage Effects 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 210000003169 central nervous system Anatomy 0.000 description 2
- 241000218691 Cupressaceae Species 0.000 description 1
- 208000011092 Hand injury Diseases 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000003137 locomotive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 210000000623 ulna Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Rehabilitation Tools (AREA)
Abstract
The utility model discloses an augmented reality AR wrist joint rehabilitation aassessment and training system, this system contains: sensors and mobile smart devices. The mobile intelligent device comprises: the wireless connection module is used for receiving the real-time action data collected and transmitted by the sensor and transmitting the real-time action data to the memory; the memory is used for receiving and storing the action data sent by the wireless connection module and sending the action data, the data stored in the memory and the artificial intelligence knowledge inference rule to the processing module; the camera is used for sending real-time acquired real rehabilitation training scene information to the processing module; the processing module is used for receiving the real rehabilitation training scene information sent by the camera, the data sent by the memory and the artificial intelligence knowledge reasoning rule, carrying out intelligent evaluation and constructing a virtual-real fusion scene for training guidance; and the display screen receives and displays the scene processed by the processing module. The utility model discloses a system makes the disease oneself train to carry out intelligent aassessment and meticulous guidance to the training.
Description
Technical Field
The utility model relates to a recovered medical instrument, concretely relates to wrist joint rehabilitation aassessment and training system based on augmented reality AR technique.
Background
The loss of one arm is equal to 60% of the human body's function, while hand injuries can result in 90% or 54% of the body's function being lost. The central nervous system has high plasticity, and specific function training can promote recombination and compensation of the central nervous system and recover the limb movement function.
The AR technology (Augmented Reality technology) is a technology for calculating the position and angle of a camera in real time and superimposing virtual objects such as text, images, videos, 3D models and the like on one or more real objects to enhance the Reality, and the technology aims to superimpose a virtual world on a real world on a screen and interact with the virtual world, and achieves some results abroad when applied to hand rehabilitation, but has relatively high treatment cost, for example, a training system developed by the university of illinois and the university of worthwhile in canada, and a patient needs to wear a head-mounted display; a virtual playing piano augmented reality system developed by the national university of singapore requires wireless data gloves; the rehabilitation system developed by the university of california, llbay, usa, requires a projection device; in the system developed at the university of otago, new zealand, the patient needs to place both hands in two specially made black boxes, which are configured with cameras to capture the hand movements, and special personnel such as therapists are required to control the system; the university of INAOE in mexico offers a relatively low cost, network-based solution, but requires two cameras and a common computer.
These systems are costly in equipment and software, lack flexibility and convenience, and some require specialized therapists to guide them. At present, domestic work is in a laboratory research and development stage, and no cheap and good related equipment and software system which can be used for clinical medical treatment exist.
SUMMERY OF THE UTILITY MODEL
The utility model aims at providing a wrist joint rehabilitation aassessment and training system based on augmented reality AR technique, this system have solved traditional rehabilitation training equipment and have lacked flexibility and convenience with current system, and need special therapist to guide, and the higher problem of medical cost can make the disease oneself train to training carries out intelligent aassessment and training to the training of disease and guides.
In order to achieve the above object, the utility model provides an augmented reality AR wrist joint rehabilitation aassessment and training system, this system contains: a sensor and a mobile smart device; the sensor is fixedly arranged on the affected limb of the patient, is in wireless connection with the mobile intelligent equipment and is used for transmitting the action data of the patient, which is acquired in real time, to the mobile intelligent equipment; and the mobile intelligent equipment receives the action data for processing and displaying.
The mobile smart device includes: the wireless connection module is used for being in wireless connection with the sensor, receiving the action data acquired and transmitted by the sensor and sending the action data to the memory; the memory is connected with the wireless connection module and used for receiving and storing the action data sent by the wireless connection module, and sending the action data, the historical action data, the normal wrist joint action activity evaluation data and the artificial intelligence knowledge reasoning rule stored in the memory to the processing module; the camera is connected with the processing module and used for sending the real-time acquired real rehabilitation training scene information to the processing module; the processing module is connected with the storage and the camera and is used for receiving real rehabilitation training scene information acquired and sent by the camera in real time, and action data, normal wrist joint action activity degree evaluation data and artificial intelligence knowledge reasoning rules sent by the storage, evaluating a training result and constructing a virtual-real fusion scene for training guidance; and the display screen is connected with the processing module and used for receiving and displaying the virtual-real fusion scene processed by the processing module.
Wherein, the processing module comprises: the augmented reality AR module is connected with the camera and the display screen, receives a real scene which is collected and sent by the camera in real time, realizes the construction of a virtual model by combining the registration and tracking of the real scene, finishes the rendering of a virtual-real fusion scene and simultaneously transmits the virtual-real fusion scene to the display screen; and the rehabilitation training evaluation module is connected with the memory and the augmented reality AR module and used for receiving the action data, the normal wrist joint action activity degree evaluation data and the artificial intelligence knowledge reasoning rule sent by the memory, carrying out rehabilitation evaluation on the action data of the patient and the normal wrist joint action activity degree evaluation data which are collected in real time by adopting artificial intelligence knowledge reasoning and combining joint action activity degree ROM (range of motion) evaluation, setting virtual and digital rehabilitation guidance training motion data according to an intelligent evaluation result, and sending the motion information to the augmented reality AR module so as to realize the construction of the augmented reality AR module on a virtual-real fusion scene.
Preferably, normal wrist joint motion includes palmar flexion, dorsiflexion, radial deviation, and ulnar deviation.
Preferably, the ROM evaluation data of the normal wrist joint metacarpophalangeal flexion and dorsiflexion radial deviation ulnar deviation movement degree comprises: the normal range of motion of palmar flexion is 0-90 degrees, the normal range of motion of dorsiflexion is 0-70 degrees, the normal range of motion of radial deviation is 0-25 degrees, and the normal range of motion of ulnar deviation is 0-55 degrees.
Preferably, the maximum angles of the normal wrist joint dorsiflexion and palmflexion can be respectively as follows: 90 degrees of palmar flexion and 70 degrees of dorsiflexion; the normal maximum angle which can be reached by the normal wrist joint radial deviation ulnar deviation movement is respectively as follows: radial deviation is 25 degrees, and ulnar deviation is 55 degrees.
Preferably, the rehabilitation training evaluation module is connected with the display screen and is used for carrying out intelligent evaluation and real-time judgment on the rehabilitation training motion data of the wrist joint of the patient, and when the motion data of the joint of the affected limb is not in the range of the rehabilitation guidance training motion data set by the current intelligent evaluation result or exceeds the maximum motion angle of normal joint action, the warning information is sent to the display screen to be displayed.
Preferably, the wireless connection module is a bluetooth module.
Preferably, the sensor is an angle sensor or a multi-axis sensor with an angle.
Preferably, the mobile smart device transmits with a fixed display device or another mobile smart device through a wireless connection, the fixed display device including: a television, a computer screen and an outdoor display screen; the mobile smart device includes: tablet computers, notebook computers and mobile phones.
Preferably, the system further comprises: and the independent video acquisition camera replaces the camera of the mobile intelligent device.
The utility model discloses an augmented reality AR wrist joint rehabilitation aassessment and training system, this system have solved traditional rehabilitation training equipment and have had the system now and lack flexibility and convenience, and need the guidance of special therapist, and the higher problem of medical cost has following advantage:
(1) the system of the utility model can lead the patient to clearly see the rehabilitation result while supporting the fine, integrated and visual evaluation and training by superposing the virtual and digital rehabilitation guidance training data to the real patient training scene;
(2) the utility model discloses the augmented reality AR module of system can set for virtual, digital rehabilitation according to artificial intelligence aassessment result and guide the training data and fuse it with real disease training scene, then visually present for the disease, and accurate control training corrects the wrong action that probably leads to wrist joint secondary damage simultaneously, encourages the rehabilitation achievement of disease;
(3) the utility model discloses the rehabilitation training evaluation module of system adopts artificial intelligence knowledge to infer and combines joint action activity ROM to assess and carry out intelligent assessment and real-time judgement, and when the sick limb joint motion data is not in the rehabilitation guidance training motion data scope that current intelligent assessment result set for, or surpasss the biggest activity angle of normal joint action, this rehabilitation training evaluation module sends warning information to the display screen to correct the action, avoid wrist joint's secondary damage;
(4) the utility model discloses a system supports medical treatment at home, and oneself is recovered, and equipment is small and exquisite, easily carry, and the low price, medical cost is low, satisfies the general crowd demand, can alleviate current recovered administrative or technical offices medical resources nervous situation effectively.
Drawings
Fig. 1 is the utility model discloses an augmented reality AR wrist joint rehabilitation aassessment and training system's schematic structure.
Fig. 2 is the utility model discloses the system of embodiment 1 shows the picture of virtual reality fusion scene on the display screen when using.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely below, and it should be understood that the described embodiments are only some embodiments of the present invention, but not all embodiments. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.
An augmented reality AR wrist rehabilitation assessment and training system, the system comprising: a sensor 1 and a mobile smart device 2.
The sensor 1 is fixedly arranged on the affected limb of the patient, is in wireless connection with the mobile intelligent device 2, and is used for transmitting the action data of the patient, which is acquired in real time, to the mobile intelligent device 2; the mobile intelligent device 2 receives the action data for processing and displaying, and may be a mobile electronic device such as a mobile phone, a tablet computer, a notebook computer, and the like.
The mobile smart device 2 includes: the wireless connection module 22 is used for being wirelessly connected with the sensor 1, receiving the action data acquired and transmitted by the sensor 1 and sending the action data to the memory 23; the memory 23 is connected with the wireless connection module 22 and used for receiving and storing the action data sent by the wireless connection module 22, and sending the action data, the evaluation data of the normal wrist joint action activity degree and the artificial intelligence knowledge reasoning rule stored in the memory 23 to the processing module 21; the camera 25 is connected with the processing module 21 and is used for sending real-time acquired real rehabilitation training scene information to the processing module 21; the processing module 21 is connected with the memory 23 and the camera 25, and is used for receiving the real rehabilitation training scene information acquired and sent by the camera 25 in real time, and the action data, the normal wrist joint action activity degree evaluation data and the artificial intelligence knowledge inference rule sent by the memory 23, evaluating the training result, and simultaneously constructing a virtual-real fusion scene for guiding training; and the display screen 24 is connected with the processing module 21 and is used for receiving and displaying the virtual-real fusion scene processed by the processing module 21.
The wireless connection module 22 is bluetooth 4.0; the processing module 21 includes: the CPU and the GPU, wherein the CPU is OctaCore 1.4GHz MT6592Cortex-A7, and the GPU is ARM Mali-450MP 4; the memory 23 includes: RAM 2GB, ROM8GB, eMMC Hynix _ H26M42003 GMR; the camera 25 can select s5k4e1gamipiraw and is provided with 500 ten thousand pixels in front; the display screen 24 is a touch screen, and cypress _ TMA463_ offset.15 is selected.
Wherein, the processing module 21 includes: the augmented reality AR module 212 is connected with the camera 25 and the display screen 24, receives the real scene collected and sent by the camera 25 in real time, realizes the construction of a virtual model by combining the registration and tracking of the real scene, completes the rendering of a virtual-real fusion scene, and simultaneously transmits the virtual-real fusion scene to the display screen 24; and a rehabilitation training evaluation module 211, which is connected to the memory 23 and the augmented reality AR module 212, and is used for receiving the motion data, the normal wrist joint motion activity evaluation data and the artificial intelligence knowledge reasoning rule sent by the memory 23, performing rehabilitation evaluation on the motion data of the patient and the normal wrist joint motion activity evaluation data acquired in real time by adopting artificial intelligence knowledge reasoning and combining joint motion activity ROM evaluation, setting virtual and digital rehabilitation guidance training motion data according to an intelligent evaluation result, and sending the motion information to the augmented reality AR module 212, so that the augmented reality AR module 212 constructs a virtual model, and finishes rendering a virtual-real fusion scene.
Further, rehabilitation assessment can be performed by adopting artificial intelligence knowledge reasoning and joint action activity ROM assessment. ROM is an important means of assessing the functional state of the locomotor system through the arc of motion (or angle of rotation) through which the joint moves.
Further, normal wrist joint movements include volar flexion, dorsiflexion, radial deviation, and ulnar deviation. Further, the ROM evaluation data of the normal wrist joint metacarpophalangeal flexion and dorsiflexion radial deviation ulnar deviation action activity degree comprises the following steps: the normal range of motion of palmar flexion is 0-90 degrees, the normal range of motion of dorsiflexion is 0-70 degrees, the normal range of motion of radial deviation is 0-25 degrees, and the normal range of motion of ulnar deviation is 0-55 degrees.
Further, the maximum angles of the normal wrist joint dorsiflexion and palmflexion can be respectively as follows: 90 degrees of palmar flexion and 70 degrees of dorsiflexion; the normal maximum angle that can be reached by the normal wrist joint radial deviation ulnar deviation movement is respectively: radial deviation is 25 degrees, and ulnar deviation is 55 degrees.
Further, the rehabilitation training evaluation module 211 is connected to the display screen 24 for performing intelligent evaluation and real-time judgment on the rehabilitation training motion data of the wrist joint of the patient, and when the range of motion of rehabilitation training of the joint of the affected limb is not within the range of the rehabilitation guidance training motion data set according to the current intelligent evaluation result, or the angle of motion reaches or exceeds the maximum value of the rehabilitation guidance training motion data set according to the intelligent evaluation result, or exceeds the maximum angle of motion of the normal joint, the warning information is sent to the display screen 24 for displaying.
Further, the wireless connection module 22 is a bluetooth module.
Further, the sensor 1 is an angle sensor or a multi-axis sensor with an angle.
Further, the sensor 1 is fixedly arranged right above the back of the hand of the affected limb of the patient.
Further, the sensor 1 may employ a BWT901BCL digital attitude sensor.
Further, the mobile intelligent device 2 is in wireless connection with a television, a desktop computer screen, a personal notebook computer screen, a tablet computer screen, a mobile phone screen, or an outdoor display screen for transmission.
Further, the system further comprises: an independent video capture camera that replaces the camera 25 of the mobile smart device 2.
More specifically, the following embodiment 1 describes the augmented reality AR wrist joint rehabilitation assessment and training system provided by the present invention in detail.
Example 1
An augmented reality AR wrist rehabilitation assessment and training system, the system comprising: the sensor 1 is connected with the mobile intelligent device 2 through Bluetooth, the sensor 1 is directly attached to or made into a bracelet and worn over the back of a hand of a patient's affected limb, and can sense and read real-time angle data of three axes (X, Y, Z axes in a space coordinate system) of motion of a patient's wrist joint. The sensor 1 adopts a BWT901BCL digital attitude sensor.
The mobile smart device 2 includes: processing module 21, wireless connection module 22, memory 23, display screen 24 and camera 25. The wireless connection module 22 is a bluetooth module, and is connected to the sensor 1, and configured to receive the motion data transmitted by the sensor 1 and send the motion data to the memory 23. The memory 23 is connected with the wireless connection module 22, receives and stores the action data sent by the wireless connection module 22, and sends the action data, the evaluation data of the normal wrist joint action activity and the artificial intelligence knowledge inference rule stored in the memory 23 to the processing module 21. The camera 25 is connected with the processing module 21, and sends real rehabilitation training scene information acquired in real time to the processing module 21. The processing module 21 is connected to both the memory 23 and the camera 25, and is configured to receive the real rehabilitation training scene information acquired and transmitted by the camera 25 in real time, the motion data transmitted by the memory 23, the normal wrist joint motion activity degree ROM evaluation data, and the artificial intelligence knowledge inference rule, to evaluate the training result, and to construct a virtual-real fusion scene for guiding the training. The display screen 24 is connected to the processing module 21, and receives and displays the virtual-real fusion scene processed by the processing module 21. The camera 25 is a front camera of the mobile intelligent device 2.
The memory 23 stores history operation data.
The memory 23 stores therein normal wrist joint dorsiflexion and radial deviation and ulnar deviation action activity ROM evaluation data, which includes: the normal movement range of palmar flexion is 0-90 degrees, the normal movement range of dorsiflexion is 0-70 degrees, the normal movement range of radius deviation is 0-25 degrees, and the normal movement range of ulna deviation is 0-55 degrees; the maximum motion angle of normal wrist joint palmar flexion can be 90 degrees, and the maximum motion angle of dorsiflexion can be 70 degrees; the maximum motion angle which can be reached by the normal wrist joint radial deviation is 25 degrees, and the maximum motion angle which can be reached by the ulnar deviation is 55 degrees.
The memory 23 stores therein artificial intelligence knowledge inference rules.
The processing module 21 includes: an augmented reality AR module 212 and a rehabilitation training evaluation module 211. The augmented reality AR module 212 is connected to both the camera 25 and the display screen 24, receives the real scene collected and sent by the camera 25 in real time, and combines with the registration and tracking of the real scene to realize the construction of a virtual model, complete the rendering of a virtual-real fusion scene, and simultaneously transmit the virtual-real fusion scene to the display screen 24. The rehabilitation training evaluation module 211 is connected with the memory 23 and the augmented reality AR module 212, receives the action data, the normal wrist joint activity evaluation data and the artificial intelligence knowledge reasoning rule sent by the memory 23, carries out rehabilitation evaluation on the action data of the patient and the normal wrist joint action data acquired in real time by adopting artificial intelligence knowledge reasoning and combining joint action activity degree ROM evaluation, sets virtual and digital rehabilitation guidance training motion data according to the intelligent evaluation result, and sends the motion information to the augmented reality AR module 212 so as to realize the construction of the virtual model by the augmented reality AR module 212 and finish the rendering of a virtual-real fusion scene.
When using, as shown in fig. 2, for the utility model discloses the system of embodiment 1 shows the picture of virtual reality fusion scene on the display screen when using, and rehabilitation training evaluation module 211 in processing module 21 adopts artificial intelligence knowledge to infer and combines joint action activity degree ROM to assess, sets for the data of first virtual object 3, second virtual object 4 and third virtual object 5 according to intelligent assessment result to as the training motion data of rehabilitation guidance. The augmented reality AR module 212 in the processing module 21 combines the real-time data of the wrist joint movement of the patient sensed and read by the sensor 1, the historical motion data, the normal wrist joint motion activity evaluation data and the artificial intelligence knowledge reasoning rule in the memory 23 and the real rehabilitation training scene information collected by the camera 25 in real time to perform registration and tracking, thereby completing modeling and rendering of the first virtual object 3, the second virtual object 4 and the third virtual object 5 in the virtual scene, and performing virtual-real scene fusion with the real rehabilitation training scene and displaying on the display screen 24 and feeding back to the patient.
In the training process, the patient realizes the control of the first virtual object 3 through the wrist joint rehabilitation training activity, when the wrist joint rehabilitation training range of motion of the patient is not in the range of the rehabilitation guidance training motion data set according to the intelligent evaluation result, namely, the first virtual object 3 controlled by the patient cannot correctly fall into the range set by the second virtual object 4 or the third virtual object 5, the rehabilitation training evaluation module 211 sends the warning information to the display screen 24 to correct the action and avoid the secondary damage of the wrist joint.
In the training process, when the movement angle of the first virtual object 3 controlled by the patient reaches or exceeds the maximum value of the rehabilitation guidance training movement data, namely the second virtual object 4 or the third virtual object 5, set according to the intelligent evaluation result, the rehabilitation training evaluation module 211 sends warning information to the display screen 24 to correct the action and avoid the secondary injury of the wrist joint.
In the training process, when the movement angle of the first virtual object 3 controlled by the patient exceeds the maximum movement angle that can be achieved by the normal wrist joint movement, the rehabilitation training evaluation module 211 sends warning information to the display screen 24 to correct the movement and avoid the secondary damage of the wrist joint.
After accomplishing a rehabilitation training, this training situation can be looked over to the disease, combines the training situation in the rehabilitation training cycle to contrast, supervises and encourages the better continuation wrist joint rehabilitation training next time of disease.
To sum up, the utility model discloses an augmented reality AR wrist joint rehabilitation aassessment and training system can make the disease oneself train to carry out intelligent meticulous aassessment and guide to the training of disease.
While the present invention has been described in detail with reference to the preferred embodiments thereof, it should be understood that the above description should not be taken as limiting the present invention. Numerous modifications and alterations to the present invention will become apparent to those skilled in the art upon reading the foregoing description. Accordingly, the scope of the invention should be limited only by the attached claims.
Claims (8)
1. An augmented reality AR wrist rehabilitation assessment and training system, the system comprising: the system comprises a sensor (1) and a mobile intelligent device (2);
the sensor (1) is fixedly arranged on an affected limb of a patient, is in wireless connection with the mobile intelligent device (2), and is used for transmitting real-time collected action data of the patient to the mobile intelligent device (2); the mobile intelligent equipment (2) receives the action data for processing and displaying;
the mobile smart device (2) comprises:
the wireless connection module (22) is used for being wirelessly connected with the sensor (1), receiving the action data acquired and transmitted by the sensor (1) and sending the action data to the memory (23);
the memory (23) is connected with the wireless connection module (22) and is used for receiving and storing the action data sent by the wireless connection module (22) and sending the action data, the evaluation data of the action activity of the normal wrist joint and the artificial intelligence knowledge inference rule stored in the memory (23) to the processing module (21);
the camera (25) is connected with the processing module (21) and is used for sending real-time acquired real rehabilitation training scene information to the processing module (21);
the processing module (21) is connected with the memory (23) and the camera (25) and is used for receiving real rehabilitation training scene information acquired and sent by the camera (25) in real time, and action data, normal wrist joint action activity degree evaluation data and artificial intelligence knowledge reasoning rules sent by the memory (23), evaluating training results and constructing a virtual-real fusion scene for training guidance; and
the display screen (24) is connected with the processing module (21) and is used for receiving and displaying the virtual-real fusion scene processed by the processing module (21);
wherein the processing module (21) comprises:
the augmented reality AR module (212) is connected with the camera (25) and the display screen (24), receives a real scene which is collected and sent by the camera (25) in real time, realizes the construction of a virtual model by combining the registration and tracking of the real scene, finishes the rendering of a virtual-real fusion scene, and simultaneously transmits the virtual-real fusion scene to the display screen (24); and
and the rehabilitation training evaluation module (211) is connected with the memory (23) and the augmented reality AR module (212) and is used for receiving the action data, the normal wrist joint action activity degree evaluation data and the artificial intelligence knowledge reasoning rule sent by the memory (23), carrying out rehabilitation evaluation on the action data of the patient and the normal wrist joint action activity degree evaluation data which are collected in real time by adopting artificial intelligence knowledge reasoning and combining joint action activity degree ROM evaluation, setting virtual and digital rehabilitation guidance training motion data according to an intelligent evaluation result, and sending the motion information to the augmented reality AR module (212) so as to realize the construction of the augmented reality AR module (212) on a virtual-real fusion scene.
2. The augmented reality AR wrist joint rehabilitation assessment and training system according to claim 1, wherein the normal wrist joint dorsiflexion and radioulnar deviation action activity ROM assessment data comprises: the normal range of motion of palmar flexion is 0-90 degrees, the normal range of motion of dorsiflexion is 0-70 degrees, the normal range of motion of radial deviation is 0-25 degrees, and the normal range of motion of ulnar deviation is 0-55 degrees.
3. The augmented reality AR wrist rehabilitation assessment and training system according to claim 2, wherein the normal maximum angles achievable for the normal wrist palmar flexion and dorsiflexion activities are respectively: 90 degrees of palmar flexion and 70 degrees of dorsiflexion; the normal maximum angle which can be reached by the normal wrist joint radial deviation ulnar deviation movement is respectively as follows: radial deviation is 25 degrees, and ulnar deviation is 55 degrees.
4. The augmented reality AR wrist joint rehabilitation assessment and training system according to claim 1, wherein the rehabilitation training assessment module (211) is connected with the display screen (24) and is used for performing intelligent assessment and real-time judgment on rehabilitation training motion data of the wrist joint of the patient, and when the rehabilitation training motion data of the affected limb is not within the range of the rehabilitation guidance training motion data set by the current intelligent assessment result or exceeds the maximum motion angle of normal joint motion, warning information is sent to the display screen (24) to be displayed.
5. The augmented reality AR wrist joint rehabilitation assessment and training system according to claim 1, wherein said wireless connection module (22) is a bluetooth module.
6. The augmented reality AR wrist rehabilitation assessment and training system according to claim 1, characterized in that said sensor (1) is an angle sensor or a multi-axis sensor with an angle.
7. The augmented reality AR wrist joint rehabilitation assessment and training system according to claim 1, wherein said mobile smart device (2) transmits with a fixed display device or another mobile smart device through a wireless connection, the fixed display device comprising: a television, a computer screen and an outdoor display screen; the mobile smart device includes: tablet computers, notebook computers and mobile phones.
8. The augmented reality AR wrist joint rehabilitation assessment and training system of claim 1, further comprising: an independent video capture camera that replaces the camera (25) of the mobile smart device (2).
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201920239309.4U CN210302240U (en) | 2019-02-22 | 2019-02-22 | Augmented reality AR wrist joint rehabilitation evaluation and training system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201920239309.4U CN210302240U (en) | 2019-02-22 | 2019-02-22 | Augmented reality AR wrist joint rehabilitation evaluation and training system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN210302240U true CN210302240U (en) | 2020-04-14 |
Family
ID=70122222
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201920239309.4U Withdrawn - After Issue CN210302240U (en) | 2019-02-22 | 2019-02-22 | Augmented reality AR wrist joint rehabilitation evaluation and training system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN210302240U (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109701224A (en) * | 2019-02-22 | 2019-05-03 | 重庆市北碚区中医院 | A kind of augmented reality AR wrist joint rehabilitation assessment and training system |
-
2019
- 2019-02-22 CN CN201920239309.4U patent/CN210302240U/en not_active Withdrawn - After Issue
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109701224A (en) * | 2019-02-22 | 2019-05-03 | 重庆市北碚区中医院 | A kind of augmented reality AR wrist joint rehabilitation assessment and training system |
CN109701224B (en) * | 2019-02-22 | 2024-02-23 | 重庆市北碚区中医院 | Augmented reality AR wrist joint rehabilitation evaluation and training system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109701224B (en) | Augmented reality AR wrist joint rehabilitation evaluation and training system | |
CN111460875B (en) | Image processing method and apparatus, image device, and storage medium | |
EP2726164B1 (en) | Augmented-reality range-of-motion therapy system and method of operation thereof | |
KR101367801B1 (en) | Finger exercising apparatus and method for assisting exercise of finger | |
Lu et al. | Immersive manipulation of virtual objects through glove-based hand gesture interaction | |
WO2009112281A1 (en) | Garment integrated apparatus for online posture and body movement detection, analysis and feedback | |
CN103677289A (en) | Intelligent interactive glove and interactive method | |
CN106843507A (en) | A kind of method and system of virtual reality multi-person interactive | |
CN107789803A (en) | A kind of cerebral apoplexy rehabilitation training of upper limbs method and system | |
CA2806642A1 (en) | Modelling of hand and arm position and orientation | |
US20140371634A1 (en) | Method and apparatus for tracking hand and/or wrist rotation of a user performing exercise | |
Choi | Ubi-rehab: An android-based portable augmented reality stroke rehabilitation system using the eglove for multiple participants | |
CN210302240U (en) | Augmented reality AR wrist joint rehabilitation evaluation and training system | |
CN211535454U (en) | Wearable knee joint rehabilitation training device | |
CN111369626A (en) | Markless point upper limb movement analysis method and system based on deep learning | |
KR20120133347A (en) | Rehabilitation training system | |
CN211180839U (en) | Motion teaching equipment and motion teaching system | |
WO2016014163A1 (en) | Three dimensional sensor-based interactive pain maps for localizing pain | |
TWI598135B (en) | Augmented reality limb training method | |
TW201619754A (en) | Medical image object-oriented interface auxiliary explanation control system and method thereof | |
Chiensriwimol et al. | Frozen shoulder rehabilitation: exercise simulation and usability study | |
Bang et al. | A Prototype of Flex Sensor Based Data Gloves to Track the Movements of Fingers | |
Matsumoto et al. | Estimation of grip strength using monocular camera for home-based hand rehabilitation | |
KR102569857B1 (en) | Method of providing practical skill training using hmd hand tracking | |
Kakaraparthi et al. | PERACTIV: personalized activity monitoring-ask my hands |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
AV01 | Patent right actively abandoned | ||
AV01 | Patent right actively abandoned | ||
AV01 | Patent right actively abandoned |
Granted publication date: 20200414 Effective date of abandoning: 20240223 |
|
AV01 | Patent right actively abandoned |
Granted publication date: 20200414 Effective date of abandoning: 20240223 |