TW202347346A - Real-time hand motion monitoring system and method thereof characterized in that the real-time hand motion monitoring system can obtain finger pressing information and distance information between each finger to evaluate hand flexibility - Google Patents

Abstract

The present invention is related to a real-time hand motion monitoring system including a hand carrier, an image acquiring device, an intermediary device and a controlling device. The hand carrier includes several pressure sensors, and each pressure sensor senses the pressing force of the first pulp section of any finger to generate first pressure signals. The intermediary device receives the first pressure signals and then process to be second pressure signals that can be received by the controlling device. The image acquiring device acquires motions of each hand to generate hand images and then transmits the hand images to the controlling device. An operation module arranged in the controlling device provides an operation interface, the controlling device processes each second pressure signal to be the pressing information, then processes the hand images to be distance information between each finger and finally displays each pressing information and distance information between each finger on the operation interface.

Description

Real-time hand motion detection system and method thereof

The present invention relates to a gesture detection device and a detection method, in particular to a real-time hand movement detection system and a method thereof.

Hands are an important sensory organ for the human body to perceive the surrounding environment. They are also the main organ for many complex movements of people. Hand movements produce gestures (such as sign language) to express language, and can also express emotions, such as clapping to express welcome and thanks. Either agree, or the visually impaired can contact the outside world by holding a white cane, or use their hands to operate musical instruments or directly produce rhythm by clapping their hands for musical expression and artistic expression. Of course, it is nothing more than using your hands to perform various actions in daily life, such as using tableware to eat, taking a cup to drink water, etc.

In order to achieve the above-mentioned various hand movements, it depends on the integrity of the hand bones and joints, the balance relationship through muscle and nerve movement control, and the normal conduction of the hand sensory nerves. In addition, hand movements can be divided into 13 basic forms, namely suspension, hold, touch, pushand press, tap, manipulation, and spherical Ball grasp, ball pinch in the first quarter, cylindroids grasp, hook and pull, tip pinch in the second quarter, and more The first section includes multiple-tip pinch and lateral pinch.

Since the hand can make various movements as mentioned above, many researchers or industry players have developed various devices to use the sensing of these movement changes to perform various application functions. For example: Taiwan Patent Publication No. TW201533608A (hereinafter referred to as the former patent Case 1), TW201537396A (hereinafter referred to as the previous patent case 2) and 201702996A (hereinafter referred to as the previous patent case 3)...etc. These previous patents are all equipped with pressure sensors on gloves. In particular, the pressure sensors in the first and second patents are located on the fingertips of the first section of the gloves corresponding to each finger for sensing. The pressing force produced by the contact between the first fingertips of the thumb and the first fingertips of the other hand.

In addition, various assessment methods have been developed for the above-mentioned hand movements, including motor function assessment, sensory function assessment, electrophysiological examination, tool assessment, etc. Among motor function assessments, non-invasive motor function assessment methods are often used. The action of touching the pads of the first section of the thumb with the pads of the first section of the other fingers is a necessary item for a normal hand function check. When checking this item, in order to understand whether the action meets the evaluation standards, one way is to confirm The pad of the first section of the thumb is in contact with the pads of the first section of the other fingers. This detection can be carried out using a glove detection device such as the previous patents.

However, some subjects who have hand injuries or brain damage resulting in hand movements are unable to complete the above movements, or some functions require the detection data of finger bending and stretching movements, which are used to evaluate the dexterity of hand movements. The glove detection device in the previous patent cannot provide detection data, and of course there is no way to provide correlation data between finger pressure and bending and extension. The third previous patent provides a bend detector and a force-sensitive resistor detector ( Please refer to paragraph 0012 of the specification of the third patent), and use the pressure change/distribution detected by the bend detector and the force-sensitive resistor detector to determine whether the user has fully grasped the grip or performed a hand braking action.

Furthermore, there are certain action assessment methods that require the distance between the first pad of the thumb and the first pad of the other fingers to change during the contact with each other, but the aforementioned patent cases are unable to provide this. The detection method of this kind of movement cannot correlate the pressing pressure path where the first finger pulp of the thumb and the first finger pulp of other fingers are in contact with each other. Therefore, it is necessary to improve this problem.

In view of the problems of the prior art, one purpose of the present invention is to solve the problem of not measuring the relative distance between the first finger pulp of the thumb and the first finger pulp of other fingers in detecting hand movements, and in measuring the relative distance between the first finger pulp and the first finger pulp. While measuring this action, it can further measure the pressure changes between the first fingertip of the thumb and the first fingertips of other fingers. It can even further provide a variety of pressure changes between the first fingertip of the thumb and the first fingertips of other fingers. Options for finger pulp movement changes, the pressure and distance between the first finger pulp of the thumb and the first finger pulp of other hand tips under various movement changes, and evaluation of hand flexibility.

According to the object of the present invention, a real-time hand movement detection system is provided, which includes a hand carrier, an image capture device, an intermediary device, and a control device. The hand carrier includes a plurality of pressure sensors, and each pressure sensor They are respectively arranged at the position of the hand carrier relative to the finger pulp of the first section of each finger, and sense the pressing force of the first section of any finger to generate a first pressure signal. The intermediary device connects the hand carrier and The control device receives the first pressure signal and processes it into the second pressure signal accepted by the control device. The image capture device is connected to the control device and captures the movements of each hand to generate a hand image, and converts the hand image into a second pressure signal. The image is transmitted to the control device. The control device is equipped with an operation module. The operation module provides an operation interface and receives each second pressure signal and hand image transmitted by the intermediary device. The control device processes each second pressure signal into a press. information, and the hand image is processed into distance information between each finger, and each pressing information and distance information between each finger are displayed on the operating interface.

Among them, the operation module is provided with the detection pressure threshold value of each finger and the activity distance threshold value between each finger. The real-time hand movement detection system further includes a first prompt unit. The first prompt unit can be set for the operation interface. A tabular diagram or pattern diagram, the control device generates a first prompt signal when the pressing information meets the detection pressure threshold, and displays it in a tabular diagram or pattern diagram according to the first prompt signal, or When the inter-finger distance information meets the inter-finger activity distance threshold, a second prompt signal is generated, and the second prompt signal is displayed in a tabular diagram or a pattern diagram.

Among them, the operation module is provided with the detection pressure threshold value of each finger and the activity distance threshold value between each finger. The real-time hand movement detection system further includes a second prompt unit. The second prompt unit is connected to the hand carrier and the control device The third prompt signal is generated when the pressing information meets the detection pressure threshold, and the third prompt signal is converted into a first driving signal that can be received by the second prompt unit through an intermediary device, and then transmitted to the second prompt unit, so that the third prompt signal can be received by the second prompt unit. The second prompting unit sends a third prompting message according to the driving signal, or generates a fourth prompting signal when the inter-finger distance information meets the inter-finger activity distance threshold, and transmits the fourth prompting signal to the intermediary device, through which the fourth question is The message is converted into a second driving signal that the prompting device can receive, and then transmitted to the second prompting unit, so that the second prompting unit sends the second prompting message according to the driving signal.

Among them, the operation module also has at least one test item. Each test item can be used to set the test time, the pressing sequence of the first fingertip of each finger, the extension or bending distance of each finger, and the number of pressings.

Among them, the operation module is also equipped with an image display window for displaying the hand image and displaying the distance representation pattern resulting from the real-time identification of the distance between the first fingertip of the thumb and the first fingertips of the other fingers.

Among them, the operation module also has a trend chart window to display the pressing information of the first fingertip of each finger and the distance information between the fingers during the test time.

According to the purpose of the present invention, a real-time hand movement detection method is provided, which includes starting the operation module provided by the control device and setting test items. The set test items include test time and the pressing sequence of the first fingertip of each finger. or times, set the detection pressure threshold and the activity distance threshold between each finger, and select the trend chart window of the operation module to display the pressing information and inter-finger distance information of those fingers during the test time, from the hand carrier relative to each A plurality of pressure sensors located at the position of the pulp of the first section of the finger sense the pressing force of the pulp of the first section of each finger, generate a first pressure signal, and transmit the first pressure signal to the intermediary device for processing into the second pressure signal received by the control device and transmitted to the control device by the intermediary device. The image capture device captures the movement of the hand to generate a hand image and transmits the hand image to the control device. The control device is controlled by the operating module Each second pressure signal is processed into pressing information, and the hand image is processed into distance information between each finger, and each pressing information and distance information between each finger are displayed on the operating interface.

Among them, the step of setting the threshold value of the activity distance between each finger includes the control device generating, at the first set time, the relative position of the pulp of the first section of the thumb and the pulp of the first section of other fingers in the hand image. The threshold value of the activity distance between each finger includes the maximum distance value and the minimum distance value.

The maximum distance value of each finger is the average or maximum value of the distance at the largest relative position between the pulp of the first section of the thumb and the pulp of the first section of each finger within the first set time.

Wherein, the minimum distance value of each finger is the average distance or the maximum value of the relative position at which the pulp of the first section of the thumb and the pulp of the first section of each finger start to contact each time within the first set time.

Among them, the step of setting the threshold value of the activity distance between each finger is for the tester to input the maximum distance value and the minimum distance value.

Among them, the step of setting the pressure threshold value of each finger includes controlling the contact of the first finger pulp of the thumb of the device with the first finger pulp of each other finger to generate the pressure threshold value of each finger. The pressure of each finger The threshold value includes the maximum pressure value and the minimum pressure value.

The maximum pressure value of each finger is the average pressure each time the pulp of the first section of the thumb contacts the pulp of the first section of each finger within the second set time.

The minimum pressure value of each finger is the average pressure each time the pulp of the first section of the thumb contacts the pulp of the first section of each finger within the second set time.

Among them, the step of setting the pressure threshold value of each finger is for the tester to input the maximum pressure value and the minimum pressure value.

Among them, each pressing information and each finger distance information can be stored in the control device or transmitted to a cloud device.

To sum up, the present invention can be used to detect the flexibility of fingers, especially the distance between the opening and closing movements of the fingers, and the force with which the pulps of the first joints of the fingers press each other. Such detection of finger flexibility It can be provided to factories to measure the hand dexterity of operators and evaluate the relationship between work efficiency and hand dexterity, or it can be provided to medical institutions so that doctors can evaluate whether finger movements meet medical testing standards.

In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but are not used to limit the present invention.

Please refer to Figures 1 and 2. The present invention provides a real-time hand movement detection system, which includes a hand carrier 1, an image capture device 2, an intermediary device 3, and a control device 4. The hand carrier 1 includes a plurality of Pressure sensors 10. Each pressure sensor 10 is disposed at a position of the hand carrier 1 relative to the pulp of the first section of each finger, and senses the pressing force of the pulp of the first section of any finger, and Generate the first pressure signal. The pressure sensor 10 may be a resistive film piezoelectric sensor or a capacitive pressure sensor 10 . In addition, the hand carrier 1 can be a glove or a fingertip cover of the first section. The tie can be a glove or a finger cot. Furthermore, more than one pressure sensor 10 can be provided on the first fingertip of each finger to measure whether the subject can press to different positions on each fingertip, for example: on each fingertip. A pressure sensor 10 is provided at the center, left and right positions respectively.

In the present invention, the intermediary device 3 can be an embedded system module (System On Module, SOM for short, or Computer On Module for short: COM), or it can be a microcontroller unit (microcontroller unit, MCU). Combined with a signal amplification and noise reduction circuit, a Bluetooth module, and a WiFi module, the intermediary device 3 is connected between the hand carrier 1 and the control device 4, receives the first pressure signal, and processes the first pressure signal into a control device For the second pressure signal received by 4, the control device 4 can be a desktop computer, a notebook computer, a tablet computer or a smart mobile phone. Furthermore, any electronic device that has computing power and can install applications can be The control device 4 referred to in the present invention.

In the present invention, the image capturing device 2 can be a network camera, a digital camera, a photographing device of a tablet computer, or a photographing device of a smart mobile phone. The image capturing device 2 is connected to the control device 4 and captures hand movements. A hand image is generated and transmitted to the control device 4 .

In the present invention, please refer to Figures 3 to 5. The control device 4 is provided with an operation module. The operation module is application software. The operation module provides an operation interface and receives each second data transmitted by the intermediary device 3. The pressure signal and the hand image transmitted by the image capture device 2 are used. The control device 4 processes each second pressure signal into pressure information, and processes the hand image into distance information between each finger, and displays each pressure information on the operation interface. and distance information between each finger.

In the present invention, as shown in Figure 3, the operation module is provided with a detection pressure threshold value for each finger and a threshold value for the movement distance between each finger. The real-time hand movement detection system further includes a first prompt unit 50. The prompt unit 50 can be one of the tabular diagrams or pattern diagrams set in the operation interface. The control device 4 generates a first prompt signal when the pressing information meets the detection pressure threshold, and based on the first prompt signal, The tabular diagram or patterned diagram is displayed, or the second prompt signal is generated when the inter-finger distance information meets the inter-finger movement distance threshold, and the tabulated diagram or patterned diagram is displayed according to the second prompt signal.

For example, please refer to Figure 3. The first prompt unit 50 is a tabular diagram, with the horizontal axis representing time, the right vertical axis being the activity distance value, and the left vertical axis being the detected pressure value, and in the table The diagram uses dotted lines in different colors to represent the activity distance threshold and detection pressure threshold, so that the subject can observe whether the action meets the detection pressure threshold or the activity distance threshold, and when the subject's action meets the detection pressure The threshold value or the activity distance threshold value can display text or patterns on the operating interface as the first prompt signal or the second prompt signal, or the first prompt signal or the second prompt signal can be displayed from an output device connected to the control device 4, for example The output device can be a speaker or an LED display panel.

In the present invention, please refer to FIG. 4 . The operation module is provided with a display interface 52 for the detection pressure threshold of each finger and the threshold of the movement distance between each finger. The real-time hand movement detection system further includes a second prompt unit. 12. The second prompt unit 12 is located on the back of the hand corresponding to the position of each finger (as shown in Figure 2), such as an LED light or a vibration motor. The control device 4 generates a third prompt signal when the pressing information meets the detection pressure threshold. The third prompt message is converted into a first driving signal that the second prompt unit 12 can receive through the intermediary device 3, and then transmitted to the second prompt unit 12, so that the second prompt unit 12 sends the third prompt message according to the first drive signal. , or the fourth prompt signal is generated when the inter-finger distance information meets the inter-finger activity distance threshold, and the fourth prompt signal is sent to the intermediary device 3, and the fourth prompt signal is converted by the intermediary device 3 into a signal that can be received by the third prompt device. The second driving signal is then transmitted to the second prompting unit 12, so that the second prompting unit 12 sends a fourth prompting message according to the driving signal.

For example, when the detection pressure threshold is met, the LED light turns from the off state to the on state, and continues to glow for 1 to 3 seconds before turning off, or when the detection activity distance threshold is met, the second drive signal drives the vibration motor The vibration continues for 1 to 3 seconds, and the subject can confirm whether the hand movements meet the detection pressure threshold and the activity distance threshold between each finger by the on-off action of the LED light and the vibration of the vibration motor.

In the present invention, please refer to Figure 4. The operation module is also provided with at least one test item 54. Each test item 54 can be used to set the test time, the pressing sequence of the fingertips of the first section of each finger, and the The distance of stretching or flexion and the number of compressions. For example: the test time is 3 minutes, the pressing sequence is that the pads of the first section of the index finger, middle finger, ring finger and little finger contact and press in sequence with the pad of the first section of the thumb, and set the pressure of the index finger, middle finger, ring finger and little finger. The detection pressure threshold value of the first fingertip is when the output value of the pressure sensor 10 is between 0.2 and 5 volts, and the fingertips of the first fingertips of the index finger, middle finger, ring finger and little finger and the first fingertip of the thumb The threshold value of the activity distance between the abdomen is between 3 and 200 millimeters (mm). Or the order in which the pads of the first section of the index finger, middle finger, ring finger and little finger come into contact with the pad of the first section of the thumb is randomly generated each time.

Based on the above, the operation module can set the sequence in which the finger pulp contacts and presses the first section of the thumb next to the position where the detection pressure threshold value of each finger and the activity distance threshold value between each finger are set. Pattern 56, for example: when the first fingertip of the little finger needs to be pressed relative to the first fingertip of the thumb, a pattern mark is displayed next to the detection pressure threshold or activity distance threshold of the little finger. When the pressing is completed, a pattern mark is displayed below. A pattern mark is displayed next to the detection pressure threshold or activity distance threshold of the finger to be pressed in each sequence, so that the subject can understand the current action to be performed.

In the present invention, as shown in FIG. 5 , the operation module is also provided with an image display window 58 for displaying an image of the hand and for displaying the real-time identification of the pulp of the first section of the thumb and the first sections of the other fingers. The distance representation pattern 580 produced by the abdominal distance. It is also possible to mark in the image display window 58 a sequence pattern 56 in which the first section of the index finger, middle finger, ring finger and little finger contacts and presses the first section of the thumb, for example: when the first section of the little finger is required. When the first finger pad of the thumb is pressed against each other, a box is marked on the position of the first finger pad of the little finger in the hand image. When the pressing is completed or a stretch and bending is completed, a box is marked on the first fingertip position of the finger to be pressed in the next sequence in the hand image, so that the subject can understand the current action to be performed.

In the present invention, please refer to FIG. 4 . The operation module is also provided with a trend chart window 59 for displaying the pressing information of the first segment of each finger and the distance information between the fingers during the test time. That is, the aforementioned tabular diagram uses the horizontal axis to represent time, and the right vertical axis is the activity distance value, and the left vertical axis is the detected pressure value, and different colors or types of lines are used to represent the activity distance in the tabular diagram. The threshold value and detection pressure threshold value are used to continuously display the change in pressure value and activity distance of the subject during the measurement time.

Please refer to Figure 6. The present invention is a real-time hand movement detection method, which includes the following steps: (S101) Start the operation module provided in the control device 4; (S102) Set the test item 54. The set test item 54 includes the test time, the pressing sequence or number of fingertips of the first section of each finger, setting the detection pressure threshold and the activity distance threshold between each finger, and selecting the operating module. The trend chart window 59 should display the pressing information of those fingers and the distance information between the fingers during the test time; (S103) A plurality of pressure sensors 10 provided at the position of the hand carrier 1 relative to the pulp of the first section of each finger sense the pressing force of the pulp of the first section of each finger to generate the first pressure. signal; (S104) Send the first pressure signal to the intermediary device 3 for processing into a second pressure signal accepted by the control device 4, and transmit it to the control device 4 by the intermediary device 3; (S105) The image capture device 2 captures hand movements to generate hand images, and transmits the hand images to the control device 4; (S106) The control device 4 uses the operation module to process each second pressure signal into pressure information, and processes the hand image into inter-finger distance information, and displays each pressure information and inter-finger distance information on the operation interface.

In the present invention, the step of setting the threshold value of the activity distance between each finger can be completed by the following two methods. One is by the control device 4 at the first setting time from the pulp of the first section of the thumb and the other fingers in the hand image. The relative position of the finger pads of the first section generates the inter-finger activity distance threshold value of each finger. The inter-finger activity distance threshold value includes the maximum distance value and the minimum distance value (as shown in Figure 4).

Furthermore, the maximum distance value of each finger is the average or maximum distance between the relative positions of the first joint of the thumb and the first joint of each finger within the first set time. value. For example, within the first set time, the distances between the three largest relative positions of the little finger and thumb are 200mm, 198mm, and 202mm respectively. The average distance is 200mm, and the maximum value is 202mm. If the maximum distance value is used as the distance The average value is 200mm, and if the maximum distance value is taken as the maximum value, it is 202mm.

The minimum distance value of each finger is the average or minimum distance value of the relative position at which the pulp of the first section of the thumb and the pulp of the first section of each finger start to contact each time within the first set time. For example, the distances between the relative positions where the little finger and the thumb are in contact three times within the first set time are 1mm, 5mm, and 3mm respectively. The average distance is 3mm, and the minimum value is 1mm. If the minimum distance value is used as the average distance The value is 3mm, and if the minimum distance value is the minimum value, it is 1mm.

What needs special explanation here is the theoretical value of the average or minimum distance between the relative positions of the first joint of the thumb and the first joint of each finger for an average person within the first set time. It should be 0mm, and the above example is based on a person with impaired hand movement, so the minimum distance value of each finger may not be zero. The aforementioned maximum distance values may only be 1mm, 5mm, or 3mm for people with impaired hand movements.

Another way to set the threshold value of the movement distance between each finger is to have the tester input the maximum distance value and the minimum distance value. In addition, the first setting time is input by the tester or built into the operation module.

In the present invention, the step of setting the pressure threshold of each finger includes the control device 4 receiving the contact between the pulp of the first section of the thumb and the pulp of the first section of the other fingers to generate the pressure threshold of each finger. , the pressure threshold value of each finger includes the maximum pressure value and the minimum pressure value (as shown in Figure 4).

Furthermore, the maximum pressure value of each finger is the average pressure of each time the pulp of the first joint of the thumb contacts the pulp of the first joint of each finger within the second set time, for example, within the second set time The average pressure of the index finger and the first section of the thumb when they contact with maximum force are 4.9 volts, 5.1 volts, and 5 volts respectively. The average pressure value is 5 volts, and the maximum pressure value of the index finger is set to 5 volts.

In the present invention, the minimum pressure value of each finger is the average pressure of the minimum force each time the pulp of the first section of the thumb contacts the pulp of the first section of each finger within the second set time. , for example, during the second set time, the average pressure of the index finger in contact with the first joint of the thumb is 0.3 volts, 0.2 volts, and 0.4 volts respectively, then the average pressure value is 0.3 volts, and the minimum pressure value of the index finger is set is 5 volts.

Another step of setting the pressure threshold value of each finger can also involve the tester inputting the maximum pressure value and the minimum pressure value. In addition, the second set time is input by the tester or built into the operation module.

In the present invention, each pressing information and each finger distance information can be stored in the control device 4 or transmitted to a cloud device, or the operation module can output whether to reset all or part of the test items 54.

In the present invention, the hand image is processed into the distance information between each finger, which can be established by using the image recognition neural network in the operating module. For example, using the open source computer vision library using the Python program. (OpenCV) for image recognition, or use Google AI platform for image recognition.

According to the above, the present invention can be used in various fields, such as medical institutions to evaluate the mobility of hand movements caused by neurological diseases (such as Alzheimer's disease), for example: during hand rehabilitation, monitoring The opening and closing state of the subject's fingers and the force of contact between the fingertips, or the factory can be used to measure the operator's hand dexterity to evaluate the relationship between work efficiency and hand dexterity.

1:Hand carrier 10: Pressure sensor 2:Image capture device 3: Intermediary device 4:Control device 50: First prompt unit 52: Display interface 56: Sequence pattern 54:Test items 58:Image display window 580: Distance representation pattern 59: Trend chart window S101~S106: step process

Figure 1 is a schematic diagram of the system architecture of the present invention. Figure 2 is a schematic diagram of the hand carrier of the present invention. FIG. 3 is a schematic diagram of a tabular diagram of the operation interface of the present invention. Figure 4 is a schematic diagram of the display interface of the operation interface of the present invention. Figure 5 is a schematic diagram of the image display window of the operation interface of the present invention. Figure 6 is a schematic flow chart of the method of the present invention.

1:Hand carrier

10: Pressure sensor

2:Image capture device

3: Intermediary device

4:Control device

50: First prompt unit

Claims (15)

A real-time hand motion detection system, including: A hand carrier, the hand carrier includes a plurality of pressure sensors, each of the pressure sensors is respectively disposed at the position of the hand carrier relative to the pulp of the first section of each finger, and senses a measured The amount of pressure exerted by the fingertips of the first joint of each finger of the user is used to generate a first pressure signal respectively; An image capturing device captures the movements of each finger of the subject's hand to generate a hand image; An intermediary device is connected to the hand carrier, receives each first pressure signal, and processes it into a second pressure signal; A control device. The control device is provided with an operation module. The operation module provides an operation interface and receives each of the second pressure signals and the hand image. The control device processes each of the second pressure signals as follows: Once the pressing information is processed, the hand image is processed as inter-finger distance information between the first fingertip of the subject's thumb and other fingers, and each pressing information and each finger are displayed on the operating interface. distance information. The real-time hand movement detection system as claimed in claim 1, further comprising a first prompting unit; The operation module is provided with a detection pressure threshold for each finger, and a fingertip activity distance threshold between the first fingertip of the thumb and other fingers; Wherein, the first prompt unit can be a tabular diagram or a patterned diagram set for the operation interface, and the control device generates a first prompt signal when the pressing information meets the detection pressure threshold. , and generate a second prompt signal based on the first prompt signal when it is displayed in a tabular diagram or pattern diagram, or the inter-finger distance information meets the inter-finger activity distance threshold, and based on the second prompt signal Displayed in the tabular schema or the graphical schema. The real-time hand movement detection system as claimed in claim 1, which includes a second prompt unit connected to the hand carrier; The operation module is provided with a detection pressure threshold value of each finger and a movement distance threshold value between fingers. When the pressing information meets the detection pressure threshold value, the control device generates a third prompt signal through the The intermediary device converts the third prompt message into a first driving signal that the second prompting unit can receive, and then transmits it to the second prompting unit, so that the second prompting unit sends a third prompt according to the first driving signal. message; Or the control device generates a fourth prompt signal when the inter-finger distance information meets the corresponding inter-finger activity distance threshold, and transmits the fourth prompt signal to the intermediary device, and the fourth prompt signal is transmitted through the intermediary device. The prompt message is converted into a second driving signal that the second prompting unit can receive, and then transmitted to the second prompting unit, so that the second prompting unit sends a fourth prompting message according to the second driving signal. The real-time hand movement detection system as described in claim 1, wherein the operation module is further provided with at least one test item, and each of the test items can be used to set a test time and the pressing of the first fingertip of each finger. The order, the distance of extension or contraction of each finger, and the number of presses. The real-time hand movement detection system as described in claim 1, wherein the operation module is further provided with an image display window for displaying the hand image and a distance representation pattern that displays the distance information between the fingers. The real-time hand movement detection system as described in claim 1, wherein the operation module is further provided with a trend chart window to display the pressing pressure of the first section of each finger during a test period. information and distance information between each finger. A real-time hand movement detection method includes the following steps: Activate an operation module provided by a control device; Set a test item in the operation module. The test item includes a test time, the pressing sequence or number of times of the first finger of each finger, and sets a detection pressure threshold value of each finger of a subject and each The threshold value of the inter-finger activity distance of the fingertip, and the selection of which finger of the subject corresponds to the press information or the inter-finger distance information to be displayed in a trend chart window of the operating module during the test time; A plurality of pressure sensors located at the position of the hand carrier relative to the pulp of the first section of each finger sense the pressing force of the pulp of the first section of each finger to generate a first pressure signal. ; Send the first pressure signal to an intermediary device for processing into a second pressure signal accepted by a control device, and transmit it to the control device by the intermediary device; An image capturing device captures the movement of the subject's hand to generate a hand image, and transmits the hand image to the control device; The control device processes each second pressure signal into a press information by the operation module, processes each hand image into an inter-finger distance information, and displays each press information and each finger on the operation interface. distance information. The real-time hand movement detection method as described in claim 7, wherein the step of setting the threshold value of the movement distance between each finger includes the control device obtaining the first thumb from the hand image at a first set time. The relative position of the fingertips of each finger and the fingertips of the first fingertips of other fingers generates the inter-finger movement distance threshold value of each finger. The inter-finger movement distance threshold value includes a maximum distance value and a minimum distance value. The real-time hand movement detection method as described in claim 8, wherein the maximum distance value of each finger is respectively the pulp of the first section of the thumb and the pulp of the first section of each finger within a first set time. The average or maximum distance between relative positions with the largest gap. The real-time hand movement detection method as described in claim 9, wherein the minimum distance value of each finger is respectively the pulp of the first section of the thumb and the pulp of the first section of each finger within the first set time. The average or maximum distance of the relative positions where contact begins. The real-time hand movement detection method as described in claim 7, wherein the step of setting the threshold value of the movement distance between the fingers is to have a tester input a maximum distance value and a minimum distance value. The real-time hand movement detection method as described in claim 7, wherein the step of setting the pressure threshold of each finger includes the control device receiving the first finger pulp of the thumb and the first finger pulp of each other finger respectively. The pressure threshold value of each finger is generated by contact with each other, and the pressure threshold value of each finger includes a maximum pressure value and a minimum pressure value. The real-time hand movement detection method as described in claim 12, wherein the maximum pressure value of each finger is the pulp of the first section of the thumb and the pulp of the first section of each finger respectively within a second set time. The average pressure of the contact. The real-time hand movement detection method as described in claim 13, wherein the minimum pressure value of each finger is the pulp of the first section of the thumb and the pulp of the first section of each finger respectively within the second set time. The average pressure of the contact. The real-time hand movement detection method as described in claim 7, wherein the step of setting the pressure threshold value of each finger involves a tester inputting a maximum pressure value and a minimum pressure value.

Images