TW201621757A - A movement detection and judgment device and method - Google Patents

Abstract

A Movement detection and judgment method comprises a display module and a position mark. The user controls a self-corresponded image shooting by a camera to fit the position mark. A processor executes an image processing method to recognize the position of the self-corresponded image which is fit the position mark or not. If it does fit the position mark, the position mark will produce a correct signal to mention the user which the position of movement is correct. Moreover, this invention comprises a wireless wearable sensor device which can display the a movement correct information or movement incorrect information.

Description

Motion detection and judgment device and method

A motion detecting device, in particular, a motion detecting and determining device and method using position marking and image computing.

Modern people often can't sit or stay in the same position for a long time because of work, so they are prone to muscle fatigue or related work injuries, such as lumbar bone spurs caused by standing or sedentary. To avoid similar work injuries, the most fundamental solution is to avoid maintaining or repeating a certain posture or movement for a long time. After a certain period of work, a few minutes of stretching can be performed, thereby effectively avoiding the above problems. However, in reality, when stretching, the stretching motion may be inaccurate due to other factors such as space limitation, and thus the stretching effect cannot be achieved, and the effect of relaxing the muscles and avoiding related work injuries cannot be achieved. A device that detects whether a related action is achieved during a stretching action to achieve a certain standard to assist an athlete in understanding whether his or her action has reached a standard.

In order to avoid the inaccuracy in the stretching exercise, the effect of stretching cannot be surely achieved. Therefore, there is a need for a device that can detect the relevant action during the stretching action to achieve a certain standard to assist the athlete to understand whether his or her action has been achieved. standard. The present invention provides a motion detection and determination method for determining a position of a corresponding image displayed on a display module, the method comprising: capturing the corresponding image when the user performs an action, so that the corresponding image is corresponding to the movement a motion display; the display position is indicated by the display module, and the position is marked as an image, the position mark indicates a position corresponding to the corresponding image; and the position of the position indicated on the display module is adjusted according to a control signal The control signal is a signal generated by the user on the display interface; and determining whether the position of the corresponding image corresponds to the position indication. If the human motion image has a corresponding position indication, the correct display message is displayed on the display module. If the human motion image does not correspond to the position indication, an action error message is displayed on the display module.

Wherein, the position indicator includes a reference position indication and a movement position indication, the reference position indication display is earlier than the movement position indication, wherein: the reference position indication provides a position basis before the user starts the movement action; and the movement The position indication provides the user with the position corresponding to each limb in the movement.

The reference position indication and the movement position indication include a corresponding distance relationship, and the corresponding distance relationship maintains a fixed distance between the reference position indication and the movement position indication; wherein: the reference position indication is toward the first according to the corresponding distance relationship The direction is adjusted by a distance; and the motion position indication is synchronized to move the same distance in the same direction.

Wherein, the plurality of images included in the motion position indicator include a corresponding distance relationship, and any one of the motion position indicators adjusts the image in a direction, and the remaining images in the motion position indicator are synchronized to the same Move the same distance in the direction.

The plurality of images included in the motion location indicator include a corresponding distance relationship, and any one of the motion location markers can be individually adjusted.

After the corresponding image is displayed on the display module, the position indication indicates that the correct action message is generated, indicating that the motion action is correct corresponding to the position indication; and the corresponding image is displayed on the display module. After the position is not corresponding to the position indication, the position indication generates an action error message indicating that the motion action is not correctly corresponding to the position indication.

The action correct message includes a first change and a second change of the motion position indicator, where the position of the corresponding image displayed on the display module corresponds to the position of the motion position, and the motion position indicator generates the first And after the first change is generated, the action position indication generates the second change when the corresponding image maintains the corresponding motion position indication for a sustain time. As can be seen from the above, the present invention has the following advantages:

1. Providing an action demonstration information and a plurality of motion location labels, so that the user can learn the motion mode according to the action demonstration information; according to the motion location label, whether the motion posture meets the standard is known;

2. Provide recording function, users can understand their own movements.

Please refer to FIG. 1 , which is a motion detection and determination system, which includes a camera device 10 and an information processing device 20 . The information processing device 20 can be a desktop computer, a notebook computer or a The photographic device 10 can be a camera detachably coupled to the desktop computer screen or a photographic lens electrically connected to the notebook computer screen and the smart phone.

The information processing device 20 includes a processing module 21, a signal transmission module 22, a storage module 23 and a display module 24. The processing module 21 and the signal transmission module 22 and the storage module 23 are electrically The signal transmission module 22 is electrically connected to the display module 24. The display module 24 can be a screen of the desktop computer, the notebook computer or the smart phone. The storage module 23 stores a control interface program and a demonstration message of the complex array operation. The control interface program transmits the mode via the signal. The group 22 displays a control interface 30 on the display module 24; the action demonstration information includes a motion description and a position indicator 40, and the position indicator 40 is an image displayed on the display module 24. Further, the image may be an image different from the back color, an image different from the background brightness, or an image having a contour shape change, thereby enhancing the visual effect received by the user on the display module 24.

The position indicator 40 includes a motion position indicator 41 and a reference position indicator 42. The reference position indicator 42 can be displayed on the display module 24 earlier than the motion position indicator 41. The reference position indicator 42 provides user motion start. The position of the front position is such that the position of the user is prevented from being beyond the range that the photographing device 24 can capture, and the reference position indicator 42 can be a single or plural image, which is not limited herein, for example, the reference position mark 42 may be an indication of a head position indicating a starting position before the user performs the motion action, or the reference position indicator 42 may be an indication of a head position and an indication of a chest position.

The motion position indicator 41 provides a motion position basis when the user performs the motion action in a plurality of images, and indicates that the user should perform a corresponding position in the motion action, for example, at intervals of a plurality of images. Corresponding to the position of the upper limb of the user, and the distance between the images may be equidistant or unequal.

The photographing device 10 continuously captures a corresponding image 45 of the user, and the corresponding image 45 is displayed on the user screen of the photographing device screen 34 after the photographing device 10 captures the user, and the corresponding image 45 corresponds to the user. This motion action performed before the photographing device 10. The location indicator 40 is displayed on the control interface 30. The description of the motion action may be an image description information, a text description information, or a combination of the two. The action demonstration information is displayed on the control interface 30.

The reference position indicator 42 and the movement position indicator 41 can be adjusted synchronously or individually according to the user's needs to match the body shape of the user or to cooperate with a rehabilitation patient who cannot smoothly move the limb. The movement position indication 41 and the reference position indication 42 may include a corresponding distance relationship, and the corresponding distance relationship is maintained between the movement position indication 41 and the reference position indication 42 when the reference position indication 41 or the movement position indication 41 moves. After a fixed distance is adjusted, the position of the reference position indicator 42 is adjusted, and the motion position indicator 41 that is subsequently generated can be adjusted according to the adjusted position of the reference position indicator 42 or moved after the movement position indicator 42 is moved. The remaining motion position indicator 42 can be moved correspondingly to a specific size relationship. In the embodiment of the present invention, the user touches the movement through the control interface 30, moves by the mouse, or moves the reference position indicator 42 by using a button input. After the reference position indicator 42 is adjusted to a specific distance in a specific direction, The movement position indicator 41 that is subsequently generated can synchronously move the specific distance to the specific direction, and the user touches the movement through the control interface 30 or moves any of the movement position indications 41 by using a button input, in any of the movement indications 41 After adjusting a certain distance to a specific direction, the remaining motion indicators 41 can synchronously move the specific distance to the specific direction. For example, if the user adjusts the reference position indicator 42 to move upward by 10 cm, the movement position indicator 41 moves up by 10 cm in synchronization, or the user adjusts any of the movement position indications 41 to move to the left by 10 cm, and the rest of the action position Mark 41 is synchronized to the left.

Further, if the user is a rehabilitation patient with hemiplegia symptoms, the range of motion of the limbs is different, and the motion position indicator 41 can individually adjust the position of the image contained therein, for example, individually adjusting a certain number of The image corresponding to the right upper limb reduces the position of the image in the display module 24, so that the user can smoothly match the motion position indicator 41.

The processing module 21 receives a picture signal output by the camera device 10 after capturing the corresponding image 45. The image signal is processed by the processing module 21 to output a picture calculation result signal to the storage module 23 And the signal transmission module 22 outputs the picture calculation result signal to the display module 24 and displayed on the control interface 30. At the same time, the user can click the button on the control interface 30, and the control interface 30 outputs a control signal corresponding to the button. The control signal is input to the processing module 21 via the signal transmission module 22, wherein the user points The processing module 21 can control the corresponding module according to the control signal, for example, controlling the opening or closing of the photographing device 10 according to the control signal, according to the touch control, the mouse click, or the keyboard button click. The control signal controls the storage module 23 to output different action demonstration information or clear the picture calculation result signal stored by the storage module 23.

Referring to FIGS. 2 and 3, the control interface 30 includes a setting interface 31, an action recording and recording interface 32, an action selection interface 33, a camera device screen 34, and an action demonstration screen 35. The setting interface 31 includes at least a start button, a stop button and a reset button. The user selects the start button or the stop button to start or stop the function of detecting and detecting the action respectively, and the reset button can make the action The information displayed by the recording interface 32 is reset to zero and the screen calculus result signal stored by the storage module 23 is cleared. The information displayed by the action recording interface 32 includes at least one exercise time and a number of action completions. The image calculation result signal output by the processing module 21 includes at least the exercise time and the number of completions of the action. The action selection interface 33 can be a plurality of selection keys. Each of the selection keys can be associated with a motion action, or can be a menu. Clicking on the menu can select a plurality of the motion actions, and the action demonstration screen 35 is corresponding to the display. The action demonstration information of the motion action selected by the action selection interface 33. The photographing device screen 34 displays a screen captured by the photographing device 10 and a plurality of position indicators 40.

It is an action flow of an embodiment of the present invention:

Step 1. Click the start button of the control interface 30 to cause the photographing device 10 to start photographing;

Step 2: The photographing device 10 captures an original image before the user starts to move;

Step 3: The user selects a motion action in the action selection interface 33, and displays the action demonstration information of the selected motion action by the action demonstration screen 35;

Step 4: The user performs the same action according to the selected motion action, and the camera device 10 captures a motion image when the user performs the action;

Step 5: The processing module performs the screen calculation processing according to the original image and the motion image, and outputs the screen calculation result to determine whether the motion action meets the standard of the action demonstration information; wherein, if the screen calculation result determines the motion If the action does not meet the criteria of the action demonstration information, the display module 24 displays an action error message to alert the user that the action error message can be text, graphics or sound. Alternatively, the motion error message may be a color change of the position indicator 42 or a change in brightness.

Step 6: Record the number of the motions in the picture calculation result that meets the action demonstration information standard in the storage module 23 and display the action record interface 32.

In the embodiment of the present invention, the image processing method includes an image recognition method and an image localization method, wherein the image recognition method has the following steps:

In step 1, the camera device 10 captures the corresponding image 45 of the user, and the corresponding image 45 includes an original image and a motion image. The original image may be an image before the motion, and the motion image may be In order to perform an image in the motion, or the original image and the motion image are images successively captured in the motion;

Step 2: performing an intersection comparison on the original image and the motion image, and comparing the pixel differences of each pixel of the two images by the cross comparison, and classifying the pixel difference by a binarization threshold to generate a background separation In the image, when the pixel difference is large, the binarization threshold is represented by black pixels; when the pixel difference of each dot is smaller than the binarization threshold, it is represented by white pixels. Wherein, the binarization threshold can be selected by the user or according to the experience of use, and the binarization threshold having the best image recognition effect can be selected;

Step 3: The background separation image further performs a noise filtering process. The noise filtering process can be selected by the user or according to the experience of using the noise filtering processing method with the best image recognition effect.

Please refer to FIG. 4, the image positioning method has the following steps:

Step 1, the user selects a motion action, the camera device screen 34 displays the reference position indicator 42;

Step 2: The user moves the limb to align the corresponding image 45 of a certain part of the body with the reference position indicator 42. In the embodiment of the present invention, the reference position indicator 42 is a position corresponding to the user's head. After the user controls the motion to make the head portion of the corresponding image 45 correspond to the reference position indicator 42, the reference position indicator 42 generates an action correct message, and the action correct message may be a color change or a blinking brightness. Variety. The reference position indicator 42 can be adjusted according to the user's needs to match the user's body shape. The step of adjusting the reference position indicator 42 is: after the reference position 42 is displayed on the display module 24, the user can The reference position 42 is moved in a touch manner directly on the display module 24, or the position displayed by the reference position 42 can be adjusted through the control interface 30;

Step 3: The user aligns the motion action with the motion position indicator 41 according to the motion position indicator 41. In the embodiment of the present invention, the motion position indicator 41 is a position corresponding to the user's limb. The movement position indicator 41 can be adjusted according to the user's needs to match the body shape or body extension of different users. The step of adjusting the motion position indicator 42 is: after the motion position indicator 41 is displayed on the display module 24, the user can directly move the motion position indicator 41 on the display module 24 by touch, or The position displayed by the movement position indicator 41 can be adjusted through the control interface 30;

Step 4: The background separation image is compared with the motion position indicator 41. When the background separation image conforms to the action position indication 41, the action position indication 41 generates the correct action message, wherein the action correct message includes a first change 43 and a second change 44, when the background separated image conforms to the action position indication 41, the action position indicator 41 generates the first change 43 and the action position is marked after the motion action lasts for a maintenance time The second change 44 is generated to alert the user of the motion state, wherein the first change and the second change of the action position 41 provide a visual and/or audible effect change to the user through the vision and/or The change in the auditory effect indicates whether the corresponding image 45 is correct and corresponds to the maintenance position of the motion position indicator 41 and the correct corresponding position indicator 41, and the visual effect change may be a color change, a blinking brightness change, and an outline change. Or sounding, the maintenance time can be adjusted according to the user's needs, or the correct message of the action can also be displayed on the display. Text on the group 24, the sound output from the drawings or the information processing apparatus 20.

Further, the present invention includes a wireless sensing wear device that senses an action information of a user's limb movement through the wireless sensing wear device, and the motion information is wirelessly transmitted to the signal transmission module 22 and displayed on the motion recording interface. 32 and stored in the storage module 23. The wireless sensing wear device can be a bending sensing device, and the bending sensing device senses the degree of bending of the user's limb, thereby determining the softness of the limb or the degree of bending of the limb when performing the certain motion. Alternatively, the wireless sensing wear device can be a g-sensor, and the gravity sensing device measures the speed of movement of the limb when the user performs a certain motion.

Further, the wireless sensing wear device can display the correct action message or the action error message, wherein the action correct message or the action error message can be a vibration sense generated by a vibration module, and the user wears the wireless device. The sensing wear device senses the vibration feeling, or may be an audio output module or a light output module, and the sound output or the light output indicates the correct action message or the action error message.

Further, the photographing device in the present creation can be a single-lens photographing device, which reduces the cost increase and complicated calculation problem that may be caused by using multiple lenses.

As can be seen from the above, the present invention has the following advantages:

1. Provide an action demonstration information and a plurality of motion location labels, so that the user can learn the motion mode according to the action demonstration information; according to the motion location label, it is understood whether the motion posture meets the standard;

2. Provide recording function, users can understand their own movements.

10‧‧‧Photographing device
20‧‧‧Information processing device
21‧‧‧Processing module
22‧‧‧Signal transmission module
23‧‧‧ Storage Module
24‧‧‧ display module
30‧‧‧Control interface
31‧‧‧Setting interface
32‧‧‧Action Recording Interface
33‧‧‧Action selection interface
34‧‧‧Photographing device screen
35‧‧‧Action demonstration screen
40‧‧‧Location Marking
41‧‧‧ sports marking
42‧‧‧ benchmark position indication
43‧‧‧First change
44‧‧‧ second change
45‧‧‧ corresponding image

1 is a block diagram of a module in accordance with a preferred embodiment of the present invention. 2 is a schematic diagram of a control interface in accordance with a preferred embodiment of the present invention. Figure 3 is a schematic view of the operation of the preferred embodiment of the present invention. 4 is a schematic diagram of the action flow of a preferred embodiment of the present invention.

40‧‧‧Location Marking

41‧‧‧ sports position

42‧‧‧ benchmark position indication

43‧‧‧First change

44‧‧‧ second change

45‧‧‧ corresponding image

Claims (10)

A motion detection and determination method for determining a position of a corresponding image displayed on a display module, the method comprising: capturing the corresponding image when the user performs an action, so that the movement of the corresponding image corresponds to the motion The display position is indicated by the display module, and the position is marked as an image, the position indication indicates a position corresponding to the corresponding image; and the position of the position indicated on the display module is adjusted according to a control signal, The control signal is a signal generated by the user on the display interface; and determining whether the position of the corresponding image corresponds to the position indication, and if the human motion image has a corresponding position indication, displaying a correct message in the display module; The human motion image does not correspond to the position indication, and an operation error message is displayed on the display module. According to the motion detection and determination method described in claim 1, the position indicator includes a reference position indication and a movement position indication, and the reference position indication is displayed earlier than the movement position indication, wherein: the reference position indication provides The user performs a positional basis before the start of the motion action; and the motion position indicator provides a position at which the user should correspond to each limb in the motion action. According to the motion detection and determination method described in claim 2, the reference position indication and the movement position indication include a corresponding distance relationship, and the corresponding distance relationship maintains a reference between the reference position indication and the movement position indication. a fixed distance; wherein: the reference position indication adjusts a distance in a direction according to the corresponding distance relationship; and the motion position indication synchronizes to move the same distance in the same direction. According to the motion detection and determination method described in claim 2, the plurality of images included in the motion position indicator include a corresponding distance relationship, and any one of the motion position indicators adjusts the distance in one direction. The remaining images in the motion location indicator are synchronized to move the same distance in the same direction. According to the motion detection and determination method described in claim 2, the plurality of images included in the motion position indicator include a corresponding distance relationship, and any one of the motion position markers can be separately adjusted. According to the motion detection and determination method described in the first to fifth aspects of the patent application, after the corresponding image is displayed on the display module corresponding to the position indication, the position indication generates an action correct message indicating the motion action. Correctly corresponding to the position indication; and the position of the corresponding image displayed on the display module is not corresponding to the position indication, the position indication generates an action error message indicating that the motion action is not correctly corresponding to the position indication. According to the motion detection and determination method described in claim 6, the action correct message includes a first change and a second change of the motion position indication, wherein: the corresponding image is displayed on the display module. When the position corresponds to the movement position indication, the movement position indication generates the first change; after the first change is generated, when the corresponding image maintains the corresponding movement position indication for a sustain time, the action position indication generates the second change And the first change and the second change are a visual effect change, and the change of the visual effect indicates that the corresponding image corresponds to the condition of the moving position indication. A motion detection and determination apparatus includes an information processing device capable of receiving a picture signal and a wireless sensing wear device, and the information processing device performs a motion detection and determination method according to items 1 to 7 of the patent application, wherein: The information processing device displays an action correct message and an action error message output by the motion detection and determination method; and the information processing device includes a control interface, and the control interface controls the information processing device to start or end the action detection. And determining the method, or controlling the information processing device to store the result of the detection and determination method. The motion detecting and judging device of claim 8 includes a single lens photographing device, wherein the lens photographing device generates the image signal, wherein: the wireless sensing wear device senses that a corresponding image of the user controls itself corresponds to A motion detection and determination method identifies a motion information of the limb motion; and the wireless sensor wearable device can display the motion correct message or the motion error message. For example, in the motion detection and determination device of claim 9, the setting interface includes an action recording interface, an action selection interface, and an action demonstration screen, wherein: the information displayed by the action recording interface includes a motion time and an action completion. The number of times, the exercise time and the number of completions of the action are the action information of the corresponding action image of the user in the corresponding action detection and determination method, and the action selection interface is a plurality of selection keys. Selecting each of the selection keys corresponds to a motion action, or a menu, clicking the menu to select a plurality of the motion actions; and the action demonstration screen correspondingly displaying one of the motion actions selected by the user by the action selection interface Demonstration information.