TWI625146B - Motion feedback method and system based on visual feedback - Google Patents

Abstract

The present invention discloses a visual feedback-based exercise training method and system thereof. The method includes the step S1 of capturing at least one of a balance state, a force application state, and an action gesture of a user to generate a state signal. Step S2, quantizing the status signal to generate a status data; in step S3, the status data is synchronously marked in a training model, wherein the training model defines a normal area and an adjustment area; and, in step S4, the user is trained according to The state data displayed by the model is adjusted to adjust its own equilibrium state, force state or action posture, so that the state data is maintained in the normal region or returned to the normal region by the adjustment region. The invention can train the user to adjust the posture of the self through visual feedback to achieve the purpose of correct movement.

Description

Motion feedback method and system based on visual feedback

The present invention relates to the technical field of sports training, and in particular to a sports training method and system based on visual feedback.

Traditionally, when a user uses a sports equipment to exercise, relevant parameters can be obtained from the sports equipment. Taking a treadmill as an example, the aforementioned parameters can be information such as the speed, slope, time, and distance of the sports equipment. In the treadmill, a sensor is provided to detect a few physiological characteristics such as the user's heartbeat and blood oxygen concentration.

The aforementioned sports equipment can only provide a device parameter and a user's physiological characteristics, and cannot allow the user to know whether his own exercise posture is correct. For example, right-handed users are accustomed to exerting force on the right side, which results in uneven force exertion on the body, which in turn causes the body's center of gravity to lean to the right side. In terms of long-term exercise, it has a great impact on the user's physical development. However, for users, they can only obtain equipment parameters and physiological change characteristics from sports equipment, which cannot determine whether the user's own exercise posture is correct. Furthermore, each sports equipment may not be able to provide relevant equipment parameters or detect the user's physiological characteristics, let alone provide further information about the correctness of the user's exercise posture.

In view of this, the present invention provides a motion feedback method and system based on visual feedback to solve the shortage of the prior art.

A first object of the present invention is to provide a visual feedback-based exercise training method that allows a user to observe at least one of a balanced state, a force-applying state, and an action posture, so as to achieve correctness through visual feedback. Purpose of exercise training for posture.

A second object of the present invention is to allow a user to operate a dynamic image or a static pattern in a normal area by changing the state of his own balance, body center of gravity, posture, and force according to the above-mentioned visual feedback-based exercise training method. Or adjust the area to achieve the purpose of sports training.

A third object of the present invention is based on the above-mentioned visual feedback-based exercise training method, which is to allow the user to perform symmetry training, balance training, and the like by capturing at least one of a user's balance state, force state, and action posture. Coordination training (that is, muscle contraction and relaxation training) or correction training.

A fourth object of the present invention is to provide a vision feedback-based exercise training system including an acquisition unit, a processing unit, and a vision feedback unit, so that a user can adjust his own balance state and force through the state data marked in a training model. State and action posture to achieve the purpose of sports training.

In order to achieve the above-mentioned object or other objects, the present invention provides an exercise training method based on visual feedback, which includes step (A) capturing at least one of a user's balance state, force application state, and action posture to generate a state Step; (B) quantify the status signal to generate a status data; step (C) the status data is labeled synchronously in a training model, where the training model defines a normal area and an adjustment area; and step (D) a user According to the state data displayed by the training model, adjust the corresponding balance state, force state or action posture to maintain the state data in the normal area or return to the normal area from the adjustment area.

To achieve the above or other objectives, the present invention provides a vision feedback-based sports training system, which includes an acquisition unit, a processing unit, and a vision feedback unit. The capturing unit captures at least one of a body signal and a posture image of a user, and generates status data. The body signal is related to at least one of a balanced state and a force-applying state of the user, and the posture image is related to an action posture of the user. The processing unit is connected to the acquisition unit. The processing unit generates a training model and marks the state data on the training model synchronously. The training model includes a normal region and an adjustment region. The visual feedback unit is connected to the processing unit. The visual feedback unit displays state data and a training model for users to adjust at least one of their balance state, force state and action posture according to the state data displayed by the training model, so that the state data is maintained in the normal area or returned from the adjustment area to Normal area.

In another embodiment, the vision feedback-based sports training system further includes a storage unit connected to the processing unit. The storage unit records the state data of the user for the user to understand or analyze changes in at least one of the equilibrium state, the force state, and the action posture during continuous training or during discontinuous training.

Compared with the conventional technology, the present invention provides a method and system for sports training based on visual feedback, which can be applied to any sports equipment or even without sports equipment. The present invention visually feedbacks the use of body signals such as the contraction state of the muscle group related to the user, pressure changes acting on the sensor (the pressure is related to the user's body center of gravity), posture images, and body movements. In order to provide the user with the correctness of identifying his or her state, he can correct the user's limb movements or strengthen the training of the user's specific body parts. In addition, users can also set thresholds or boundary ranges to help users adjust exercise posture or set training goals.

In order to fully understand the purpose, features and effects of the present invention, the following specific embodiments are used in conjunction with the accompanying drawings to make a detailed description of the present invention, which will be described later:

In the present invention, "a" or "an" is used to describe the units, elements and components described herein. This is only for convenience of explanation and provides a general meaning to the scope of the present invention. Therefore, unless it is obvious that he meant otherwise, such a description should be understood to include one, at least one, and the singular also includes the plural.

In the present invention, the term "synchronization" is used to describe a system or method. State data can be marked on the training model with short time or no time delay, so that users can timely feedback through visual feedback. Way to immediately adjust your balance, center of gravity, posture, force, etc.

In this article, the terms "include", "include", "have", "include" or any other similar language are intended to cover non-exclusive inclusions. For example, an element, structure, article, or device containing a plurality of elements is not limited to only those elements listed herein, but may include an element, structure, article, or device that is not explicitly listed but is generally inherent to the element, structure, article, or device Other requirements. In addition, unless expressly stated to the contrary, the term "or" means an inclusive "or" rather than an exclusive "or".

Please refer to FIG. 1, which is a schematic flowchart of a motion training method based on visual feedback according to the first embodiment of the present invention. In FIG. 1, the visual feedback-based exercise training method starts at step S11 and captures at least one of a balance state, a force application state, and an action posture of a user to generate a state signal. Among them, the equilibrium state is related to the change in at least one of the tilt angle, the moving speed, and the swing amplitude of the user's torso; the force state is related to the contraction change of the muscle group of the user's limb; and the action posture is related The changes in the posture of the user's movement are described in detail below.

In the embodiment of the balanced state, the inclination angle, moving speed, and swing amplitude of the trunk during the movement can be retrieved from the center of the trunk of the user. The tilt angle refers to the angle between the front (or back) of the torso and the ground plane; the moving speed refers to the distance the user moves over a period of time; and the swing amplitude refers to the angle between the side of the torso and the ground plane.

In the embodiment of the force state, for example, a muscle electrical signal generated by the contraction of a muscle group (such as the lower muscle group) on the skin surface of the lower limb can be captured, and a time sequence or A blessing to determine contraction changes in muscle groups. The aforementioned time sequence is a state of muscle contraction or relaxation in each unit time.

In the embodiment of the action posture, the user can view the posture of the user's movement by capturing the posture image of the user's movement.

Step S12 is to quantify the status signal to generate a status data, for example, to convert the vibration or timing of the status signal into status data for subsequent calculation.

In step S13, the system status data is marked on the training model synchronously. The training model can be a bar graph, a flat rectangular coordinate system graph, or a moving image graph. Users can visually judge their balance state, force state and action posture through charts or image diagrams. Furthermore, the training model can define normal regions and adjustment regions. The state data falling in the normal area indicates that its balance state, force application state, and action posture belong to the normal range, and the state data falling in the adjustment region indicates that its equilibrium state, force state, and action posture need to be adjusted.

For example, the training model uses a left bar graph to indicate the force state of the left foot, and a right bar graph to indicate the force state of the right foot. In this embodiment, the force application state of the left foot is reflected on the left bar graph, and the strength of the force is represented by the length of the bar graph. Similarly, the force state of the right foot is reflected in the right bar graph, which is represented in the same way as the left bar graph. Therefore, the user can directly judge whether the force state of the left foot and the right foot is symmetrical and balanced through the length of the length of the respective bar icon in the left bar graph and the right bar graph.

In step S14, the user adjusts the corresponding balance state, force application state, or action posture according to the state data displayed by the training model, so that the state data is maintained in the normal region or returned from the adjustment region to the normal region.

As an example, if the user observes that the length of the bar icon on the left bar graph is longer than the length of the bar icon on the right bar graph, the user can selectively shift the force of the left foot To the right foot, reduce the force on the left foot or strengthen the force on the right foot to achieve the purpose of training left-right symmetry or balance.

In another embodiment, the process of recording the state data is marked in the training model to form a marked trajectory for the user to refer to.

Please refer to FIG. 2, which is a block diagram of a visual feedback-based motion training system according to a second embodiment of the present invention. The vision feedback-based motion training system 10 includes an acquisition unit 12, a processing unit 14, and a vision feedback unit 16.

The acquisition unit 12 acquires a body signal and a posture image of the user, and generates status data SD. Among them, the status data SD may be graphics, images, numerical values, and the like. The capturing unit 12 may be, for example, an inertial sensor, a pressure sensor, a myoelectric signal sensor, an image capturing device, and the like. The body signal is related to at least one of a balanced state and a force-applying state of the user, and the posture image is related to an action posture of the user.

In the embodiment in which the capturing unit 12 is an inertial sensor, it can be set at the center of the user's torso to obtain the body signal of at least one of the user's torso tilt angle, moving speed and swing amplitude; In the embodiment in which the taking unit 12 is a pressure sensor, it is arranged below the user's torso to capture the body of at least one of a pressure center, a moving speed and a moving distance of the user's torso. Signal.

In the embodiment in which the capturing unit 12 is a myoelectric signal sensor, it can be disposed on the skin surface of the muscle group of the user to capture the myoelectric signal of the user on the skin surface of the muscle group. The processing unit 14 can calculate the timing and amplitude of the myoelectric signals captured by the capturing unit 12 to determine the contraction changes of a muscle group (such as the lower limb muscle group) on the skin surface of the muscle group.

In the embodiment in which the capturing unit 12 is an image capturing device, it can be arranged in front of or behind the user to capture the user's action posture to form a posture image, so that the user can observe his own posture to achieve himself Purpose of adjusting attitude.

The processing unit 14 is connected to the capturing unit 12. The processing unit 14 generates a training model 142. The training model 142 may be, for example, a bar graph, a plane rectangular coordinate system graph, or a moving image graph. The processing unit 14 synchronously marks the state data SD on the training model 142. The training model 142 includes a normal region 144 and an adjustment region 146.

The visual feedback unit 16 is connected to the processing unit 14. For example, the visual feedback unit 16 may be a projector, a display, or the like. The visual feedback unit 16 displays the state data SD and the training model 142, so that the user can adjust at least one of his balance state, force state and posture through the state data SD marked on the training model 142, so that the state data SD is maintained at The normal area 144 or the adjustment area 146 returns to the normal area 144.

In another embodiment, the visual feedback-based sports training system 10 further includes a storage unit (not shown) for recording user status data SD. The storage unit is connected to the processing unit 14.

Referring to FIG. 3 together, it illustrates a scenario where the training model in FIG. 2 of the present invention is a bar graph. In FIG. 3, the training model 142 is illustrated by using two bar graphs as an example. The two bar graphs respectively correspond to the urging state of the left foot and the urging state of the right foot of the user. In the two bar graphs, if the bar graph is elongated in the + Y direction, the force is gradually increased; otherwise, the bar graph is shortened in the -Y direction, which means that the force is gradually decreased. When the user applies force on the left foot, the left state data SD (ie, the stripe part) will fill in the + Y direction, that is, the length of the state data SD will increase; otherwise, when the user reduces the force on the left foot, the left side The state data SD will be eliminated in the -Y direction, that is, the length of the state data SD will be shortened. Therefore, the user can adjust the length of the state data SD through the force exerted by the left foot, thereby determining whether the force exerted by the left foot is appropriate.

In FIG. 3, it is additionally assumed that the range of the bar graph below 70% belongs to the normal region 144 and more than 70% belongs to the adjustment region 146. If the user applies force to make the state data SD fall in the normal area 144, the force applied by the left foot is considered appropriate; otherwise, if the user applies force to the adjustment area 146, the user needs to change his own force Method, the state data SD can be returned from the adjustment area 146 to the normal area 144. Through the above-mentioned repeated operations, the training effect can be achieved.

In another embodiment, a threshold (that is, a 70% setting) can be set through the processing unit 14 to adjust the ranges of the aforementioned normal region 144 and the adjustment region 146 to meet different training needs.

Similarly, the bar graph on the right side also has the same operation principle, which will not be repeated here. With the change of the bar graph on the left and right, the user can adjust the force application state to achieve the purpose of training.

Referring to FIG. 4 together, it is a schematic diagram illustrating a scenario where the training model in FIG. 2 of the present invention is a flat rectangular coordinate system diagram. In FIG. 4, the training model 142 is illustrated by using a flat rectangular coordinate system diagram as an example. The plane rectangular coordinate system diagram includes the X axis and the Y axis, and is divided into four quadrants I, II, III, and IV through the X axis and the Y axis. In this embodiment, the training model 142 is used to test the balance state of the user. The part at the origin O is called the center of equilibrium. When the user is in a balanced state, the state data SD will be marked at the origin O. When the user is in an unbalanced state, for example, when the center of gravity of the user's torso is tilted to the right front, the state data SD will move from the origin O toward the quadrant I. At this time, the user can according to the state data SD located in the quadrant I It is understood that the center of gravity of the trunk is not in a balanced state. If the user wants to return from an unbalanced state to a balanced state, the user can adjust the trunk so that the center of gravity moves to the lower left, so that the state data SD moves from quadrant I to quadrant III. Move, and then have a chance to return to the equilibrium center O. In this embodiment, a circular boundary range 148 can be set by the processing unit 14 to set the normal region 144 and the adjustment region 146. The user can determine whether he is in a balanced state according to the status data SD in the normal region 144 or the adjustment region 146. The aforementioned boundary range 148 can be set by the processing unit 14.

The present invention has been disclosed in the foregoing with a preferred embodiment, but those skilled in the art should understand that this embodiment is only for describing the present invention, and should not be interpreted as limiting the scope of the present invention. It should be noted that all changes and substitutions equivalent to this embodiment should be included in the scope of the present invention. Therefore, the scope of protection of the present invention shall be defined by the scope of the patent application.

10‧‧‧ Sports Training System
12‧‧‧ Capture Unit
14‧‧‧ processing unit
142‧‧‧Training model
144‧‧‧normal area
146‧‧‧adjusted area
148‧‧‧ boundary range
16‧‧‧Visual feedback unit
SD‧‧‧ Status Information
O‧‧‧ origin

FIG. 1 is a schematic flowchart of a visual feedback-based motion training method according to a first embodiment of the present invention. FIG. 2 is a block diagram of a visual feedback-based motion training system according to a second embodiment of the present invention. FIG. 3 is a schematic diagram illustrating a scenario in which the training model in FIG. 2 is a bar graph. FIG. 4 is a schematic diagram illustrating a scenario where the training model in FIG. 2 of the present invention is a flat rectangular coordinate system diagram.

Claims (14)

A visual feedback-based exercise training method includes: capturing at least one of a user's balance state, a force state, and an action posture to generate a state signal; quantifying the state signal to generate a state Data; the state data is labeled synchronously in a training model, wherein the training model defines a normal region and an adjustment region; and the user adjusts the corresponding balance state according to the state data displayed by the training model, The force application state or the action posture keeps the state data in the normal area or returns from the adjustment area to the normal area. According to the visual feedback-based exercise training method described in item 1 of the scope of the patent application, the balance state is related to at least one of an inclination angle, a moving speed, and a swing amplitude of the user's torso. According to the visual feedback-based exercise training method described in item 1 of the patent application scope, wherein the force application state is related to a contraction change of a muscle group of the user's limb. According to the visual feedback-based exercise training method described in item 1 of the patent application scope, wherein the action posture is related to the posture change of the user's movement. As described in item 1 of the scope of the patent application, the visual feedback-based motion training method further includes a process of recording the state data being marked in the training model to form a marked trajectory. A motion feedback system based on visual feedback includes: an acquisition unit that acquires at least one of a body signal and a posture image of a user to generate state data, wherein the body signal is related to the use At least one of a balanced state and a force-applied state of the person, and the gesture image is related to an action gesture of the user; a processing unit is connected to the capturing unit, the processing unit generates a training model, and The status data is synchronously marked on the training model, wherein the training model includes a normal area and an adjustment area; and a visual feedback unit connected to the processing unit. The visual feedback unit displays the status data and the training model for The user adjusts at least one of the balance state, the force application state, and the action posture according to the state data displayed by the training model, so that the state data is maintained in the normal region or returned from the adjustment region to the Normal area. According to the vision feedback-based exercise training system described in item 6 of the patent application scope, wherein the capturing unit is at least one of an inertial sensor and a pressure sensor, the inertial sensor is provided in the use The torso center of the user to capture the body signal of at least one of the user's torso angle, a moving speed, and a swing amplitude; the pressure sensor is disposed below the user's torso, The body signal of at least one of a pressure center, a moving speed and a moving distance of the user's torso is captured. The visual feedback-based exercise training system according to item 6 of the scope of the patent application, wherein the capturing unit is a myoelectric signal sensor, and the myoelectric signal sensor is disposed on a muscle group of the user The skin surface to capture a myoelectric signal from the user on the skin surface of the muscle group. The motion feedback system based on visual feedback as described in item 8 of the scope of the patent application, wherein the processing unit calculates a timing and an amplitude of the electromyographic signal captured by the capturing unit to determine the time on the skin surface of the muscle group. Changes in the contraction of a muscle group. The visual feedback-based exercise training system as described in item 6 of the scope of the patent application, wherein the capture unit is an image capture device, and the image capture device is disposed in front of or behind the user to capture The action posture of the user forms the posture image. The visual feedback-based motion training system according to item 6 of the patent application scope, wherein the training model is a bar graph, a flat rectangular coordinate system graph, or a moving image graph. The visual feedback-based motion training system according to item 11 of the patent application scope, wherein the training model is the bar graph, and the processing unit sets a threshold value in the bar graph to define the normal area and the adjustment region. The visual feedback-based motion training system according to item 11 of the patent application scope, wherein the training model is the plane rectangular coordinate system diagram or the moving image diagram, and the processing unit is in the plane rectangular coordinate system diagram or the moving image The map sets a boundary range to define the normal area and the adjustment area. The visual feedback-based sports training system described in item 6 of the scope of patent application, further includes a storage unit connected to the processing unit, and the storage unit records the status data of the user.