CN118160002A

CN118160002A - Motion gesture analysis device and intelligent sports equipment comprising same

Info

Publication number: CN118160002A
Application number: CN202280071571.7A
Authority: CN
Inventors: 俞善庆
Original assignee: Drax Inc
Current assignee: Drax Inc
Priority date: 2021-12-28
Filing date: 2022-12-26
Publication date: 2024-06-07

Abstract

According to an embodiment, an exercise posture analysis apparatus, which analyzes an exercise posture of a user using exercise equipment, may include: a photographing unit for obtaining a moving image by photographing a user moving using the sporting goods; an equipment detection unit for detecting sports equipment-related information related to at least one of an action and a length of the sports equipment; and an analysis unit that calculates a rotation angle of the body part of the user based on the moving image, and determines a movement posture of the user based on the calculated rotation angle of the body part.

Description

Motion gesture analysis device and intelligent sports equipment comprising same

Technical Field

The present invention relates to a motion gesture analysis apparatus and an intelligent motion device including the same, which can determine whether a user performs a motion in an appropriate motion gesture.

Background

Exercise equipment is provided in various forms according to body parts or use purposes, etc., which increase muscle strength, and is mainly used for training body parts, such as an upper body or a lower body, using hands or feet. The user may move the selected weight through the exercise structure of the exercise apparatus to perform the exercise.

However, since physical conditions of a user using the sporting goods, and background knowledge of the user about the sports are different, the sports posture of the user using the sporting goods may be different. But has a problem in that it is difficult to check whether the user properly uses the sporting goods according to the physical characteristics of the user, the exercise performance, or the use of the sporting goods.

Disclosure of Invention

Technical challenges

As a preferred embodiment of the present invention, the movement posture analysis apparatus and the intelligent movement device can accurately judge the movement posture of the user, preventing inaccurate feedback from being transmitted to the user.

Means for solving the technical challenges

The exercise posture analysis apparatus according to an embodiment, which analyzes an exercise posture of a user using exercise equipment, may include: a photographing unit for obtaining a moving image by photographing a user moving using the sporting goods; an equipment detection unit for detecting sports equipment-related information related to at least one of an action and a length of the sports equipment; and an analysis unit that calculates a rotation angle of the body part of the user from the moving image, and determines a movement posture of the user from the calculated rotation angle of the body part.

The analysis unit may include: a feature point extraction unit configured to extract a plurality of feature points corresponding to a plurality of joint portions of the user based on the moving image of the user; an angle calculation unit for connecting the plurality of feature points to generate a plurality of bone lines corresponding to a body part of a user, and calculating a rotation angle of at least one of the plurality of bone lines; an angle correction unit for correcting the rotation angle calculated by the angle calculation unit, based on the sports equipment-related information; and a posture judging unit for judging the degree to which the rotation angle corrected by the angle correcting unit deviates from the reference rotation angle, so as to determine the movement posture of the user.

The photographing unit may be a camera disposed facing a side of the sporting goods.

The sporting goods may be a heavy sporting goods including a plurality of weight plates and a sporting structure transmitting loads of the weight plates to a user, and the equipment detecting unit may include a first sensor for directly or indirectly detecting a moving distance of the weight plates.

The angle correction unit may calculate at least one of a moving distance and a rotation angle of the moving structure according to the moving distance of the weight plate detected by the first sensor, and may correct the rotation angle calculated by the angle calculation unit according to at least one of the moving distance and the angle change of the moving structure.

The sports apparatus may be a barbell sports apparatus including a support bar and weight plates clamped at both ends of the support bar, and the apparatus detecting unit may be used to obtain a length or a motion of the barbell sports apparatus.

The equipment detecting unit may include a second sensor provided to the barbell exercise equipment and configured to detect movement of the barbell exercise equipment.

The angle correction unit may detect a moving distance of the barbell piece of sports equipment according to a detection result of the second sensor, and may correct the rotation angle calculated by the angle calculation unit according to the moving distance of the barbell piece of sports equipment.

The second sensor may be provided to the support bar.

The photographing unit acquires an image of the support bar by photographing the support bar of the barbell sporting goods, the angle correcting unit calculates a length of the support bar according to the image of the support bar, and may correct the rotation angle calculated by the angle calculating unit according to the length of the support bar.

The intelligent sports apparatus according to another embodiment may include: sports equipment; and a movement posture analysis device that analyzes a movement posture of a user using the sports equipment, the movement posture analysis device may include: a photographing unit for obtaining a moving image by photographing a user moving using the sporting goods; an equipment detection unit for detecting sports equipment-related information related to at least one of an action and a length of the sports equipment; and an analysis unit for calculating a rotation angle of the body part of the user during the movement according to the moving image, and determining a movement posture of the user according to the calculated rotation angle of the body part.

The motion gesture analysis method according to another embodiment may include: extracting a plurality of feature points corresponding to a plurality of joint parts of a user according to a moving image of the user obtained by a photographing unit; connecting the plurality of feature points to generate a plurality of bone lines corresponding to a body part of a user, and calculating a rotation angle of at least one bone line of the plurality of bone lines; correcting the calculated rotation angle based on the sports equipment-related information detected by the equipment detecting unit; and judging the degree of the rotation angle deviating from the reference rotation angle so as to determine the movement posture of the user.

A computer readable storage medium storing one or more programs for performing a motion gesture analysis method according to another embodiment may include: a command for extracting a plurality of feature points corresponding to a plurality of joint portions of a user from a moving image of the user obtained by a photographing unit; a command for connecting the plurality of feature points to generate a plurality of bone lines corresponding to a body part of a user and calculating a rotation angle of at least one of the plurality of bone lines; a command for correcting the calculated rotation angle based on the sports equipment-related information detected by the equipment detecting unit; and a command for judging the degree to which the rotation angle deviates from the reference rotation angle so as to determine the movement posture of the user.

Technical effects

As a preferred embodiment of the present invention, a motion gesture analysis apparatus and an intelligent motion device including the same analyze a motion gesture of a user using a motion image of the user, and by compensating an error using a separate means independent of the user, accurate feedback about the motion gesture can be provided to the user.

Drawings

FIG. 1 is a block diagram of a smart sports device according to an embodiment.

Fig. 2 is a partial perspective view of a smart sports device according to an embodiment.

Fig. 3 and 4 are process diagrams of detecting a motion gesture of a user in the intelligent sports apparatus of fig. 2.

Fig. 5 is an operation conceptual diagram of the movement posture analysis apparatus according to an embodiment.

Fig. 6 is a conceptual diagram of the rotation angle of the bone line disclosed in fig. 5.

Fig. 7 and 8 are conceptual views of the rotation angle of a bone line according to various physical conditions.

Fig. 9 is a schematic diagram of an example of a fixture detection unit of the movement posture analysis apparatus according to the embodiment.

Fig. 10 is a schematic diagram of an example of a user interface unit according to an embodiment.

Fig. 11 and 12 are schematic views of a motion gesture analysis apparatus applied to a sporting goods according to another embodiment.

Fig. 13 is a schematic view of an example of an equipment detection unit applied to the sporting equipment of fig. 11.

Fig. 14 is a schematic view of another example of an equipment detection unit applied to the sporting equipment of fig. 11.

Fig. 15 is a schematic diagram of an example of a fixture detection unit according to another embodiment.

Fig. 16 is a block diagram of a movement posture analysis apparatus including a fixture detection unit according to another embodiment.

FIG. 17 is a schematic diagram of a smart gym environment providing a plurality of smart sports devices, according to an embodiment.

Detailed Description

Several embodiments of the present invention will be described in detail below with reference to the attached drawings so that those skilled in the art can easily implement the present invention.

Fig. 1 is a block diagram of a smart sports device 1 according to an embodiment. Fig. 2 is a partial perspective view of the intelligent sports apparatus 1 according to an embodiment. Fig. 3 and 4 are process diagrams of detecting a motion gesture of a USER (USER) in the intelligent sports apparatus 1 of fig. 2.

Referring to fig. 1, an intelligent sports apparatus 1 according to an embodiment may include a sports equipment 2 and a sports posture analysis device 100.

Referring to fig. 1 and 2, the sporting goods 2 may be sporting goods that generates motions according to the weight motions of a USER (USER). The sporting goods 2 may be a heavy sporting goods.

For example, the sporting goods 2 may include: a plurality of weight plates 21; a frame structure 23 for supporting the plurality of weight plates 21 so as to be movable in a gravitational direction and a direction opposite thereto, for example, up and down; and a moving structure 26 for contacting a body part of a USER (USER) and transmitting a load of the weight plate 21 to the USER (USER).

The plurality of weight plates 21 are stacked in order in the up-down direction. The plurality of weight plates 21 have a predetermined weight, respectively. The weight of the weight plates 21 may be the same or different from each other. As an example, the weight of each of the plurality of weight plates 21 may be 5kg, and may be identical to each other. As another example, a portion of the plurality of weight plates 21 may weigh 5kg, while another portion of the plurality of weight plates 21 may weigh 10kg. In addition, the plurality of weight plates 21 may have different weights.

The frame structure 23 may include: a base frame 231; and a pair of guide rails 233 extending in the up-down direction to move the plurality of weight plates 21 in the up-down direction and provided on the base frame 231. A pair of guide rails 233 may extend through the plurality of weight plates 21. The frame structure 23 includes connecting wires 235 for transmitting a force applied by a USER (USER) to the weight plate 21.

In the sporting goods 2 according to the embodiment, the USER (USER) applies a force to the sporting structure 26 to move the weight plate 21 corresponding to the selected weight in a direction opposite to the gravitational direction or in the gravitational direction. The movement structure 26 may be implemented in various forms according to the body part to be moved.

As an example, the sporting goods 2 may be a leg extension machine (leg extension). The moving structure 26 may be configured to rotate a pad contacting an ankle (lower tibia) of a USER (USER) about a predetermined axis.

Referring to fig. 3 and 4, when the sporting goods 2 is a leg stretcher, a USER (USER) sits on a chair of the sporting goods 2 and performs a reciprocating motion of stretching and bending knees in a state that the ankle is in contact with the sporting goods 26, so that thigh muscles of the USER (USER) can be stimulated.

However, this movement effect can only be produced when the movement is performed in a standard posture suitable for the purpose of the movement structure 26. For example, when a USER (USER) performs exercise in a standard posture, i.e., sits on a chair, brings the back into contact with the back 261 of the chair, and performs reciprocating motion of stretching and bending the knees in a posture in which the angle between the tibia and the foot is maintained at 90 degrees in a state in which the handles 263 are held with both hands to prevent the buttocks from falling from the seat 262.

However, when the USER (USER) moves alone on the sporting goods 2 without the aid of the trainer (trainer), since the physical condition of each USER (USER) is different, the background knowledge of the movement, etc., is also different, some USERs (USERs) moving on the sporting goods 2 may move in an incorrect movement posture different from the standard posture.

Even if the number of weight plates 21 provided in the sporting goods 2 is the same and the sporting structure 26 moves along a predetermined trajectory, the sporting effect may be different according to the sporting posture of the USER (USER). In other words, even if the weight of the weight plate 21 and the moving distance of the weight plate 21 are the same, the load actually applied to a target body part of the USER (USER), such as the thigh, may be different.

In addition, if the exercise posture of the USER (USER) is different from the standard posture, the load may not be applied to the body part for which the exercise apparatus 2 is directed, but to another body part, which may cause injury to the USER (USER). For example, if a USER (USER) moves in an incorrect movement posture, a load may be applied to the knees instead of the thighs, which may cause injury to the knees of the USER (USER). As the number of weight plates 21 set increases, the risk of injury to the USER (USER) may increase.

In view of this, the movement posture analysis apparatus 100 according to the embodiment may analyze whether the USER (USER) moves in a movement posture corresponding to the standard posture. As an example, the movement posture analysis apparatus 100 may include a photographing unit 110 and an analysis unit 130.

Fig. 5 is a conceptual diagram of the operation of the movement posture analysis apparatus 100 according to an embodiment, and fig. 6 is a conceptual diagram of the rotation angle of the bone line B disclosed in fig. 5.

Referring to fig. 2 to 5, the photographing unit 110 may photograph a USER (USER) who moves using the sporting goods 2 to obtain a moving image of the USER (USER).

The photographing unit 110 may measure the movement of a USER (USER) using the sporting goods 2. For example, the photographing unit 110 may be provided at one side of the sporting goods 2. For example, the photographing unit 110 may be provided at the front side of the sporting goods 2. The photographing unit 110 may be provided at a side of the sporting goods 2.

The photographing unit 110 may continuously photograph moving images of a USER (USER) who moves using the sporting goods 2. The photographing unit 110 may continuously obtain n image frames. Thus, it is possible to continuously obtain a moving image of the USER (USER) who moves using the sporting goods 2.

The photographing unit 110 may be a camera. The photographing unit 110 may be spaced apart from the USER (USER) or the sporting goods 2 by a predetermined distance D. By performing photographing using one camera, the unit price of the product can be reduced as compared to the photographing unit 110 using a plurality of cameras, so that the price competitiveness of the exercise posture analysis apparatus 100 can be ensured.

The analysis unit 130 may calculate a rotation angle of the body part during the movement of the USER (USER) based on the moving image. The analysis unit 130 may determine a movement posture of the USER (USER) according to the calculated rotation angle of the body part. As an example, the analysis unit 130 may include a feature point extraction unit 131, an angle calculation unit 132, an angle correction unit 141, and a posture determination unit 142.

The feature point extraction unit 131 may extract a plurality of feature points C corresponding to a plurality of joint parts of the USER (USER) from the moving image of the USER (USER). For example, the feature point extraction unit 131 may extract feature points C corresponding to shoulders, elbows, wrists, pelvis, knees, ankles, and feet of a USER (USER). Since the process of extracting the feature point C is a technical content known in the related art, a detailed description thereof will be omitted.

Referring to fig. 1, 5 and 6, the angle calculation unit 132 may generate a bone line B connecting the plurality of feature points C extracted by the feature point extraction unit 131. For example, a first bone line B1 connecting the first feature point C1 corresponding to the pelvis and the second feature point C2 corresponding to the knee, a second bone line B2 connecting the second feature point C2 corresponding to the knee and the third feature point C3 corresponding to the ankle, and a third bone line B3 connecting the third feature point C3 corresponding to the ankle and the fourth feature point C4 corresponding to the foot may be generated.

Referring to fig. 1 and 6, the angle calculating unit 132 may calculate a rotation angle of at least one bone line B among the plurality of bone lines B during a USER (USER) movement. For example, the angle calculating unit 132 may calculate the rotation angle θ1 of the second bone line B2 with respect to the first bone line B1. For example, the angle calculating unit 132 may calculate the rotation angle of the third bone line B3 with respect to the second bone line B2.

Under ideal conditions, the rotation angle (or angle change) calculated by the angle calculation unit 132 can accurately match the rotation angle of the body part rotation of the actual USER (USER). However, in actual conditions, the rotation angle of the bone line B calculated by the angle calculation unit 132 may be different from the rotation angle at which the body part of the USER (USER) is actually rotated due to various factors such as the photographing unit 110 using a single camera, various physical conditions of the USER (USER), and the like.

For example, when the photographing unit 110 photographs a motion of a USER (USER) using a single camera, an error may occur in extracting a feature point C of a three-dimensional structure corresponding to a joint of the USER (USER). For example, as shown in fig. 7 and 8, each USER (USER) may have different physical conditions, and the distance D1 and the distance D2 between the USER (USER) and the photographing unit 110 may be different. Errors may occur in the extraction of the feature point C compared to the joint position of the actual USER (USER), and errors may also occur in the generation of the bone line B from the feature point C compared to the position of the body part of the actual USER (USER). Accordingly, the rotation angle calculated by the angle calculation unit 132 may be in error with the actual rotation angle of the USER (USER) body part.

As such, when the rotation angle calculated by the angle calculating unit 132 is in error with the actual rotation angle of the body part of the USER (USER), it may be difficult to accurately judge whether the movement posture of the USER (USER) meets the standard posture. In other words, the judgment of whether or not the motion posture of the USER (USER) meets the standard posture may be inaccurate. For example, even if the movement posture of the USER (USER) is incorrect, and does not conform to the standard posture, the correct posture conforming to the standard posture may be erroneously determined. For another example, even if the movement posture of the USER (USER) is correct, an erroneous posture that does not match the standard posture may be determined.

If these inaccurate determinations repeatedly occur, the reliability of the movement posture analysis apparatus 100 is reduced, which may become a key cause for the USER (USER) not to use the movement posture analysis apparatus 100 itself.

Referring again to fig. 1, the movement posture analysis apparatus 100 according to the embodiment includes a fixture detection unit 150, an angle correction unit 141, and a posture determination unit 142 to provide accurate feedback related to a USER (USER) movement posture.

The equipment detection unit 150 may obtain information related to the sporting equipment 2, which relates to at least one of the motion and the length of the sporting equipment 2. For example, the equipment detection unit 150 may obtain information related to the motion of the sporting equipment 2. A detailed description of the fixture detection unit 150 will be described later with reference to fig. 9.

The angle correction unit 141 may correct the rotation angle calculated by the angle calculation unit 132 according to the sports apparatus 2-related information. The angle correction unit 141 may correct an error of a rotation angle calculated from the moving image photographed by the photographing unit 110 according to information independent of the image information of the photographing unit 110.

Fig. 9 is a schematic diagram of an example of the equipment detection unit 150 of the movement posture analysis apparatus 100 according to the embodiment.

Referring to fig. 1,2 and 9, the equipment detection unit 150 according to the embodiment may include a first sensor 151 for detecting movement of the weight plate 21. The first sensor 151 may directly detect movement of the weight plate 21, or indirectly detect movement of the weight plate 21 by detecting movement of another member that moves together with the weight plate 21.

As an example, the first sensor 151 may include at least one laser sensor. For example, the first sensor 151 may detect movement of the pin structure 25. The pin structure 25 may include: an insertion region 251 that is inserted into the weight plate 21 or between the weight plates 21; and a holding region 253 connected to the insertion region 251. For example, the first sensor 151 may irradiate the laser beam L to the holding region 253 of the pin structure 25. For example, the first sensor 151 may overlap the holding region 253 in the gravitational direction. The first sensor 151 may indirectly detect movement of the weight plate 21 by detecting movement of the pin structure 25. However, the measurement object and arrangement of the first sensor 151 are not limited thereto, and may be different as needed.

The first sensor 151 may detect a moving distance of the weight plate 21. The angle correction unit 141 may calculate at least one of a moving distance and a rotating angle of the moving structure 26 according to the moving distance of the weight plate 21. For example, when the moving structure 26 has a rotatable structure, the rotation angle at which the moving structure 26 rotates may be calculated from the moving distance of the weight plate 21. For example, although not shown, if the moving structure 26 has a straight-line moving structure, the moving distance of the moving structure 26 along the straight line can be calculated from the moving distance of the weight plate 21.

The angle correction unit 141 may calculate the rotation angle of the USER (USER) body part in contact with the moving structure 26 based on the rotation angles of the moving structure 26. For example, from information detected by the first sensor 151 independent of the photographing unit 110, a rotation angle of the ankle or tibia that is in contact with the moving structure 26 during the movement of the USER (USER) may be calculated.

The angle correction unit 141 can calculate only the rotation angle related to some body parts of the USER (USER) from the information detected by the first sensor, but it may be difficult to calculate the rotation angles of the remaining body parts. For example, the angle correction unit 141 can calculate only the rotation angle of the tibia of the USER (USER) from the information detected by the first sensor 151, and cannot calculate the pose of other body parts of the USER (USER).

However, the rotation angle calculated from the information detected by the first sensor 151 may be relatively accurate as compared to the rotation angle calculated from the moving image photographed by the photographing unit 110. In other words, the rotation angle calculated from the information detected by the first sensor 151 may have a relatively small error compared to the rotation angle calculated from the moving image photographed by the photographing unit 110. That is, even though there are fewer measurable body parts, the rotation angle calculated from the information detected by the first sensor 151 may have higher measurement accuracy than the rotation angle calculated from the information detected by the photographing unit 110.

In view of these differences in accuracy, the angle correction unit 141 may calculate an error of the rotation angle calculated by the angle calculation unit 132 using the rotation angle calculated from the information detected by the first sensor 151. The angle correction unit 141 may correct the rotation angle calculated by the angle calculation unit 132 to reflect the calculated error.

For example, if errors occur between the rotation angle of the body part calculated from the first sensor 151 and the rotation angle of the body part calculated from the photographing unit 110, the position of the entire feature point C may be modified to a position where these errors have been corrected. For example, the positions of the first, second, and third feature points C1, C2, and C3 may be modified to reflect an error between the rotation angle of the tibia calculated according to the photographing unit 110 and the rotation angle of the tibia calculated according to the first sensor 151. When the positions of the first, second, and third feature points C1, C2, and C3 are modified, the positions of the remaining feature points C, for example, the fourth feature point C4, may be modified. The position of the fourth feature point C4 may be modified to correspond to the modification distances and modification ratios of the first feature point C1, the second feature point C2, and the third feature point C3. By modifying the positions of these feature points C, not only the bone line B corresponding to the body part where the error is detected but also at least one of the length and the angle of the bone line B corresponding to the other body parts where the error is not detected can be modified. For example, based on the information detected by the first sensor 151, not only the length of the second skeletal line B2 corresponding to the tibia but also the length of the third skeletal line B3 corresponding to the foot can be corrected.

The posture determining unit 142 may determine the degree to which the rotation angle corrected by the angle correcting unit 141 deviates from the reference rotation angle to determine the movement posture of the USER (USER).

The reference rotation angle may be set in various ways. As an example, the reference rotation angle may be determined based on a moving image of a trainer moving in a standard posture on the sporting goods 2. For example, a plurality of feature points C are extracted from a moving image of a coach, and a reference rotation angle can be determined from the rotation angle of a skeleton line B connecting the extracted plurality of feature points C.

The posture judging unit 142 may compare the corrected rotation angle of the bone line B with the reference rotation angle. It may be determined whether the corrected rotation angle and the reference rotation angle are outside a preset reference range. From this, the degree to which the movement posture of the USER (USER) deviates from the standard posture can be determined.

Based on the result of the judgment by the posture judgment unit 142, feedback as to whether the movement posture is correct or not can be provided to the USER (USER).

For example, if it is determined that the movement posture of the USER (USER) matches the standard posture within the standard range, information notifying the USER (USER) that the movement posture is accurate may be provided. For example, if it is determined that the movement posture of the USER (USER) is out of the standard range of the standard posture, information notifying the USER (USER) that the movement posture is inaccurate may be provided.

The movement posture analysis method including the following steps may be performed by the movement posture analysis apparatus 100 described above. For example, the motion gesture analysis method may include: extracting a plurality of feature points C corresponding to a plurality of joint parts of the USER (USER) from the moving image of the USER (USER) obtained by the photographing unit 110; connecting the plurality of feature points C to generate a plurality of bone lines B corresponding to a body part of a USER (USER), and calculating a rotation angle of at least one bone line B of the plurality of bone lines B; correcting the calculated rotation angle based on the sports equipment 2-related information detected by the equipment detecting unit 150; and determining the degree to which the rotation angle deviates from the reference rotation angle in order to determine the movement posture of the USER (USER).

Referring again to fig. 1, the athletic posture analysis device 100 according to an embodiment further includes a component for measuring a movement state of a USER (USER) on the athletic equipment 2 and feeding back the result thereof.

For example, the exercise posture analysis apparatus 100 includes: a fixture detection unit 150; a user interface unit 160 for outputting a user interface screen; a memory 170 for storing at least one command; and a processor 120 for controlling the user interface unit 160.

In addition to a function of improving accuracy in analyzing a USER (USER) movement posture, the equipment detecting unit 150 may perform a function of detecting a USER (USER) movement state. For example, the equipment detecting unit 150 may detect the movement speed of the USER (USER) by detecting the movement distance and movement speed of the weight plate 21.

The user interface unit 160 may include: an input unit for receiving an input or the like for operating or setting the sporting goods 2 from a USER (USER); and an output unit for displaying information such as a movement state or a movement result. For example, the user interface unit 160 may have a form of a touch screen, but is not limited thereto.

The processor 120 may manage various functions provided by the weight exercising device 1 or information for managing an exercise state of a USER (USER) by executing at least one command stored in the memory 170. The movement state of the USER (USER) may have meanings including the number or time of movements of the USER (USER), the movement level, the movement speed, the trajectory of body movements of the USER (USER), etc. The processor 120 may include the analysis unit 130 described above.

The processor 120 may include at least one processing module. Such as at least one of a central processing unit (Central Processing Unit), a microprocessor (microprocessor), a graphics processing unit (Graphic Processing Unit), an Application SPECIFIC INTEGRATED Circuits (ASIC), a digital signal Processor (DIGITAL SIGNAL Processor, DSP), and a field programmable gate array (Field Programmable GATE ARRAYS, FPGA). The processor 120 may control other components included in the sporting goods 2 to perform functions corresponding to USER (USER) inputs received through the USER interface unit 160. The processor 120 may execute commands, software modules, or programs stored in the memory 170, or read data or files stored in the memory 170, or store new programs or applications in the memory 170.

The memory 170 may store at least one command. Processor 120 may correspond to an example of a computer capable of executing the commands stored in memory 170. The memory 170 may store commands, software modules, or programs. The Memory 170 may include at least one of random access Memory (Random Access Memory, RAM), static random access Memory (Static Random Access Memory, SRAM), read-Only Memory (ROM), flash Memory (flash Memory), electrically erasable programmable Read-Only Memory (EEPROM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), magnetic Memory, magnetic disk, and optical disk.

User Interface (UI) modules and motion management modules may be stored in memory 170. The user interface module and the motion management module may be software modules or programs including at least one command and may correspond to a portion of another program. Processor 120 may load the user interface module and the motion management module from memory 170 and execute the corresponding commands.

The user interface module may include a user interface input/output module and a user interface configuration module. The USER interface input/output module may confirm USER (USER) input to a USER interface screen displayed on the USER interface unit 160 and control output of USER interface elements generated or changed in the USER interface configuration module. The user interface configuration module may generate or change user interface elements to be displayed on the user interface unit 160 according to information confirmed through the motion management module, the user interface unit 160, the sensor module, and the like.

Fig. 10 is a schematic diagram of an example of a user interface unit 160 according to an embodiment.

Referring to fig. 1, 9 and 10, the processor 120 may control the USER interface unit 160 to display a USER interface element representing a motion state of a USER (USER) corresponding to the motion of the sporting goods detected by the equipment detection unit 150 on a USER interface screen. The processor 120 may control the user interface unit 160 to display a second user interface element representing a recommended exercise guide when exercising using the sporting goods 2 on the user interface screen together with the user interface element.

As such, a USER (USER) using the sporting goods 2 may recognize the weight setting state and the sports state using data (or information) displayed on the USER interface screen. Accordingly, the USER (USER) can perform the exercise more effectively.

The movement gesture analysis apparatus 100 may further include a communication interface unit 180. The communication interface unit 180 may perform wired or wireless communication with other devices or networks. To this end, the communication interface unit 180 may include a communication module supporting at least one of various wired and wireless communication methods. For example, a communication module performing short-range communication such as Wi-Fi (Wireless Fidelity), various types of mobile communication such as 3G, 4G, 5G, or ultra-wideband communication may be included, a communication module performing wired communication using a coaxial cable or an optical cable, or the like may be included, but is not limited thereto, and various types of communication modules according to the development of communication technology may be included. The communication interface unit 180 is connected to a device located outside the sporting goods 2, and may transmit and receive a message including a signal or data. The exercise posture analysis apparatus 100 may be connected to and communicate with a smart gym server 330, a terminal 320 in the form of a wearable device, a smart phone, or a manager terminal 340 in the form of a PC, a notebook, a smart phone, or an external server 310 through a communication interface unit 180.

In the above-described embodiment, as an example of the sporting goods 2, although a weight sporting goods including a plurality of weight plates 21 is described with emphasis, an application object of the sporting posture analysis device 100 is not limited thereto and may be applied to various sporting goods 2.

Fig. 11 and 12 are schematic views of a movement posture analysis apparatus 100 applied to the sporting goods 2A according to another embodiment. Fig. 13 is a schematic view of an example of the equipment detection unit 150 applied to the sporting equipment 2A of fig. 11. Fig. 14 is a schematic diagram of another example of the equipment detection unit 150 applied to the sporting equipment 2A of fig. 11.

Referring to fig. 1, 11 and 12, the exercise apparatus 2A may be a barbell exercise apparatus. For example, the sporting goods 2A may include a support bar 27, and the weight plates 21A may be clamped at both ends of the support bar 27.

When the lower body is to be moved using the sporting goods 2A according to the embodiment, the USER (USER) rests the support bar 27 on the shoulder and can perform the bending and stretching actions of the knees in a state of stretching the waist.

The movement posture analysis apparatus 100 according to the embodiment may include a photographing unit 110, a fixture detection unit 150, and an analysis unit 130. The analysis unit 130 may include a feature point extraction unit 131, an angle calculation unit 132, an angle correction unit 141, and a posture determination unit 142. Since the photographing unit 110 and the analyzing unit 130 are repeated from those mentioned in the above embodiments, a difference, i.e., the equipment detecting unit 150, will be described with emphasis.

When the sporting goods 2A includes a barbell sporting goods, the equipment detecting unit 150 may include a second sensor 152 provided on the barbell sporting goods. Second sensor 152 may be used to detect movement of the barbell piece of athletic equipment.

The second sensor 152 may be at least one of an acceleration sensor and a gyro sensor. However, the second sensor 152 is not limited thereto, and may be changed in various ways as long as it can detect the movement of the barbell piece of sports equipment.

Referring to fig. 13, the second sensor 152 may be provided on the support bar 27. Accordingly, the moving distance of the support bar 27 during the movement of the USER (USER) can be detected. From the detected movement distance of the support bar 27, the rotation angle of the USER (USER) tibia can be estimated.

In fig. 13, although an example in which the second sensor 152 is provided on the support rod 27 is described with emphasis, the arrangement of the second sensor 152 is not limited thereto and may be changed. For example, as shown in fig. 14, a second sensor 152 may be provided on each weight plate 21A.

On the other hand, in the embodiment, the first sensor 151 or the second sensor 152 is shown as one of the components of the fixture detection unit 150, but the fixture detection unit 150 may not include a separate sensor.

Fig. 15 is a schematic diagram of an example of a fixture detection unit 150 according to another embodiment, and fig. 16 is a block diagram of a motion gesture analysis apparatus 100A including the fixture detection unit 150 according to another embodiment.

Referring to fig. 15 and 16, the intelligent sports apparatus 1-1 according to the embodiment may include a sports posture analysis device 100A and a sports equipment 2.

The equipment detecting unit 150 does not include a separate sensor, and may obtain information related to the sporting equipment 2 according to information about surrounding configurations, other than information of a USER (USER) body part, among the information photographed by the photographing unit 110.

For example, the equipment detecting unit 150 may detect the length of the support bar 27 in the image of the barbell exercise equipment photographed by the photographing unit 110. For example, the support rods 27 may be provided with a predetermined pattern 28 at certain intervals, and accordingly, the end length RL of the support rod 27 remaining after insertion of the weight plate 21A may be calculated from the pattern 28 of the support rod 27. Since the end length RL of the support bar 27 is a length calculated from the determined distance between the patterns 28 and the number of patterns 28, it can be calculated relatively accurately.

In this way, the fixture detection unit 150 can detect the length of the support bar 27 in the moving image photographed by the photographing unit 110, and the angle correction unit 141 can correct the rotation angle calculated by the angle calculation unit 132 according to the length of the support bar 27. For example, an error of the feature point C extracted by the feature point extraction unit 131 may be detected according to the length of the support bar 27, and the rotation angle may be corrected according to the detected error of the feature point C.

Referring to fig. 17, a plurality of intelligent sports apparatuses (1A, 1B, 1C, and 1N) are connected to an intelligent gym server 330 through a network. A manager, such as a trainer or intelligent gym person in charge, may access intelligent gym server 330 through manager terminal 340.

Each USER (USER a, USER B, USER C, and USER N) moving to the intelligent gym can enter the intelligent gym after verifying the identity through the terminal 320 such as the wearable device, the smart phone, etc. when entering the intelligent gym. For example, the user marks the terminal 320 on an unmanned terminal such as a self-service terminal at the entrance of the intelligent gym through a near field Communication (NEAR FIELD Communication) or Radio Frequency identification (Radio Frequency IDentification, RFID) mode, and the user can enter after verifying the identity of the member. Information about the user whose membership has been confirmed may be transmitted from the intelligent gym server 330 to at least one of the intelligent sports apparatuses (1A, 1B, 1C, and 1N) through the network.

When a USER (USER) approaches any one of the intelligent sports devices (1A, 1B, 1C, and 1N) and marks a wearable device to the intelligent sports device 1, the intelligent sports device 1 may automatically set a sports plan customized according to the USER's ability level and sports performance history according to information received from the intelligent gym server 330.

The intelligent gym server 330 may store USER information of a plurality of USERs (USER a, USER B, USER C, and USER N), device information of the intelligent sports devices (1A, 1B, 1C, and 1N), and other information for operating facilities or intelligent gyms.

The athletic process information stored in the intelligent gym server 330 may be updated when a manager, such as a trainer, registers a user-customized athletic plan in the manager terminal 340. The intelligent exercise devices (1A, 1B, 1C, and 1N) may receive exercise process information from the intelligent gym server 330 connected through a network. On the other hand, in the above-described embodiment, the leg stretcher for enhancing the strength of the upper leg is exemplified as the exercise apparatus as the intelligent exercise apparatuses (1A, 1B, 1C, and 1N), but is not limited thereto, and may be applied in various manners as long as it is an exercise apparatus for exercise.

Embodiments according to the present invention may be implemented in the form of a computer program executable by various components on a computer, and such a computer program may be recorded on a computer-readable storage medium.

The above-described movement posture analysis apparatus may be implemented in the form of a computer-readable storage medium including at least one program storing instructions executable by a processor. The computer is a device capable of calling a command stored in a storage medium and performing an operation of the disclosed examples according to the called command, and may include a motion gesture analysis device of the disclosed examples. The computer readable storage medium may include hardware devices dedicated to storing and executing program commands, such as magnetic media like hard disks, floppy disks, magnetic tapes, optical recording media like CD-ROMs, DVDs, magneto-optical media like floppy disks (floptical disk), and ROMs, RAMs, flash memories, etc. Further, the storage medium may include an intangible medium that is implemented in a form that can be transmitted through a network, for example, a medium that can be implemented in software or an application program and can be transmitted and distributed through a network.

On the other hand, the computer program may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of a computer program may include not only machine language code, such as created by a compiler, but also high-level language code that may be executed by a computer using an interpreter or the like.

Hereinabove, the preferred embodiments thereof are described with emphasis. Those skilled in the art to which the invention pertains will appreciate that the invention may be implemented in modified forms without deviating from the essential characteristics of the invention. Accordingly, the disclosed embodiments should be considered in an illustrative and not a limiting sense. The scope of the invention is indicated in the claims rather than in the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims

1. An exercise posture analysis apparatus that analyzes an exercise posture of a user using exercise equipment, comprising:

a photographing unit for obtaining a moving image by photographing a user moving using the sporting goods;

an equipment detection unit for detecting sports equipment-related information related to at least one of an action and a length of the sports equipment; and

An analysis unit that calculates a rotation angle of the body part of the user based on the moving image, and determines a movement posture of the user based on the calculated rotation angle of the body part,

The analysis unit includes:

A feature point extraction unit configured to extract a plurality of feature points corresponding to a plurality of joint portions of the user based on the moving image of the user;

an angle calculation unit for connecting the plurality of feature points to generate a plurality of bone lines corresponding to a body part of a user, and calculating a rotation angle of at least one of the plurality of bone lines;

an angle correction unit for correcting the rotation angle calculated by the angle calculation unit, based on the sports equipment-related information; and

And a posture judging unit for judging the degree to which the rotation angle corrected by the angle correcting unit deviates from the reference rotation angle, so as to determine the movement posture of the user.

2. The exercise posture analysis apparatus according to claim 1, wherein,

The shooting unit is a camera arranged facing one side part of the sports equipment.

3. The exercise posture analysis apparatus according to claim 1, wherein,

The sports equipment is a weight sports equipment, which comprises a plurality of weight plates and a sports structure for transmitting the load of the weight plates to a user,

The equipment detecting unit includes a first sensor for directly or indirectly detecting a moving distance of the weight plate.

4. The exercise posture analysis apparatus according to claim 3, wherein,

The angle correction unit calculates at least one of a moving distance and a rotation angle of the moving structure according to the moving distance of the weight plate detected by the first sensor, and corrects the rotation angle calculated by the angle calculation unit according to at least one of the moving distance and the angle change of the moving structure.

5. The exercise posture analysis apparatus according to claim 1, wherein,

The sports equipment is barbell sports equipment, which comprises a supporting rod and weight plates clamped at two ends of the supporting rod,

The equipment detection unit is used for obtaining the length or the action of the barbell sports equipment.

6. The exercise posture analysis apparatus according to claim 5, wherein,

The equipment detecting unit includes a second sensor provided to the barbell exercise equipment and configured to detect movement of the barbell exercise equipment.

7. The exercise posture analysis apparatus according to claim 6, wherein,

The angle correction unit detects a moving distance of the barbell exercise device according to a detection result of the second sensor, and corrects the rotation angle calculated by the angle calculation unit according to the moving distance of the barbell exercise device.

8. The exercise posture analysis apparatus according to claim 7, wherein,

The second sensor is arranged on the supporting rod.

9. The exercise posture analysis apparatus according to claim 5, wherein,

The photographing unit acquires an image of the support bar by photographing the support bar of the barbell sporting goods,

The angle correction unit calculates a length of the support rod from an image of the support rod, and corrects the rotation angle calculated by the angle calculation unit according to the length of the support rod.

10. An intelligent sports apparatus, comprising: sports equipment; and a movement posture analysis device that analyzes a movement posture of a user using the sports equipment,

The movement posture analysis device includes:

An analysis unit for calculating a rotation angle of the body part of the user during the movement according to the moving image, and determining a movement posture of the user according to the calculated rotation angle of the body part,

The analysis unit includes:

11. The intelligent sports apparatus of claim 10, wherein,

12. The intelligent sports apparatus of claim 11, wherein,

13. The intelligent sports apparatus of claim 11, wherein,

14. The intelligent sports apparatus of claim 13, wherein,

15. A method of motion gesture analysis, comprising:

Extracting a plurality of feature points corresponding to a plurality of joint parts of a user according to a moving image of the user obtained by a photographing unit;

Connecting the plurality of feature points to generate a plurality of bone lines corresponding to a body part of a user, and calculating a rotation angle of at least one bone line of the plurality of bone lines;

correcting the calculated rotation angle based on the sports equipment-related information detected by the equipment detecting unit; and

The degree to which the rotation angle deviates from the reference rotation angle is judged so as to determine the movement posture of the user.