KR102003801B1 - Apparatus for recogniting free weight training motion and method thereof - Google Patents

Abstract

Disclosed are a smart apparatus for recognizing free weight training motions and a method thereof. The apparatus recognizes various information such as movements with respect to the phase, angle, speed, and displacement of the main joints of the body of a user in the motion, excercise types, exercise repetition numbers, and the exercise weight by using a stereo camera and various sensors and recognizes free weight training motions of the user in the motion based on the recognized various information, thereby confirming the free weight training motions of the user in the motion.

Description

[0001] APPARATUS FOR RECOGNIZING FREE WEIGHT TRAINING MOTION AND METHOD [0002]

The present invention relates to an apparatus and a method for recognizing a smart free weight training motion, and more particularly, to a motion recognition apparatus and method using a motion sensor, The present invention relates to a smart free weight training motion recognition apparatus and method for recognizing various information such as a motion pattern, a motion pattern, a motion repetition count, a motion weight and the like, and recognizing a free weight training motion in motion based on the recognized various information .

Weight training refers to resistance exercise to develop strong physical strength through muscle development, and exercise methods are classified as free weight training and machine weight training.

In the case of a free-weight type exercise device that exercises while lifting a weft or dumbbell, the exercise device is not commonly used due to its complicated structure and high price. It can not be measured.

Also, in the case of free-weight training performed with repetitive inaccurate motions or support of abnormal weight, there is a risk of injury.

Korean Patent No. 10-1387953 [Title: Exercise Weighing Apparatus and Exercise Management System Including It]

An object of the present invention is to provide a method and apparatus for measuring a motion of a user's body, such as a phase, an angle, a velocity, a displacement, etc., of a user during a movement using a motion camera using a stereo camera, various sensors, And recognizing the free weight training operation in which the user is exercising by using the exercise machine based on the recognized various information and a method thereof.

It is another object of the present invention to provide a method and apparatus for training a user to exercise a pre-weight training exercise in which a user is exercising a pre- The present invention relates to a smart free weight training motion recognition apparatus and method for providing feedback on partial reinforcement exercises and retraining of exercise techniques through comparison.

The apparatus for recognizing a smart free-weight training motion according to an embodiment of the present invention includes a motion-sensing device for acquiring motion information of a user's body during movement, motion of each joint, and unique identifier attached to the motion- camera; A sensor unit for measuring a state of a fitness device used by a user during exercise using the exercise device; And a control unit for controlling the motion information of the joint, the type of motion and the number of repetitions of the motion, the type and weight of the exercise apparatus, and the motion of the joint during exercise using the exercise apparatus, based on the acquired image information and the state of the measured exercise apparatus The foot position, the weight distribution of the foot, the pressure distribution of the foot, and the pressures of the foot compartments according to time, and the movement information, the movement pattern and the number of repetitions of the movement, The user confirms a free-weight training operation during exercise using a fitness device based on the verified position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressure of the foot compartment, According to the standard posture information according to the motion form, the motion information of the joint, the motion form, And a controller for comparing the weight of the instrument, the foot position, the weight distribution of the foot, the pressure distribution of the foot, and the pressure of the foot compartment, and generating feedback information related to the user's free- .

In one embodiment of the present invention, the sensor unit may include an ultrasonic sensor for measuring a range of movement of a section in which the exercise device repeatedly moves; An RFID reader for recognizing a unique identifier attached to the exercise device; A hall sensor for measuring a magnitude of a magnetic field with respect to a magnet attached to the exercise device; A magnetic sensor for measuring a magnitude of a magnetic field with respect to the magnet attached to the exercise device; And a pressure plate for measuring movement of the user's body and movement of the respective joints with respect to time during the movement of the user using the exercise device.

As an example related to the present invention, the control unit may determine at least one of movement of each joint of the user in the obtained image information and movement range of a section in which the exercise apparatus repeatedly moves included in the measured state of the exercise apparatus, Wherein the user identifies the type of exercise and the number of repetitions of the exercise while the user is exercising by using the exercise device, recognizes the unique identifier attached to the exercise device in the obtained image information, And determining a type and a weight of the exercise device corresponding to the unique identifier based on at least one of the unique identifiers of the exercise device, Based on the foot pressure, the position of the foot, the weight distribution of the foot, At least one of the pressure distribution and the pressure per foot compartment can be identified.

As an example associated with the present invention, the exercise forms may be selected from the group consisting of: Babel DeLift, Vent Overbellows, Babel Shoulder Press, Barrel Rock, Babel Bench Press, Incline / Dickle Barbell Bench Press, Babel Squat, Babel Lunge, Dumbbell Dead Rift, Dumbbell Shoulder Press, Alternate Dumbbell Rock, Dumbbell Bench Press, Incline / Dickle Dumbbell Chest Press, Dumbbell Squat, Dumbbell Lunge, Dumbbell Thrower, Dumbbell Laterale , A native rock dumbbell triesps extension, and a dumbbell kickback.

According to an embodiment of the present invention, the control unit calculates a change in a center line and a gravitational line of a user for each exercise interval according to a time change of a user during a movement using a fitness device based on the obtained image information, The kinematic factors of each joint can be calculated based on the movement of each joint according to the time change during exercise included in the state of the exercise apparatus.

A method for recognizing a smart free weight training operation according to an embodiment of the present invention is a method for recognizing a smart free weight training motion by a stereoscopic camera using an exercise device to acquire an image including a motion of a user in motion, Acquiring information; Measuring a state of a exercise device used by a user during exercise using the exercise device by a sensor unit; The control unit causes the user to select one of the motion of the joint of the user in the acquired image information and the motion range of the interval in which the exercise apparatus repeatedly moves included in the measured state of the exercise apparatus, Confirming movement information of a joint in motion, a motion pattern, and the number of repetitions of movement; And a control unit for controlling the movement of the exercise equipment based on at least one of a unique identifier attached to the exercise equipment in the acquired image information and a unique identifier recognized from the exercise equipment included in the measured state of the exercise equipment, Confirming the type and weight of the object; The control unit calculates the position of the foot, the weight distribution of the foot, and the body weight of the foot according to the change of time during exercise based on the foot pressure of the body and the joints with respect to the movement of each joint, Identifying at least one of a pressure distribution of the foot segment and a pressure of the foot segment; The control unit determines whether or not the movement information of the joint, the type of motion and the number of times of repetition of motion, the kind and weight of the identified exercise device, the identified foot position, the weight distribution of the foot, the pressure distribution of the foot, Checking a free-weight training operation by the user using the exercise device based on the motion; The control unit calculates standard posture information according to a predetermined exercise form for each exercise instrument previously stored in the storage unit, motion information of the determined joint, weight of the exercise apparatus according to the exercise form and the number of exercise repetitions, Comparing the distribution, pressure distribution of the foot, and pressure of the foot compartment; Generating, by the control unit, feedback information related to the free-weight training operation of the user according to the comparison result; And providing the generated feedback information to the user by the control unit.

As an example related to the present invention, the feedback information includes at least one of: optimum exercise course information as customized information, achievement information according to a user's exercise purpose, mechanical factors of each joint according to a user's exercise purpose, Information for re-training of the exercise technique, and the standard posture information, and comparison image information about the body of the user, motion of each joint, and position of the foot of the user.

The present invention relates to various information such as a motion, a motion form, a motion repetition count, a motion weight, and the like regarding a phase, an angle, a velocity, and a displacement of a body main joint of a user during exercise using a motion camera using a stereo camera and various sensors And recognizing the free weight training operation in which the user is exercising using the exercise machine based on the recognized various information, the free weight training operation of the user in motion can be easily and conveniently confirmed.

Further, the present invention provides a comparison between information collected in association with a free-weight training operation in which a user is exercising using a fitness device, information relating to a pre-stored optimal exercise course, and free- Provides feedback on partial strengthening exercises and re-training of exercise techniques, thereby providing a customized exercise method optimized for the user and enhancing a desired portion in particular.

FIG. 1 is a block diagram showing a configuration of a smart free weight training motion recognition apparatus according to an embodiment of the present invention.
2 is a block diagram showing a configuration of a sensor unit according to an embodiment of the present invention.
FIG. 3 is a graph illustrating changes in foot pressure according to an embodiment of the present invention.
4 to 28 are diagrams illustrating types of free weight training according to an embodiment of the present invention.
29 is a view showing an example of a center line of a human body according to an embodiment of the present invention.
30 is a view showing an example of a center line and a gravity line of a human body according to an embodiment of the present invention.
31 to 32 are flowcharts illustrating a method of recognizing a smart free weight training operation according to an embodiment of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art can be properly understood. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. The term "comprising" or "comprising" or the like in the present invention should not be construed as necessarily including the various elements or steps described in the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a configuration of an apparatus 100 for recognizing a smart free-weight training motion according to an embodiment of the present invention.

1, the smart free weight training motion recognition apparatus 100 includes a stereo camera 100, a sensor unit 200, a communication unit 300, a storage unit 400, a display unit 500, (600) and a control unit (700). All of the components of the smart free-weight training motion recognition apparatus 100 shown in Fig. 1 are not essential components, and the smart free-weight training motion recognition apparatus 100 can be recognized by more components than the components shown in Fig. May be implemented, or the smart free weight training motion recognition device 100 may be implemented by fewer components.

The smart free weight training motion recognition device 10 may be applied to various terminals such as a personal computer, a notebook computer, a slate PC, a tablet PC, and the like.

The free weight training included in the weight training represents a movement using the body of the user (for example, squat, lunge, chin, push-up, etc.), or using a barbell, a dumbbell (or kettlebell), an EZ bar, The characteristic of weight training is that the range of motion of the joint is wide and the body can exercise freely.

In addition, the machine weight training included in the weight training represents a movement using a machine (or a mechanism) in a fitness club or the like, and includes a leg press, a chest press, a city draw, Is that the range is defined by the machine (or instrument / machine), so that safe movement can be performed.

Accurate exercise methods, repetition times, and proper weight training provide various benefits for the human being due to the improvement of muscle strength and increase of muscle, but injuries occur due to repetition of incorrect motion during exercise or support of abnormal body weight.

In the case of weight lifting, for example, various muscles of the body are used during exercise. Exactly the exercise technique, the weight distribution of the foot according to the exercise zone, and the exercise speed (or power) It becomes an important factor.

According to the technical features of the present invention, it is possible to partially reinforce or re-train the exercise technique by comparing the pressure distribution of the foot and the exercise technique according to the exercise interval for each athlete having excellent performance and the exercise interval.

Here, the motion section means that the muscles used by the body of the exercise section are different. This means that the desired part can be strengthened specifically through the measurement of the motion section.

In addition, the free-weight training motion has several features as follows.

In other words, the first thing is that the movements that stand up after touching the ground move repeatedly only in a certain range (or height from the ground). The measurement of repeated movements of the moving range (or height) during exercise is repeatedly performed at a certain height relative to the height (for example, 83% to 116% in the case of a shoulder press) using an ultrasonic sensor It is possible to know the shape of the movement and the number of repetitions of the movement by measuring the height with the ground moving repeatedly by mounting (built-in or detachable).

Second, the other measurement method is to use a stereo camera to photograph (or measure) repeatedly moving joints to find out the shape of the movement and the number of repetitions of the movement.

Third, the above two methods may be applied separately or the two methods may be combined.

Fourth, by using the above-mentioned methods, it is possible to propose an ideal exercise by checking the foot and the left / right / front / back weight distribution of the body during exercise.

In addition, the measurement element for measuring the motion according to the embodiment of the present invention may include the following measurement elements.

In other words, the measurement element may be a type of motion (for example, determining the height and the motion and determining what kind of motion is being performed), a repetition frequency of the motion (for example, a measurement of the height at which the barbell and the dumbbell repeatedly move, (For example, measuring the weight of a barbell or a dumbbell), a motion of the body and joints using a stereo camera (for example, a phase due to movement of the joint , Measurement and analysis of angles, velocities, displacements, etc.), measurement and analysis using time information of motion, measurement and analysis of foot pressure on body and joint motion using pressure plate, Measurement and analysis of pressure distribution and foot pressure using temporal analysis, using stereo camera and pressure plate, Measurement and analysis of the motion, measurement and analysis of the motion and foot pressure using the information of the time per section, and measurement of the amount of movement through movement of the joint, and the like.

The stereo camera 100 may be constituted (or arranged) by at least one or more (or plural) on the front and / or side of a user in motion using a exercise device.

In addition, the stereo camera 100 may be configured to display, on the front and / or side of the user in motion, a motion of the user's body and / or each joint, a unique identifier (or unique image ID), and the like are acquired (or photographed). Here, the motion of each joint includes a phase, an angle, a velocity, a displacement, and the like according to the motion of the joint. In addition, the exercise apparatus includes a barbell, a dumbbell (or a kettlebell), an E-Z bar, and the like. In addition, the unique identifier may include different information depending on the kind of the exercise apparatus, the weight of the exercise apparatus, and the like. At this time, the image information may be image information of the user's body and / or joints moving from the front and / or side of the user in motion.

2, the sensor unit 200 includes an ultrasonic sensor 210, an RFID reader 220, a hall sensor 230, a magnetic sensor 240, and a pressure plate 250. Not all the components of the sensor unit 200 shown in Fig. 2 are essential components, and the sensor unit 200 may be implemented by more components than the components shown in Fig. 2, The sensor unit 200 may be implemented.

The sensor unit 200 measures the state of the exercise machine used by the user during the exercise. Here, the state of the exercise device (or the state information of the exercise device) may include information on a change in height with time of the exercise device, a unique identifier of the exercise device, a magnetic field size, And foot pressure for each exercise zone.

The ultrasonic sensor 210 measures the height of the section (or the range of motion of the moving section) in which the exercising apparatus repeatedly moves by the user in motion. At this time, the ultrasonic sensor 210 may measure the height change of the section in which the corresponding exercise device repeatedly moves with time.

The RFID reader 220 recognizes a unique identifier attached to a fitness instrument used by the user in motion. At this time, the exercise device may be a state in which different unique identifiers (or tags including different unique identifiers) are attached for each weight and type. Here, the tag including the unique identifier may be attached to the exercise device.

In addition, when the exercise device used by the user in motion is provided with a left / right weight (or a fixed weight) such as a barbell, a dumbbell, or an EZ bar, the RFID reader 220 may be provided with tags Or recognizes a unique identifier in one tag attached to one of the left and right sides. In this case, when the RFID reader 220 recognizes the unique IDs from the tags attached to the left and right sides, the weight of the exercise instrument is calculated based on the weight information included in the recognized unique identifier (for example, The weight of the exercise instrument can be calculated by adding up the weight information of the weight of the exercise machine and the weight of the exercise machine. Weight information included in the unique identifier recognized from the tag (for example, weight information obtained by adding left and right weight).

The Hall sensor 230 measures the magnitude of a magnetic field with respect to a magnet attached to a fitness instrument used by the user during exercise. At this time, magnets having different magnetic field sizes may be attached to one side of the exercise device.

The magnetic sensor 240 measures a magnitude of a magnetic field with respect to a magnet attached to a fitness instrument used by the user during the exercise.

The distance between the Hall sensor 230 or the magnetic sensor 240 and the magnet attached to the exercise device is set to a radius within a predetermined error range so that the hall sensor 230 or the magnetic sensor 240 ), The magnitude of the magnetic field is constantly measured from the magnet attached to the exercise device, thereby increasing the accuracy.

The pressure plate (or pressure scaffold) 250 measures the foot pressure of the user during the movement using the exercise device for each exercise zone with respect to the movement of the body and / or each joint according to time. Here, the exercise period represents a state in which a specific muscle, an angle of a joint, and the like used for each step are divided into a series of exercises performed by the user.

As shown in FIG. 3, when the user exercises using the exercising apparatus while the pressure plate 250 is depressed, a pressure applied to both feet of the user varies according to the exercise interval according to the time variation .

That is, as shown in FIG. 3, the foot pressure, the angle of the joint, and the speed of motion of the first to second sections of the inferior-limb impression are compared with the Olympic gold medal list to determine the asymmetry, It is possible to obtain a relative comparison result and utilize it as information for a partial strengthening exercise of the user based on the obtained comparison result. The pulling motion of the weight lifting can be used to calculate the power by measuring symmetry of the left and right joints using the foot pressure and the time required for each section, the center line and the gravity line (or the center line), and measuring the exercise time per section.

As described above, the stereo camera 100 and the sensor unit 200 are configured (or arranged / installed) on the front and / or side of a user who is exercising using a fitness device, (Or acquire / measure) various information related to a user in motion.

In addition, human beings are standing in an upright position and are subjected to gravity (which causes the vertebral muscles to be loaded with a vertical load on the vertebrae), and while many movements are characteristic of animals, Or measuring the joint motion in a state where the influence of gravity is minimized, it is not an accurate measurement of each joint.

In measuring the human body, excluding gravity, measuring and predicting movements or movements is an unscientific method of measurement.

Therefore, the measurement of the accurate muscle strength of the body is an important factor for predicting the athletic performance (or the athletic performance), and the sensor unit 200 according to the embodiment of the present invention for measuring the body center of gravity using the pressure plate 250 or the like ) Provides a measurement method using the pressure of the foot and the center line and the gravity line (or center line) of the body front and the side, It can help improve your ability.

The communication unit 300 communicates with at least one external terminal or any internal component via a wired / wireless communication network. At this time, the external arbitrary terminal may include a terminal (not shown), a server (not shown), and the like. Here, the wireless Internet technology includes a wireless LAN (WLAN), a digital living network alliance (DLNA), a wireless broadband (Wibro), a world interoperability for a microwave (WiMAX), a high speed downlink packet access ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) And the communication unit 300 transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above. In addition, the near field communication technology includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct. The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the communication unit 300 can transmit information to an arbitrary terminal through a universal serial bus (USB).

In addition, the communication unit 300 may be configured to transmit data to a plurality of communication terminals in accordance with technical standards or communication methods (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution The terminal, the server, and the like on a mobile communication network constructed in accordance with a long term evolution (e. G., Long Term Evolution-Advanced)

In addition, the communication unit 300 collects various information measured from the sensor unit 200.

The storage unit 400 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

In addition, the storage unit 400 stores data and programs necessary for the smart-free-weight training motion recognition device 10 to operate.

That is, the storage unit 400 stores a plurality of application programs (application programs or applications) and a smart free weight training motion recognition device 10 that are operated by the smart free weight training motion recognition apparatus 10 Data, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may reside on the smart free weight training motion recognition device 10 from the time of shipment for the basic function of the smart free weight training motion recognition device 10. The application program is stored in the storage unit 400 and installed in the smart free weight training motion recognition device 10 so that the operation of the smart free weight training motion recognition device 10 Function). ≪ / RTI >

The storage unit 400 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory And a PROM (Programmable Read-Only Memory). In addition, the smart free weight training motion recognition apparatus 10 may operate in association with the web storage or operate a web storage that performs a storage function of the storage unit 400 on the Internet .

The storage unit 400 stores various information measured through the sensor unit 200 collected under the control of the controller 700.

In addition, the storage unit 400 stores personal information related to an arbitrary user. At this time, the personal information includes the user's name (or nickname), age, height (or key), weight, foot size, and the like.

In addition, the storage unit 400 stores the motion range of the body and the motion range, the type and weight information of the exercise apparatus according to the unique identifier, the magnetic field size information according to the weight of the exercise apparatus, (Or manages) the standard attitude information according to the received information.

At this time, the above-mentioned motion patterns can be classified into various types of movement such as a movement using a barbell, such as Babel DeLift, Vent Over Babel Row, Babel Shoulder Press, Barrel Rock, Babel Bench Press, Incline / Dickle Barbell Bench Press, Babel Squat, Babel Lunge, Dumbbell Dead Drift, Dumbbell Low, Dumbbell Shoulder Press, Alternate Dumbbell Rock, Dumbbell Bench (or Chest) Press, Incline / Dickle Dumbbell Chest Press, Dumbbell Squat, Low, EZ Bar Triespens Extension and Dumbbell (or Kettlebell) , Dumbbell lunge, dumbbell slug, dumbbell lateralize, dumbbell triesps extension, and dumbbell kickback. Herein, the exercising device (for example, a barbell or a dumbbell) used for the same exercise operation may be different from the other conditions (for example, the deadline, the row, the shoulder press, the carcass, the bench press, the incline / decline bench press, the squat, Lt; / RTI > Therefore, the discrimination of the exercise apparatus can be confirmed through image analysis of the image in the image information or a unique identifier recognized by the exercise apparatus.

As shown in FIG. 4, the barbell deadlift is a movement in which the barbell equipped with the ultrasonic sensor 210 moves from the lower part of the pelvis to the middle part of the shin. The joints used by the Babel de Drift are the hip joints, the shoulder joints and the like, and the muscles used are the back muscles of the back and lower limbs. In addition, when checking with the stereo camera 100, only the hip joint moves while standing in a free weight training motion by the barbell drift, and movement of the height of the head occurs. Further, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 20 cm, The range of movement ranges from about 44% to 11%.

As shown in FIG. 5, the bent over barbell row is a movement in which the barbell equipped with the ultrasonic sensor 210 or the like moves from the lower part of the pelvis to the lower part of the knee. The joints used by the bent over barbellows are shoulder and elbow joints, and the muscles used are lucid muscles, biceps brachial muscles, and upper arm radial muscles. When checking with the stereo camera 100, it is the first characteristic that the head is fixed in a state where the head position is lowered during the free weight training exercise by the bent over barbell, and when the head is lowered, Movement) and elbow (or flexion) joints. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 40 cm, The range of motion ranges from about 44% to 22%.

As shown in FIG. 6, the barbell shoulder press is a movement in which the barbell equipped with the ultrasonic sensor 210 or the like moves from the clavicle height to the head. The joints used by the barbell shoulder presses are shoulder and elbow joints, and the muscles used are deltoid, triceps, and triceps. Further, when checking with the stereo camera (100), only movement of the shoulder (abduction movement) and elbow (extension movement) joints in the stand-up state during free weight training exercise by the barbell shoulder press is only the corresponding shoulder press Feature. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 150 cm to 210 cm, The range of movement ranges from about 83% to 116%.

As shown in FIG. 7, the barbell arm curl is a movement in which the barbell equipped with the ultrasonic sensor 210 and the like moves from the pelvis height to the collarbone. The joints used by the barbell curls are elbow joints and the like, and the muscles used are the biceps brachii and the like. Further, when checking with the stereo camera (100), only movement of the elbow (flexion) joint in the standing state during the free weight training exercise by the barbarian curl is characterized by only the arm curl. In addition, the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210 can be confirmed. For example, when the height is 180 cm, the range of movement is about 80 cm to 150 cm, The range of motion ranges from about 44% to 83%.

As shown in FIG. 8, the barbell bench press is a movement in which the barbell equipped with the ultrasonic sensor 210 moves over the head from the clavicle height. The joints used by the barbell bench presses are shoulder and elbow joints, and the muscles used are pectoralis major muscle, triceps brachii muscle, and the like. When checking with the stereo camera 100, in the case of free-weight training exercise by the barbell bench press, a feature that the shoulder and the elbow only move in a lying state (the point where the knee is bent and the head and the pelvis are horizontal) . At this time, the barbell bench press is different from the arm-pushing-up in that the exercise in the lying state is performed by bending the knee. In addition, the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210 can be confirmed. For example, when the height is 180 cm, the range of movement is about 70 cm to 110 cm, The range of motion ranges from about 39% to 61%.

As shown in FIG. 9, an incline barbell bench press is a movement in which a barbell equipped with an ultrasonic sensor 210 or the like moves from the clavicle height to the head. The joints used by the above-mentioned incline barbell bench presses are shoulder and elbow joints, and the muscles used are pectoralis major muscle, triceps brachii muscle, and the like. When checking with the stereo camera 100, in the case of the free weight training exercise by the above-mentioned incline barbell bench press, the shoulder and the elbow (in the case where the head is bent higher than the pelvis) There are features that only move. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 90 cm to 130 cm, The range of motion ranges from about 50% to 72%.

As shown in FIG. 10, the decline barbell bench press is a movement in which the barbell equipped with the ultrasonic sensor 210 moves over the head from the clavicle height. The joints used by the Dickle barbell bench presses are shoulder and arm dreaming joints, and the muscles used are pectoralis muscle, triceps brachii, and the like. Further, in the case of confirming with the stereo camera 100, in the free-weight training exercise by the declining barbell bench press, the shoulder and the elbow (in the case where the head is lower than the pelvis) There are features that only move. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 60 cm to 80 cm, The range of motion ranges from about 33% to 44%.

As shown in FIG. 11, the barbell squat is a movement in which the barbell equipped with the ultrasonic sensor 210 moves from the clavicle to the navel. The joints used by the barbell squat are the hip joints and the knee joints, and the muscles used are quadriceps, biceps femoris, semitransparent muscles, intussusception, and gluteus maximus. Further, when checking with the stereo camera 100, both of the knees and the hip joint are flexed and stretched at the same time in a standing state during free weight training exercise by the barbell squat. In addition, it is possible to confirm the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the range of motion is about 150 cm to 100 cm, The range of movement ranges from about 83% to 55%.

As shown in FIG. 12, the barbell lunge is a movement in which the barbell equipped with the ultrasonic sensor 210 and the like moves from the level below the clavicle to the lower part of the chest. The joints used by the barbellunge are the hip joint and the knee joint, and the muscles used are quadriceps, biceps femoris, semitendinosus, semicircular canal, gluteus maximus, and the like. In the stereo camera 100, when the free weight training using the barbellunge is performed, one leg in the standing position is a hip joint and a knee joint, and a foot located in the back is bent and extended in the knee joint . In addition, the range of the moving height of the stereo camera 100 or the ultrasonic sensor 210 can be confirmed. For example, when the height is 180 cm, the range of movement is about 140 cm to 120 cm. The range of movement ranges from about 78% to 67%.

As shown in FIG. 13, the barbell shurge is a movement in which the barbell equipped with the ultrasonic sensor 210 moves from the large electron to the pelvis. The joint used by the barbell shroud is a pelvic joint or the like, and the muscle used is a stem or the like. Further, when checking with the stereo camera 100, there is a characteristic that only the height of both shoulders is changed in the standing state during the free weight training exercise by the barbell shroud. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 100 cm, The range of motion ranges from about 44% to 55%.

As shown in FIG. 14, the barbell upright row is a movement in which the barbell equipped with the ultrasonic sensor 210 or the like moves from the navel level to the collarbone. The joints used by the barbell upright row are the shoulder and elbow joints, and the muscles used are the trapezius, the deltoid muscle, and the upper arm radial muscle. Further, when checking with the stereo camera 100, both shoulders and elbows simultaneously move in a standing state during free weight training exercise by the barbell upright row, and the height of the elbows is similar to that of the shoulders. In addition, it can be confirmed by a range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 140 cm, The range of motion ranges from about 44% to 77%.

As shown in FIG. 15, the E-Z bar triceps extension is a movement in which the E-Z bar equipped with the ultrasonic sensor 210 moves from the center of the back of the head to the top of the head. The joints used by the E-Z bar Triess extension are shoulders and elbows, and the muscles used are triceps brachii. When the stereoscopic camera 100 confirms the EZ bar triesps extension, when the user exercises the free weight training using the EZ bar Triess extension, both arms are lifted in a standing state, and only the height of the hand is changed by the movement of the elbow joint Feature. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 155 cm to 205 cm, The range of motion ranges from about 86% to 113%.

As shown in FIG. 16, the dumbbell deadlift is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the lower part of the pelvis to the middle part of the shin. The joints used by the dumbbell deciduous are the hip, the shoulder joint, etc., and the muscles used are the back muscles of the back and lower limbs. Further, when checking with the stereo camera 100, only the hip joint moves while standing in a free-weight training motion by the dumbbell dead drift, and movement of the height of the head occurs. Further, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 20 cm, The range of movement ranges from about 44% to 11%.

As shown in FIG. 17, the bent over dumbbell row is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the lower part of the pelvis to the lower part of the knee. The joints used by the vented dumbbell low are the shoulder and elbow joints, and the muscles used are lucid muscles, biceps brachii, and upper arm radial muscles. When checking with the stereo camera 100, it is the first feature that the head is fixed in a state where the head position is lowered during the free weight training exercise by the vent over dumbbell row. In the state where the head is lowered, Movement) and elbow (or flexion) joints. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 40 cm, The range of motion ranges from about 44% to 22%.

As shown in FIG. 18, the dumbbell shoulder press is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the clavicle height to the head. The joints used by the dumbbell shoulder presses are shoulder and elbow joints, and the muscles used are deltoid, triceps, and triceps. Further, in the case of checking with the stereo camera 100, in the free-weight training exercise by the dumbbell shoulder press, only the shoulder press (abduction movement) and the elbow (extension movement) Feature. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 150 cm to 210 cm, The range of movement ranges from about 83% to 116%.

As shown in FIG. 19, the alternate dumbbell arm curl is a movement in which the dumbbell equipped with the ultrasonic sensor 210 and the like moves from the pelvis height to the collarbone. The joints used by the alternate dumbbell arm curl are elbow joints and the like, and the muscles used are the biceps brachii and the like. Further, when checking with the stereo camera 100, there is a feature that only the movement of the elbow (flexion) joint moves in the standing state during the free weight training exercise by the alternate dumbbell arm curl is the only arm curl. In addition, the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210 can be confirmed. For example, when the height is 180 cm, the range of movement is about 80 cm to 150 cm, The range of motion ranges from about 44% to 83%.

As shown in FIG. 20, the dumbbell bench press (or chest press) is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the clavicle height to the head. The joints used by the dumbbell bench presses are the shoulder and elbow joints, and the muscles used are pectoralis major, triceps brachii, and the like. When checking with the stereo camera 100, in the free-weight training exercise by the dumbbell bench press, the feature that only the shoulders and the elbows move in a lying state (the point where the knee is bent and the head and the pelvis are horizontal) . At this time, the dumbbell bench press is different from the push-up pushing in that the exercise in the lying state is performed by bending the knee. In addition, the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210 can be confirmed. For example, when the height is 180 cm, the range of movement is about 70 cm to 110 cm, The range of motion ranges from about 39% to 61%.

As shown in FIG. 21, an incline dumbbell chest press is a movement in which a dumbbell equipped with an ultrasonic sensor 210 or the like moves from the height of the clavicle to the head. The joints used by the above-mentioned incline dumbbell chest press are the shoulder and elbow joints, and the muscles used are pectoralis major, triceps brachii, and the like. In the case of checking with the stereo camera 100, in the free-weight training exercise by the above-mentioned incline dumbbell chest press, the shoulder and elbow (in the case where the head is bent higher than the pelvis) There are features that only move. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 90 cm to 130 cm, The range of motion ranges from about 50% to 72%.

As shown in FIG. 22, the decline dumbbell chest press is a movement in which the dumbbell equipped with the ultrasonic sensor 210 moves over the head from the clavicle height. The joints used by the Dickle dumbbell chest press are the shoulder and arm joints, and the muscles used are pectoralis muscle, triceps brachii, and the like. In the case of confirming with the stereo camera 100, during the free weight training exercise by the dickle dumbbell chest press, the shoulder and the elbow (in the case where the head is lower than the pelvis) There are features that only move. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 60 cm to 80 cm, The range of motion ranges from about 33% to 44%.

As shown in FIG. 23, the dumbbell squat is a movement in which the dumbbell equipped with the ultrasonic sensor 210 moves from the clavicle to the navel. The joints used by the dumbbell squat are the hip joint and the knee joint, and the muscles used are quadriceps femoris, biceps femoris, semitendinosus, semicircular canal, and gluteus maximus. Further, when checking with the stereo camera 100, both of the knees and the hip joint are flexed and stretched at the same time in a standing state during the free weight training exercise by the dumbbell squat. In addition, it is possible to confirm the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the range of motion is about 150 cm to 100 cm, The range of movement ranges from about 83% to 55%.

As shown in FIG. 24, the dumbbell lunge is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the level below the clavicle to the lower portion of the chest. The joints used by the dumbbell lunge are the hip joint and the knee joint, and the muscles used are quadriceps, biceps femoris, semitendinosus, semicircular canal, and gluteus maximus. When the stereoscopic camera 100 confirms that the dumbbell lunge is used for free-weight training, in the standing state, one leg is in the hip joint and the knee joint, and the foot in the back is bent and extended in the knee joint . In addition, the range of the moving height of the stereo camera 100 or the ultrasonic sensor 210 can be confirmed. For example, when the height is 180 cm, the range of movement is about 140 cm to 120 cm. The range of movement ranges from about 78% to 67%.

As shown in FIG. 25, the dumbbell shurge is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the large electron to the side of the pelvis. The joint used by the dumbbell shroud is a pelvic joint or the like, and the muscle used is a stem or the like. Further, when checking with the stereo camera 100, there is a characteristic that only the height of both shoulders changes in a standing state during free weight training exercise by the dumbbell shroud. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 80 cm to 100 cm, The range of motion ranges from about 44% to 55%.

As shown in FIG. 26, the dumbbell lateral raise is a movement in which the dumbbell equipped with the ultrasonic sensor 210 moves from the large electron to the shoulder. The joints used by the dumbbell lateralization are the shoulder joints and the muscle used is the deltoid. Further, when checking with the stereo camera 100, both hands are moved to the shoulder height in a standing state during free weight training exercise by the dumbbell lateralization, and the elbow joint is fixed. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the range of movement is about 80 cm to 150 cm, The range of motion ranges from about 44% to 83%.

As shown in FIG. 27, the one-arm dumbbell triceps extension is a movement in which the dumbbell equipped with the ultrasonic sensor 210 and the like moves from the center of the back of the head to the top of the head. The joints used by the original dumbbell triesps extension include shoulders and elbows, and the muscles used are triceps brachii. When the stereoscopic camera 100 confirms the movement of the dumbbell triesps extension, one arm is lifted in a standing state during free-weight training by the dumbbell tricuspension extension, and then the height of the hand changes only by movement of the elbow joint . In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the movement range is about 155 cm to 205 cm, The range of motion ranges from about 86% to 113%.

As shown in FIG. 28, the dumbbell kick back is a movement in which the dumbbell equipped with the ultrasonic sensor 210 or the like moves from the side of the pelvis to the lumbar region. The joint used by the dumbbell kickback is an elbow or the like, and the muscle used is the brachial plexus muscle and the like. Further, when checking with the stereo camera 100, there is a feature that, during the free weight training exercise by the dumbbell kickback, the elbow only performs extension motion after the position of the head is lowered. In addition, it can be confirmed by the range of the height moving through the stereo camera 100 or the ultrasonic sensor 210. For example, when the height is 180 cm, the range of motion is about 90 cm to 110 cm, The range of movement ranges from about 50% to 61%.

In addition, the storage unit 400 may store (or manage) the motion range ratio and the motion range of the body according to the following exercise type by the control of the controller 700. [ At this time, a predetermined reference value (for example, 180 cm) may be used as the elongation.

Motion form Motion range (cm) Rate of movement range of body relative to height (%) Babel De Drift 80 to 20 44 ~ 11 Bent over barbellows 80 ~ 40 44 ~ 22 Babel Shoulder Press 150 ~ 210 83 to 116 Babel Arm Curl 80 to 150 44 ~ 83 Babel Bench Press 70-110 39 to 61 Inline barbell bench press 90 ~ 130 50 to 72 Dickle barbell bench press 60 to 80 33 to 44 Babel Squat 150-100 83 to 55 Babel Lunge 140-120 78 to 67 Babel Schlug 80-100 44 to 55 Babel Upright Low 80-140 44 ~ 77 E-Z bar Triesens extension 150 ~ 205 86 ~ 113 Dumbbell Deadline 80 to 20 44 ~ 11 Vent Over Dumbbell Low 80 ~ 40 44 ~ 22 Dumbbell shoulder press 150 ~ 210 83 to 116 Alternate Dumbbell Arm Curl 80 to 150 44 ~ 83 Dumbbell Bench Press 70-110 39 to 61 Incline dumbbell chest press 90 ~ 130 50 to 72 Dickle Dumbbell Chest Press 60 to 80 33 to 44 Dumbbell squat 150-100 83 to 55 Dumbbell Lunge 140-120 78 to 67 Dumbbell Shurug 80-100 44 to 55 Dumbbell Raterize 80 to 150 44 ~ 83 Wollaston Dumbbell Triesps Extension 155 ~ 205 86 ~ 113 Dumbbell kickback 90-110 50 ~ 61

The display unit 500 may display various contents such as various menu screens using the user interface and / or graphical user interface stored in the storage unit 400 under the control of the controller 700 have. Here, the content displayed on the display unit 500 includes various text or image data (including various information data) and a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 500 may be a touch screen.

The display unit 500 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) And may include at least one of a flexible display, a 3D display, an e-ink display, and an LED (Light Emitting Diode).

In addition, the display unit 500 displays various information measured through the sensor unit 200 collected under the control of the controller 700.

The voice output unit 600 outputs voice information included in a signal processed by the control unit 700. Here, the audio output unit 600 may include a receiver, a speaker, a buzzer, and the like.

Also, the voice output unit 600 outputs the guidance voice generated by the controller 700.

The sound output unit 600 outputs sound information (or a sound effect) corresponding to various information measured through the sensor unit 200 collected by the controller 700.

The controller or microcontroller unit (MCU) 700 executes the overall control function of the smart free weight training motion recognition device 10. [

In addition, the control unit 700 executes an overall control function of the smart free weight training motion recognition device 10 using the program and data stored in the storage unit 400. [ The controller 700 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the storage unit 400 and performs booting using the O / S stored in the storage unit 400. The CPU may use various programs, contents, data, etc. stored in the storage unit 400 So that various operations can be performed.

In addition, the controller 700 controls the motion of each joint of the user in the acquired (or photographed) image information, the height of a section in which the corresponding exercise device included in the measured state of the exercise device repeatedly moves (Or judging / calculating / measuring) the motion information (or the information of the body joint), the motion pattern and the number of repetitions of the motion of the user in motion based on the motion range of the motion of the user. Herein, the above-mentioned exercise forms are classified into various exercises such as a movement using a barbell, such as Babel des Drift, Vent Over Babelow, Babel Shoulder Press, Babel's Carmel, Babel Bench Press, Incline / Dickle Barbell Bench Press, Babel Squat, Babel Lunge, Dumbbell Dead Drift, Dumbbell Low, Dumbbell Shoulder Press, Alternate Dumbbell Rock, Dumbbell Bench (or Chest) Press, Incline / Dickle Dumbbell Chest Press, Dumbbell Squat, Low, EZ Bar Triespens Extension and Dumbbell (or Kettlebell) , Dumbbell lunge, dumbbell slug, dumbbell lateralize, dumbbell triesps extension, and dumbbell kickback. At this time, the exercise device (for example, a barbell or a dumbbell) used for the same exercise operation may be in a different state Lt; / RTI > Therefore, the discrimination of the exercise apparatus can be confirmed through image analysis of the image in the image information or a unique identifier recognized by the exercise apparatus.

That is, the controller 700 measures (or confirms / estimates) the elongation of the user through image processing for the user, which is an object in the image information. At this time, the controller 700 may check extension information in the personal information related to the user stored in the storage unit 400 in advance.

In addition, the controller 700 measures (or calculates / estimates / estimates / estimates) the height of the section in which the exerciser repeatedly moves (or the range of motion of the repeated section / the range of motion of the body) )do.

In addition, the controller 700 calculates the ratio of the body movement to the body height of the user.

In addition, the controller 700 may calculate a ratio of the motion range of the body relative to the calculated height, a height of a section in which the calculated motion mechanism repeatedly moves, a body and / or joint shape of the user in the image information, The user confirms movement information (or information on the body joint), motion pattern, and the number of repetitions of the motion using the exercise apparatus based on the user's body and / or the movement pattern of the joint.

That is, the controller 700 determines whether or not a corresponding user corresponding to the computed ratio of the motion range of the body relative to the kidney and the calculated motion range and the motion range of the body, Use a device to identify the type of exercise you are doing.

In addition, the control unit 700 can confirm (or calculate) the number of repetitions of the movement of the exercise device during exercise by checking the repetition number of the movement pattern of the user's body and / or joint according to the change of time.

In addition, the control unit 700 may be configured to determine whether or not the movement information of the moving joint (or the body of the user) using the exercise apparatus, based on the height of the interval in which the measured exercise apparatus repeatedly moves (or the range of motion of the repeatedly moving interval) Joint information), motion pattern, and number of repetitions of motion.

That is, the control unit 700 calculates the ratio of the movement range according to the height (or the height range) of the section in which the measured exercise apparatus repeatedly moves as compared with the extension in the personal information related to the user stored in advance in the storage unit 400 do.

In addition, the controller 700 may determine whether or not the user is moving based on the calculated ratio of the movement range of the body relative to the elongation, the height of the interval in which the measured movement mechanism repeatedly moves, Using the instrument, check the motion information (or information on the body joint) of the joint in motion, the motion pattern, and the number of repetitions of the motion.

That is, the control unit 700 determines whether the calculated movement range of the body relative to the elongated body and the measured exercise apparatus are repeatedly moved The corresponding user corresponding to the height range of the section confirms the exercise form during exercise using the exercise device.

In addition, the control unit 700 can confirm (or calculate) the number of repetitions of the movement of the exercise device during exercise by checking the repetition number of the movement pattern of the user's body and / or joint according to the change of time.

In addition, when the controller 700 moves only specific joints using the image information obtained through the stereo camera 100, the user can check the motion pattern during exercise using the exercise machine.

For example, the control unit 700 determines whether or not a user is moving a shoulder press and a shoulder presser on which the user is moving based on the characteristic that the user stands on the image information obtained through the stereo camera 100 and the shoulders and elbows move, .

For example, the control unit 700 may determine that the position of the user's head in the image information obtained through the stereo camera 100 is lowered and the shoulder and elbows move, The user can check the overvoltage in motion.

In this way, the control unit 700 can determine the movement information (or the information of the body joint) of the joint being motioned by the user using the exercise apparatus based on the obtained image information and / or the measured state information of the exercise apparatus, And the number of repetitions of motion patterns and motions can be confirmed.

In addition, the control unit 700 may identify a unique identifier attached to the exercise device in the acquired (or photographed) image information, a unique identifier attached to the exercise device recognized through the RFID reader 220, And the type and weight of the exercising device corresponding to the unique identifier based on the sensor 230 and the magnetic field size measured through the magnetic sensor 240. [

That is, the controller 700 recognizes a unique identifier attached to a fitness instrument in the image information through image processing of the image information. In addition, the controller 700 identifies the type and weight information of the exercise device corresponding to the recognized unique identifier from the type and weight information of the exercise device according to the unique identifier stored in the storage 400 in advance. At this time, the controller 700 checks the characteristic (or characteristic point) of the exercise device, which is an object in the corresponding image information, through the image processing of the image information, It is also possible to identify (or identify) the type of exercise equipment. Here, the type of the exercise machine includes a barbell, a dumbbell (or kettlebell), an E-Z bar, and the like.

In addition, the control unit 700 checks the type and weight of the exercise device corresponding to the unique identifier attached to the exercise device recognized through the RFID reader 220. FIG.

That is, the control unit 700 controls the movement of the exercising device, which corresponds to the unique identifier attached to the exercising device recognized through the RFID reader 220, from the type and weight information of the exercise device according to the unique identifier previously stored in the storage unit 400 Check the type and weight information.

Also, the controller 700 checks the weight of the corresponding exercise device corresponding to the magnitude of the magnetic field measured through the hall sensor 230, the magnetic sensor 240, and the like.

That is, the control unit 700 calculates a corresponding motion corresponding to the magnitude of the magnetic field measured by the Hall sensor 230, the magnetic sensor 240, and the like among the magnetic field size information of each exercise instrument stored in the storage unit 400, Check the weight of the instrument.

In this way, the controller 700 can check the type and weight of the exerciser that the user is using during the exercise based on the obtained image information and / or the measured state information of the exercise apparatus.

In addition, the control unit 700 controls the movement of the user's center line and gravity line (or center line) of the user according to the time change of the user during the movement using the exercise device based on the obtained (or photographed) (Or measurement / confirmation). At this time, the controller 700 may use the image information photographed from the front of the user and the image information photographed from the side of the user to calculate the change of the body center line and the gravity line (or the center line). At this time, the gravitational line (or center line) of the human body can be measured on the side of the human body, and the center line of the human body can be measured on the front side of the human body.

Ideal exercise techniques can maximize weight, and abnormal activity of the median line and the center of gravity (or center and line of gravity) can not maximize weight and can cause acute injury For example, if the balance is unbalanced), and repeated stress increases in certain areas may cause chronic injury.

As shown in Fig. 29, the center line of the human body is a point at which the human body is divided into left and right.

As shown in Fig. 30, the center of gravity or the center line of the human body and the gravity line, which are centers of the mass of the human body, are the points where the weight of all the parts is balanced. The position of this point is the spatial size of the human body, Distribution, posture, structural malformation, and external forces.

In the average human body, the center of gravity is the point above the centerline just before the level of the second sacrum.

The line of gravity is a vertical line passing through the center of gravity. The gravitational line that acts on a person standing in an ideal posture is called the mastoid process, the front of the second sacral vertebra, It goes past the front of the hip joint, the knee joint, the ankle joint, or the talocrural joint.

In addition, gravity through the back of the waist creates a constant expansion torque to the waist and promotes a natural lordosis curve. On the other hand, gravity through the front of the waist produces a constant bending torque. In both cases, the external torque generated by the gravitational line must be neutralized by forces and torques passively produced by the muscles actively and by connective tissue.

Abnormal curvatures change the correlation between the gravitational line and each vertebral region, resulting in a decrease in the exercise performance and injuries.

In the case of abnormal vertebral curvature, damage may be caused by increased stress on muscles, ligaments, bones, spinal discs, dendritic joints, and spinal nerve roots.

Based on this gravity line and the center line dividing the human body, we can measure the asymmetry of the joints in the front and back, the left and right joints, and compare the measurement of the foot pressure and the asymmetry of the foot pressure.

In addition, when the center of gravity coincides with the gravity line during exercise, the exercise can be performed stably and the exercise can be performed with a high weight.

That is, the control unit 700 uses the center line and the gravity line (or the center line) related to the user who is exercising using the exercise device to check, Based on the fact that the injury can be reduced, the current exercise equipment can be used to feed back information such as the correct posture to the user in motion.

In addition, the position of the center of gravity of the barbell can be inferred by using the pressure on the foot at the front or rear.

In addition, the controller 700 controls the foot position, the foot position, and the ankle position according to the time change during exercise based on the foot pressure of each exercise zone with respect to the movement of the body and / or each joint according to the time change measured through the pressure plate 250 (Eg left and right foot) weight distribution, foot pressure distribution, foot pressure (eg, pressure distribution along the front / rear / left / right segments).

In addition, the controller 700 controls the movement of each joint according to the change of time during exercise based on the foot pressure of the exercise section with respect to the movement of the body and / or each joint according to the time change measured through the pressure plate 250 Identify (or calculate / measure) the different forms of exercise and the low pressure for all range low and low range for each exercise zone.

That is, the control unit 700 divides the foot pressure into four sections of front and rear, right and left, and analyzes pressure distributions applied to both feet of the four sections. At this time, the controller 700 may analyze the pressure distributions applied to both feet of the exercise period according to time changes.

In addition, the controller 700 controls the movement of each joint (or the movement form of each joint according to the time change during movement according to the measured value measured through the sensor unit 200) Calculate (or measure) the element. At this time, the movement of each joint includes information on the phase, angle, velocity, displacement, and the like of each joint according to the time change measured by the sensor unit 200. The mechanical factors of each joint include momentum, an amount of impact, torque, moment of inertia, centripetal force, work, uniformity, kinetic energy, position energy, angular momentum, centripetal acceleration and the like.

That is, the controller 700 calculates the momentum, the force, and the action time, which are the product of the mass and the velocity, based on the movement of each joint (including the phase, angle, speed, displacement, etc.) (W), the product of the force and the velocity, the moment of inertia, which is the product of the product of the mass and the radius of the radius of rotation, the centripetal force, the product of the mass and the centripetal acceleration, Kinetic energy based on velocity, kinetic energy based on mass and height and gravitational acceleration, angular momentum as a product of moment of inertia and angular velocity, centripetal acceleration as a product of rotation radius and angular velocity, and the like. .

In addition, the controller 700 determines whether or not the movement information (or the information of the body joint) of the joint, the type of movement and the number of repetitions of the motion, the kind and weight of the exercise device, The pressure distribution of the foot, the pressure of the foot compartment, etc., the user confirms (or recognizes) the free-weight training motion during the exercise using the exercise device.

In addition, the control unit 700 may store standard posture information according to a preset exercise type for each exercise device previously stored in the storage unit 400, movement information (or information of a body joint) of the joint, The weight of the exercise equipment, the position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressure of the foot compartment are compared according to the number of times. Here, the standard posture information may include movement information of a joint associated with an optimal exercise course and a free-weight training operation corresponding to a player having a good performance (for example, a gold medalist at an international tournament) The position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressures of the foot compartment.

Muscle strength is a comprehensive term that includes muscle strength, muscle strength, and muscle endurance. The muscle strength is expressed as the maximum muscle strength (1RM), muscle strength (for example, 6 times or less), muscular strength To 12 times), and muscle endurance (for example, 12 times or more).

When the user sets the goal of the exercise (or the target amount / training target) as the muscular movement, the controller 700 controls the display unit 500 and / Or outputs the alarm information through the audio output unit 600.

In this way, by measuring the correct posture and number of repetitions, you can maximize the efficiency of your workout and help you achieve your goal safely and quickly.

At this time, the exercise load and the repetition frequency according to the training target can be set as shown in [Table 2].

Training Goals Load (% 1RM) Goal iteration count set rest time muscular strength > = 85 <= 6 2 to 6 25 minutes Improvisation
Single expression item
Repeated expression
80 ~ 90
75 ~ 85
1-2
3 to 5
3 to 5
3 to 5
2 to 5 minutes
2 to 5 minutes Malice 67 ~ 85 6-12 3 to 6 30 seconds to 90 seconds Muscle endurance > = 67 > = 12 2 to 3 Less than 30 seconds

For example, if you are doing a muscular exercise, your maximal strength (1RM) means the maximum weight that can be lifted once. If you can repeat once with 100kg, you can repeat 12 times with the weight of 67% of maximum muscle strength and 6 times with 85% .

Also, the controller 700 generates feedback information related to the corresponding free-weight training operation of the user according to the comparison result. Here, the feedback information may include information on optimal exercise courses, customized information, achievement information according to a user's exercise purpose, epidemiological factors (or epidemiological factors) of the respective joints, (For example, information on the motion and posture of the body and / or joints, information on the position of the foot, information on the weight distribution of the foot, information on the pressure distribution of the foot, etc.) And pressure information for each foot segment), standard posture information, and comparison image information about the body of the photographed user and / or the motion or foot position of each joint. At this time, the optimal exercise course information includes the posture information of the body according to the exercise, using the body center line and the gravity line (or the center line) of the user according to the calculated time interval. In addition, the achievement information according to the user's exercise purpose includes information on whether the user normally performed the target amount or the like according to the exercise purpose, the exercise performance rate according to the exercise purpose, etc. according to the comparison result. Here, the purpose of exercise may be to strengthen muscular strength, power, muscular strength, muscular endurance, and the like.

The control unit 700 outputs the generated feedback information to the corresponding user through the display unit 500 and / or the audio output unit 600, or transmits the feedback information to the terminal (not shown) The feedback information can be transmitted (or provided) through the communication unit 300. [

In this way, various information such as the motion, the motion pattern, the number of repetitions of motion, and the exercise weight of the user's physical joints of the user during exercise using the stereo camera, various sensors, and the like regarding the phase, angle, And recognizes the free weight training operation in which the user is exercising using the exercise machine based on the recognized various information.

Also, as described above, a comparison between the information collected in association with the free-weight training operation in which the user is exercising using the exerciser, the information relating to the pre-stored optimal exercise course, and the information related to the free- It is possible to provide feedback on partial strengthening exercises, retraining of exercise techniques, and the like.

Hereinafter, a smart free weight training operation recognition method according to the present invention will be described in detail with reference to FIGS. 1 to 32. FIG.

31 to 32 are flowcharts illustrating a method of recognizing a smart free weight training operation according to an embodiment of the present invention.

First, the stereo camera 100 acquires (or photographed) image information including a motion of a user and / or a movement of each joint, a unique identifier (or unique image ID) )do. Here, the motion of each joint includes a phase, an angle, a velocity, a displacement, and the like according to the motion of the joint. In addition, the exercise device includes a barbell, a dumbbell (or kettlebell), an E-Z bar, and the like. In addition, the unique identifier may include different information depending on the kind of the exercise apparatus, the weight of the exercise apparatus, and the like. At this time, the image information may be image information obtained by photographing the movement of the user's body and / or joints on the front and / or side of the user using the exercise device.

For example, the stereo camera 100 may include a movement of each user's body and / or each joint, a first unique identifier attached to the first exercise device, etc., in front of the user using the first exercise device And acquires second image information including a body of the user and / or movement of each joint, a first unique identifier attached to the corresponding first exercise device, and the like (S3110).

In addition, the sensor unit 200 measures the state of the exercise device used by the user using the exercise device. Here, the state of the exercise device (or the state information of the exercise device) may include information on a change in height with time of the exercise device, a unique identifier of the exercise device, a magnetic field size, And foot pressure for each exercise zone.

That is, the ultrasonic sensor 210 included in the sensor unit 200 measures the height of the section (or the range of motion of the moving section) in which the exercising apparatus repeatedly moves by the user using the exercising apparatus.

In addition, the RFID reader 220 included in the sensor unit 200 recognizes a unique identifier attached to a exercise device used by a user using the exercise device. At this time, the exercise device may be a state in which different unique identifiers (or tags including different unique identifiers) are attached for each weight and type. Here, the tag including the unique identifier may be attached to the exercise device. In addition, when the exercise device used by the user in motion is provided with a left / right weight (or a fixed weight) such as a barbell, a dumbbell, or an EZ bar, the RFID reader 220 may include a tag Or recognizes unique identifiers in one tag attached to one of the left and right sides. In this case, when the RFID reader 220 recognizes the unique IDs from the tags attached to the left and right sides, the weight of the exercise instrument is calculated based on the weight information included in the recognized unique identifier (for example, The weight of the exercise instrument can be calculated by adding up the weight information of the weight of the exercise machine and the weight of the exercise machine. Weight information included in the unique identifier recognized from the tag (for example, weight information obtained by adding left and right weight).

The hall sensor 230 or the magnetic sensor 240 included in the sensor unit 200 measures a magnetic field size of a magnet attached to a fitness device used by a user using the exercise device. In this case, a magnet having a different magnetic field size may be attached to one side of the exercise device, and the distance between the hall sensor 230 or the magnet sensor 240 and the magnet attached to the exercise device may be preset It can be configured to be located at a radius within an error range, thereby improving the accuracy.

In addition, the pressure plate 250 included in the sensor unit 200 measures the foot pressure of the user during the movement using the exercise device for each exercise zone with respect to the movement of the body and / or each joint according to the time change. Here, the exercise period represents a state in which a specific muscle, an angle of a joint, and the like used for each step are divided into a series of exercises performed by the user.

For example, as shown in FIG. 6, the ultrasonic sensor 210 measures a height of a section where the barbell is repeatedly moved (for example, a range of 150 cm to 210 cm ).

In addition, the RFID reader 220 recognizes a first unique identifier (for example, information on a barbell exercise device, 5 kg, etc.) in one tag attached to one of the left and right sides of the barbell.

In addition, the magnetic sensor 240 measures a first magnetic field magnitude with respect to the first magnet attached to the barbell.

As shown in FIG. 6, the pressure plate 250 measures a foot pressure of a user during a movement using the barbell for a movement interval of the user's body and / or each joint according to a time change S3120).

Thereafter, the controller 700 controls the motion of each joint of the user in the acquired (or photographed) image information, the height of the section in which the corresponding exercise apparatus included in the measured state of the exercise apparatus repeatedly moves (Or judging / calculating / measuring) the movement information (or information of the body joint), the motion pattern, and the number of repetitions of the motion in the movement using the exercise device. Herein, the above-mentioned exercise forms are classified into various exercises such as a movement using a barbell, such as Babel des Drift, Vent Over Babelow, Babel Shoulder Press, Babel's Carmel, Babel Bench Press, Incline / Dickle Barbell Bench Press, Babel Squat, Babel Lunge, Dumbbell Dead Drift, Dumbbell Low, Dumbbell Shoulder Press, Alternate Dumbbell Rock, Dumbbell Bench (or Chest) Press, Incline / Dickle Dumbbell Chest Press, Dumbbell Squat, Low, EZ Bar Triespens Extension and Dumbbell (or Kettlebell) , Dumbbell lunge, dumbbell slug, dumbbell lateralize, dumbbell triesps extension, and dumbbell kickback. At this time, the exercise device (for example, a barbell or a dumbbell) used for the same exercise operation may be in a different state Lt; / RTI &gt; Therefore, the discrimination of the exercise apparatus can be confirmed through image analysis of the image in the image information or a unique identifier recognized by the exercise apparatus.

That is, the controller 700 measures (or confirms / estimates) the elongation of the user through image processing for the user, which is an object in the image information. At this time, the controller 700 may check extension information in the personal information related to the user stored in the storage unit 400 in advance. In addition, the controller 700 measures (or calculates / estimates / estimates / estimates) the height of the section in which the exerciser repeatedly moves (or the range of motion of the repeated section / the range of motion of the body) )do. In addition, the controller 700 calculates the ratio of the body movement to the body height of the user. In addition, the controller 700 may calculate a ratio of the motion range of the body relative to the calculated height, a height of a section in which the calculated motion mechanism repeatedly moves, a body and / or joint shape of the user in the image information, The user confirms movement information (or information on the body joint), motion pattern, and the number of repetitions of the motion using the exercise apparatus based on the user's body and / or the movement pattern of the joint. That is, the controller 700 confirms motion of the user's body joint (or movement information of the joint) through image processing for the user, which is an object in the image information. In addition, the controller 700 may determine whether a corresponding user corresponding to the calculated motion range ratio and motion range of the body of the elderly among the motion range ratios and motion ranges of the body compared to the elongation- Use a device to identify the type of exercise you are doing. In addition, the control unit 700 can confirm (or calculate) the number of repetitions of the movement of the exercise device during exercise by checking the repetition number of the movement pattern of the user's body and / or joint according to the change of time.

In addition, the control unit 700 may determine the type of exercise and the number of repetitions of the exercise using the exercise apparatus based on the height of the interval in which the measured exercise apparatus repeatedly moves (or the range of motion of the repeatedly moving interval) Check.

That is, the control unit 700 calculates the ratio of the movement range according to the height (or the height range) of the section in which the measured exercise apparatus repeatedly moves as compared with the extension in the personal information related to the user stored in advance in the storage unit 400 do. In addition, the controller 700 may determine whether or not the user is moving based on the calculated ratio of the movement range of the body relative to the elongation, the height of the interval in which the measured movement mechanism repeatedly moves, Use the instrument to check the motion pattern and the number of repetitions of the motion. That is, the control unit 700 determines whether the calculated movement range of the body relative to the elongated body and the measured exercise apparatus are repeatedly moved The corresponding user corresponding to the height range of the section confirms the exercise form during exercise using the exercise device. In addition, the control unit 700 can confirm (or calculate) the number of repetitions of the movement of the exercise device during exercise by checking the repetition number of the movement pattern of the user's body and / or joint according to the change of time.

In this way, the control unit 700 can determine the movement information (or the information of the body joint) of the joint being motioned by the user using the exercise apparatus based on the obtained image information and / or the measured state information of the exercise apparatus, And the number of repetitions of motion patterns and motions can be confirmed.

For example, the controller 700 measures the height of the user (for example, 180 cm) through image processing for the user in the obtained first image information and / or second image information.

In addition, the control unit 700 may perform the image processing on the obtained first image information (or the second image information) so that the motion range of the user in the first image information (For example, from 150 cm to 210 cm from the ground), and the ratio of the movement range of the user to the height of the user (for example, 83% to 116% corresponding to 150 cm to 210 cm: 180 cm) ).

In addition, the controller 700 may calculate a movement range ratio (e.g., 83% to 116%) of the calculated body height relative to the body, a motion range of the user (e.g., 150 cm to 210 cm) Or the movement form of the user's body in the second image information and the like, the user confirms a shoulder press during free-weight training during exercise using the first exercise device, (E.g., 10 times) through the analysis of the information (or the second image information).

The control unit 700 may check the elongation (for example, 180 cm) in the personal information related to the user stored in advance in the storage unit 400 and check the elongation of the user and the ultrasonic sensor 210, (For example, 150 cm to 210 cm) in which the first exercising apparatus repeatedly moves by the user using the first exercising apparatus measured through the first exercising apparatus (for example, For example, 83% to 116% corresponding to 150 cm to 210 cm: 180 cm).

In addition, the controller 700 may calculate the movement range ratio (e.g., 83% to 116%) of the body relative to the calculated elongation, the interval of the first exercise instrument measured through the ultrasonic sensor 210 repeatedly (For example, 150 cm to 210 cm), a repetitive motion pattern of the first exercise device measured through the ultrasonic sensor 210, and the like, the user performs a pre-weight training during exercise using the first exercise device (E.g., 10 times) through analysis of a change in the height of a section in which the first exercise device measured through the ultrasonic sensor 210 repeatedly checks the shoulder press (S3130).

Thereafter, the controller 700 identifies a unique identifier attached to the exercise device in the acquired (or photographed) image information, or inputs a unique identifier attached to the exercise device recognized through the RFID reader 220, And the type and weight of the exercising device corresponding to the unique identifier based on the sensor 230 and the magnetic field size measured through the magnetic sensor 240. [

That is, the controller 700 recognizes a unique identifier attached to a fitness instrument in the image information through image processing of the image information. In addition, the controller 700 identifies the type and weight information of the exercise device corresponding to the recognized unique identifier from the type and weight information of the exercise device according to the unique identifier stored in the storage 400 in advance. At this time, the controller 700 checks the characteristic (or characteristic point) of the exercise device, which is an object in the corresponding image information, through the image processing of the image information, It is also possible to identify (or identify) the type of exercise equipment. Here, the type of the exercise machine includes a barbell, a dumbbell (or kettlebell), an E-Z bar, and the like.

In addition, the control unit 700 checks the type and weight of the exercise device corresponding to the unique identifier attached to the exercise device recognized through the RFID reader 220. FIG.

That is, the control unit 700 controls the movement of the exercising device, which corresponds to the unique identifier attached to the exercising device recognized through the RFID reader 220, from the type and weight information of the exercise device according to the unique identifier previously stored in the storage unit 400 Check the type and weight information.

Also, the controller 700 checks the weight of the corresponding exercise device corresponding to the magnitude of the magnetic field measured through the hall sensor 230, the magnetic sensor 240, and the like.

That is, the control unit 700 calculates a corresponding motion corresponding to the magnitude of the magnetic field measured by the Hall sensor 230, the magnetic sensor 240, and the like among the magnetic field size information of each exercise instrument stored in the storage unit 400, Check the weight of the instrument.

In this way, the controller 700 can check the type and weight of the exerciser that the user is using during the exercise based on the obtained image information and / or the measured state information of the exercise apparatus.

For example, the controller 700 recognizes the first unique identifier attached to the first exercise device in the acquired first image information, and determines the type and weight of the exercise device according to the unique identifier previously stored in the storage 400 (For example, barbell) and weight information (for example, 5 kg) corresponding to the recognized first unique identifier among the information.

The control unit 700 may determine the type and the weight of the exerciser according to the unique identifier previously stored in the storage unit 400, (For example, barbell) and weight information (for example, 5 kg) corresponding to the unique identifier.

In another example, the control unit 700 may store weight information (e.g., weight information) corresponding to the first magnetic field size measured by the magnetic sensor 240 among the magnetic field size information of the exercise instrument previously stored in the storage unit 400 5 kg) is confirmed (S3140).

Then, the control unit 700 determines the change in the center line of the human body and the gravitational line (or the center line) of the user according to the movement time of the user during the movement using the exercise device based on the obtained (or photographed) (Or measurement / confirmation). At this time, the controller 700 may use the image information photographed from the front of the user and the image information photographed from the side of the user to calculate the change of the body center line and the gravity line (or the center line).

For example, the controller 700 may calculate the first and second image information based on the obtained first image information and the second image information based on the body center line and gravity line (or center line ) Is calculated (S3150).

Then, the control unit 700 calculates the foot position, the foot position, and the ankle according to the time change during exercise based on the foot pressure of each exercise zone with respect to the movement of the body and / or each joint according to the time change measured through the pressure plate 250 (Eg left and right foot) weight distribution, foot pressure distribution, foot pressure (eg, pressure distribution along the front / rear / left / right segments).

In addition, the controller 700 controls the movement of each joint according to the change of time during exercise based on the foot pressure of the exercise section with respect to the movement of the body and / or each joint according to the time change measured through the pressure plate 250 Identify (or calculate / measure) the different forms of exercise and the low pressure for all range low and low range for each exercise zone.

For example, the control unit 700 may calculate the foot position of each exercise zone according to the time during exercise based on the foot pressure applied by both feet of the user while using the barbell as the first exercise device, the weight distribution of the foot , Pressure distribution of the foot, pressure of the foot segment, motion pattern of each joint motion segment, and low pressure of the entire foot pressure and foot pressure of each exercise zone (S3160).

Thereafter, the control unit 700 determines a dynamic value of each joint based on the movement of each joint (or the motion form of each joint) according to the time change during movement according to the measurement value measured through the sensor unit 200 Calculate (or measure) the element. At this time, the movement of each joint includes information on the phase, angle, velocity, displacement, and the like of each joint according to the time change measured by the sensor unit 200. The mechanical factors of each joint include momentum, an amount of impact, torque, moment of inertia, centripetal force, work, uniformity, kinetic energy, position energy, angular momentum, centripetal acceleration and the like.

In operation S3170, the control unit 700 calculates mechanical factors of the joints according to changes in time during exercise based on the foot pressures applied by both feet of the user using the barbell.

Thereafter, the controller 700 determines whether or not the movement information (or the information of the body joint) of the joint, the type of movement and the number of repetitions of the movement, the type and weight of the exercise device, the position of the verified foot, The pressure distribution of the foot, the pressure of the foot compartment, etc., the user confirms (or recognizes) the free-weight training motion during the exercise using the exercise device.

For example, the controller 700 may determine movement information (or information on body joints) of the joint, which is confirmed through the analysis of the first image information and / or the second image information, (E.g., barbell) and weight (e.g., 5 kg), the position of the foot during the exercise, the weight distribution of the foot, the pressure distribution of the foot, the pressure of the foot, The player confirms the barbell shoulder press, which is a free weight training motion in motion (S3180).

Then, the control unit 700 determines whether or not the standard posture information according to the exercise type preset for each exercise device stored in the storage unit 400, the movement information (or the information of the body joint) The weight of the exercise equipment, the position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressure of the foot compartment are compared according to the number of times. Here, the standard posture information may include movement information of a joint associated with an optimal exercise course and a free-weight training operation corresponding to a player having a good performance (for example, a gold medalist at an international tournament) The position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressures of the foot compartment.

For example, the controller 700 compares the standard posture information of each exercise machine stored in the storage unit 400 with the information related to the barbell shoulder press being exercised by the corresponding user (S3190).

Then, the controller 700 generates feedback information related to the corresponding free-weight training operation of the user according to the comparison result. Here, the feedback information may include information on optimal exercise courses, customized information, achievement information according to a user's exercise purpose, epidemiological factors (or epidemiological factors) of the respective joints, (For example, information on the motion and posture of the body and / or joints, information on the position of the foot, information on the weight distribution of the foot, information on the pressure distribution of the foot, etc.) And pressure information for each foot segment), standard posture information, and comparison image information about the body of the photographed user and / or the motion or foot position of each joint. At this time, the optimal exercise course information includes the posture information of the body according to the exercise, using the body center line and the gravity line (or the center line) of the user according to the calculated time interval. In addition, the achievement information according to the user's exercise purpose includes information on whether the user normally performed the target amount or the like according to the exercise purpose, the exercise performance rate according to the exercise purpose, etc. according to the comparison result. Here, the purpose of exercise may be to strengthen muscular strength, power, muscular strength, muscular endurance, and the like.

Also, the controller 700 provides (or outputs) the generated feedback information to the corresponding user.

For example, the control unit 700 displays information for comparing the standard attitude information and the attitude of the user with respect to the barbell shoulder press during the movement based on the comparison result through the display unit 500 (S3200) so that the user can easily confirm the information to be corrected during the movement of the shoulder press.

As described above, the embodiment of the present invention uses a stereo camera, various sensors, and the like to measure motion, motion pattern, number of repetitions of motion, exercise weight, and the like with respect to the phase, angle, And recognizes the free weight training operation in which the user is exercising based on the recognized various information, thereby confirming the free weight training operation of the user in a simple and convenient manner.

The embodiment of the present invention may also be applied to a method and apparatus for training a user to perform a pre-weight training operation in association with a pre-stored optimal exercise course and a pre-weight training operation corresponding to a player of good performance, By providing a feedback on partial reinforcement exercises and retraining of motor skills through comparison of the information, it is possible to provide a customized exercise method optimized for the user and strengthen the desired part in particular.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100: Smart free weight training motion recognition device
100: stereo camera 200: sensor unit
300: communication unit 400:
500: display section 600: audio output section
700: control unit 210: ultrasonic sensor
220: RFID reader 230: Hall sensor
240: magnetic sensor 250: pressure plate

Claims (7)

A stereo camera for acquiring image information including a movement of a user's body in motion, movement of each joint, and unique identifier attached to the exercise device using the exercise device;
A sensor unit for measuring a state of a fitness device used by a user during exercise using the exercise device; And
The motion information, the type of motion and the number of repetitions of the motion, the type and weight of the exercise device, the time of exercise, and the like, based on the acquired image information and the measured state of the exercise device using the exercise device The foot position, the weight distribution of the foot, the pressure distribution of the foot, and the pressures of the foot compartment, respectively, and determine the movement information of the joint, the type of motion and the number of repetitions of the motion, The user confirms a free-weight training operation during exercise using a fitness device based on the verified position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressure of the foot compartment, According to the standard posture information according to the motion form, the motion information of the joint, the motion form, A controller for comparing the weight of the exercise instrument, the position of the foot, the weight distribution of the foot, the pressure distribution of the foot, and the pressure of the foot compartment, and generating feedback information related to the user's free- Smart free weight training motion recognition device. The method according to claim 1,
The sensor unit includes:
An ultrasonic sensor for measuring a movement range of a section in which the exercise device repeatedly moves;
An RFID reader for recognizing a unique identifier attached to the exercise device;
A hall sensor for measuring a magnitude of a magnetic field with respect to a magnet attached to the exercise device;
A magnetic sensor for measuring a magnitude of a magnetic field with respect to the magnet attached to the exercise device; And
And a pressure plate for measuring movement of the user's body and movement of the respective joints in accordance with time with respect to a user in motion using the exercise device, Recognition device. The method according to claim 1,
Wherein,
Based on at least one of a motion of each joint of the user in the obtained image information and a motion range of a section in which the exercise apparatus repeatedly moves included in the measured state of the exercise apparatus, And the number of repetitions of motion is checked,
The type and weight of the exercise device corresponding to the unique identifier based on at least one of the unique identifier attached to the exercise device in the acquired image information and the unique identifier recognized from the exercise device included in the measured state of the exercise device However,
The foot position, the weight distribution of the foot, the pressure distribution of the foot, and the foot of the foot are calculated based on the foot pressure of the exercise zone with respect to the movement of the body and each joint according to the time variation included in the measured state of the exercise apparatus And at least one of the pressure of each of the compartments is identified. The method according to claim 1,
Preferably,
Barbell de Drift, Bent Over Barbellows, Barbell Shoulder Presses, Barbell Rocks, Babel Bench Press, Incline / Decline Barbell Bench Press, Babel Squats, Babel Lunge, Babel Schrug, Babel Uplite Row, EZ Bar Triesps Extension, Dumbbell Dead Drift At least one of dumbbell low, dumbbell shoulder press, alternate dumbbell archer, dumbbell bench press, incline / decline dumbbell chest press, dumbbell squat, dumbbell lunge, dumbbell slurry, dumbbell lateralize, dumbbell triassic extension and dumbbell kickback Wherein the smart-weight-training-operation-recognizing device comprises: The method according to claim 1,
Wherein,
Calculating a change in a center line and a gravitational line of a user of each exercise section according to a time change of a user during exercise using a fitness device based on the acquired image information, Wherein the dynamic element of each joint is calculated on the basis of the movement of each joint according to the motion of the robot. Acquiring, by a stereo camera, image information including movement of a user's body in motion, movement of each joint, and unique identifier attached to the exercise device using a exercise device;
Measuring a state of a exercise device used by a user during exercise using the exercise device by a sensor unit;
The control unit causes the user to select one of the motion of the joint of the user in the acquired image information and the motion range of the interval in which the exercise apparatus repeatedly moves included in the measured state of the exercise apparatus, Confirming the movement information of the joint in motion, the motion pattern, and the number of times of repetition of motion, respectively;
And a control unit for controlling the movement of the exercise equipment based on at least one of a unique identifier attached to the exercise equipment in the acquired image information and a unique identifier recognized from the exercise equipment included in the measured state of the exercise equipment, Confirming the type and weight of the object;
The control unit calculates the position of the foot, the weight distribution of the foot, and the body weight of the foot according to the change of time during exercise based on the foot pressure of the body and the joints with respect to the movement of each joint, A pressure distribution of the foot segment and a pressure of the foot segment, respectively;
The control unit determines whether or not the movement information of the joint, the type of motion and the number of times of repetition of motion, the kind and weight of the identified exercise device, the identified foot position, the weight distribution of the foot, the pressure distribution of the foot, Checking a free-weight training operation by the user using the exercise device based on the motion;
The control unit calculates standard posture information according to a predetermined exercise form for each exercise instrument previously stored in the storage unit, motion information of the determined joint, weight of the exercise apparatus according to the exercise form and the number of exercise repetitions, Comparing the distribution, pressure distribution of the foot, and pressure of the foot compartment;
Generating, by the control unit, feedback information related to the free-weight training operation of the user according to the comparison result; And
And providing the generated feedback information to the user by the control unit. The method according to claim 6,
Wherein the feedback information includes:
The user can be informed of optimal exercise course information, achievement information according to the user's exercise purpose, mechanical factors of each joint according to the user's exercise purpose, information for partial reinforcement exercise, information for re- And at least one of the standard posture information and the comparison image information about the body of the user and the motion or foot position of each joint.

Images