WO2017161734A1 - Correction of human body movements via television and motion-sensing accessory and system - Google Patents

Correction of human body movements via television and motion-sensing accessory and system Download PDF

Info

Publication number
WO2017161734A1
WO2017161734A1 PCT/CN2016/088197 CN2016088197W WO2017161734A1 WO 2017161734 A1 WO2017161734 A1 WO 2017161734A1 CN 2016088197 W CN2016088197 W CN 2016088197W WO 2017161734 A1 WO2017161734 A1 WO 2017161734A1
Authority
WO
WIPO (PCT)
Prior art keywords
motion
human body
somatosensory
accessory
preset
Prior art date
Application number
PCT/CN2016/088197
Other languages
French (fr)
Chinese (zh)
Inventor
李水旺
Original Assignee
乐视控股(北京)有限公司
乐视致新电子科技(天津)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 乐视控股(北京)有限公司, 乐视致新电子科技(天津)有限公司 filed Critical 乐视控股(北京)有限公司
Publication of WO2017161734A1 publication Critical patent/WO2017161734A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/23Recognition of whole body movements, e.g. for sport training
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47214End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • A63B2024/0012Comparing movements or motion sequences with a registered reference
    • A63B2024/0015Comparing movements or motion sequences with computerised simulations of movements or motion sequences, e.g. for generating an ideal template as reference to be achieved by the user

Definitions

  • the embodiments of the present application relate to the field of somatosensory recognition technologies, and in particular, to a human body motion and system through a television and a somatosensory accessory.
  • the exerciser can place a floor mirror beside the TV, so that he can see whether his or her movement is normal when he follows the action in the TV.
  • the inventors have found that such a method is too complicated and takes up space in the room, so that the exerciser cannot exercise in a stretch.
  • the exerciser needs to take into account both the standard movements in the TV set and the movements in the floor mirror, which will make the exerciser more tired, and through the contrast of the naked eye, it is impossible to keep the movements and the standard movements completely consistent.
  • Embodiments of the present application provide a method for correcting human body motion through a television and a somatosensory accessory And the system can automatically monitor the movement of the human body and correct the movement of the human body.
  • An embodiment of the present application provides a method for correcting a human body motion through a television and a somatosensory accessory.
  • the television and the body-sensing accessory are communicatively coupled.
  • the method includes: the somatosensory accessory identifies a human body motion in a current frame image, and acquires the human body motion. a motion corresponding to the motion; the somatosensory accessory compares the acquired simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen; the somatosensory accessory generates a correction according to the determined difference Prompt information and play the correction prompt information on the TV.
  • the simulation action includes a human skeleton corresponding to the human body motion; the human body motion in the current frame image is recognized, and a simulation action corresponding to the human body motion is acquired, including: using a preset The body part classifier identifies a preset number of target parts corresponding to the human body motion in the current frame picture; performs clustering processing on the pixel points in the preset number of target parts identified according to a preset clustering algorithm, and acquires each a bone point corresponding to the target part; the acquired bone point constitutes a simulated motion corresponding to the human body motion.
  • the using the preset body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture comprises: acquiring a body part training set, wherein the body part training set includes a preset number of human bodies a part sample map; extracting a feature value vector of the body part sample map of the human body part training; calculating a classification condition of the body part training part sample map according to the extracted feature value vector; based on the classification condition Identifying a preset number of target parts corresponding to human motion in the current frame picture.
  • determining a difference between the simulated motion and the motion specimen including: acquiring a center point of the simulated motion and a preset The center points of the set motion specimens coincide; the difference between the simulated motion and the motion specimen at the preset position is determined.
  • correction prompt information played by the television is voice information or text information or image information.
  • the method further includes: identifying a preset object in the current frame picture, and calculating a motion amount corresponding to the human body in the current frame picture according to the number of times of reciprocation of the preset object in the preset area.
  • An embodiment of the present application provides a computer readable recording medium having recorded thereon a program configured to execute the above method.
  • Embodiments of the present application provide a system for correcting a human body motion through a television and a somatosensory accessory, the system comprising: a somatosensory accessory configured to recognize a human body motion in a current frame image, and obtain a simulated motion corresponding to the human body motion And comparing the obtained simulated motion with the preset motion specimen, determining a difference between the simulated motion and the motion specimen; generating corrective prompt information according to the determined difference; the television, and the somatosensory accessory
  • the communication connection is configured to display an action specimen preset by the somatosensory accessory, and play the correction prompt information generated by the somatosensory accessory.
  • the simulation action includes a human skeleton corresponding to the human body motion; the somatosensory accessory identifies a human body motion in a current frame image, and acquires a simulation motion corresponding to the human body motion, specifically:
  • the somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture; and perform pixel points in the preset number of target parts identified according to a preset clustering algorithm
  • the clustering process acquires a skeletal point corresponding to each target part; and the acquired skeletal point constitutes a simulated action corresponding to the human body motion.
  • the somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture, specifically: the somatosensory accessory acquires a human body part training set, and the body part training Concentrating includes a preset number of human body part sample maps; extracting a feature value vector of the human body part training concentrated human body part sample map; calculating a classification condition of the human body part training concentrated human body part sample map based on the extracted feature value vector And identifying, according to the classification condition, a preset number of target parts corresponding to the human body motion in the current frame picture.
  • the somatosensory accessory is further configured to: identify a preset object in the current frame picture, and calculate a corresponding body in the current frame picture according to a number of times of reciprocation of the preset object in a preset area The amount of exercise.
  • the method and system for correcting human body motion through a television and a somatosensory accessory are provided by the embodiments of the present application, and the human body motion is monitored by using the somatosensory accessory, and the human body motion in the current frame picture is recognized, so that the human body motion can be acquired.
  • FIG. 1 is a flow chart of a method for correcting a human body motion through a television and a somatosensory accessory according to an embodiment of the present application;
  • FIG. 2 is a flowchart of a method for identifying a human skeleton corresponding to a human body motion in a current frame picture according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of calculating a classification condition by a support vector machine according to an embodiment of the present application.
  • FIG. 1 is a flow chart of a method for correcting a human body motion through a television and a somatosensory accessory according to an embodiment of the present application. As shown in FIG. 1, the method includes:
  • Step S1 The somatosensory accessory recognizes the human body motion in the current frame picture, and acquires a simulated motion corresponding to the human body motion.
  • the body motion of the front exerciser of the television can be monitored by installing the somatosensory accessory on the television, wherein the somatosensory accessory can be a somatosensory camera.
  • the somatosensory accessory can identify the human body motion in the current frame picture to obtain a simulated motion corresponding to the human body motion.
  • the process of recognizing the human body motion may be performed in the somatosensory accessory or in a processor connected to the somatosensory accessory. For example, after acquiring the current frame picture, the somatosensory accessory can send the picture to a processor connected thereto, and then the current frame picture can be identified by the processor.
  • the simulated action may be an action that is completely consistent with the action of the human body, or may be only a human bone corresponding to the action of the human body.
  • the human body considering that the human body can be represented by 20 skeletal points, the human body skeleton corresponding to the human body motion can be generated after recognizing the human body motion in the current frame picture. Multiple bone points can be included in the bone, such as at least 20.
  • the human bone can reflect the movements of various parts of the human body in front of the television, thereby facilitating comparison of the human body motion with the standard motion in the television.
  • the human skeleton corresponding to the human motion in the current frame picture may be specifically identified by the following steps.
  • Step S11 Identify a preset number of target parts corresponding to the human body motion in the current frame picture by using a preset body part classifier.
  • a human body part classifier may be preset, and the human body part classifier may analyze a picture of the human body to identify various parts included in the human body.
  • the human body can be divided into a head, a shoulder, an arm, an elbow, a crotch, a foot, a wrist, a hand, a trunk, a leg, and a knee, and each of the above-mentioned parts can be further divided into Multiple sections up, down, left and right to allow for more precise identification of the human body.
  • the human body part classifier can be established by a machine learning method, that is, the human body part classifier is trained by using pictures of various parts of the human body, so that the human body part classifier can be generated. To divide the classification conditions of different parts, and then input the picture to be processed to the body part classifier, so that The classification condition identifies each human body part in the picture to be processed.
  • the human body part training set may be acquired in advance, and the human body part training set includes a preset number of human body part sample maps.
  • the human body part sample map can cover the above various human body parts.
  • the feature value vector of the sample map of the human body part in the training part of the human body part may be extracted.
  • the feature value vector may be a pixel value vector corresponding to the body part sample map.
  • the body part sample map is composed of a plurality of pixel points
  • the RGB values corresponding to the respective pixel points may be extracted, and the feature values extracted by each pixel point are sequentially arranged to constitute the feature.
  • Value vector For example, the eigenvalue vector formed after the alignment is a series of arranged values in the form of:
  • Ra, Gb, Bc are any integers from 0 to 255 to represent the RGB values corresponding to the pixel points, respectively.
  • the classification condition of the human body part training concentrated body part sample map may be calculated based on the extracted feature value vector.
  • an implementation method of calculating a classification condition of a body part sample map in the training sample is introduced by using a support vector machine (Support Vector Machine) algorithm as an example.
  • Support vector machines were first proposed by Cortes and Vapnik in 1995. They show many unique advantages in solving small sample, nonlinear and high-dimensional pattern recognition, and can be applied to other machine learning problems such as function fitting. Overall, support vector machines can solve the problem of classification and classification criteria for complex transactions.
  • the basic principle of classification by the support vector machine algorithm is explained using the example of the linear classification shown in FIG.
  • the points in the left graph represent the input training samples
  • the points represented by the forks in the right graph represent the calculated C1 training samples
  • the points represented by the circles Indicates the calculated C2 training sample.
  • the classified training samples C1 and C2 can be obtained, and the classification conditions of the C1 and C2 classes can be obtained.
  • the categorization condition (vv' line in the figure, also known as hyperplane) can be represented by a linear function, for example as:
  • w and b are parameters obtained by the support vector machine to calculate the eigenvalue vector set (called “training” in the support vector machine), and x represents the eigenvalue vector of the picture.
  • the input feature value vectors are, for example, two-dimensional vectors, that is, corresponding to each point on the coordinates in FIG.
  • the support vector machine algorithm which continuously searches for the straight line within the range of the input feature value vector, obtains such a straight line by trying to calculate the distance between each searched line and each feature value vector (the point in the figure):
  • the straight line is the largest and equal distance from the nearest feature value vector on both sides.
  • the calculated straight line vv' is a hyperplane. It can be seen from the right graph in Fig. 3 that in the two-dimensional case, the hyperplane vv' is a straight line, and the straight line is the largest and equal distance from the nearest feature value vector on both sides, and the distance is L.
  • the classification condition of different human body parts in the training samples can be obtained by the algorithm of the support vector machine.
  • a preset number of target parts corresponding to the human body motion in the current frame picture may be identified based on the categorization condition.
  • the human body part classifier may classify the human body motions in the current frame picture by using the classification condition, thereby identifying a preset number of target parts included in the human body motion in the current frame picture.
  • Step S12 Perform clustering processing on the pixel points in the preset target number of the identified target points according to the preset clustering algorithm, and acquire the skeletal points corresponding to each target part.
  • the preset number of objects that are identified may be determined according to a preset clustering algorithm.
  • the pixel points in the target part are clustered to obtain the bone points corresponding to each target part.
  • the clustering algorithm may include at least one of a K-MEANS algorithm, a cohesive hierarchical clustering algorithm, or a DBSCAN algorithm.
  • the clustering algorithm can gather the pixel points in the identified target part to a point, and the final gathered point can be used as the skeletal point corresponding to the target part.
  • each identified target part is clustered, so that the skeletal points corresponding to the respective target parts can be obtained.
  • Step S13 The acquired skeleton points constitute a simulation action corresponding to the human body motion.
  • the skeleton points corresponding to the respective target portions are acquired, the skeleton points are sequentially connected, and a skeleton map corresponding to the human body motion can be obtained, and the skeleton map can be used as Get the simulated action.
  • connection between two adjacent bone points can form a human body motion
  • the line between the left shoulder bone point and the left elbow bone point can outline the left upper arm line of the human body.
  • the outlined line can be used as a simulation action corresponding to the left upper arm of the human body motion.
  • Step S2 comparing the obtained simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen.
  • the acquired simulated motion may be compared with the preset motion specimen to determine whether the current human motion and the motion specimen are consistent, That is to say, by comparing the simulated action with the action specimen, it can be determined whether the human body motion is in place at the current moment.
  • the center point of the simulated motion to be acquired may be coincident with the center point of the preset motion specimen.
  • the center point may be the center point of the human torso, such as the center point of the chest cavity.
  • the preset position may be preset for different action specimens. Specify first. For example, for an action specimen, the focus is on the accuracy of the position of the arms and feet. Then, in this case, the arm and the foot in the action specimen can be determined as the preset position, and when the simulated motion and the motion specimen are compared, only the positions of the arm and the foot can be compared, thereby determining The difference between the simulated motion and the motion specimen at the position of the arm and the foot.
  • Step S3 Generate corrective prompt information according to the determined difference, and play the corrected prompt information by using a television, and the corrected prompt information is voice information or text information or image information.
  • the correction prompt information when there is a difference between the simulated action and the action specimen at the preset position, the correction prompt information may be generated according to the determined difference.
  • the correction prompt information may correspond to the preset position in step S2. For example, when there is a difference between the simulated motion and the motion specimen at the position of the arm, the correction prompt information of "arm position mismatch" can be generated.
  • the positional relationship between the simulated motion and the motion specimen at the preset position may be further determined, and a more detailed correction is generated based on the determined positional relationship.
  • Prompt message For example, when the simulated motion is inconsistent with the arm portion in the motion specimen, the positional relationship between the arm of the simulated motion and the arm of the motion specimen can be determined. For example, the arm of the simulated motion is located above the arm of the motion specimen, then In this case, a correction message "Please move the arm down" can be generated to more clearly remind the exerciser of the area to be corrected and the direction of correction.
  • the exercise amount of the exerciser may be counted according to the difference of the exercise equipment used by the exerciser.
  • the preset object in the current frame picture may be identified.
  • the preset object may be, for example, an exercise device such as a dumbbell or a barbell.
  • the specific recognition process can also be performed by the support vector machine method, by learning different exercise devices to generate classification conditions for classifying different exercise devices, and further, the classification conditions can be used in the current frame picture. Exercise equipment for identification.
  • the amount of motion corresponding to the human body in the current frame picture may be calculated according to the number of times of reciprocation of the preset object in the preset area.
  • the preset area may be determined in advance according to the difference of the preset object, and the preset area may be a range of positions where the preset object is used by the exerciser.
  • the preset area of the dumbbell is often the length range of the exerciser's arm, and the preset area of the barbell may be the length range of the exerciser's height.
  • the preset object performs a reciprocating motion in the preset area, and then the exerciser can be considered to perform one motion, so that the number of reciprocations of the preset object in the preset area can be counted. Calculate the amount of exercise of the exerciser.
  • the embodiment of the present application provides a method for correcting a human body motion through a television and a somatosensory accessory, and monitoring the human body motion using the somatosensory accessory, and recognizing the human body motion in the current frame image, thereby obtaining the action with the human body.
  • Corresponding simulation action by comparing the acquired simulation action with the standard action in the television, it can be known whether the human body action is standardized, and when it is not standardized, the correction prompt information can be sent to the exerciser in front of the TV.
  • An embodiment of the present application provides a computer readable recording medium having recorded thereon a program configured to execute the above method.
  • the computer readable recording medium includes any mechanism for storing or transmitting information in a form readable by a computer (eg, a computer).
  • a machine-readable medium includes read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash storage media, electrical, optical, acoustic, or other forms of propagation signals (eg, carrier waves) , infrared signals, digital signals, etc.).
  • Embodiments of the present application also provide a system for correcting human body motion through a television and a somatosensory accessory.
  • the system can include:
  • the somatosensory accessory is configured to identify a human body motion in the current frame image, obtain a simulated motion corresponding to the human body motion, compare the acquired simulated motion with a preset motion specimen, and determine the simulated motion and the simulated motion a difference between the action specimens; generating correction prompt information according to the determined difference;
  • the television is communicatively connected to the somatosensory accessory, configured to display an action specimen preset by the somatosensory accessory, and play the correction prompt information generated by the somatosensory accessory, wherein the correction prompt information is voice Information or text information or image information.
  • the somatosensory accessory may be a somatosensory camera.
  • the simulated action includes a human skeleton corresponding to the human body motion.
  • the somatosensory accessory recognizes the human body motion in the current frame picture, and acquires a simulation action corresponding to the human body motion, specifically:
  • the somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture; and the pixel points in the preset number of target parts identified according to a preset clustering algorithm Performing a clustering process to acquire a skeletal point corresponding to each target part; and the acquired skeletal point constitutes a simulated action corresponding to the human body action.
  • the somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture, specifically: the somatosensory accessory acquires a human body part training set, and the human body part training set Include a preset number of human body part sample maps; extract a feature value vector of the human body part training concentrated human body part sample map; calculate a classification condition of the human body part training concentrated human body part sample map based on the extracted feature value vector; And determining, according to the classification condition, a preset number of target parts corresponding to the human body motion in the current frame picture.
  • the somatosensory accessory compares the acquired simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen, specifically: the simulated motion that the somatosensory accessory will acquire The center point coincides with a center point of the preset motion specimen; and the difference between the simulation motion and the motion specimen at the preset position is determined.
  • the somatosensory accessory is further configured to identify a preset object in the current frame picture, and calculate a number of times of reciprocation in the preset area according to the preset object. The amount of motion corresponding to the human body in the current frame picture.
  • a program instructing related hardware may be completed by a program instructing related hardware, and the program is stored in a storage medium.
  • a number of instructions are included to cause a device (which may be a microcontroller, chip, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the present application.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
  • the method and system for correcting human body motion through the television and the somatosensory accessory are provided by the embodiment of the present application, and the human body motion is monitored by using the somatosensory accessory, and the human body motion in the current frame picture is recognized, thereby obtaining and The simulation action corresponding to the human body motion; by comparing the acquired simulation action with the standard action in the television, it is possible to know whether the human body action is standardized, and when it is not standardized, it can issue a correction to the exerciser in front of the TV set. Prompt message.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Image Analysis (AREA)

Abstract

Embodiments of the present application are applicable in the technical field of motion sensing. Provided are a method and system for correcting human body movements via a television and a motion-sensing accessory. The method comprises: a motion-sensing accessory recognizes a human body movement in a current frame of image and acquires a simulated action corresponding to the human body movement; the motion-sensing accessory compares the acquired simulated action with a preset action sample and determines the difference between the simulated action and the action sample; and the motion-sensing accessory generates correction tip information on the basis of the determined difference and plays back the correction tip information via a television. The embodiments of the present application are capable of automatically monitoring human body movements and providing correction tips.

Description

通过电视和体感配件矫正人体动作及系统Correcting human movements and systems with TV and somatosensory accessories
本申请要求于2016年3月24日提交中国专利局、申请号为201610173854.9,发明名称为“通过电视和体感配件矫正人体动作及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 201610173854.9, filed on March 24, 2016, entitled "Correcting Human Body Actions and Systems Through Television and Somatosensory Accessories", the entire contents of which are incorporated by reference. In this application.
技术领域Technical field
本申请实施方式涉及体感识别技术领域,尤其涉及一种通过电视和体感配件矫正人体动作及系统。The embodiments of the present application relate to the field of somatosensory recognition technologies, and in particular, to a human body motion and system through a television and a somatosensory accessory.
背景技术Background technique
随着生活质量的不断提高,人们承受的生活压力也越来越大。为了缓解生活压力、保持身体健康或者塑造更好的体型,人们往往选择进行各种各样的体育运动,例如跑步、做瑜伽或者做健身操等等。As the quality of life continues to increase, people are under increasing pressure to live. In order to relieve stress, maintain good health or shape a better body, people often choose to perform a variety of sports, such as running, doing yoga or doing aerobics.
由于当前环境问题日益严重,户外的空气质量往往较差,因此人们更愿意选择在室内从事体育运动。例如,人们可以去健身房中,从事跑步、瑜伽、游泳等体育运动,也可以在家中跟随电视机内的健身动作进行健身。Due to the increasing environmental problems, outdoor air quality tends to be poor, so people are more willing to choose to engage in sports indoors. For example, people can go to the gym, engage in sports such as running, yoga, swimming, etc., or they can follow the fitness exercises in the TV at home.
目前,如果选择去健身房进行锻炼,那么一方面健身房的价格往往较高,会增加锻炼者的日常支出;另一方面健身房的教练人数往往有限,不可能针对每个锻炼者制定合适的运动计划或者进行运动动作的指导。如果选择在家中跟随电视内的健身动作进行健身,那么锻炼者往往无法观察到自身的运动动作,有时候动作不到位会大大降低健身的效率。At present, if you choose to go to the gym for exercise, then the price of the gym is often higher, which will increase the daily expenses of the exerciser; on the other hand, the number of coaches in the gym is often limited, it is impossible to develop a suitable exercise plan for each exerciser or Guide the movements. If you choose to follow the fitness exercises in the TV at home to exercise, then the exercisers often can not observe their own sports, sometimes the action is not in place will greatly reduce the efficiency of fitness.
针对上述情况,锻炼者可以在电视机旁放置一面落地镜,从而可以在跟随电视机内的动作进行健身时,能够看到自身的动作是否规范。在实现本申请过程中发明人发现,这样的方法过于复杂,会占据室内的空间,使得锻炼者无法舒展地进行锻炼。同时,锻炼者需要同时兼顾电视机中的标准动作和落地镜中自身的动作,会使得锻炼者比较累,并且通过肉眼的对比,也无法将自身的动作与标准动作保持完全一致。In view of the above situation, the exerciser can place a floor mirror beside the TV, so that he can see whether his or her movement is normal when he follows the action in the TV. In the process of implementing the present application, the inventors have found that such a method is too complicated and takes up space in the room, so that the exerciser cannot exercise in a stretch. At the same time, the exerciser needs to take into account both the standard movements in the TV set and the movements in the floor mirror, which will make the exerciser more tired, and through the contrast of the naked eye, it is impossible to keep the movements and the standard movements completely consistent.
由上可见,现有技术中亟需一种对人体动作进行矫正的方法。It can be seen from the above that there is a need in the prior art for a method of correcting human motion.
发明内容Summary of the invention
本申请实施方式提供一种通过电视和体感配件矫正人体动作的方法 及系统,可以自动对人体动作进行监控,并且对人体动作进行矫正提示。Embodiments of the present application provide a method for correcting human body motion through a television and a somatosensory accessory And the system can automatically monitor the movement of the human body and correct the movement of the human body.
本申请实施方式提供一种通过电视和体感配件矫正人体动作的方法,所述电视和体感配件通信连接,所述方法包括:体感配件对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作;体感配件将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异;体感配件根据确定的所述差异生成矫正提示信息,并通过电视播放所述矫正提示信息。An embodiment of the present application provides a method for correcting a human body motion through a television and a somatosensory accessory. The television and the body-sensing accessory are communicatively coupled. The method includes: the somatosensory accessory identifies a human body motion in a current frame image, and acquires the human body motion. a motion corresponding to the motion; the somatosensory accessory compares the acquired simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen; the somatosensory accessory generates a correction according to the determined difference Prompt information and play the correction prompt information on the TV.
进一步地,所述模拟动作包括与所述人体动作相对应的人体骨骼;所述对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作,包括:利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位;根据预设聚类算法对识别的所述预设数量的目标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点;将获取的所述骨骼点构成与所述人体动作相对应的模拟动作。Further, the simulation action includes a human skeleton corresponding to the human body motion; the human body motion in the current frame image is recognized, and a simulation action corresponding to the human body motion is acquired, including: using a preset The body part classifier identifies a preset number of target parts corresponding to the human body motion in the current frame picture; performs clustering processing on the pixel points in the preset number of target parts identified according to a preset clustering algorithm, and acquires each a bone point corresponding to the target part; the acquired bone point constitutes a simulated motion corresponding to the human body motion.
进一步地,所述利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位,包括:获取人体部位训练集,所述人体部位训练集中包括预设数量的人体部位样本图;提取所述人体部位训练集中人体部位样本图的特征值向量;基于提取的所述特征值向量计算所述人体部位训练集中人体部位样本图的归类条件;基于所述归类条件识别当前帧图片中人体动作对应的预设数量的目标部位。Further, the using the preset body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture comprises: acquiring a body part training set, wherein the body part training set includes a preset number of human bodies a part sample map; extracting a feature value vector of the body part sample map of the human body part training; calculating a classification condition of the body part training part sample map according to the extracted feature value vector; based on the classification condition Identifying a preset number of target parts corresponding to human motion in the current frame picture.
进一步地,所述将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异,包括:将获取的所述模拟动作的中心点与预设的动作标本的中心点重合;确定所述模拟动作和所述动作标本在预设位置处的差异。Further, comparing the acquired simulated action with a preset motion sample, determining a difference between the simulated motion and the motion specimen, including: acquiring a center point of the simulated motion and a preset The center points of the set motion specimens coincide; the difference between the simulated motion and the motion specimen at the preset position is determined.
进一步地,所述通过电视播放的矫正提示信息为语音信息或文字信息或图像信息。Further, the correction prompt information played by the television is voice information or text information or image information.
进一步地,所述方法还包括:对所述当前帧图片中的预设对象进行识别,并根据所述预设对象在预设区域内的往复次数计算所述当前帧图片中人体对应的运动量。 Further, the method further includes: identifying a preset object in the current frame picture, and calculating a motion amount corresponding to the human body in the current frame picture according to the number of times of reciprocation of the preset object in the preset area.
本申请实施方式提供一种在其上记录有配置为执行上述方法的程序的计算机可读记录介质。An embodiment of the present application provides a computer readable recording medium having recorded thereon a program configured to execute the above method.
本申请实施方式提供一种通过电视和体感配件矫正人体动作的系统,所述系统包括:体感配件,配置为对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作;将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异;根据确定的所述差异生成矫正提示信息;电视,与所述体感配件通信连接,配置为显示体感配件预设的动作标本,并播放体感配件生成的矫正提示信息。Embodiments of the present application provide a system for correcting a human body motion through a television and a somatosensory accessory, the system comprising: a somatosensory accessory configured to recognize a human body motion in a current frame image, and obtain a simulated motion corresponding to the human body motion And comparing the obtained simulated motion with the preset motion specimen, determining a difference between the simulated motion and the motion specimen; generating corrective prompt information according to the determined difference; the television, and the somatosensory accessory The communication connection is configured to display an action specimen preset by the somatosensory accessory, and play the correction prompt information generated by the somatosensory accessory.
进一步地,所述模拟动作包括与所述人体动作相对应的人体骨骼;所述体感配件对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作,具体为:所述体感配件利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位;根据预设聚类算法对识别的所述预设数量的目标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点;将获取的所述骨骼点构成与所述人体动作相对应的模拟动作。Further, the simulation action includes a human skeleton corresponding to the human body motion; the somatosensory accessory identifies a human body motion in a current frame image, and acquires a simulation motion corresponding to the human body motion, specifically: The somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture; and perform pixel points in the preset number of target parts identified according to a preset clustering algorithm The clustering process acquires a skeletal point corresponding to each target part; and the acquired skeletal point constitutes a simulated action corresponding to the human body motion.
进一步地,所述体感配件利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位,具体为:所述体感配件获取人体部位训练集,所述人体部位训练集中包括预设数量的人体部位样本图;提取所述人体部位训练集中人体部位样本图的特征值向量;基于提取的所述特征值向量计算所述人体部位训练集中人体部位样本图的归类条件;基于所述归类条件识别当前帧图片中人体动作对应的预设数量的目标部位。Further, the somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture, specifically: the somatosensory accessory acquires a human body part training set, and the body part training Concentrating includes a preset number of human body part sample maps; extracting a feature value vector of the human body part training concentrated human body part sample map; calculating a classification condition of the human body part training concentrated human body part sample map based on the extracted feature value vector And identifying, according to the classification condition, a preset number of target parts corresponding to the human body motion in the current frame picture.
进一步地,所述体感配件还配置为:对所述当前帧图片中的预设对象进行识别,并根据所述预设对象在预设区域内的往复次数计算所述当前帧图片中人体对应的运动量。Further, the somatosensory accessory is further configured to: identify a preset object in the current frame picture, and calculate a corresponding body in the current frame picture according to a number of times of reciprocation of the preset object in a preset area The amount of exercise.
本申请实施方式提供的一种通过电视和体感配件矫正人体动作的方法及系统,利用体感配件对人体动作进行监测,并对当前帧图片中人体动作进行识别,从而可以获取与所述人体动作相对应的模拟动作;通过 将获取的模拟动作与电视机中的标准动作进行对比,从而可以获知所述人体动作是否规范,当不规范时,可以向电视机前的锻炼者发出矫正提示信息。由上可见,本申请实施方式实现了自动对人体动作进行监控,并且有选择地进行矫正提示。The method and system for correcting human body motion through a television and a somatosensory accessory are provided by the embodiments of the present application, and the human body motion is monitored by using the somatosensory accessory, and the human body motion in the current frame picture is recognized, so that the human body motion can be acquired. Corresponding simulation action; Comparing the acquired simulation action with the standard action in the television, it is possible to know whether the human body action is standardized, and when it is not standardized, the correction prompt information can be sent to the exerciser in front of the television. It can be seen from the above that the embodiment of the present application realizes automatic monitoring of human body motion and selectively corrects the prompt.
附图说明DRAWINGS
为了更清楚地说明本申请实施方式或现有技术中的技术方案,下面将对实施方式或现有技术描述中所需要使用的附图逐一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the description of the prior art will be briefly introduced one by one. It is obvious that the drawings in the following description are Some embodiments of the present application can also obtain other drawings based on these drawings without any creative work for those skilled in the art.
图1为本申请实施方式提供的一种通过电视和体感配件矫正人体动作的方法流程图;1 is a flow chart of a method for correcting a human body motion through a television and a somatosensory accessory according to an embodiment of the present application;
图2为本申请实施方式提供的识别出当前帧图片中人体动作对应的人体骨骼的方法流程图;FIG. 2 is a flowchart of a method for identifying a human skeleton corresponding to a human body motion in a current frame picture according to an embodiment of the present disclosure;
图3为本申请实施方式通过支持向量机计算分类条件的示意图。FIG. 3 is a schematic diagram of calculating a classification condition by a support vector machine according to an embodiment of the present application.
具体实施方式detailed description
为使本申请实施方式的目的、技术方案和优点更加清楚,下面将结合本申请实施方式中的附图,对本申请实施方式中的技术方案进行清楚、完整地描述,显然,所描述的实施方式是本申请一部分实施方式,而不是全部的实施方式。基于本申请中的实施方式,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施方式,都属于本申请保护的范围。The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without the inventive work are all within the scope of the present application.
虽然下文描述流程包括以特定顺序出现的多个操作,但是应该清楚了解,这些过程可以包括更多或更少的操作,这些操作可以顺序执行或并行执行,例如使用并行处理器或多线程环境。Although the processes described below include a plurality of operations occurring in a particular order, it should be clearly understood that the processes can include more or fewer operations that can be performed sequentially or in parallel, such as using a parallel processor or a multi-threaded environment.
图1为本申请实施方式提供的一种通过电视和体感配件矫正人体动作的方法流程图。如图1所示,所述方法包括:FIG. 1 is a flow chart of a method for correcting a human body motion through a television and a somatosensory accessory according to an embodiment of the present application. As shown in FIG. 1, the method includes:
步骤S1:体感配件对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作。 Step S1: The somatosensory accessory recognizes the human body motion in the current frame picture, and acquires a simulated motion corresponding to the human body motion.
在本申请实施方式中,可以通过在电视机上安装体感配件,从而可以对电视机前锻炼者的人体动作进行监测,其中体感配件可以是体感摄像头。In the embodiment of the present application, the body motion of the front exerciser of the television can be monitored by installing the somatosensory accessory on the television, wherein the somatosensory accessory can be a somatosensory camera.
在本申请实施方式中,体感配件可以对当前帧图片中的人体动作进行识别,以获取与所述人体动作相对应的模拟动作。在本申请实施方式中,对人体动作进行识别的过程可以在体感配件中完成,也可以在与所述体感配件相连的处理器中完成。例如,体感配件在获取到所述当前帧图片后,可以将该图片发送至与其相连的处理器中,然后可以通过所述处理器对所述当前帧图片进行识别。In the embodiment of the present application, the somatosensory accessory can identify the human body motion in the current frame picture to obtain a simulated motion corresponding to the human body motion. In the embodiment of the present application, the process of recognizing the human body motion may be performed in the somatosensory accessory or in a processor connected to the somatosensory accessory. For example, after acquiring the current frame picture, the somatosensory accessory can send the picture to a processor connected thereto, and then the current frame picture can be identified by the processor.
在本申请实施方式中,所述模拟动作可以为与所述人体动作完全一致的动作,也可以仅仅为与所述人体动作相对应的人体骨骼。在本申请实施方式中,考虑到人体可以通过20个骨骼点来进行表示,因此可以在对当前帧图片中的人体动作进行识别后,生成与所述人体动作相对应的人体骨骼,所述人体骨骼中可以包括多个骨骼点,例如至少20个。通过所述人体骨骼可以反应出电视机前的人体各个部位的动作,从而方便将人体动作与电视机中的标准动作进行对比。In the embodiment of the present application, the simulated action may be an action that is completely consistent with the action of the human body, or may be only a human bone corresponding to the action of the human body. In the embodiment of the present application, considering that the human body can be represented by 20 skeletal points, the human body skeleton corresponding to the human body motion can be generated after recognizing the human body motion in the current frame picture. Multiple bone points can be included in the bone, such as at least 20. The human bone can reflect the movements of various parts of the human body in front of the television, thereby facilitating comparison of the human body motion with the standard motion in the television.
在本申请实施方式中,如图2所示,具体可以通过以下几个步骤来识别出当前帧图片中人体动作对应的人体骨骼。In the embodiment of the present application, as shown in FIG. 2, the human skeleton corresponding to the human motion in the current frame picture may be specifically identified by the following steps.
步骤S11:利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位。Step S11: Identify a preset number of target parts corresponding to the human body motion in the current frame picture by using a preset body part classifier.
在本申请实施方式中,可以预先设置人体部位分类器,所述人体部位分类器可以对人体的图片进行分析,从而识别出该人体中包含的各个部位。例如,人体可以划分为头部、肩部、臂部、肘部、踝部、脚部、腕部、手部、躯干部、腿部以及膝部,在上述的每个部位处又可以划分为上下左右多个部分,以便对于人体进行更加精确地识别。In the embodiment of the present application, a human body part classifier may be preset, and the human body part classifier may analyze a picture of the human body to identify various parts included in the human body. For example, the human body can be divided into a head, a shoulder, an arm, an elbow, a crotch, a foot, a wrist, a hand, a trunk, a leg, and a knee, and each of the above-mentioned parts can be further divided into Multiple sections up, down, left and right to allow for more precise identification of the human body.
在本申请实施方式中,所述人体部位分类器可以通过机器学习的方法来建立,也就是说,利用人体各个部位的图片训练所述人体部位分类器,从而可以让所述人体部位分类器生成用以划分不同部位的分类条件,然后便可以对所述人体部位分类器输入待处理的图片,从而可以根据所 述分类条件对所述待处理的图片中的各个人体部位进行识别。In the embodiment of the present application, the human body part classifier can be established by a machine learning method, that is, the human body part classifier is trained by using pictures of various parts of the human body, so that the human body part classifier can be generated. To divide the classification conditions of different parts, and then input the picture to be processed to the body part classifier, so that The classification condition identifies each human body part in the picture to be processed.
具体地,在本申请实施方式中,可以预先获取人体部位训练集,所述人体部位训练集中包括预设数量的人体部位样本图。为了保证得出的分类条件比较准确,在本申请实施方式中可以在所述人体部位训练集中设置尽可能多的人体部位样本图,所述人体部位样本图可以涵盖上述的各个人体部位。在获取人体部位训练集之后,在本申请实施方式中,可以提取所述人体部位训练集中人体部位样本图的特征值向量。所述特征值向量可以是人体部位样本图对应的像素值向量。由于人体部位样本图是由若干像素点构成,在本申请实施方式中可以将各个像素点对应的RGB值提取出来,并且将每个像素点提取出的特征值按照顺序排列,以构成所述特征值向量。例如,排列后构成的特征值向量如下面形式的一系列排列的数值:Specifically, in the embodiment of the present application, the human body part training set may be acquired in advance, and the human body part training set includes a preset number of human body part sample maps. In order to ensure that the obtained classification conditions are relatively accurate, in the embodiment of the present application, as many human body part sample maps as possible can be set in the human body part training set, and the human body part sample map can cover the above various human body parts. After acquiring the training set of the human body part, in the embodiment of the present application, the feature value vector of the sample map of the human body part in the training part of the human body part may be extracted. The feature value vector may be a pixel value vector corresponding to the body part sample map. Since the body part sample map is composed of a plurality of pixel points, in the embodiment of the present application, the RGB values corresponding to the respective pixel points may be extracted, and the feature values extracted by each pixel point are sequentially arranged to constitute the feature. Value vector. For example, the eigenvalue vector formed after the alignment is a series of arranged values in the form of:
(RGB(1,1),RGB(1,2),…,RGB(1,120),RGB(2,1),RGB(2,2),…,RGB(2,120),…,RGB(200,1),RGB(200,2),…RGB(200,120))(RGB(1,1), RGB(1,2),...,RGB(1,120),RGB(2,1),RGB(2,2),...,RGB(2,120),...,RGB(200,1 ), RGB (200, 2), ... RGB (200, 120))
其中,RGB(m,n)=Ra,Gb,Bc,m、n分别表示人体部位样本图中某一像素所处的行和列;对于200像素*120像素的图片而言,m的取值范围可以为1至200,n的取值范围可以为1至120。Ra,Gb,Bc为0-255中的任一整数,用以分别代表该像素点对应的RGB值。Where RGB(m,n)=Ra, Gb, Bc,m,n respectively represent the row and column of a pixel in the sample image of the human body part; for the picture of 200 pixels*120 pixels, the value of m The range can be from 1 to 200, and the value of n can range from 1 to 120. Ra, Gb, Bc are any integers from 0 to 255 to represent the RGB values corresponding to the pixel points, respectively.
在本申请实施方式中,在提取得到各个人体部位样本图对应的特征值向量后,便可以基于提取的所述特征值向量计算所述人体部位训练集中人体部位样本图的归类条件。具体地,这里以采用支持向量机(Support Vector Machine)算法为例介绍计算所述训练样本中人体部位样本图的分类条件的实现方式。支持向量机是Cortes和Vapnik于1995年首先提出的,它在解决小样本、非线性及高维模式识别中表现出许多特有的优势,并能够推广应用到函数拟合等其他机器学习问题中。整体来说,支持向量机可以解决复杂事务的分类及分类标准的问题。In the embodiment of the present application, after extracting the feature value vector corresponding to each human body part sample map, the classification condition of the human body part training concentrated body part sample map may be calculated based on the extracted feature value vector. Specifically, an implementation method of calculating a classification condition of a body part sample map in the training sample is introduced by using a support vector machine (Support Vector Machine) algorithm as an example. Support vector machines were first proposed by Cortes and Vapnik in 1995. They show many unique advantages in solving small sample, nonlinear and high-dimensional pattern recognition, and can be applied to other machine learning problems such as function fitting. Overall, support vector machines can solve the problem of classification and classification criteria for complex transactions.
利用图3显示的线性分类的例子解释通过支持向量机算法进行分类的基本原理。如图3所示,左侧坐标图中的点表示输入的训练样本,右侧坐标图中的叉代表的点表示计算得到的C1类训练样本,圆圈代表的点 表示计算得到的C2类训练样本。如图3所示,将训练样本通过支持向量机算法计算后,可以获得分类后的C1和C2两类训练样本,并且可以得到划分C1和C2两类的归类条件。The basic principle of classification by the support vector machine algorithm is explained using the example of the linear classification shown in FIG. As shown in FIG. 3, the points in the left graph represent the input training samples, and the points represented by the forks in the right graph represent the calculated C1 training samples, and the points represented by the circles. Indicates the calculated C2 training sample. As shown in FIG. 3, after the training samples are calculated by the support vector machine algorithm, the classified training samples C1 and C2 can be obtained, and the classification conditions of the C1 and C2 classes can be obtained.
对于图3的线性分类来说,所述归类条件(图中的vv’线,也称为超平面)可以用一个线性函数来表示,例如表示为:For the linear classification of Figure 3, the categorization condition (vv' line in the figure, also known as hyperplane) can be represented by a linear function, for example as:
f(x)=wx+bf(x)=wx+b
其中,w和b为支持向量机对特征值向量集合进行计算(支持向量机中称为“训练”)后得到的参数,x代表图片的特征值向量。Where w and b are parameters obtained by the support vector machine to calculate the eigenvalue vector set (called "training" in the support vector machine), and x represents the eigenvalue vector of the picture.
f(x)表示支持向量机中的映射关系。对于f(x)=0的情况,此时的特征值向量x即位于所述超平面上。对于f(x)大于0的情况,对应图3右侧坐标图中超平面右上侧的特征值向量;对于f(x)小于0的情况,对应图3右侧坐标图中超平面左下侧的特征值向量。f(x) represents the mapping relationship in the support vector machine. For the case of f(x) = 0, the eigenvalue vector x at this time is located on the hyperplane. For the case where f(x) is greater than 0, the eigenvalue vector corresponding to the upper right side of the hyperplane in the graph on the right side of FIG. 3; for the case where f(x) is less than 0, the eigenvalue corresponding to the lower left side of the hyperplane in the graph of the right side of FIG. vector.
输入的特征值向量例如均为二维向量,即对应图3中坐标上的每个点。支持向量机算法,即不断搜索输入的特征值向量范围内的直线,通过尝试计算每一个搜索到的这种直线与每一特征值向量(图中的点)的距离,得到一个这样的直线:该直线距离两侧最近特征值向量的距离最大且相等。如图3中右侧坐标图所示,计算得到的直线vv’即超平面。从图3中右侧坐标图可以看出,二维情况下超平面vv’为一直线,该直线距离两侧最近特征值向量的距离最大且相等,该距离均为L。The input feature value vectors are, for example, two-dimensional vectors, that is, corresponding to each point on the coordinates in FIG. The support vector machine algorithm, which continuously searches for the straight line within the range of the input feature value vector, obtains such a straight line by trying to calculate the distance between each searched line and each feature value vector (the point in the figure): The straight line is the largest and equal distance from the nearest feature value vector on both sides. As shown in the right graph of Fig. 3, the calculated straight line vv' is a hyperplane. It can be seen from the right graph in Fig. 3 that in the two-dimensional case, the hyperplane vv' is a straight line, and the straight line is the largest and equal distance from the nearest feature value vector on both sides, and the distance is L.
这样,通过支持向量机的算法,便可以得到划分训练样本中不同人体部位的分类条件。接着,在本申请实施方式中,可以基于所述归类条件识别当前帧图片中人体动作对应的预设数量的目标部位。具体地,所述人体部位分类器可以利用分类条件对当前帧图片中的人体动作进行分类,从而识别出所述当前帧图片中的人体动作包含的预设数量的目标部位。In this way, the classification condition of different human body parts in the training samples can be obtained by the algorithm of the support vector machine. Then, in the embodiment of the present application, a preset number of target parts corresponding to the human body motion in the current frame picture may be identified based on the categorization condition. Specifically, the human body part classifier may classify the human body motions in the current frame picture by using the classification condition, thereby identifying a preset number of target parts included in the human body motion in the current frame picture.
步骤S12:根据预设聚类算法对识别的所述预设数量的目标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点。Step S12: Perform clustering processing on the pixel points in the preset target number of the identified target points according to the preset clustering algorithm, and acquire the skeletal points corresponding to each target part.
在本申请实施方式中,在获取到所述当前帧图片中人体动作对应的多个目标部位后,便可以根据预设聚类算法对识别的所述预设数量的目 标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点。具体地,所述聚类算法可以包括K-MEANS算法、凝聚层次聚类算法或DBSCAN算法中的至少一种。所述聚类算法可以将识别出的目标部位中的像素点聚集于一点,最终聚集的这一点便可以作为所述目标部位对应的骨骼点。In the implementation manner of the present application, after acquiring a plurality of target parts corresponding to the human body motion in the current frame picture, the preset number of objects that are identified may be determined according to a preset clustering algorithm. The pixel points in the target part are clustered to obtain the bone points corresponding to each target part. Specifically, the clustering algorithm may include at least one of a K-MEANS algorithm, a cohesive hierarchical clustering algorithm, or a DBSCAN algorithm. The clustering algorithm can gather the pixel points in the identified target part to a point, and the final gathered point can be used as the skeletal point corresponding to the target part.
这样,对每个识别出的目标部位均进行聚类处理,从而可以得到各个目标部位对应的骨骼点。In this way, each identified target part is clustered, so that the skeletal points corresponding to the respective target parts can be obtained.
步骤S13:将获取的所述骨骼点构成与所述人体动作相对应的模拟动作。Step S13: The acquired skeleton points constitute a simulation action corresponding to the human body motion.
在本申请实施方式中,在获取了各个目标部位对应的骨骼点后,将这些骨骼点按顺序进行连线,便可以得到与所述人体动作相对应的骨骼图,所述骨骼图便可以作为获取的模拟动作。In the embodiment of the present application, after the skeleton points corresponding to the respective target portions are acquired, the skeleton points are sequentially connected, and a skeleton map corresponding to the human body motion can be obtained, and the skeleton map can be used as Get the simulated action.
在所述模拟动作中,相邻两个骨骼点之间的连线便可以形成人体的动作,例如,左肩部骨骼点与左手肘骨骼点之间的连线可以勾勒出人体左上臂的线条,该勾勒出的线条便可以作为与人体动作的左上臂相对应的模拟动作。In the simulation action, the connection between two adjacent bone points can form a human body motion, for example, the line between the left shoulder bone point and the left elbow bone point can outline the left upper arm line of the human body. The outlined line can be used as a simulation action corresponding to the left upper arm of the human body motion.
步骤S2:将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异。Step S2: comparing the obtained simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen.
在本申请实施方式中,在获取了与人体动作相对应的模拟动作之后,便可以将获取的所述模拟动作与预设的动作标本进行对比,从而判断当前人体动作与动作标本是否一致,也就是说,通过对所述模拟动作与所述动作标本进行对比,可以确定当前时刻人体动作是否到位。In the embodiment of the present application, after the simulated action corresponding to the human body motion is acquired, the acquired simulated motion may be compared with the preset motion specimen to determine whether the current human motion and the motion specimen are consistent, That is to say, by comparing the simulated action with the action specimen, it can be determined whether the human body motion is in place at the current moment.
在本申请实施方式中,可以将将获取的所述模拟动作的中心点与预设的动作标本的中心点重合。所述中心点可以为人体躯干的中心点,例如胸腔的中心点。在将所述模拟动作的中心点与预设动作标本的中心点重合之后,便可以判断模拟动作的其他部位是否与动作标本的其他部位对应一致。这样,便可以确定所述模拟动作和所述动作标本在预设位置处的差异。In the embodiment of the present application, the center point of the simulated motion to be acquired may be coincident with the center point of the preset motion specimen. The center point may be the center point of the human torso, such as the center point of the chest cavity. After the center point of the simulated motion is coincident with the center point of the preset motion specimen, it can be determined whether the other portion of the simulated motion corresponds to the other portion of the motion specimen. In this way, the difference between the simulated motion and the motion specimen at the preset position can be determined.
在本申请实施方式中,所述预设位置可以是针对不同的动作标本预 先指定的。例如,对于某个动作标本而言,其重点在于手臂和脚的位置是否准确。那么,在这种情况下,便可以将该动作标本中的手臂和脚确定为预设位置,在对模拟动作与动作标本进行对比时,可以仅对手臂和脚的位置进行对比,从而可以确定模拟动作与动作标本在手臂和脚的位置处存在的差异。In the embodiment of the present application, the preset position may be preset for different action specimens. Specify first. For example, for an action specimen, the focus is on the accuracy of the position of the arms and feet. Then, in this case, the arm and the foot in the action specimen can be determined as the preset position, and when the simulated motion and the motion specimen are compared, only the positions of the arm and the foot can be compared, thereby determining The difference between the simulated motion and the motion specimen at the position of the arm and the foot.
步骤S3:根据确定的所述差异生成矫正提示信息,并通过电视播放所述矫正提示信息,所述矫正提示信息为语音信息或文字信息或图像信息。Step S3: Generate corrective prompt information according to the determined difference, and play the corrected prompt information by using a television, and the corrected prompt information is voice information or text information or image information.
在本申请实施方式中,当所述模拟动作和所述动作标本在预设位置处存在差异时,便可以根据确定的差异生成矫正提示信息。所述矫正提示信息可以与步骤S2中的预设位置相对应。例如,当模拟动作与动作标本在手臂的位置处存在差异时,便可以生成“手臂位置不符”的矫正提示信息。In the embodiment of the present application, when there is a difference between the simulated action and the action specimen at the preset position, the correction prompt information may be generated according to the determined difference. The correction prompt information may correspond to the preset position in step S2. For example, when there is a difference between the simulated motion and the motion specimen at the position of the arm, the correction prompt information of "arm position mismatch" can be generated.
进一步地,在本申请实施方式中,还可以生成更加具体地矫正提示信息。例如,在确定出模拟动作与动作标本的预设位置处存在差异时,可以进一步地判断模拟动作与动作标本在所述预设位置处的位置关系,并基于判断的位置关系生成更加详细的矫正提示信息。例如,当模拟动作与动作标本中的手臂部位不一致时,可以判断模拟动作的手臂与动作标本的手臂之间的位置关系,例如模拟动作的手臂位于所述动作标本的手臂的上方,那么在这种情况下,便可以生成“请将手臂向下移动”的矫正提示信息,以更加明确地提醒锻炼者应当矫正的部位以及矫正的方向。Further, in the embodiment of the present application, it is also possible to generate more specific correction prompt information. For example, when it is determined that there is a difference between the simulated action and the preset position of the motion specimen, the positional relationship between the simulated motion and the motion specimen at the preset position may be further determined, and a more detailed correction is generated based on the determined positional relationship. Prompt message. For example, when the simulated motion is inconsistent with the arm portion in the motion specimen, the positional relationship between the arm of the simulated motion and the arm of the motion specimen can be determined. For example, the arm of the simulated motion is located above the arm of the motion specimen, then In this case, a correction message "Please move the arm down" can be generated to more clearly remind the exerciser of the area to be corrected and the direction of correction.
在本申请另一实施方式中,在对人体动作进行矫正外,还可以根据锻炼者使用的锻炼器械的不同,来统计锻炼者的运动量。具体地,在本申请实施方式中,可以对所述当前帧图片中的预设对象进行识别。所述预设对象例如可以为哑铃、杠铃等锻炼器械。具体的识别过程同样可以通过支持向量机的方法,通过对不同的锻炼器械进行学习,以生成对不同的锻炼器械进行分类的分类条件,进一步地便可以通过所述分类条件对当前帧图片中的锻炼器械进行识别。 In another embodiment of the present application, in addition to correcting the movement of the human body, the exercise amount of the exerciser may be counted according to the difference of the exercise equipment used by the exerciser. Specifically, in the embodiment of the present application, the preset object in the current frame picture may be identified. The preset object may be, for example, an exercise device such as a dumbbell or a barbell. The specific recognition process can also be performed by the support vector machine method, by learning different exercise devices to generate classification conditions for classifying different exercise devices, and further, the classification conditions can be used in the current frame picture. Exercise equipment for identification.
在识别出所述当前帧图片中的预设对象后,便可以根据所述预设对象在预设区域内的往复次数计算所述当前帧图片中人体对应的运动量。所述预设区域可以根据所述预设对象的不同而预先进行确定,所述预设区域可以为所述预设对象在被锻炼者使用时所处的位置范围。例如,哑铃的预设区域往往为锻炼者手臂的长度范围,杠铃的预设区域可以为锻炼者身高的长度范围。在本申请实施方式中,所述预设对象在预设区域内进行一次往复运动,便可以认为锻炼者进行了一次运动,从而可以统计所述预设对象在预设区域内的往复次数,来计算锻炼者的运动量。After the preset object in the current frame picture is identified, the amount of motion corresponding to the human body in the current frame picture may be calculated according to the number of times of reciprocation of the preset object in the preset area. The preset area may be determined in advance according to the difference of the preset object, and the preset area may be a range of positions where the preset object is used by the exerciser. For example, the preset area of the dumbbell is often the length range of the exerciser's arm, and the preset area of the barbell may be the length range of the exerciser's height. In the embodiment of the present application, the preset object performs a reciprocating motion in the preset area, and then the exerciser can be considered to perform one motion, so that the number of reciprocations of the preset object in the preset area can be counted. Calculate the amount of exercise of the exerciser.
由上可见,本申请实施方式提供的一种通过电视和体感配件矫正人体动作,利用体感配件对人体动作进行监测,并对当前帧图片中人体动作进行识别,从而可以获取与所述人体动作相对应的模拟动作;通过将获取的模拟动作与电视机中的标准动作进行对比,从而可以获知所述人体动作是否规范,当不规范时,可以向电视机前的锻炼者发出矫正提示信息。As can be seen from the above, the embodiment of the present application provides a method for correcting a human body motion through a television and a somatosensory accessory, and monitoring the human body motion using the somatosensory accessory, and recognizing the human body motion in the current frame image, thereby obtaining the action with the human body. Corresponding simulation action; by comparing the acquired simulation action with the standard action in the television, it can be known whether the human body action is standardized, and when it is not standardized, the correction prompt information can be sent to the exerciser in front of the TV.
本申请实施方式提供一种在其上记录有配置为执行上述方法的程序的计算机可读记录介质。An embodiment of the present application provides a computer readable recording medium having recorded thereon a program configured to execute the above method.
所述计算机可读记录介质包括用于以计算机(例如计算机)可读的形式存储或传送信息的任何机制。例如,机器可读介质包括只读存储器(ROM)、随机存取存储器(RAM)、磁盘存储介质、光存储介质、闪速存储介质、电、光、声或其他形式的传播信号(例如,载波、红外信号、数字信号等)等。The computer readable recording medium includes any mechanism for storing or transmitting information in a form readable by a computer (eg, a computer). For example, a machine-readable medium includes read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash storage media, electrical, optical, acoustic, or other forms of propagation signals (eg, carrier waves) , infrared signals, digital signals, etc.).
本申请实施方式还提供一种通过电视和体感配件矫正人体动作的系统。所述系统可以包括:Embodiments of the present application also provide a system for correcting human body motion through a television and a somatosensory accessory. The system can include:
体感配件,配置为对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作;将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异;根据确定的所述差异生成矫正提示信息;The somatosensory accessory is configured to identify a human body motion in the current frame image, obtain a simulated motion corresponding to the human body motion, compare the acquired simulated motion with a preset motion specimen, and determine the simulated motion and the simulated motion a difference between the action specimens; generating correction prompt information according to the determined difference;
电视,与所述体感配件通信连接,配置为显示体感配件预设的动作标本,并播放体感配件生成的矫正提示信息,所述矫正提示信息为语音 信息或文字信息或图像信息。The television is communicatively connected to the somatosensory accessory, configured to display an action specimen preset by the somatosensory accessory, and play the correction prompt information generated by the somatosensory accessory, wherein the correction prompt information is voice Information or text information or image information.
在本申请一具体实施方式中,所述体感配件可以是体感摄像头。In a specific embodiment of the present application, the somatosensory accessory may be a somatosensory camera.
在本申请一具体实施方式中,所述模拟动作包括与所述人体动作相对应的人体骨骼。In a specific embodiment of the present application, the simulated action includes a human skeleton corresponding to the human body motion.
相应地,所述体感配件对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作,具体为:Correspondingly, the somatosensory accessory recognizes the human body motion in the current frame picture, and acquires a simulation action corresponding to the human body motion, specifically:
所述体感配件利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位;根据预设聚类算法对识别的所述预设数量的目标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点;将获取的所述骨骼点构成与所述人体动作相对应的模拟动作。The somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture; and the pixel points in the preset number of target parts identified according to a preset clustering algorithm Performing a clustering process to acquire a skeletal point corresponding to each target part; and the acquired skeletal point constitutes a simulated action corresponding to the human body action.
其中,所述体感配件利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位,具体为:所述体感配件获取人体部位训练集,所述人体部位训练集中包括预设数量的人体部位样本图;提取所述人体部位训练集中人体部位样本图的特征值向量;基于提取的所述特征值向量计算所述人体部位训练集中人体部位样本图的归类条件;基于所述归类条件识别当前帧图片中人体动作对应的预设数量的目标部位。The somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture, specifically: the somatosensory accessory acquires a human body part training set, and the human body part training set Include a preset number of human body part sample maps; extract a feature value vector of the human body part training concentrated human body part sample map; calculate a classification condition of the human body part training concentrated human body part sample map based on the extracted feature value vector; And determining, according to the classification condition, a preset number of target parts corresponding to the human body motion in the current frame picture.
所述体感配件将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异,具体为:所述体感配件将获取的所述模拟动作的中心点与预设的动作标本的中心点重合;确定所述模拟动作和所述动作标本在预设位置处的差异。The somatosensory accessory compares the acquired simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen, specifically: the simulated motion that the somatosensory accessory will acquire The center point coincides with a center point of the preset motion specimen; and the difference between the simulation motion and the motion specimen at the preset position is determined.
此外,在本申请另一具体实施方式中,所述体感配件还配置为对所述当前帧图片中的预设对象进行识别,并根据所述预设对象在预设区域内的往复次数计算所述当前帧图片中人体对应的运动量。In another embodiment of the present application, the somatosensory accessory is further configured to identify a preset object in the current frame picture, and calculate a number of times of reciprocation in the preset area according to the preset object. The amount of motion corresponding to the human body in the current frame picture.
需要说明的是,上述各个功能模块的具体实现方式与前述通过电视和体感配件矫正人体动作的的方法中的步骤S1至S3中的描述一致,这里便不再赘述。It should be noted that the specific implementation manners of the foregoing various functional modules are consistent with the descriptions in the foregoing steps S1 to S3 in the method for correcting human body motion through the television and the somatosensory accessory, and are not described herein again.
本领域技术人员可以理解实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序存储在一个存储介质 中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。Those skilled in the art can understand that all or part of the steps in implementing the above embodiments may be completed by a program instructing related hardware, and the program is stored in a storage medium. A number of instructions are included to cause a device (which may be a microcontroller, chip, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
由上可见,本申请实施方式提供的一种通过电视和体感配件矫正人体动作的方法和系统,利用体感配件对人体动作进行监测,并对当前帧图片中人体动作进行识别,从而可以获取与所述人体动作相对应的模拟动作;通过将获取的模拟动作与电视机中的标准动作进行对比,从而可以获知所述人体动作是否规范,当不规范时,可以向电视机前的锻炼者发出矫正提示信息。It can be seen from the above that the method and system for correcting human body motion through the television and the somatosensory accessory are provided by the embodiment of the present application, and the human body motion is monitored by using the somatosensory accessory, and the human body motion in the current frame picture is recognized, thereby obtaining and The simulation action corresponding to the human body motion; by comparing the acquired simulation action with the standard action in the television, it is possible to know whether the human body action is standardized, and when it is not standardized, it can issue a correction to the exerciser in front of the TV set. Prompt message.
上面对本申请的各种实施方式的描述以描述的目的提供给本领域技术人员。其不旨在是穷举的、或者不旨在将本申请限制于单个公开的实施方式。如上所述,本申请的各种替代和变化对于上述技术所属领域技术人员而言将是显而易见的。因此,虽然已经具体讨论了一些另选的实施方式,但是其它实施方式将是显而易见的,或者本领域技术人员相对容易得出。本申请旨在包括在此已经讨论过的本申请的所有替代、修改、和变化,以及落在上述申请的精神和范围内的其它实施方式。The above description of various embodiments of the present application is provided to those skilled in the art for the purpose of description. It is not intended to be exhaustive or to limit the invention to the single disclosed embodiments. As described above, various alternatives and variations of the present application will be apparent to those skilled in the art. Thus, while a few alternative embodiments have been discussed in detail, other embodiments will be apparent or apparent to those skilled in the art. The present application is intended to cover all alternatives, modifications, and variations of the present invention, as well as other embodiments that fall within the spirit and scope of the application.
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于方法实施例而言,由于其基本相似于系统实施例,所以描述的比较简单,相关之处参见系统实施例的部分说明即可。The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the method embodiment, since it is basically similar to the system embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the system embodiment.
虽然通过实施例描绘了本申请,本领域普通技术人员知道,本申请有许多变形和变化而不脱离本申请的精神,希望所附的权利要求包括这些变形和变化而不脱离本申请的精神。 While the present invention has been described by the embodiments of the present invention, it will be understood by those skilled in the art

Claims (11)

  1. 一种通过电视和体感配件矫正人体动作的方法,所述电视和体感配件通信连接,其特征在于,所述方法包括:A method for correcting a human body motion through a television and a somatosensory accessory, wherein the television and the somatosensory accessory are communicatively coupled, wherein the method comprises:
    体感配件对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作;The somatosensory accessory recognizes the human body motion in the current frame picture, and acquires a simulated motion corresponding to the human body motion;
    体感配件将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异;The somatosensory accessory compares the acquired simulated motion with a preset motion specimen to determine a difference between the simulated motion and the motion specimen;
    体感配件根据确定的所述差异生成矫正提示信息,并通过电视播放所述矫正提示信息。The somatosensory accessory generates correction prompt information according to the determined difference, and plays the correction prompt information through a television.
  2. 根据权利要求1所述的通过电视和体感配件矫正人体动作的方法,其特征在于,所述模拟动作包括与所述人体动作相对应的人体骨骼;The method of correcting a human body motion by a television and a somatosensory accessory according to claim 1, wherein the simulated motion comprises a human skeleton corresponding to the human body motion;
    所述对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作,包括:The identifying the human motion in the current frame image, and acquiring the simulated motion corresponding to the human motion, including:
    利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位;Identifying a preset number of target parts corresponding to the human body motion in the current frame picture by using a preset body part classifier;
    根据预设聚类算法对识别的所述预设数量的目标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点;Performing clustering processing on the pixels in the preset number of target parts that are identified according to a preset clustering algorithm, and acquiring bone points corresponding to each target part;
    将获取的所述骨骼点构成与所述人体动作相对应的模拟动作。The acquired bone points constitute a simulated motion corresponding to the human body motion.
  3. 根据权利要求2所述的通过电视和体感配件矫正人体动作的方法,其特征在于,所述利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位,包括:The method for correcting a human body motion by using a television and a somatosensory accessory according to claim 2, wherein the pre-set body part classifier identifies a preset number of target parts corresponding to the human body motion in the current frame picture, including :
    获取人体部位训练集,所述人体部位训练集中包括预设数量的人体部位样本图;Obtaining a body part training set, wherein the body part training set includes a preset number of body parts sample maps;
    提取所述人体部位训练集中人体部位样本图的特征值向量;Extracting a feature value vector of the sample map of the body part of the human body part training;
    基于提取的所述特征值向量计算所述人体部位训练集中人体部位样本图的归类条件;Calculating a classification condition of the sample map of the human body part training body set based on the extracted feature value vector;
    基于所述归类条件识别当前帧图片中人体动作对应的预设数量的目标部位。And determining, according to the classification condition, a preset number of target parts corresponding to the human body motion in the current frame picture.
  4. 根据权利要求1所述的通过电视和体感配件矫正人体动作的方法, 其特征在于,所述将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异,包括:A method of correcting a human body motion by a television and a somatosensory accessory according to claim 1, The method is characterized in that: comparing the acquired simulated action with a preset action sample, determining a difference between the simulated action and the action specimen, including:
    将获取的所述模拟动作的中心点与预设的动作标本的中心点重合;The center point of the acquired simulated motion is coincident with the center point of the preset motion specimen;
    确定所述模拟动作和所述动作标本在预设位置处的差异。Determining the difference between the simulated motion and the motion specimen at a preset position.
  5. 根据权利要求1所述的通过电视和体感配件矫正人体动作的方法,其特征在于,所述通过电视播放的矫正提示信息为语音信息或文字信息或图像信息。The method for correcting a human body motion by a television and a somatosensory accessory according to claim 1, wherein the correction prompt information played by the television is voice information or text information or image information.
  6. 根据权利要求1所述的通过电视和体感配件矫正人体动作的方法,其特征在于,所述方法还包括:The method of claim 1, wherein the method further comprises:
    对所述当前帧图片中的预设对象进行识别,并根据所述预设对象在预设区域内的往复次数计算所述当前帧图片中人体对应的运动量。Identifying a preset object in the current frame picture, and calculating a motion amount corresponding to the human body in the current frame picture according to the number of times of reciprocation of the preset object in the preset area.
  7. 一种通过电视和体感配件矫正人体动作的系统,其特征在于,所述系统包括:A system for correcting human motion through a television and a somatosensory accessory, the system comprising:
    体感配件,配置为对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作;将获取的所述模拟动作与预设的动作标本进行对比,确定所述模拟动作与所述动作标本之间的差异;根据确定的所述差异生成矫正提示信息;The somatosensory accessory is configured to identify a human body motion in the current frame image, obtain a simulated motion corresponding to the human body motion, compare the acquired simulated motion with a preset motion specimen, and determine the simulated motion and the simulated motion a difference between the action specimens; generating correction prompt information according to the determined difference;
    电视,与所述体感配件通信连接,配置为显示体感配件预设的动作标本,并播放体感配件生成的矫正提示信息。The television is communicably connected to the somatosensory accessory, configured to display an action specimen preset by the somatosensory accessory, and play the correction prompt information generated by the somatosensory accessory.
  8. 根据权利要求7所述的通过电视和体感配件矫正人体动作的系统,其特征在于,所述模拟动作包括与所述人体动作相对应的人体骨骼;The system for correcting a human body motion by a television and a somatosensory accessory according to claim 7, wherein the simulated motion comprises a human skeleton corresponding to the human body motion;
    所述体感配件对当前帧图片中的人体动作进行识别,获取与所述人体动作相对应的模拟动作,具体为:The somatosensory accessory identifies the human body motion in the current frame picture, and acquires a simulated action corresponding to the human body motion, specifically:
    所述体感配件利用预先设置的人体部位分类器,识别当前帧图片中人体动作对应的预设数量的目标部位;根据预设聚类算法对识别的所述预设数量的目标部位中的像素点进行聚类处理,获取每个目标部位对应的骨骼点;将获取的所述骨骼点构成与所述人体动作相对应的模拟动作。The somatosensory accessory uses a pre-set body part classifier to identify a preset number of target parts corresponding to the human body motion in the current frame picture; and the pixel points in the preset number of target parts identified according to a preset clustering algorithm Performing a clustering process to acquire a skeletal point corresponding to each target part; and the acquired skeletal point constitutes a simulated action corresponding to the human body action.
  9. 根据权利要求8所述的通过电视和体感配件矫正人体动作的系统,其特征在于,所述体感配件利用预先设置的人体部位分类器,识别当前 帧图片中人体动作对应的预设数量的目标部位,具体为:The system for correcting a human body motion by a television and a somatosensory accessory according to claim 8, wherein the somatosensory accessory uses a preset body part classifier to identify the current The preset number of target parts corresponding to the human body motion in the frame picture is specifically:
    所述体感配件获取人体部位训练集,所述人体部位训练集中包括预设数量的人体部位样本图;提取所述人体部位训练集中人体部位样本图的特征值向量;基于提取的所述特征值向量计算所述人体部位训练集中人体部位样本图的归类条件;基于所述归类条件识别当前帧图片中人体动作对应的预设数量的目标部位。The somatosensory accessory acquires a training set of a human body part, wherein the human body part training set includes a preset number of human body part sample maps; and extracting the feature value vector of the human body part training concentrated human body part sample map; and extracting the feature value vector based on Calculating a classification condition of the sample map of the body part in the training part of the human body part; and identifying a preset number of target parts corresponding to the human body motion in the current frame picture based on the classification condition.
  10. 根据权利要求7所述的通过电视和体感配件矫正人体动作的系统,其特征在于,所述体感配件还配置为:The system for correcting a human body motion through a television and a somatosensory accessory according to claim 7, wherein the somatosensory accessory is further configured to:
    对所述当前帧图片中的预设对象进行识别,并根据所述预设对象在预设区域内的往复次数计算所述当前帧图片中人体对应的运动量。Identifying a preset object in the current frame picture, and calculating a motion amount corresponding to the human body in the current frame picture according to the number of times of reciprocation of the preset object in the preset area.
  11. 一种在其上记录有配置为执行权利要求1所述方法的程序的计算机可读记录介质。 A computer readable recording medium having recorded thereon a program configured to perform the method of claim 1.
PCT/CN2016/088197 2016-03-24 2016-07-01 Correction of human body movements via television and motion-sensing accessory and system WO2017161734A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610173854.9A CN105847987A (en) 2016-03-24 2016-03-24 Method and system for correcting human body actions through television and body feeling accessory component
CN201610173854.9 2016-03-24

Publications (1)

Publication Number Publication Date
WO2017161734A1 true WO2017161734A1 (en) 2017-09-28

Family

ID=56583258

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088197 WO2017161734A1 (en) 2016-03-24 2016-07-01 Correction of human body movements via television and motion-sensing accessory and system

Country Status (2)

Country Link
CN (1) CN105847987A (en)
WO (1) WO2017161734A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106548675A (en) * 2016-11-08 2017-03-29 湖南拓视觉信息技术有限公司 Virtual military training method and device
CN106648112A (en) * 2017-01-07 2017-05-10 武克易 Somatosensory action recognition method
CN106599882A (en) * 2017-01-07 2017-04-26 武克易 Body sensing motion identification device
CN109308437B (en) * 2017-07-28 2022-06-24 上海史贝斯健身管理有限公司 Motion recognition error correction method, electronic device, and storage medium
CN109815776B (en) * 2017-11-22 2023-02-10 腾讯科技(深圳)有限公司 Action prompting method and device, storage medium and electronic device
CN108091380A (en) * 2017-11-30 2018-05-29 中科院合肥技术创新工程院 Teenager's basic exercise ability training system and method based on multi-sensor fusion
CN110298218B (en) * 2018-03-23 2022-03-04 上海史贝斯健身管理有限公司 Interactive fitness device and interactive fitness system
KR20200077775A (en) * 2018-12-21 2020-07-01 삼성전자주식회사 Electronic device and method for providing information thereof
CN113058261B (en) * 2021-04-22 2024-04-19 杭州当贝网络科技有限公司 Somatosensory motion recognition method and system based on reality scene and game scene

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090085864A1 (en) * 2007-10-02 2009-04-02 Gershom Kutliroff Method and system for gesture classification
CN102324041A (en) * 2011-09-09 2012-01-18 深圳泰山在线科技有限公司 Pixel classification method, joint body gesture recognition method and mouse instruction generating method
CN102413886A (en) * 2009-05-01 2012-04-11 微软公司 Show body position
CN104516496A (en) * 2013-10-04 2015-04-15 财团法人工业技术研究院 Multi-person guidance system and method capable of adjusting motion sensing range
CN105307017A (en) * 2015-11-03 2016-02-03 Tcl集团股份有限公司 Method and device for correcting posture of smart television user

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103390174A (en) * 2012-05-07 2013-11-13 深圳泰山在线科技有限公司 Physical education assisting system and method based on human body posture recognition
CN103230664B (en) * 2013-04-17 2015-07-01 南通大学 Upper limb movement rehabilitation training system and method based on Kinect sensor
CN104157107B (en) * 2014-07-24 2016-05-18 燕山大学 A kind of human posture's apparatus for correcting based on Kinect sensor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090085864A1 (en) * 2007-10-02 2009-04-02 Gershom Kutliroff Method and system for gesture classification
CN102413886A (en) * 2009-05-01 2012-04-11 微软公司 Show body position
CN102324041A (en) * 2011-09-09 2012-01-18 深圳泰山在线科技有限公司 Pixel classification method, joint body gesture recognition method and mouse instruction generating method
CN104516496A (en) * 2013-10-04 2015-04-15 财团法人工业技术研究院 Multi-person guidance system and method capable of adjusting motion sensing range
CN105307017A (en) * 2015-11-03 2016-02-03 Tcl集团股份有限公司 Method and device for correcting posture of smart television user

Also Published As

Publication number Publication date
CN105847987A (en) 2016-08-10

Similar Documents

Publication Publication Date Title
WO2017161734A1 (en) Correction of human body movements via television and motion-sensing accessory and system
US20230338778A1 (en) Method and system for monitoring and feed-backing on execution of physical exercise routines
CN108256433B (en) Motion attitude assessment method and system
WO2021051579A1 (en) Body pose recognition method, system, and apparatus, and storage medium
US10186041B2 (en) Apparatus and method for analyzing golf motion
Ar et al. A computerized recognition system for the home-based physiotherapy exercises using an RGBD camera
CN110448870B (en) Human body posture training method
Chen et al. Computer-assisted self-training system for sports exercise using kinects
WO2017161733A1 (en) Rehabilitation training by means of television and somatosensory accessory and system for carrying out same
CN110544301A (en) Three-dimensional human body action reconstruction system, method and action training system
US11403882B2 (en) Scoring metric for physical activity performance and tracking
Anilkumar et al. Pose estimated yoga monitoring system
US20150092981A1 (en) Apparatus and method for providing activity recognition based application service
KR20220028654A (en) Apparatus and method for providing taekwondo movement coaching service using mirror dispaly
CN113762133A (en) Self-weight fitness auxiliary coaching system, method and terminal based on human body posture recognition
KR102320960B1 (en) Personalized home training behavior guidance and correction system
CN113409651B (en) Live broadcast body building method, system, electronic equipment and storage medium
KR20140043174A (en) Simulator for horse riding and method for simulation of horse riding
Goyal et al. Yoga pose perfection using deep learning: An algorithm to estimate the error in yogic poses
WO2023108842A1 (en) Motion evaluation method and system based on fitness teaching training
Yang et al. Research on face recognition sports intelligence training platform based on artificial intelligence
US20220328159A1 (en) Range of motion determination
Torres et al. Detection of proper form on upper limb strength training using extremely randomized trees for joint positions
KR102568538B1 (en) Apparatus and Method for Estimating Human Motion using Mobile Robot
US20230145451A1 (en) Monitoring exercise activity in a gym environment

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16895085

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16895085

Country of ref document: EP

Kind code of ref document: A1