WO2017156835A1 - Smart method and system for body building posture identification, assessment, warning and intensity estimation - Google Patents

Smart method and system for body building posture identification, assessment, warning and intensity estimation Download PDF

Info

Publication number
WO2017156835A1
WO2017156835A1 PCT/CN2016/080735 CN2016080735W WO2017156835A1 WO 2017156835 A1 WO2017156835 A1 WO 2017156835A1 CN 2016080735 W CN2016080735 W CN 2016080735W WO 2017156835 A1 WO2017156835 A1 WO 2017156835A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
motion
glove
fitness
user
Prior art date
Application number
PCT/CN2016/080735
Other languages
French (fr)
Chinese (zh)
Inventor
伍楷舜
邹永攀
王丹
吴金咏
Original Assignee
深圳大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳大学 filed Critical 深圳大学
Publication of WO2017156835A1 publication Critical patent/WO2017156835A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A41WEARING APPAREL
    • A41DOUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
    • A41D19/00Gloves
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0075Means for generating exercise programs or schemes, e.g. computerized virtual trainer, e.g. using expert databases
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/83Special sensors, transducers or devices therefor characterised by the position of the sensor
    • A63B2220/833Sensors arranged on the exercise apparatus or sports implement
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/50Wireless data transmission, e.g. by radio transmitters or telemetry
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/75Measuring physiological parameters of the user calorie expenditure

Definitions

  • the invention relates to an intelligent detecting device, in particular to an intelligent method and system for fitness posture recognition, evaluation, early warning and strength estimation.
  • the human body In the daily fitness process, especially during strength training, the human body will consume a large amount of calories. In order to help the nutritional supplement and diet after training, do not accurately estimate the calorie consumption of the human body during training; at the same time, correct The posture is a necessary condition for any training program. This is because the correct posture helps to alleviate or even eliminate any potential training injuries and helps the trainer's health.
  • the present invention provides an intelligent method and system for fitness posture recognition, evaluation, early warning, and strength estimation, which solves the problem of cumbersome energy consumption of the human body during the exercise process and the problem of adding additional equipment. .
  • an intelligent method for fitness posture recognition, evaluation, early warning, and strength estimation including the following steps:
  • the processor module transmits the pre-processed pressure sensor and the IMU inertial unit data to the mobile terminal APP by means of the communication unit by wireless communication;
  • the algorithm for running the data processing is obtained. Fitness posture judgment, motion quality assessment, exercise intensity estimation results, and the results are displayed graphically in the APP; when it is determined that the fitness movement is not standard or the fitness intensity is excessive, the APP will alert the user;
  • the APP uploads the result of the data processing to the user's personal database of the cloud server, and the cloud server promotes the corresponding fitness service for the user based on the historical data of the user.
  • the user opens the smart glove worn on the wrist by a button or a switch, and the sensing module of the smart glove is provided with a plurality of pressure sensors.
  • the step (S2) further includes: (S21), collecting pressure data and motion posture data by a pressure sensor and an IMU inertia unit, and performing data of the obtained acceleration sensor, magnetic sensor, and gyroscope Sliding mean filtering to eliminate background noise; (S22), according to the motion characteristics of a complete fitness movement, combined with 9-axis IMU data to cut the fitness exercise, get the starting point and end point of each complete movement, thus the continuous fitness process According to each motion movement, the segmentation is performed; (S23), the segmented data is classified by the machine learning method to realize the gesture recognition function; (S24), after the posture determination is performed, the user's motion data and the standard motion are implemented.
  • the database is matched to evaluate the overall quality of the user's actions.
  • the stability and smoothness of the user action data are analyzed, and various evaluation indicators of the user's fitness action quality are obtained; (S25), after the posture determination is performed, for each action process Further segmentation, split into the forward and return, and two sub-processes
  • S25 after the posture determination is performed, for each action process Further segmentation, split into the forward and return, and two sub-processes
  • the acceleration sensor and the gyro uses an complementary filter to accurately estimate the attitude angle of the glove.
  • the complementary filter is used to combine the estimated value of the attitude angle of the acceleration sensor with the attitude of the glove and the attitude of the glove to the attitude angle of the glove; in step S27, a complementary filter is used.
  • the way to estimate the attitude angle of the glove during the movement according to the mechanical principle, eliminate the projection component of gravity in the direction of the wisdom glove, and extract the wisdom glove itself.
  • the acceleration value generated by the motion realizes the acceleration calibration; (S28), according to the kinesiology principle of the human body, the trajectory of the fitness movement is reconstructed in combination with the nine-axis IMU data, and the reading of the pressure sensor is combined with the processing of the step S3 to calculate the glove movement.
  • the work according to the relationship between the established work and calorie consumption model to calculate calorie consumption; (S29), record the calorie consumption, and remind the meal mix and nutritional balance.
  • the invention also provides an intelligent system for fitness posture recognition, assessment, early warning and strength estimation, including:
  • a signal acquisition and calculation module for collecting signals of the movement state of the smart glove and evaluating the motion state information for preliminary calculation
  • An abnormality detecting module configured to identify, by using an anomaly detection algorithm, whether the signal is abnormal
  • the action judging module is used for classifying the target action class and other action classes to distinguish the abnormal mode caused by the strength training threshold as the target action class, and determining whether the posture of the smart glove is deviated;
  • an alarm module for issuing an alert signal when it is determined that an attitude deviation occurs.
  • the signal acquisition and calculation module includes:
  • An inductive acquisition unit for turning on the entire system and collecting motion data, and the collected motion data includes motion data in the direction of strength training and motion data in all directions of three-dimensional coordinates;
  • a data processing unit configured to average the force and motion information in each direction, and use the average value as the motion state information
  • the smoothing unit performs ETL analysis on the data obtained by the data processing unit, and smoothes the motion state information by a moving average method.
  • the abnormality detecting module includes:
  • An abnormality calculating unit configured to perform data segmentation on the time series of the motion state information to obtain a subsequence, and calculate local abnormal data of the subsequence;
  • the abnormal output unit is configured to output the sub-sequence as an abnormal mode when the abnormal data is greater than or equal to a preset threshold.
  • the action judging module includes:
  • a model unit for establishing a high-dimensional feature model based on a statistical learning theory preset wherein the high-dimensional feature model uses an abnormal pattern in a set space due to changes in motion state information due to various human actions as a training sample;
  • the motion recognition unit is configured to map the abnormal pattern output by the abnormal output unit to a high-dimensional feature model of a type of support vector machine, and separate the target action class.
  • a feedback module is further included for feeding back response information for the hand posture warning signal, and adjusting a high-dimensional feature model of a type of support vector machine.
  • the invention has the beneficial effects that the invention performs calorie measurement and hand gesture recognition on the basis of the existing sensor technology, and adopts an effective data processing method and an algorithm model, and can be widely applied in strength training. Provide a good and useful reference for fitness enthusiasts, and provide a recommendation for post-meal mix and nutritional balance.
  • FIG. 1 is a schematic diagram of an intelligent method for transmitting and receiving data of fitness posture recognition, evaluation, early warning, and strength estimation according to the present invention.
  • An intelligent method for fitness posture recognition, assessment, early warning, and strength estimation includes the following steps:
  • the processor module transmits the pre-processed pressure sensor and the IMU inertial unit data to the mobile terminal APP by means of the communication unit by wireless communication;
  • the algorithm for running the data processing is obtained.
  • Fitness posture judgment, motion quality assessment, exercise intensity estimation results, and the results are displayed graphically in the APP; when determining that the fitness posture is not standard, the APP will alert the user; meanwhile, the APP will process the data.
  • the result is uploaded to the user's personal database of the cloud server, and the cloud server promotes the corresponding fitness service for the user based on the historical data of the user.
  • the user opens the smart glove worn on the wrist through a button or a switch, and the sensing module of the smart glove is provided with a plurality of pressure sensors.
  • the step (S2) further includes: (S21), collecting pressure data and motion posture data through the pressure sensor and the IMU inertia unit, and performing sliding average filtering on the obtained acceleration sensor, the magnetic sensor and the gyroscope data to eliminate the background Noise; (S22), according to the motion characteristics of a complete fitness movement, combined with the 9-axis IMU data to cut the fitness exercise, get the starting point of each complete movement And the end point, thereby dividing the continuous exercise process according to each exercise action; (S23), applying the machine learning method to the segmented data (ie, data corresponding to each action) (eg, SVM, KNN) ()) to perform classification and realize the function of gesture recognition; (S24), after the posture determination is performed, the user's motion data is matched with the standard action database (for example, the fitness coach's fitness data), and the overall quality of the user motion is evaluated.
  • the standard action database for example, the fitness coach's fitness data
  • the complementary filter is used to combine The speed sensor estimates the glove attitude angle and the gyroscope's estimated attitude angle of the glove; in step S27, the complementary filter is used to estimate the attitude angle of the glove during the movement, and the gravity is removed in the wisdom glove according to the mechanical principle.
  • the projection component in the direction of motion extracts the acceleration value generated by the movement of the smart glove itself to achieve acceleration calibration; (S28), according to the kinesiology of the human body, combined with the nine-axis IMU data to reconstruct the trajectory of the fitness movement, combined with the reading of the pressure sensor
  • the work done by the glove movement is calculated, and the calorie consumption is calculated according to the relationship model between the established work and the calorie consumption; (S29), the calorie consumption is recorded, and the meal matching and nutritional balance are reminded.
  • the invention also provides an intelligent system for fitness posture recognition, assessment, early warning and strength estimation, including:
  • a signal acquisition and calculation module for collecting signals of the movement state of the smart glove and evaluating the motion state information for preliminary calculation
  • An abnormality detecting module configured to identify, by using an anomaly detection algorithm, whether the signal is abnormal
  • the action judging module is used for classifying the target action class and other action classes to distinguish the abnormal mode caused by the strength training threshold as the target action class, and determining whether the posture of the smart glove is deviated;
  • an alarm module for issuing an alert signal when it is determined that an attitude deviation occurs.
  • the signal acquisition and calculation module includes:
  • An inductive acquisition unit for turning on the entire system and collecting motion data, and the collected motion data includes motion data in the direction of strength training and motion data in all directions of three-dimensional coordinates;
  • a data processing unit configured to average the force and motion information in each direction, and use the average value as the motion state information
  • the smoothing unit performs ETL analysis on the data obtained by the data processing unit, and smoothes the motion state information by a moving average method.
  • the abnormality detecting module includes:
  • An abnormality calculating unit configured to perform data segmentation on the time series of the motion state information to obtain a subsequence, and calculate local abnormal data of the subsequence;
  • the abnormal output unit is configured to output the sub-sequence as an abnormal mode when the abnormal data is greater than or equal to a preset threshold.
  • the action judging module includes:
  • a model unit for establishing a high-dimensional feature model based on a statistical learning theory preset wherein the high-dimensional feature model uses an abnormal pattern in a set space due to changes in motion state information due to various human actions as a training sample;
  • the motion recognition unit is configured to map the abnormal pattern output by the abnormal output unit to a high-dimensional feature model of a type of support vector machine, and separate the target action class.
  • a feedback module is further included for feeding back response information for the hand posture warning signal, and adjusting a high-dimensional feature model of a type of support vector machine.
  • the smart glove is a smart glove for recognizing calories and hand gestures, including: a processor module, a storage module, a communication module, a sensing module, an early warning prompt module, a display module, a power module, and a switch module.
  • the cloud server the storage module, the communication module, the sensing module, the warning prompt module, the display module, the power module, the switch module, and the cloud server are respectively connected to the processor module, wherein the sensing module includes a pressure sensor and an IMU inertia
  • the sensing module includes a pressure sensor and an IMU inertia
  • the unit, the pressure sensor and the IMU inertia unit are respectively responsible for sensing the amount of pressure of the hand and the IMU data during the fitness process of the user, and collecting the source data for the user strength training, and transmitting the source data to the processor module.
  • the processor module is responsible for preprocessing the source data; the storage module is responsible for storing the result of the processor preprocessing and the processing result returned from the cloud server; the communication module is responsible for the source data, the preprocessed Data is passed to the cloud server for further data processing and analysis by the cloud server And is responsible for transmitting the result of the cloud server processing to the smart glove; the warning prompting module is responsible for issuing a warning to the user when the user action is not standard, the exercise is excessive, or the force is not in any situation; the display module is responsible for Will use The results of the type of action, calories burned, and posture standard during the fitness process are displayed.
  • One or more pressure sensors are disposed on the sensing module of the glove, the pressure sensor is disposed at the hand grasping force, and the IMU inertia unit is disposed at the wrist for convenient use by the customer;
  • the storage module includes a built-in large capacity
  • the memory and the external memory interface facilitate the storage and invocation of the user's motion data;
  • the source data is respectively used to sense the amount of pressure of the hand and the data collected by the IMU data during the fitness process of the user through the pressure sensor and the IMU inertia unit.
  • an intelligent method of fitness posture recognition, assessment, early warning, and intensity estimation includes the following steps:
  • the pressure sensor's membrane pressure sensor and the IMU inertia unit are used to collect source data during strength training; the source data is transmitted to the processor module for processing;
  • step S4 Performing an ETL process by performing the ETL process on the data obtained by the received pressure sensor and the IMU inertia unit, which is a process of extracting, transposing, loading, and delivering the data obtained by the step S2 by the ETL technology;
  • the process refers to the Extract, Transform and Load of the data, that is, the process of extracting, transposing, loading and delivering the data, which refers to the important steps of preprocessing the data before the data processing; in step S4, according to the set calculation model, the human body
  • the mechanical work outputted during the movement can be linked to the calories burned by the human body in the process by a conversion factor, combined with the readings of the load cell and the reconstructed motion trajectory to calculate the work, thereby calculating the calories burned and
  • a type of support vector machine that distinguishes the target action class from other action classes; takes the strength training as the target action class, and determines whether the threshold of the strength training is exceeded, and if so, sends a reminder signal;
  • the processor module receives the pressure sensor and the IMU inertia unit to measure the required motion data, and establishes the relationship between the motion signal and the strength training action, and only needs to use a simple sensor to pass the calorie of the detected person.
  • Consumption and recognition of hand posture judging that the subject is No deviation of the hand posture occurs and an alarm is issued, which reduces the dependence on the cumbersome measuring device, and greatly improves the correct rate of hand posture recognition; in a specific movement, the calorie consumption can be displayed through the mobile device terminal Recommended with meals.
  • the user preferably opens the entire system by means of a button or switch, which may be a button and a switch implemented by a touch sensor, which may be provided at the IMU inertial unit accessory for user operation.
  • a button or switch which may be a button and a switch implemented by a touch sensor, which may be provided at the IMU inertial unit accessory for user operation.
  • the abnormality detection algorithm is used to identify the abnormality of the acquired motion information is a time series anomaly detection algorithm based on the local anomaly factor, and includes the following steps:
  • the pressure data and the motion attitude data are collected by the pressure sensor and the IMU inertia unit, and the obtained acceleration sensor, the magnetic sensor and the gyroscope data are subjected to sliding mean filtering to eliminate background noise based on the wearable computing technology, and the sliding mean filter is eliminated.
  • the sliding window width is 7;
  • An accurate estimation of the glove attitude is achieved by using a complementary filter for reading the acceleration sensor and the gyroscope, the complementary filter being used to combine the estimated value of the attitude angle of the acceleration sensor with the attitude of the glove and the estimated attitude of the gyroscope to the attitude of the glove;
  • the projection component of the gravity in the direction of the wisdom glove is removed according to the mechanical principle, and the acceleration value generated by the movement of the wisdom glove is extracted to realize the acceleration calibration.
  • Obtain the calibrated acceleration data obtain the speed value of the wisdom glove movement by one-time integration; after the integral gets the speed value of the wisdom glove movement, according to the movement characteristics of the wisdom glove starting from the static state and ending at the static state, the wisdom The speed of the glove movement is calibrated;
  • the resulting velocity value is integrated once to obtain the displacement of the wisdom glove movement.
  • the analysis and processing of the data is realized by the complementary filter, and the attitude of the object in space can be combined by the acceleration and the angular velocity to achieve accurate estimation. Therefore, the estimated value of the glove attitude angle measured by the complementary filter combined with the acceleration sensor is The estimated value of the glove attitude angle measured by the gyroscope, which in turn gives an accurate estimate of the glove posture.
  • the acceleration value generated by the movement of the smart glove itself is extracted, that is, the acceleration component of the wisdom glove in three directions of the three-dimensional coordinates is filtered out, which can be realized by complementary filtering or Kalman filtering. In order to reduce the speed drift after the integration, the integral is only for the acceleration value corresponding to the movement of the glove.
  • the exponential mean is used as the judgment whether the glove acceleration value corresponds to the stationary state or the motion state of the glove;
  • the exponential mean is greater than the threshold, The acceleration in the window is determined to correspond to the motion state of the glove; otherwise, it is determined to correspond to the stationary state of the glove; when the judgment process is completed, the integral is only applied to the acceleration value corresponding to the glove motion state, thereby obtaining
  • Corresponding speed values which correspond to the acceleration values of the glove in a static state, are regarded as zero values; the threshold values are comprehensively determined in the data processing process in combination with sensors, algorithms, and user requirements. In different cases, the threshold values are It will be different.
  • the index state average (EMA) described in step S24 is used to determine the motion state of the glove. When it is determined to be stationary, the corresponding speed value is forcibly set to zero.
  • This example also includes a high-dimensional feature model for the adjustment of a type of support vector machine for calorie consumption and hand gesture recognition.
  • the high-dimensional feature model is pre-established based on the statistical learning theory, and the high-dimensional feature model is used as a training sample by setting an abnormal pattern of information changes due to various posture deviation actions in the space;
  • the abnormal pattern is mapped to a high-dimensional feature model of a type of support vector machine, and the target action class is separated, and whether the motion posture is deviated is determined, and if so, a warning signal is issued.
  • the relationship model is that the mechanical work outputted by the human body during the movement is linked to the calories consumed by the human body in the process by the conversion factor, and the work is calculated by combining the readings of the load cell and the reconstructed motion trajectory, thereby calculating The calories burned out then distinguish the target action class from the other action classes.
  • the model is constructed based on the relationship between work and calories in the glove posture, so that the calculation and analysis can be performed.
  • the work state can be expressed by the motion state, which shows the start time of the motion, the end time of the motion, and the instantaneous speed of the motion; Not all internal energy can be used for work, and part of the internal energy can be lost due to heat consumption and blood flow.
  • the internal energy of the human body can be successfully converted according to a certain ratio.
  • the model relationship between work and calorie consumption is constructed. Mechanical work is measured in wearable computing, usually by measuring the motion trajectory to calculate the work done by the human body. Further, measuring motion trajectories is accomplished using some common sensors such as acceleration sensors and gravity sensors.
  • the data obtained in this example is generated over time, that is, the time series model.
  • the subsequence refers to intercepting a piece of data acquired by the sensing module and passing through the ETL process.
  • the length and data amount of the subsequence according to the processing capability of the system, Defining settings; the local anomaly data refers to data calculated by a support vector machine method in a subsequence, and part of the data is significantly deviated from other data of the subsequence;
  • the preset threshold is a preset threshold In the data processing process, combined with sensors, algorithms and user requirements for comprehensive determination, in different cases, this threshold will be different.
  • This example also preferably includes a high-dimensional feature model for adjusting and improving a class of support vector machines, and provides system feedback that can optimize detection and decision algorithms. If the alert is not turned off in time, the system will send help information to others through other devices associated with the signal, such as sending instant messages or text messages through third-party applications.

Abstract

A smart method for body building posture identification, assessment, warning and intensity estimation. The method comprises: (S1) using a thin-film pressure sensor of a pressure sensor and an IMU inertial unit on a smart glove to collect original data during strength training; (S2) transmitting the original data to a processor module for performing data pre-processing; and (S3) the processor module transmitting the pre-processed data of the pressure sensor and the IMU inertial unit to a mobile terminal APP by means of wireless communication. Further provided is a smart system for body building posture identification, assessment, warning and intensity estimation.

Description

健身姿势识别、评估、预警和强度估算的智能方法及系统Intelligent method and system for fitness posture recognition, assessment, early warning and strength estimation 技术领域Technical field
本发明涉及智能检测装置,尤其涉及一种健身姿势识别、评估、预警和强度估算的智能方法及系统。The invention relates to an intelligent detecting device, in particular to an intelligent method and system for fitness posture recognition, evaluation, early warning and strength estimation.
背景技术Background technique
如今,随着健康生活的理念越来越深入人心,越来越多的健身爱好者希望能够测量出参加力量训练时候的卡路里的消耗及之后的饮食调节,然而,传统的获取运动过程中人体的能量消耗不仅程序繁琐,且还需要额外的设备,因此我们急切需要找到一种能够方便并有效的检测力量训练时的卡路里的消耗和动作识别的方法。Nowadays, with the concept of healthy living becoming more and more popular, more and more fitness enthusiasts hope to measure the calorie consumption and subsequent dietary adjustment during strength training. However, the traditional acquisition of the human body during exercise Energy consumption is not only cumbersome, but also requires additional equipment, so we urgently need to find a way to easily and effectively detect calorie consumption and motion recognition during strength training.
日常健身过程中,尤其是力量训练时,人体将消耗大量的卡路里,为了有助于训练后的营养补充和膳食搭配,又不要较准确地估算出人体在训练过程中的卡路里消耗;同时,正确的姿势是任何训练项目的必要条件。这是因为正确的姿势有助于减轻甚至消除任何潜在的训练伤病,有助于训练者的身体健康。In the daily fitness process, especially during strength training, the human body will consume a large amount of calories. In order to help the nutritional supplement and diet after training, do not accurately estimate the calorie consumption of the human body during training; at the same time, correct The posture is a necessary condition for any training program. This is because the correct posture helps to alleviate or even eliminate any potential training injuries and helps the trainer's health.
为了实现对健身时动作的准备检测和卡路里的消耗,人们提出了利用跑步机,自行车,跑鞋来检测卡路里的消耗的方法,然而采用这些方法搭建的检测系统本身都存在着种种不足,这些系统都采取了特定运动的计算模块来检测卡路里的消耗,在利用这些特定的计算模块进行卡路里的计算的时候,测量模块并不是可移动的,不能够真正地做到可穿戴,在目前的研究和工业生产中,并没有一种设备能够实现上述的功能,后者现有的方法由于模块的特殊性并不能够广泛地应用到这个场景。In order to achieve the preparation for the exercise and the calorie consumption, people have proposed the use of treadmills, bicycles, running shoes to detect the calorie consumption. However, the detection system built by these methods has its own shortcomings. A specific motion calculation module is used to detect calorie consumption. When using these specific calculation modules for calorie calculations, the measurement module is not mobile and cannot be truly wearable, in current research and industry. In production, there is no device that can achieve the above functions. The existing method of the latter cannot be widely applied to this scenario due to the particularity of the module.
发明内容Summary of the invention
为了解决现有技术的问题,本发明提供一种健身姿势识别、评估、预警和强度估算的智能方法及系统,解决现有技术中获取运动过程中人体的能量消耗程序繁琐以及增加额外设备的问题。In order to solve the problems of the prior art, the present invention provides an intelligent method and system for fitness posture recognition, evaluation, early warning, and strength estimation, which solves the problem of cumbersome energy consumption of the human body during the exercise process and the problem of adding additional equipment. .
本发明是通过以下技术方案实现的:一种健身姿势识别、评估、预警和强度估算的智能方法,包括如下步骤: The present invention is achieved by the following technical solutions: an intelligent method for fitness posture recognition, evaluation, early warning, and strength estimation, including the following steps:
(S1)利用智能手套上的压力传感器的薄膜压力传感器和IMU惯性单元来采集力量训练时的原始数据;(S1) using the membrane pressure sensor of the pressure sensor on the smart glove and the IMU inertia unit to collect raw data during strength training;
(S2)将原始数据传输到处理器模块进行数据预处理;(S2) transmitting the original data to the processor module for data preprocessing;
(S3)处理器模块将预处理得到的压力传感器和IMU惯性单元数据通过通信单元以无线通信的方式传输给移动终端APP;(S4)移动终端APP接收到数据之后,运行数据处理的算法,得到健身姿势判定、动作质量评估、运动强度估算的结果,并将结果在APP中以图形化的方式显示出来;当判定健身动作不标准或者健身强度过量时,APP将会对用户进行预警提示;同时,APP将数据处理的结果上传至云端服务器的用户个人数据库中,云端服务器基于用户的历史数据,为用户推介相应的健身服务。(S3) the processor module transmits the pre-processed pressure sensor and the IMU inertial unit data to the mobile terminal APP by means of the communication unit by wireless communication; (S4) after the mobile terminal APP receives the data, the algorithm for running the data processing is obtained. Fitness posture judgment, motion quality assessment, exercise intensity estimation results, and the results are displayed graphically in the APP; when it is determined that the fitness movement is not standard or the fitness intensity is excessive, the APP will alert the user; The APP uploads the result of the data processing to the user's personal database of the cloud server, and the cloud server promotes the corresponding fitness service for the user based on the historical data of the user.
作为本发明的进一步改进:所述步骤(S1)中,用户通过按钮或开关将戴在手腕上的智能手套打开,所述智慧手套的感知模块上设置有数个的压力传感器。As a further improvement of the present invention, in the step (S1), the user opens the smart glove worn on the wrist by a button or a switch, and the sensing module of the smart glove is provided with a plurality of pressure sensors.
作为本发明的进一步改进:所述步骤(S2)中进一步包括:(S21),通过压力传感器和IMU惯性单元采集压力数据和运动姿态数据,将获得的加速度传感器、磁传感器和陀螺仪的数据进行滑动均值滤波,以消除背景噪声;(S22),根据一个完整健身动作的运动特征,结合9轴IMU数据对健身运动进行切割,得到每一个完整动作的起点和终点,从而将连续的健身运动过程按照每一个运动动作进行切分;(S23),对切分后的数据运用机器学习的方法进行分类,实现姿势识别的功能;(S24),实现姿势判定后,将用户的动作数据与标准动作的数据库进行匹配,评估用户动作的整体质量,同时,对用户动作数据进行稳定性、平滑性分析,得到用户健身动作质量的各个评估指标;(S25),实现姿势判定后,对每一个动作过程中进行进一步切分,使其分成去程与回程,并对两个分过程进行时域和幅度域上的分析,当时域和幅度域上的指标超过设定的阈值时,动作被判定为不标准,并给予用户相应的不标准提示;(S26),对加速度传感器和陀螺仪的读数采用互补滤波器的方式实现手套姿态角的准确估计,该互补滤波器用于结合加速度传感器对于手套姿态角的估计值和陀螺仪对于手套姿态角的估计值;步骤S27,采用互补滤波器的方式估计出手套在运动过程中的姿态角后,根据力学原理消除掉重力在智慧手套运动方向上的投射分量,提取出由于智慧手套自身 运动所产生的加速度值,实现加速度校准;(S28),根据人体运动学原理结合九轴IMU数据重构健身运动的轨迹,结合压力传感器的读数,经过步骤S3的处理,计算出手套运动所做的功,按照建立的功与卡路里消耗的关系模型计算卡路里消耗;(S29),记录卡路里的消耗,并进行膳食搭配和营养均衡的提醒。As a further improvement of the present invention, the step (S2) further includes: (S21), collecting pressure data and motion posture data by a pressure sensor and an IMU inertia unit, and performing data of the obtained acceleration sensor, magnetic sensor, and gyroscope Sliding mean filtering to eliminate background noise; (S22), according to the motion characteristics of a complete fitness movement, combined with 9-axis IMU data to cut the fitness exercise, get the starting point and end point of each complete movement, thus the continuous fitness process According to each motion movement, the segmentation is performed; (S23), the segmented data is classified by the machine learning method to realize the gesture recognition function; (S24), after the posture determination is performed, the user's motion data and the standard motion are implemented. The database is matched to evaluate the overall quality of the user's actions. At the same time, the stability and smoothness of the user action data are analyzed, and various evaluation indicators of the user's fitness action quality are obtained; (S25), after the posture determination is performed, for each action process Further segmentation, split into the forward and return, and two sub-processes In the analysis of the time domain and the amplitude domain, when the indicators on the time domain and the amplitude domain exceed the set threshold, the action is judged as non-standard, and the user is given a corresponding non-standard prompt; (S26), the acceleration sensor and the gyro The reading of the instrument uses an complementary filter to accurately estimate the attitude angle of the glove. The complementary filter is used to combine the estimated value of the attitude angle of the acceleration sensor with the attitude of the glove and the attitude of the glove to the attitude angle of the glove; in step S27, a complementary filter is used. The way to estimate the attitude angle of the glove during the movement, according to the mechanical principle, eliminate the projection component of gravity in the direction of the wisdom glove, and extract the wisdom glove itself. The acceleration value generated by the motion realizes the acceleration calibration; (S28), according to the kinesiology principle of the human body, the trajectory of the fitness movement is reconstructed in combination with the nine-axis IMU data, and the reading of the pressure sensor is combined with the processing of the step S3 to calculate the glove movement. The work, according to the relationship between the established work and calorie consumption model to calculate calorie consumption; (S29), record the calorie consumption, and remind the meal mix and nutritional balance.
本发明同时提供了一种健身姿势识别、评估、预警和强度估算的智能系统,包括:The invention also provides an intelligent system for fitness posture recognition, assessment, early warning and strength estimation, including:
信号获取与计算模块,用于收集智能手套运动状态时的信号,并评估运动状态信息加以初步计算;a signal acquisition and calculation module for collecting signals of the movement state of the smart glove and evaluating the motion state information for preliminary calculation;
异常检测模块,用于通过异常检测算法识别信号是否变化的异常;An abnormality detecting module, configured to identify, by using an anomaly detection algorithm, whether the signal is abnormal;
动作判断模块,用于将目标动作类和其他动作类进行区分的一类支持向量机,以超出力量训练阈值所导致的异常模式作为目标动作类,并判断智慧手套的运动姿势是否发生姿势偏离;The action judging module is used for classifying the target action class and other action classes to distinguish the abnormal mode caused by the strength training threshold as the target action class, and determining whether the posture of the smart glove is deviated;
以及警报模块,用于当判断发生姿态偏离时发出警示信号。And an alarm module for issuing an alert signal when it is determined that an attitude deviation occurs.
作为本发明的进一步改进:所述信号获取与计算模块包括:As a further improvement of the present invention, the signal acquisition and calculation module includes:
感应采集单元,用于开启整个系统并收集运动数据,收集的运动数据包括力量训练方向上的力和三维坐标各个方向上的运动数据;An inductive acquisition unit for turning on the entire system and collecting motion data, and the collected motion data includes motion data in the direction of strength training and motion data in all directions of three-dimensional coordinates;
数据处理单元,用于对每一个方向上的力和运动信息求得平均值,将此平均值作为运动状态信息;a data processing unit, configured to average the force and motion information in each direction, and use the average value as the motion state information;
平滑单元,针对数据处理单元所得到的数据进行ETL分析,并通过滑动平均方法对运动状态信息进行平滑处理。The smoothing unit performs ETL analysis on the data obtained by the data processing unit, and smoothes the motion state information by a moving average method.
作为本发明的进一步改进:所述异常检测模块包括:As a further improvement of the present invention, the abnormality detecting module includes:
异常计算单元,用于对运动状态信息的时间序列实施数据分割得到子序列,计算子序列的局部异常数据;An abnormality calculating unit, configured to perform data segmentation on the time series of the motion state information to obtain a subsequence, and calculate local abnormal data of the subsequence;
异常输出单元,用于当所述的异常数据大于或等于预设阈值时,将子序列作为异常模式输出。The abnormal output unit is configured to output the sub-sequence as an abnormal mode when the abnormal data is greater than or equal to a preset threshold.
作为本发明的进一步改进:所述动作判断模块包括:As a further improvement of the present invention, the action judging module includes:
建立模型单元,用于基于统计学习理论预设建立高维特征模型,所述高维特征模型以设定空间内由于各项人体动作导致运动状态信息变化的异常模式作为训练样本; Establishing a model unit for establishing a high-dimensional feature model based on a statistical learning theory preset, wherein the high-dimensional feature model uses an abnormal pattern in a set space due to changes in motion state information due to various human actions as a training sample;
动作识别单元,用于将异常输出单元所输出的异常模式映射至一类支持向量机的高维特征模型中,分离出目标动作类。The motion recognition unit is configured to map the abnormal pattern output by the abnormal output unit to a high-dimensional feature model of a type of support vector machine, and separate the target action class.
作为本发明的进一步改进:还包括反馈模块,用于反馈针对手部姿势警报信号的响应信息,调整一类支持向量机的高维特征模型。As a further improvement of the present invention, a feedback module is further included for feeding back response information for the hand posture warning signal, and adjusting a high-dimensional feature model of a type of support vector machine.
本发明的有益效果是:本发明在现有的传感器技术的基础上,进行卡路里的测量和手部姿势识别的工作,采用有效的的数据处理方法和算法模型,可广泛地应用力量训练中,为健身爱好者提供良好有益的的参考,并能够提供后期膳食搭配和营养均衡推荐。The invention has the beneficial effects that the invention performs calorie measurement and hand gesture recognition on the basis of the existing sensor technology, and adopts an effective data processing method and an algorithm model, and can be widely applied in strength training. Provide a good and useful reference for fitness enthusiasts, and provide a recommendation for post-meal mix and nutritional balance.
附图说明DRAWINGS
图1为本发明健身姿势识别、评估、预警和强度估算的智能方法发送和接收数据的示意图。1 is a schematic diagram of an intelligent method for transmitting and receiving data of fitness posture recognition, evaluation, early warning, and strength estimation according to the present invention.
具体实施方式detailed description
下面结合附图和实施例对本发明作进一步的描述。The invention will now be further described with reference to the drawings and embodiments.
一种健身姿势识别、评估、预警和强度估算的智能方法,包括如下步骤:An intelligent method for fitness posture recognition, assessment, early warning, and strength estimation includes the following steps:
(S1)利用智能手套上的压力传感器的薄膜压力传感器和IMU惯性单元来采集力量训练时的原始数据;(S1) using the membrane pressure sensor of the pressure sensor on the smart glove and the IMU inertia unit to collect raw data during strength training;
(S2)将原始数据传输到处理器模块进行数据预处理;(S2) transmitting the original data to the processor module for data preprocessing;
(S3)处理器模块将预处理得到的压力传感器和IMU惯性单元数据通过通信单元以无线通信的方式传输给移动终端APP;(S4)移动终端APP接收到数据之后,运行数据处理的算法,得到健身姿势判定、动作质量评估、运动强度估算的结果,并将结果在APP中以图形化的方式显示出来;当判定健身姿势不标准时,APP将会对用户进行预警提示;同时,APP将数据处理的结果上传至云端服务器的用户个人数据库中,云端服务器基于用户的历史数据,为用户推介相应的健身服务。(S3) the processor module transmits the pre-processed pressure sensor and the IMU inertial unit data to the mobile terminal APP by means of the communication unit by wireless communication; (S4) after the mobile terminal APP receives the data, the algorithm for running the data processing is obtained. Fitness posture judgment, motion quality assessment, exercise intensity estimation results, and the results are displayed graphically in the APP; when determining that the fitness posture is not standard, the APP will alert the user; meanwhile, the APP will process the data. The result is uploaded to the user's personal database of the cloud server, and the cloud server promotes the corresponding fitness service for the user based on the historical data of the user.
所述步骤(S1)中,用户通过按钮或开关将戴在手腕上的智能手套打开,所述智慧手套的感知模块上设置有数个的压力传感器。In the step (S1), the user opens the smart glove worn on the wrist through a button or a switch, and the sensing module of the smart glove is provided with a plurality of pressure sensors.
所述步骤(S2)中进一步包括:(S21),通过压力传感器和IMU惯性单元采集压力数据和运动姿态数据,将获得的加速度传感器、磁传感器和陀螺仪的数据进行滑动均值滤波,以消除背景噪声;(S22),根据一个完整健身动作的运动特征,结合9轴IMU数据对健身运动进行切割,得到每一个完整动作的起点 和终点,从而将连续的健身运动过程按照每一个运动动作进行切分;(S23),对切分后的数据(即对应于每一个动作的数据)运用机器学习的方法(比如:SVM,KNN等)进行分类,实现姿势识别的功能;(S24),实现姿势判定后,将用户的动作数据与标准动作的数据库(比如:健身教练的健身数据)进行匹配,评估用户动作的整体质量,同时,对用户动作数据进行稳定性、平滑性分析,得到用户健身动作质量的各个评估指标;(S25),实现姿势判定后,对每一个动作过程中进行进一步切分,使其分成去程与回程,并对两个分过程进行时域和幅度域上的分析,当时域和幅度域上的指标超过设定的阈值时,动作被判定为不标准,并给予用户相应的不标准提示;(S26),对加速度传感器和陀螺仪的读数采用互补滤波器的方式实现手套姿态角的准确估计,该互补滤波器用于结合加速度传感器对于手套姿态角的估计值和陀螺仪对于手套姿态角的估计值;步骤S27,采用互补滤波器的方式估计出手套在运动过程中的姿态角后,根据力学原理消除掉重力在智慧手套运动方向上的投射分量,提取出由于智慧手套自身运动所产生的加速度值,实现加速度校准;(S28),根据人体运动学原理结合九轴IMU数据重构健身运动的轨迹,结合压力传感器的读数,经过步骤S3的处理,计算出手套运动所做的功,按照建立的功与卡路里消耗的关系模型计算卡路里消耗;(S29),记录卡路里的消耗,并进行膳食搭配和营养均衡的提醒。The step (S2) further includes: (S21), collecting pressure data and motion posture data through the pressure sensor and the IMU inertia unit, and performing sliding average filtering on the obtained acceleration sensor, the magnetic sensor and the gyroscope data to eliminate the background Noise; (S22), according to the motion characteristics of a complete fitness movement, combined with the 9-axis IMU data to cut the fitness exercise, get the starting point of each complete movement And the end point, thereby dividing the continuous exercise process according to each exercise action; (S23), applying the machine learning method to the segmented data (ie, data corresponding to each action) (eg, SVM, KNN) ()) to perform classification and realize the function of gesture recognition; (S24), after the posture determination is performed, the user's motion data is matched with the standard action database (for example, the fitness coach's fitness data), and the overall quality of the user motion is evaluated. Perform stability and smoothness analysis on the user action data, and obtain various evaluation indicators of the user's fitness action quality; (S25), after the posture determination is implemented, further segmentation is performed for each action process to be divided into a forward process and a return process. And the two sub-processes are analyzed in the time domain and the amplitude domain. When the indicators in the domain and the amplitude domain exceed the set threshold, the action is judged as non-standard, and the user is given a corresponding non-standard prompt; (S26 ), the accelerometer and the gyroscope are read by a complementary filter to achieve an accurate estimation of the glove attitude angle. The complementary filter is used to combine The speed sensor estimates the glove attitude angle and the gyroscope's estimated attitude angle of the glove; in step S27, the complementary filter is used to estimate the attitude angle of the glove during the movement, and the gravity is removed in the wisdom glove according to the mechanical principle. The projection component in the direction of motion extracts the acceleration value generated by the movement of the smart glove itself to achieve acceleration calibration; (S28), according to the kinesiology of the human body, combined with the nine-axis IMU data to reconstruct the trajectory of the fitness movement, combined with the reading of the pressure sensor After the processing of step S3, the work done by the glove movement is calculated, and the calorie consumption is calculated according to the relationship model between the established work and the calorie consumption; (S29), the calorie consumption is recorded, and the meal matching and nutritional balance are reminded.
本发明同时提供了一种健身姿势识别、评估、预警和强度估算的智能系统,包括:The invention also provides an intelligent system for fitness posture recognition, assessment, early warning and strength estimation, including:
信号获取与计算模块,用于收集智能手套运动状态时的信号,并评估运动状态信息加以初步计算;a signal acquisition and calculation module for collecting signals of the movement state of the smart glove and evaluating the motion state information for preliminary calculation;
异常检测模块,用于通过异常检测算法识别信号是否变化的异常;An abnormality detecting module, configured to identify, by using an anomaly detection algorithm, whether the signal is abnormal;
动作判断模块,用于将目标动作类和其他动作类进行区分的一类支持向量机,以超出力量训练阈值所导致的异常模式作为目标动作类,并判断智慧手套的运动姿势是否发生姿势偏离;The action judging module is used for classifying the target action class and other action classes to distinguish the abnormal mode caused by the strength training threshold as the target action class, and determining whether the posture of the smart glove is deviated;
以及警报模块,用于当判断发生姿态偏离时发出警示信号。And an alarm module for issuing an alert signal when it is determined that an attitude deviation occurs.
所述信号获取与计算模块包括:The signal acquisition and calculation module includes:
感应采集单元,用于开启整个系统并收集运动数据,收集的运动数据包括力量训练方向上的力和三维坐标各个方向上的运动数据; An inductive acquisition unit for turning on the entire system and collecting motion data, and the collected motion data includes motion data in the direction of strength training and motion data in all directions of three-dimensional coordinates;
数据处理单元,用于对每一个方向上的力和运动信息求得平均值,将此平均值作为运动状态信息;a data processing unit, configured to average the force and motion information in each direction, and use the average value as the motion state information;
平滑单元,针对数据处理单元所得到的数据进行ETL分析,并通过滑动平均方法对运动状态信息进行平滑处理。The smoothing unit performs ETL analysis on the data obtained by the data processing unit, and smoothes the motion state information by a moving average method.
所述异常检测模块包括:The abnormality detecting module includes:
异常计算单元,用于对运动状态信息的时间序列实施数据分割得到子序列,计算子序列的局部异常数据;An abnormality calculating unit, configured to perform data segmentation on the time series of the motion state information to obtain a subsequence, and calculate local abnormal data of the subsequence;
异常输出单元,用于当所述的异常数据大于或等于预设阈值时,将子序列作为异常模式输出。The abnormal output unit is configured to output the sub-sequence as an abnormal mode when the abnormal data is greater than or equal to a preset threshold.
所述动作判断模块包括:The action judging module includes:
建立模型单元,用于基于统计学习理论预设建立高维特征模型,所述高维特征模型以设定空间内由于各项人体动作导致运动状态信息变化的异常模式作为训练样本;Establishing a model unit for establishing a high-dimensional feature model based on a statistical learning theory preset, wherein the high-dimensional feature model uses an abnormal pattern in a set space due to changes in motion state information due to various human actions as a training sample;
动作识别单元,用于将异常输出单元所输出的异常模式映射至一类支持向量机的高维特征模型中,分离出目标动作类。The motion recognition unit is configured to map the abnormal pattern output by the abnormal output unit to a high-dimensional feature model of a type of support vector machine, and separate the target action class.
还包括反馈模块,用于反馈针对手部姿势警报信号的响应信息,调整一类支持向量机的高维特征模型。A feedback module is further included for feeding back response information for the hand posture warning signal, and adjusting a high-dimensional feature model of a type of support vector machine.
在一实施例中,该智能手套为一种卡路里消耗和手部姿势识别的智慧手套,包括:处理器模块、存储模块、通信模块、感知模块、预警提示模块、显示模块、电源模块、开关模块和云服务器,所述存储模块、通信模块、感知模块、预警提示模块、显示模块、电源模块、开关模块和云服务器分别与处理器模块相连接,其中,所述感知模块包括压力传感器和IMU惯性单元,所述压力传感器和IMU惯性单元分别用于负责感应用户健身过程中的手部受压力量大小和IMU数据,进而针对用户力量训练收集源数据,并将所述源数据传送给处理器模块;所述处理器模块负责对源始数据的预处理;所述存储模块负责存储处理器预处理的结果以及从云服务器传回的处理结果;所述通信模块负责将源数据、预处理后的数据传至云服务器,供云服务器作进一步的数据处理和分析,并负责将云服务器处理的结果传回至智慧手套;所述预警提示模块则负责当用户动作不标准、运动超量或者受力不当中任意一种情况时给用户发出警示;所述显示模块负责将用 户健身过程中的动作类型、消耗卡路里和姿势标准度的结果显示出来。In an embodiment, the smart glove is a smart glove for recognizing calories and hand gestures, including: a processor module, a storage module, a communication module, a sensing module, an early warning prompt module, a display module, a power module, and a switch module. And the cloud server, the storage module, the communication module, the sensing module, the warning prompt module, the display module, the power module, the switch module, and the cloud server are respectively connected to the processor module, wherein the sensing module includes a pressure sensor and an IMU inertia The unit, the pressure sensor and the IMU inertia unit are respectively responsible for sensing the amount of pressure of the hand and the IMU data during the fitness process of the user, and collecting the source data for the user strength training, and transmitting the source data to the processor module. The processor module is responsible for preprocessing the source data; the storage module is responsible for storing the result of the processor preprocessing and the processing result returned from the cloud server; the communication module is responsible for the source data, the preprocessed Data is passed to the cloud server for further data processing and analysis by the cloud server And is responsible for transmitting the result of the cloud server processing to the smart glove; the warning prompting module is responsible for issuing a warning to the user when the user action is not standard, the exercise is excessive, or the force is not in any situation; the display module is responsible for Will use The results of the type of action, calories burned, and posture standard during the fitness process are displayed.
手套的感知模块上设置有一个或两个以上的压力传感器,所述压力传感器设置在手掌握力处,所述IMU惯性单元设置在手腕处,便于客户使用方便;所述存储模块包括内置大容量存储器和外置的存储器接口,便于用户运动数据的存储和调用;所述源数据为通过压力传感器和IMU惯性单元分别感应用户健身过程中的手部受压力量大小和IMU数据所对应的采集数据。One or more pressure sensors are disposed on the sensing module of the glove, the pressure sensor is disposed at the hand grasping force, and the IMU inertia unit is disposed at the wrist for convenient use by the customer; the storage module includes a built-in large capacity The memory and the external memory interface facilitate the storage and invocation of the user's motion data; the source data is respectively used to sense the amount of pressure of the hand and the data collected by the IMU data during the fitness process of the user through the pressure sensor and the IMU inertia unit. .
在一种实施例中,一种健身姿势识别、评估、预警和强度估算的智能方法,包括以下步骤:In one embodiment, an intelligent method of fitness posture recognition, assessment, early warning, and intensity estimation includes the following steps:
利用压力传感器的薄膜压力传感器和IMU惯性单元来搜集力量训练时的源数据;将源数据传输到处理器模块进行处理;The pressure sensor's membrane pressure sensor and the IMU inertia unit are used to collect source data during strength training; the source data is transmitted to the processor module for processing;
将接收到的压力传感器和IMU惯性单元所获取的数据进行ETL过程,进行ETL分析,所述ETL过程为通过ETL技术对步骤S2所得到的数据进行抽取、转置、加载和交付的过程;TL过程指数据的Extract、Transform和Load,即对数据进行抽取、转置、加载和交付的过程,是指数据处理之前对数据进行预处理的重要步骤;步骤S4中,根据设置的计算模型,人体在运动过程中对外输出的机械功可以通过一个转化因子与人体在这一过程中消耗的卡路里联系起来,结合测力传感器的读数和重构所得运动轨迹来计算功,从而计算出消耗的卡路里和将目标动作类和其他动作类进行区分的一类支持向量机;将超出力量训练作为目标动作类,并判断是否超出力量训练的阈值,若是,则发出提醒信号;本步骤S4将数据传输到可移动设备,进行记录,推荐膳食食谱、营养搭配及训练计划,;所述阀值可以根据用户的需求进行自定义设置,如在使用杠铃时,由预先设置的力的大小,称之为阈值,如果超过这个预先设置的大小,则发出信号;Performing an ETL process by performing the ETL process on the data obtained by the received pressure sensor and the IMU inertia unit, which is a process of extracting, transposing, loading, and delivering the data obtained by the step S2 by the ETL technology; The process refers to the Extract, Transform and Load of the data, that is, the process of extracting, transposing, loading and delivering the data, which refers to the important steps of preprocessing the data before the data processing; in step S4, according to the set calculation model, the human body The mechanical work outputted during the movement can be linked to the calories burned by the human body in the process by a conversion factor, combined with the readings of the load cell and the reconstructed motion trajectory to calculate the work, thereby calculating the calories burned and A type of support vector machine that distinguishes the target action class from other action classes; takes the strength training as the target action class, and determines whether the threshold of the strength training is exceeded, and if so, sends a reminder signal; this step S4 transmits the data to the Mobile devices, record, recommend dietary recipes, nutritional mix and training programs; Threshold may be based on user demand to customize settings, such as in the use of barbells, preset by the size of the force, called the threshold, and if this exceeds a preset magnitude, a signal is issued;
以及,计算出消耗的卡路里,通过支持向量机建立分类模型,将超出力量训练的源数据作为目标动作类,其他的作为非目标动作类;然后判断是否超出力量训练的阈值,若是则发出提醒信号,若否则将数据传输到可移动设备进行记录,并推荐膳食食谱、营养搭配及训练计划。And calculating the calories burned, establishing a classification model through the support vector machine, using the source data beyond the strength training as the target action class, and the other as the non-target action class; then determining whether the threshold of the strength training is exceeded, and if so, issuing a reminder signal If otherwise, transfer the data to a mobile device for recording, and recommend dietary recipes, nutritional mixes, and training programs.
在实际应用中,通过处理器模块接收压力传感器和IMU惯性单元测量出所需的运动数据,建立出运动信号和力量训练动作的关系,只需要使用简单的传感器即能够通过被检测者的卡路里的消耗和手部姿势的识别,判断出被检测者是 否发生手部姿势的偏离并进行报警,减少了对笨重的测量设备的依赖,将大大地提高手部姿势识别的正确率;在特定的运动中,可通过可移动设备终端显示出卡路里消耗量及膳食搭配推荐。In practical applications, the processor module receives the pressure sensor and the IMU inertia unit to measure the required motion data, and establishes the relationship between the motion signal and the strength training action, and only needs to use a simple sensor to pass the calorie of the detected person. Consumption and recognition of hand posture, judging that the subject is No deviation of the hand posture occurs and an alarm is issued, which reduces the dependence on the cumbersome measuring device, and greatly improves the correct rate of hand posture recognition; in a specific movement, the calorie consumption can be displayed through the mobile device terminal Recommended with meals.
用户优选通过按钮或开关将整个系统打开,所述按钮和开关可以是通过触摸感应器来实现的按钮和开关,所述按钮和开关可以设置在IMU惯性单元附件,以便于用户操作。The user preferably opens the entire system by means of a button or switch, which may be a button and a switch implemented by a touch sensor, which may be provided at the IMU inertial unit accessory for user operation.
利用异常检测算法识别所获取的运动信息的异常是基于局部异常因子的时间序列异常检测算法,包括以下步骤:The abnormality detection algorithm is used to identify the abnormality of the acquired motion information is a time series anomaly detection algorithm based on the local anomaly factor, and includes the following steps:
通过压力传感器和IMU惯性单元采集压力数据和运动姿态数据,基于可穿戴计算技术,将获得的加速度传感器、磁传感器和陀螺仪的数据进行滑动均值滤波,以消除背景噪声,所述滑动均值滤波器的滑动窗口宽度为7;The pressure data and the motion attitude data are collected by the pressure sensor and the IMU inertia unit, and the obtained acceleration sensor, the magnetic sensor and the gyroscope data are subjected to sliding mean filtering to eliminate background noise based on the wearable computing technology, and the sliding mean filter is eliminated. The sliding window width is 7;
对加速度传感器和陀螺仪的读数采用互补滤波器的方式实现手套姿态的准确估计,该互补滤波器用于结合加速度传感器对于手套姿态角的估计值和陀螺仪对于手套姿态角的估计值;An accurate estimation of the glove attitude is achieved by using a complementary filter for reading the acceleration sensor and the gyroscope, the complementary filter being used to combine the estimated value of the attitude angle of the acceleration sensor with the attitude of the glove and the estimated attitude of the gyroscope to the attitude of the glove;
采用互补滤波器的方式估计出手套在运动过程中的姿态角后,根据力学原理消除掉重力在智慧手套运动方向上的投射分量,提取出由于智慧手套自身运动所产生的加速度值,实现加速度校准;After using the complementary filter to estimate the attitude angle of the glove during the movement, the projection component of the gravity in the direction of the wisdom glove is removed according to the mechanical principle, and the acceleration value generated by the movement of the wisdom glove is extracted to realize the acceleration calibration. ;
获取经过校准后的加速度数据,采用一次积分的方式获得智慧手套运动的速度值;积分得到智慧手套运动的速度值之后,根据智慧手套起始于静止状态并终止于静止状态的运动特征,对智慧手套运动的速度进行校准;Obtain the calibrated acceleration data, obtain the speed value of the wisdom glove movement by one-time integration; after the integral gets the speed value of the wisdom glove movement, according to the movement characteristics of the wisdom glove starting from the static state and ending at the static state, the wisdom The speed of the glove movement is calibrated;
对所得速度值进行一次积分,从而得到智慧手套运动的位移大小。The resulting velocity value is integrated once to obtain the displacement of the wisdom glove movement.
通过互补滤波器实现数据的分析处理,物体在空间中的姿态,可由加速度和角速度结合相应进而达到准确估计的目的,因此,所述通过互补滤波器结合加速度传感器测量的手套姿态角的估计值和陀螺仪测量的手套姿态角的估计值,进而得到手套姿势的准确估计。提取出由于智慧手套自身运动所产生的加速度值,也就是要滤除掉智慧手套在三维坐标的三个方向上的加速度分量,这一点可以通过互补滤波或卡曼滤波等方式实现。为了较少积分后的速度漂移,积分只针对对应于手套运动时的加速度值,为此,指数均值(EMA)被采用作为判断手套加速度值对应于手套的静止状态还是运动状态;当滑动窗口内指数均值大于阈值时, 该窗口内的加速度被判断为对应于手套的运动状态;反之,则被判断为对应于手套的静止状态;当判断过程完成后,积分只被作用于对应手套运动状态下的加速度值,从而获得相应的速度值,而对应于手套静止状态下的加速度值则被视为零值;所述阈值是在数据处理过程中,结合传感器、算法以及用户需求进行综合确定,不同的情况下,此阈值会有所不同。采用步骤S24所述的指数均值(EMA)判断手套的运动状态,当判定为静止时,则将对应的速度值强制设置为0。The analysis and processing of the data is realized by the complementary filter, and the attitude of the object in space can be combined by the acceleration and the angular velocity to achieve accurate estimation. Therefore, the estimated value of the glove attitude angle measured by the complementary filter combined with the acceleration sensor is The estimated value of the glove attitude angle measured by the gyroscope, which in turn gives an accurate estimate of the glove posture. The acceleration value generated by the movement of the smart glove itself is extracted, that is, the acceleration component of the wisdom glove in three directions of the three-dimensional coordinates is filtered out, which can be realized by complementary filtering or Kalman filtering. In order to reduce the speed drift after the integration, the integral is only for the acceleration value corresponding to the movement of the glove. For this reason, the exponential mean (EMA) is used as the judgment whether the glove acceleration value corresponds to the stationary state or the motion state of the glove; When the exponential mean is greater than the threshold, The acceleration in the window is determined to correspond to the motion state of the glove; otherwise, it is determined to correspond to the stationary state of the glove; when the judgment process is completed, the integral is only applied to the acceleration value corresponding to the glove motion state, thereby obtaining Corresponding speed values, which correspond to the acceleration values of the glove in a static state, are regarded as zero values; the threshold values are comprehensively determined in the data processing process in combination with sensors, algorithms, and user requirements. In different cases, the threshold values are It will be different. The index state average (EMA) described in step S24 is used to determine the motion state of the glove. When it is determined to be stationary, the corresponding speed value is forcibly set to zero.
本例还包括用于卡路里消耗和手部姿势识别的调整一类支持向量机的高维特征模型,This example also includes a high-dimensional feature model for the adjustment of a type of support vector machine for calorie consumption and hand gesture recognition.
结合所得到的位移值,结合薄膜压力传感器的读数,经过处理,计算出手套运动所做的功,按照建立的功与卡路里消耗的关系模型计算卡路里消耗;Combining the obtained displacement value, combined with the reading of the film pressure sensor, after processing, calculating the work done by the glove movement, and calculating the calorie consumption according to the relationship model between the established work and the calorie consumption;
记录卡路里的消耗,并进行膳食搭配和营养均衡的提醒;Record calorie consumption and remind you of dietary mix and nutritional balance;
基于统计学习理论预先建立高维特征模型,所述高维特征模型以设定空间内由于各项姿态偏离动作导致的信息变化的异常模式作为训练样本;The high-dimensional feature model is pre-established based on the statistical learning theory, and the high-dimensional feature model is used as a training sample by setting an abnormal pattern of information changes due to various posture deviation actions in the space;
将异常模式映射至一类支持向量机的高维特征模型中,分离出目标动作类,并判断出运动姿态是否发生偏离,若是则发出警示信号。The abnormal pattern is mapped to a high-dimensional feature model of a type of support vector machine, and the target action class is separated, and whether the motion posture is deviated is determined, and if so, a warning signal is issued.
所述关系模型为根据人体在运动过程中对外输出的机械功通过转化因子与人体在这一过程中消耗的卡路里联系起来,结合测力传感器的读数和重构所得运动轨迹来计算功,从而计算出消耗的卡路里进而将目标动作类和其他动作类进行区分。The relationship model is that the mechanical work outputted by the human body during the movement is linked to the calories consumed by the human body in the process by the conversion factor, and the work is calculated by combining the readings of the load cell and the reconstructed motion trajectory, thereby calculating The calories burned out then distinguish the target action class from the other action classes.
本例根据手套姿势做功与卡路里之间的关系来构建出模型,从而来进行计算分析,功与能量之间可用运动状态来表示,体现出运动开始时刻、运动结束时刻和运动的瞬时速度;因为不是所有的内能用来做功,一部分内能由于热量消耗,血液流动而损耗,人体的内能按照一定的比率转化成功。能量流失的计量按照以下的公式来计算:人体运动过程中对外输出的机械功=卡路里消耗转为机械功的效率*人体运动过程中消耗高的卡路里。基于机器学习的相关知识,构建出做功与卡路里消耗之间的模型关系。可穿戴计算中测量机械功,通常是测量运动轨迹从而计算出来人体所做的功。进一步,测量运动轨迹是用一些常见的传感器例如加速度传感器和重力传感器来实现。In this example, the model is constructed based on the relationship between work and calories in the glove posture, so that the calculation and analysis can be performed. The work state can be expressed by the motion state, which shows the start time of the motion, the end time of the motion, and the instantaneous speed of the motion; Not all internal energy can be used for work, and part of the internal energy can be lost due to heat consumption and blood flow. The internal energy of the human body can be successfully converted according to a certain ratio. The measurement of energy loss is calculated according to the following formula: the mechanical output of the external output during the movement of the human body = the efficiency of calorie consumption to mechanical work * the calories burned during the movement of the human body. Based on the relevant knowledge of machine learning, the model relationship between work and calorie consumption is constructed. Mechanical work is measured in wearable computing, usually by measuring the motion trajectory to calculate the work done by the human body. Further, measuring motion trajectories is accomplished using some common sensors such as acceleration sensors and gravity sensors.
本例获取的数据是随着时间而产生的,也就是时间序列模型,为便于实 现数据分析和处理,本例对获取的数据进行分割,而子序列指的是截取一段由感知模块获取并经过ETL过程的数据,至于子序列的长度和数据量,根据系统的处理能力可以自定义设置;所述局部异常数据是指在子序列中,按照支持向量机的方法计算,部分数据明显与此子序列的其他数据有偏差的数据;所述预设阀值为预先设置的阀值,是在数据处理过程中,结合传感器、算法以及用户需求进行综合确定,不同的情况下,此阈值会有所不同。The data obtained in this example is generated over time, that is, the time series model. Now data analysis and processing, this example divides the acquired data, and the subsequence refers to intercepting a piece of data acquired by the sensing module and passing through the ETL process. As for the length and data amount of the subsequence, according to the processing capability of the system, Defining settings; the local anomaly data refers to data calculated by a support vector machine method in a subsequence, and part of the data is significantly deviated from other data of the subsequence; the preset threshold is a preset threshold In the data processing process, combined with sensors, algorithms and user requirements for comprehensive determination, in different cases, this threshold will be different.
本例还优选包括用于调整完善一类支持向量机的高维特征模型,提供可以优化检测和决策算法的系统反馈。如果警报没有及时被关闭,系统则会通过信号关联的其他设备向他人发出求助信息,比如通过第三方应用发送即时信息或短信等求助。This example also preferably includes a high-dimensional feature model for adjusting and improving a class of support vector machines, and provides system feedback that can optimize detection and decision algorithms. If the alert is not turned off in time, the system will send help information to others through other devices associated with the signal, such as sending instant messages or text messages through third-party applications.
以上内容是结合具体实现方式对本发明做的进一步阐述,不应认定本发明的具体实现只局限于以上说明。对于本技术领域的技术人员而言,在不脱离本发明构思的前提下,还可以做出若干简单推演或替换,均应视为有本发明所提交的权利要求确定的保护范围之内。 The above content is further described in connection with the specific implementation manner, and it should not be construed that the specific implementation of the present invention is limited to the above description. It will be apparent to those skilled in the art that the present invention may be practiced without departing from the spirit and scope of the invention.

Claims (8)

  1. 一种健身姿势识别、评估、预警和强度估算的智能方法,其特征在于:包括如下步骤:An intelligent method for fitness posture recognition, evaluation, early warning and strength estimation, which comprises the following steps:
    (S1)利用智能手套上的压力传感器的薄膜压力传感器和IMU惯性单元来采集力量训练时的原始数据;(S1) using the membrane pressure sensor of the pressure sensor on the smart glove and the IMU inertia unit to collect raw data during strength training;
    (S2)将原始数据传输到处理器模块进行数据预处理;(S2) transmitting the original data to the processor module for data preprocessing;
    (S3)处理器模块将预处理得到的压力传感器和IMU惯性单元数据通过通信单元以无线通信的方式传输给移动终端APP;(S3) the processor module transmits the pre-processed pressure sensor and the IMU inertial unit data to the mobile terminal APP by means of the communication unit in a wireless communication manner;
    (S4)移动终端APP接收到数据之后,运行数据处理的算法,得到健身姿势判定、动作质量评估、运动强度估算的结果,并将结果在APP中以图形化的方式显示出来;当判定健身动作不标准或者健身强度过量时,APP将会对用户进行预警提示;同时,APP将数据处理的结果上传至云端服务器的用户个人数据库中,云端服务器基于用户的历史数据,为用户推介相应的健身服务。(S4) After receiving the data, the mobile terminal APP runs an algorithm of data processing to obtain a result of fitness posture determination, motion quality evaluation, and exercise intensity estimation, and displays the result in a graphical manner in the APP; When the standard is not standard or the fitness intensity is excessive, the APP will prompt the user for warning; at the same time, the APP uploads the data processing result to the user personal database of the cloud server, and the cloud server introduces the corresponding fitness service for the user based on the historical data of the user. .
  2. 根据权利要求1所述的健身姿势识别、评估、预警和强度估算的智能方法,其特征在于:所述步骤(S1)中,用户通过按钮或开关将戴在手腕上的智能手套打开,所述智慧手套的感知模块上设置有数个的压力传感器。The intelligent method for fitness posture recognition, evaluation, early warning and strength estimation according to claim 1, wherein in the step (S1), the user opens the smart glove worn on the wrist by a button or a switch, There are several pressure sensors on the sensor module of the wisdom glove.
  3. 根据权利要求1所述的健身姿势识别、评估、预警和强度估算的智能方法,其特征在于,所述步骤(S2)中进一步包括:(S21),通过压力传感器和IMU惯性单元采集压力数据和运动姿态数据,将获得的加速度传感器、磁传感器和陀螺仪的数据进行滑动均值滤波,以消除背景噪声;(S22),根据一个完整健身动作的运动特征,结合9轴IMU数据对健身运动进行切割,得到每一个完整动作的起点和终点,从而将连续的健身运动过程按照每一个运动动作进行切分;(S23),对切分后的数据运用机器学习的方法进行分类,实现姿势识别的功能;(S24),实现姿势判定后,将用户的动作数据与标准动作的数据库进行匹配,评估用户动作的整体质量,同时,对用户动作数据进行稳定性、平滑性分析,得到用户健身动作质量的各个评估指标;(S25),实现姿势判定后,对每一个动作过程中进行进一步切分,使其分成去程与回程,并对两个分过程进行时域和幅度域上的分析,当时域和幅度域上的指标超过设定的阈值时,动作被判定为不标准,并给予用户相应的不标准提示;(S26),对加速度传感器和陀螺仪的读数采用互补滤波器的 方式实现手套姿态角的准确估计,该互补滤波器用于结合加速度传感器对于手套姿态角的估计值和陀螺仪对于手套姿态角的估计值;步骤S27,采用互补滤波器的方式估计出手套在运动过程中的姿态角后,根据力学原理消除掉重力在智慧手套运动方向上的投射分量,提取出由于智慧手套自身运动所产生的加速度值,实现加速度校准;(S28),根据人体运动学原理结合九轴IMU数据重构健身运动的轨迹,结合压力传感器的读数,经过步骤S3的处理,计算出手套运动所做的功,按照建立的功与卡路里消耗的关系模型计算卡路里消耗;(S29),记录卡路里的消耗,并进行膳食搭配和营养均衡的提醒。The intelligent method for fitness posture recognition, evaluation, early warning and strength estimation according to claim 1, wherein the step (S2) further comprises: (S21), collecting pressure data by using a pressure sensor and an IMU inertia unit; Motion posture data, the obtained acceleration sensor, magnetic sensor and gyroscope data are subjected to sliding mean filtering to eliminate background noise; (S22), according to the motion characteristics of a complete fitness movement, combined with 9-axis IMU data to cut the exercise The starting point and the end point of each complete movement are obtained, so that the continuous exercise process is divided according to each movement action; (S23), the segmented data is classified by the machine learning method, and the posture recognition function is realized. (S24), after the posture determination is implemented, the user's motion data is matched with the standard action database, and the overall quality of the user motion is evaluated, and at the same time, the user motion data is analyzed for stability and smoothness, and the user's fitness motion quality is obtained. Each evaluation indicator; (S25), after the posture determination, for each action process Further segmentation is performed to divide into the forward and return paths, and the two sub-processes are analyzed in the time domain and the amplitude domain. When the indicators in the domain and the amplitude domain exceed the set threshold, the action is judged as not Standard and give the user a corresponding non-standard prompt; (S26), the complementary sensor is used for the reading of the accelerometer and the gyroscope The method achieves accurate estimation of the attitude angle of the glove, and the complementary filter is used to combine the estimated value of the attitude angle of the acceleration sensor with the attitude of the glove and the attitude of the glove to the attitude angle of the glove; and in step S27, the complementary filter is used to estimate the movement of the glove during the movement. After the attitude angle, the projection component of gravity in the direction of the wisdom glove is removed according to the mechanics principle, and the acceleration value generated by the movement of the wisdom glove is extracted to realize the acceleration calibration; (S28), according to the kinematics principle of the human body The axis IMU data reconstructs the trajectory of the fitness movement, combined with the reading of the pressure sensor, through the processing of step S3, calculates the work done by the glove movement, and calculates the calorie consumption according to the relationship model between the established work and the calorie consumption; (S29), recording Calorie consumption, and reminders of dietary mix and nutritional balance.
  4. 一种健身姿势识别、评估、预警和强度估算的智能系统,其特征在于:包括:An intelligent system for fitness posture recognition, assessment, early warning and strength estimation, comprising:
    信号获取与计算模块,用于收集智能手套运动状态时的信号,并评估运动状态信息加以初步计算;a signal acquisition and calculation module for collecting signals of the movement state of the smart glove and evaluating the motion state information for preliminary calculation;
    异常检测模块,用于通过异常检测算法识别信号是否变化的异常;An abnormality detecting module, configured to identify, by using an anomaly detection algorithm, whether the signal is abnormal;
    动作判断模块,用于将目标动作类和其他动作类进行区分的一类支持向量机,以超出力量训练阈值所导致的异常模式作为目标动作类,并判断智慧手套的运动姿势是否发生姿势偏离;The action judging module is used for classifying the target action class and other action classes to distinguish the abnormal mode caused by the strength training threshold as the target action class, and determining whether the posture of the smart glove is deviated;
    以及警报模块,用于当判断发生姿态偏离时发出警示信号。And an alarm module for issuing an alert signal when it is determined that an attitude deviation occurs.
  5. 根据权利要求4所述的健身姿势识别、评估、预警和强度估算的智能系统,其特征在于:所述信号获取与计算模块包括:The intelligent system for fitness posture recognition, evaluation, early warning and strength estimation according to claim 4, wherein the signal acquisition and calculation module comprises:
    感应采集单元,用于开启整个系统并收集运动数据,收集的运动数据包括力量训练方向上的力和三维坐标各个方向上的运动数据;An inductive acquisition unit for turning on the entire system and collecting motion data, and the collected motion data includes motion data in the direction of strength training and motion data in all directions of three-dimensional coordinates;
    数据处理单元,用于对每一个方向上的力和运动信息求得平均值,将此平均值作为运动状态信息;a data processing unit, configured to average the force and motion information in each direction, and use the average value as the motion state information;
    平滑单元,针对数据处理单元所得到的数据进行ETL分析,并通过滑动平均方法对运动状态信息进行平滑处理。The smoothing unit performs ETL analysis on the data obtained by the data processing unit, and smoothes the motion state information by a moving average method.
  6. 根据权利要求4所述的健身姿势识别、评估、预警和强度估算的智能系统,其特征在于,所述异常检测模块包括:The intelligent system for fitness posture recognition, evaluation, early warning, and strength estimation according to claim 4, wherein the abnormality detecting module comprises:
    异常计算单元,用于对运动状态信息的时间序列实施数据分割得到子序列,计算子序列的局部异常数据;An abnormality calculating unit, configured to perform data segmentation on the time series of the motion state information to obtain a subsequence, and calculate local abnormal data of the subsequence;
    异常输出单元,用于当所述的异常数据大于或等于预设阈值时,将子序列作为异 常模式输出。An abnormal output unit, configured to use the subsequence as different when the abnormal data is greater than or equal to a preset threshold Normal mode output.
  7. 根据权利要求4所述的健身姿势识别、评估、预警和强度估算的智能系统,其特征在于,所述动作判断模块包括:The intelligent system for fitness posture recognition, evaluation, early warning and strength estimation according to claim 4, wherein the action judgment module comprises:
    建立模型单元,用于基于统计学习理论预设建立高维特征模型,所述高维特征模型以设定空间内由于各项人体动作导致运动状态信息变化的异常模式作为训练样本;Establishing a model unit for establishing a high-dimensional feature model based on a statistical learning theory preset, wherein the high-dimensional feature model uses an abnormal pattern in a set space due to changes in motion state information due to various human actions as a training sample;
    动作识别单元,用于将异常输出单元所输出的异常模式映射至一类支持向量机的高维特征模型中,分离出目标动作类。The motion recognition unit is configured to map the abnormal pattern output by the abnormal output unit to a high-dimensional feature model of a type of support vector machine, and separate the target action class.
  8. 根据权利要求4所述的健身姿势识别、评估、预警和强度估算的智能系统,其特征在于,还包括反馈模块,用于反馈针对手部姿势警报信号的响应信息,调整一类支持向量机的高维特征模型。 The intelligent system for fitness posture recognition, evaluation, early warning and strength estimation according to claim 4, further comprising a feedback module for feeding back response information for the hand posture warning signal, and adjusting a type of support vector machine High dimensional feature model.
PCT/CN2016/080735 2016-03-18 2016-04-29 Smart method and system for body building posture identification, assessment, warning and intensity estimation WO2017156835A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610155560.3A CN105797350A (en) 2016-03-18 2016-03-18 Intelligent method and system for body building posture recognition, evaluation, early-warning and intensity estimation
CN201610155560.3 2016-03-18

Publications (1)

Publication Number Publication Date
WO2017156835A1 true WO2017156835A1 (en) 2017-09-21

Family

ID=56454460

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/080735 WO2017156835A1 (en) 2016-03-18 2016-04-29 Smart method and system for body building posture identification, assessment, warning and intensity estimation

Country Status (2)

Country Link
CN (1) CN105797350A (en)
WO (1) WO2017156835A1 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491767A (en) * 2018-03-06 2018-09-04 北京因时机器人科技有限公司 Autonomous roll response method, system and manipulator based on Online Video perception
CN109480858A (en) * 2018-12-29 2019-03-19 中国科学院合肥物质科学研究院 It is a kind of for quantify detect disturbances in patients with Parkinson disease bradykinesia symptom wearable intelligence system and method
CN109635415A (en) * 2018-12-07 2019-04-16 国网湖北省电力有限公司电力科学研究院 Distributed photovoltaic system exception early warning accuracy rate calculation method based on ROC curve
CN110782967A (en) * 2019-11-01 2020-02-11 成都乐动信息技术有限公司 Fitness action standard degree evaluation method and device
CN110991482A (en) * 2019-10-31 2020-04-10 深圳市木瓜有子健康科技有限公司 Body-building action recognition method, terminal and computer storage medium
CN112370050A (en) * 2020-11-17 2021-02-19 哈尔滨理工大学 Human body posture and motion energy consumption identification system and identification method
CN112580587A (en) * 2020-12-29 2021-03-30 西安精密机械研究所 Bone joint damage information evaluation system and evaluation method based on vibration noise signals
CN113671847A (en) * 2021-08-13 2021-11-19 珠海格力电器股份有限公司 Linkage control method, system and device of intelligent household equipment and storage medium
WO2022100597A1 (en) * 2020-11-12 2022-05-19 华为技术有限公司 Adaptive action evaluation method, electronic device, and storage medium
CN114612977A (en) * 2022-03-10 2022-06-10 苏州维科苏源新能源科技有限公司 Big data based acquisition and analysis method
CN114602154A (en) * 2022-03-04 2022-06-10 南京七加二网络科技有限公司 AI self-service competitive training system
CN115100746A (en) * 2022-07-07 2022-09-23 江苏动泰运动用品有限公司 Human body fitness training management system based on artificial intelligence
CN115607146A (en) * 2022-12-16 2023-01-17 东南大学 Wearable single-node device for leg posture estimation and measurement method
CN116028556A (en) * 2023-03-28 2023-04-28 山东无界智能科技有限公司 Intelligent processing method for transmission data of AR terminal system
CN116578910A (en) * 2023-07-13 2023-08-11 成都航空职业技术学院 Training action recognition method and system
CN117084671A (en) * 2023-10-19 2023-11-21 首都医科大学宣武医院 Motion evaluation system based on gyroscope signals
CN117133110A (en) * 2023-10-27 2023-11-28 山东大学 Gymnasium safety risk early warning method and system based on machine vision

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107785076A (en) * 2016-08-30 2018-03-09 李祥臣 A kind of continuous dynamic motion and physiological data Treatment Analysis system and method
CN107049324B (en) 2016-11-23 2019-09-17 深圳大学 A kind of judgment method and device of limb motion posture
CN107029407A (en) * 2017-03-30 2017-08-11 成都和煦医疗科技有限公司 A kind of intelligent motherhood behaviour instrument for training
US10603566B2 (en) * 2017-08-29 2020-03-31 Pixart Imaging Inc. Method and system for posture correction adapted to a sporting equipment
US11457837B2 (en) 2017-08-29 2022-10-04 Pixart Imaging Inc. Direction control apparatus with sensor, and method and system for determining driver status using the same
CN108073915A (en) * 2018-01-12 2018-05-25 广州慧睿思通信息科技有限公司 It kowtows number system and method
CN108635805B (en) * 2018-03-29 2020-01-10 维沃移动通信有限公司 Motion reminding method and terminal equipment
US20210220702A1 (en) * 2018-04-26 2021-07-22 Sensarii Pty Ltd Systems and methods for formulating a performance metric of a motion of a swimmer
CN108888265A (en) * 2018-05-23 2018-11-27 四川斐讯信息技术有限公司 A kind of movement method for early warning and device
CN109260672B (en) * 2018-08-28 2020-07-07 百度在线网络技术(北京)有限公司 Motion data analysis method and device, wearable device and storage medium
TWI704528B (en) * 2018-10-08 2020-09-11 財團法人資訊工業策進會 Riding-posture analyzing system and method
CN111013117A (en) * 2019-05-09 2020-04-17 深圳市云康创新网络科技有限公司 Fitness training plan management system and method
CN110052013A (en) * 2019-05-28 2019-07-26 上海应用技术大学 A kind of instant auxiliary system of body-building
CN110502107A (en) * 2019-07-26 2019-11-26 森博迪(深圳)科技有限公司 Wearable real-time action instructs system and method
CN110619940B (en) * 2019-09-19 2023-01-10 福建宜准信息科技有限公司 Body-building running scheme generation method based on ant colony optimization algorithm
CN113133670B (en) * 2020-01-17 2023-03-21 佛山市顺德区美的电热电器制造有限公司 Cooking equipment, cooking control method and device
CN111657621B (en) * 2020-06-04 2022-05-13 福建奇鹭物联网科技股份公司 Sports shoe for detecting wearing time and sports strength and injury prevention method
CN112364770B (en) * 2020-11-11 2023-02-17 天津大学 Commercial Wi-Fi-based human activity recognition and action quality evaluation method
CN116963807A (en) * 2021-03-19 2023-10-27 深圳市韶音科技有限公司 Motion data display method and system
CN113926160B (en) * 2021-10-08 2022-07-12 重庆邮电大学 Upper limb flexor resistance training auxiliary system for household personnel
CN114334084B (en) * 2022-03-01 2022-06-24 深圳市海清视讯科技有限公司 Body-building data processing method, device, equipment and storage medium
CN114495177A (en) * 2022-04-06 2022-05-13 北京蓝田医疗设备有限公司 Scene interactive human body action and balance intelligent evaluation method and system
CN114931743A (en) * 2022-06-15 2022-08-23 康键信息技术(深圳)有限公司 Exercise evaluation method, exercise evaluation device, electronic apparatus, and readable storage medium
CN116153518B (en) * 2023-04-23 2023-07-28 中国人民解放军总医院 Disease seed risk quantitative analysis method and system based on big data technology

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020194668A1 (en) * 2001-05-24 2002-12-26 Seung-Woo Kwon Functional golf gloves
CN102799263A (en) * 2012-06-19 2012-11-28 深圳大学 Posture recognition method and posture recognition control system
CN104288983A (en) * 2014-09-05 2015-01-21 惠州Tcl移动通信有限公司 Wearable device and body building method based on same
CN104888444A (en) * 2015-05-20 2015-09-09 深圳大学 Intelligent gloves, method and system for calorie consumption and hand posture recognition

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101549205A (en) * 2008-04-02 2009-10-07 北京国浩微磁电子智能传感器技术研究所 System for recognizing human gait, real-time monitoring energy consumption thereof and instructing exercise training thereof
CN101518442B (en) * 2008-07-05 2011-04-20 杭州义盛祥通信技术有限公司 Sport quantization watch and sport quantitative analysis method
WO2012109244A1 (en) * 2011-02-07 2012-08-16 New Balance Athletic Shoe, Inc. Systems and methods for monitoring athletic performance
US8948832B2 (en) * 2012-06-22 2015-02-03 Fitbit, Inc. Wearable heart rate monitor
WO2014184448A1 (en) * 2013-05-17 2014-11-20 Medieta Oy Method and system for providing an early risk recognition monitoring
JP6210272B2 (en) * 2013-06-26 2017-10-11 セイコーエプソン株式会社 Input device, pulse rate calculation device, and input method
CN203749393U (en) * 2013-11-01 2014-08-06 孙明 Personal health intelligent wristband system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020194668A1 (en) * 2001-05-24 2002-12-26 Seung-Woo Kwon Functional golf gloves
CN102799263A (en) * 2012-06-19 2012-11-28 深圳大学 Posture recognition method and posture recognition control system
CN104288983A (en) * 2014-09-05 2015-01-21 惠州Tcl移动通信有限公司 Wearable device and body building method based on same
CN104888444A (en) * 2015-05-20 2015-09-09 深圳大学 Intelligent gloves, method and system for calorie consumption and hand posture recognition

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108491767A (en) * 2018-03-06 2018-09-04 北京因时机器人科技有限公司 Autonomous roll response method, system and manipulator based on Online Video perception
CN109635415A (en) * 2018-12-07 2019-04-16 国网湖北省电力有限公司电力科学研究院 Distributed photovoltaic system exception early warning accuracy rate calculation method based on ROC curve
CN109480858A (en) * 2018-12-29 2019-03-19 中国科学院合肥物质科学研究院 It is a kind of for quantify detect disturbances in patients with Parkinson disease bradykinesia symptom wearable intelligence system and method
CN109480858B (en) * 2018-12-29 2022-02-22 中国科学院合肥物质科学研究院 Wearable intelligent system and method for quantitatively detecting motor retardation symptoms of Parkinson patients
CN110991482A (en) * 2019-10-31 2020-04-10 深圳市木瓜有子健康科技有限公司 Body-building action recognition method, terminal and computer storage medium
CN110782967B (en) * 2019-11-01 2023-04-21 成都乐动信息技术有限公司 Body-building action standard degree assessment method and device
CN110782967A (en) * 2019-11-01 2020-02-11 成都乐动信息技术有限公司 Fitness action standard degree evaluation method and device
WO2022100597A1 (en) * 2020-11-12 2022-05-19 华为技术有限公司 Adaptive action evaluation method, electronic device, and storage medium
CN112370050A (en) * 2020-11-17 2021-02-19 哈尔滨理工大学 Human body posture and motion energy consumption identification system and identification method
CN112580587A (en) * 2020-12-29 2021-03-30 西安精密机械研究所 Bone joint damage information evaluation system and evaluation method based on vibration noise signals
CN113671847A (en) * 2021-08-13 2021-11-19 珠海格力电器股份有限公司 Linkage control method, system and device of intelligent household equipment and storage medium
CN114602154A (en) * 2022-03-04 2022-06-10 南京七加二网络科技有限公司 AI self-service competitive training system
CN114612977A (en) * 2022-03-10 2022-06-10 苏州维科苏源新能源科技有限公司 Big data based acquisition and analysis method
CN115100746A (en) * 2022-07-07 2022-09-23 江苏动泰运动用品有限公司 Human body fitness training management system based on artificial intelligence
CN115607146A (en) * 2022-12-16 2023-01-17 东南大学 Wearable single-node device for leg posture estimation and measurement method
CN116028556A (en) * 2023-03-28 2023-04-28 山东无界智能科技有限公司 Intelligent processing method for transmission data of AR terminal system
CN116028556B (en) * 2023-03-28 2023-06-09 山东无界智能科技有限公司 Intelligent processing method for transmission data of AR terminal system
CN116578910A (en) * 2023-07-13 2023-08-11 成都航空职业技术学院 Training action recognition method and system
CN116578910B (en) * 2023-07-13 2023-09-15 成都航空职业技术学院 Training action recognition method and system
CN117084671A (en) * 2023-10-19 2023-11-21 首都医科大学宣武医院 Motion evaluation system based on gyroscope signals
CN117084671B (en) * 2023-10-19 2024-04-02 首都医科大学宣武医院 Motion evaluation system based on gyroscope signals
CN117133110A (en) * 2023-10-27 2023-11-28 山东大学 Gymnasium safety risk early warning method and system based on machine vision
CN117133110B (en) * 2023-10-27 2024-02-02 山东大学 Gymnasium safety risk early warning method and system based on machine vision

Also Published As

Publication number Publication date
CN105797350A (en) 2016-07-27

Similar Documents

Publication Publication Date Title
WO2017156835A1 (en) Smart method and system for body building posture identification, assessment, warning and intensity estimation
WO2017156834A1 (en) Intelligent gloves for measuring calorie consumption and monitoring hand gesture recognition, and estimation method and system
CN104888444B (en) Wisdom gloves, the method and system of a kind of calorie of consumption and hand positions identification
AU2020273327B2 (en) Systems and methods of swimming analysis
CN102292025B (en) Determining energy expenditure of a user
US10802038B2 (en) Calculating pace and energy expenditure from athletic movement attributes
WO2017049957A1 (en) Intelligent falling detection and alarming apparatus and processing method thereof
US20160089078A1 (en) Device and method for sleep monitoring
Kang et al. Real-time elderly activity monitoring system based on a tri-axial accelerometer
Huynh et al. Fall detection system using combination accelerometer and gyroscope
CN103543834A (en) Gesture recognition device and method
US20160058373A1 (en) Running Energy Efficiency
CN206470693U (en) A kind of Emotion identification system based on wearable device
Adaskevicius Method for recognition of the physical activity of human being using a wearable accelerometer
Pietroni et al. Methodologies for continuous activity classification of user through wearable devices: Feasibility and preliminary investigation
CN103870814A (en) Non-contact real-time eye movement identification method based on intelligent camera
Prudêncio et al. Physical activity recognition from smartphone embedded sensors
Lin et al. A comparison of finger and wrist motion tracking to detect bites during food consumption
Sarcevic et al. Wireless Sensor Network based movement classification using wrist-mounted 9DOF sensor boards
CN108784720B (en) Control system for spasm detection based on muscle tension sensor and detection method thereof
Nguyen et al. An instrumented measurement scheme for the assessment of upper limb function in individuals with Friedreich Ataxia
US20180211557A1 (en) Teaching compatibility determining device, system, method and recording medium
CN107510335B (en) A kind of cup amount of drinking water statistical method
Tang et al. Fall detection system for monitoring an elderly person based on six-axis gyroscopes
RU2763700C1 (en) Method for monitoring the hydration of a living organism

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16893998

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18.01.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16893998

Country of ref document: EP

Kind code of ref document: A1