WO2018157460A1

WO2018157460A1 - Method and device for counting human motions

Info

Publication number: WO2018157460A1
Application number: PCT/CN2017/081465
Authority: WO
Inventors: 黄晓萍
Original assignee: 华为技术有限公司
Priority date: 2017-03-03
Filing date: 2017-04-21
Publication date: 2018-09-07
Also published as: CN108885789A

Abstract

A method and device for counting human motions, which carries out counting of human motions by means of a terminal device. Provided is a method for automatically counting human motions, thus reducing to a certain extent the error rate in counting. The method, applied to a terminal device comprising a camera, comprises: the terminal device starts the camera in response to an instruction triggered by a user for starting counting of human motions; when the camera is aimed at a target part of the user, the terminal device monitors the image of the motions made by the user by means of the camera; every time that the terminal device determines that a proportion of change condition for the target part in the image is met, the terminal device adds one to the number of human motions of the user, the proportion of change condition being that the proportion of the target part in the image changes from increasing to decreasing, or the proportion of the target part in the image changes from decreasing to increasing; and the terminal device informs the user of the final number of human motions after detecting by means of the camera that the human motion has stopped.

Description

Counting method and device for human body movement

This application claims the priority of the Chinese patent application filed on March 3, 2017, the Chinese Patent Office, application number 201710124463.2, the invention titled "a method and equipment for counting the number of push-ups by mobile phone camera and evaluating the quality of motion". The entire contents of this application are incorporated herein by reference.

Technical field

The present application relates to the field of information technology, and in particular, to a method and device for counting human motion.

Background technique

At present, when users are doing sports (such as push-ups, sit-ups, and high-lifting legs), they are counted manually. If the person counting is not focused, it is easy to count errors.

Summary of the invention

The embodiment of the present application provides a counting method and device for human body motion, which realizes human body motion counting through a terminal device, and provides an automatic human body motion counting method, and the person who counts is not paying attention when compared with manual counting. Concentration, it is easy to count the wrong situation, which reduces the counting error rate to some extent.

In a first aspect, the embodiment of the present application provides a method for counting a human body motion, where the method is applied to a terminal device including a camera, and the method includes: the terminal device is configured to start an instruction for counting a human body motion in response to a user trigger Activating the camera; the terminal device monitors, by the camera, a picture of the human body movement when the camera is aligned with the target part of the user; the terminal device determines that the target part is satisfied once When the ratio change condition of the picture is occupied, the number of times of the human body movement of the user is increased once, and the ratio change condition is that the proportion change of the target part in the picture changes from increasing to decreasing, or The proportion of the target portion in the picture changes from decreasing to increasing; the terminal device notifies the user of the number of times the body movement is finally performed after the body motion is stopped by the camera.

The human body motion in the present application refers to a type of motion in which certain parts of the body have a certain position in the relative space when the user is exercising.

In the above design, the target device of the terminal device monitors the proportion change of the target part of the user to the screen, thereby realizing automatic counting by the terminal device, eliminating the need for manual counting, and improving the correct rate of counting to a certain extent.

When the terminal device notifies the user of the number of times of exercise, the terminal device can display through the interface, and can also pass voice or the like.

In addition, after the terminal device monitors that the movement of the human body is stopped by the camera, the user can immediately notify the user of the number of times of the final body movement, and can also save the first time, and receive an instruction triggered by the user for viewing the number of times of the human body movement. By giving the user. It is also possible to notify the user of the number of times the human body moves, set the time, and when the set time is reached, pass the number of times the human body moves to the user.

In a possible design, before the terminal device monitors the user's motion of the human body motion through the camera, the method further includes: the terminal device responding to the user-triggered instruction for recording the standard motion of the human body motion The terminal device monitors, by the camera, a screen of a standard action of the user to perform the human body motion when the camera is aligned with a target portion of the user; the terminal device records the user corresponding to the standard action a target portion occupies a maximum ratio and a minimum ratio of the picture; the terminal device determines, when each of the target parts accounts for a ratio change condition of the picture, determines a maximum value and a ratio of a ratio that occurs when the ratio change condition is satisfied Minimum a value, the maximum value of the ratio is a maximum value when the target portion accounts for a change in the proportion of the picture from an increase to a decrease, and the ratio minimum value is a change in a ratio of the target portion to the picture. a minimum value at the time of the increase; the terminal device determines the user according to a comparison result of the maximum ratio of the proportional maximum value corresponding to the standard action, and a comparison result of the minimum ratio of the ratio minimum value and the standard action The quality of the movement of the human body is notified to the user.

The above design provides an automated way to assess the quality of motion.

When the terminal device notifies the user of the motion quality of the motion, the terminal device can display through the interface, and can also pass voice or the like.

In a second aspect, the embodiment of the present application provides a method for counting human motion, and the method is applied to a terminal device including an imaging device, including: the terminal device is configured to start counting for a human body motion in response to a user trigger. Instructing to activate the imaging device; the terminal device monitors a change in physical distance between the target portion and the imaging device by the imaging device when the imaging device is aligned with a target portion of the user The terminal device increases the number of times of the human body motion for the user once the distance change condition of the physical distance between the target portion and the imaging device is satisfied once, and the distance change condition is the target a change in physical distance between the portion and the imaging device is changed from increasing to decreasing, or a change in physical distance between the target portion and the imaging device is changed from decreasing to increasing; the terminal device is photographed After the device detects that the movement of the human body is stopped, the device notifies the user of the number of times the body movement is finally performed.

Wherein, the imaging device is a focusing camera, or the imaging device comprises a camera and a ranging aid.

The above design monitors the change of the physical distance between the target part of the user and the imaging device through the imaging device of the terminal device, thereby realizing automatic counting by the terminal device, eliminating the need for manual counting, and improving the counting correctly to a certain extent. rate.

In a possible design, before the terminal device monitors a change in the physical distance between the target portion and the imaging device by the imaging device, the method further includes:

The terminal device is responsive to a user-triggered instruction to record a standard motion of the human body motion;

When the imaging device is aligned with the target portion of the user, the terminal device monitors a distance between the target portion and the imaging device when the user performs a standard motion of the human body motion through the imaging device. Variety;

The terminal device records a maximum distance and a minimum distance between the target part corresponding to the standard action and the imaging device;

Determining, by the terminal device, a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied, each time the distance change condition that satisfies the physical distance between the target part and the imaging apparatus is determined, the distance being the largest a value is a maximum value when the physical distance between the target portion and the imaging device changes from increasing to decreasing, and the minimum value is a change in physical distance between the target portion and the imaging device. Reduce the minimum value when it changes to increase;

Determining, by the terminal device, the action quality of the user's human body motion according to a comparison result of the distance maximum value corresponding to the maximum distance corresponding to the standard action and a comparison result of the distance minimum value and the minimum distance corresponding to the standard action Quantity and notify the user.

The above design provides an automated way to assess the quality of motion.

In a third aspect, the embodiment of the present application provides a counting device for human motion, including a camera and a processor;

The camera is configured to collect a picture of a user doing body motion;

The processor is configured to start the camera in response to a user-triggered instruction for turning on a motion count for a human body; and monitor the user to perform a human body through the camera when the camera is aligned with a target portion of the user a screen of motion; determining, once each time the target portion meets a condition change ratio of the screen, increasing the number of times of movement of the user's body, the ratio change condition being that the target portion occupies the screen The change in the ratio changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing; after the camera detects that the movement of the human body is stopped, the movement of the human body is finally Notify the user of the number of times.

In a possible design, the processor is further configured to: in response to a user-triggered instruction to record a standard motion of the human motion, before the user monitors a screen of the human motion by the camera; When the camera is aligned with the target portion of the user, the user monitors the screen of the standard motion of the human body movement by the camera; and records the maximum proportion and the minimum ratio of the target portion of the user corresponding to the standard action. Determining, when each of the target parts accounts for a ratio change condition of the picture, determining a maximum value of the ratio and a ratio minimum value that occur when the ratio change condition is satisfied, the ratio maximum value being that the target part accounts for a maximum value when the scale change of the screen changes from an increase to a decrease, wherein the minimum value is a minimum value when the target portion accounts for a change in the ratio of the screen from a decrease to an increase; The comparison result of the maximum ratio corresponding to the standard action, and the comparison result of the minimum ratio of the ratio minimum value and the standard action Determining the quality of operation of the body movement of the user, and notifies the user.

In a possible design, the device may further comprise a display device or a speaker;

The processor displays to the user through the display interface of the display device when notifying the user; or notifies the user through the speaker.

In a fourth aspect, the embodiment of the present application further provides a counting device for human motion, including an imaging device and a processor;

The imaging device is configured to monitor a physical distance change between a target part of the user and the imaging device;

The processor is configured to start the imaging device in response to a user-triggered instruction for turning on a motion count for a human body; and monitor the image by the imaging device when the imaging device is aligned with the target portion a change in the physical distance between the target portion and the imaging device; when determining a distance change condition that satisfies the physical distance between the target portion and the imaging device once, the number of times the human body movement of the user is increased once The distance change condition is that the physical distance change between the target portion and the imaging device is changed from increasing to decreasing, or the physical distance between the target portion and the imaging device is changed from decreasing After the movement of the human body is stopped by the imaging device, the number of times the final body movement is finally notified to the user.

In one possible design, the imaging device is a focusing camera, or the imaging device includes a camera and a ranging aid.

In a possible design, the processor is further configured to: in response to a user-triggered instruction to record a standard motion of the human motion; when the camera device is aligned with a target portion of the user, The camera device monitors a distance change between the target portion and the camera device when the user performs the standard action of the human body motion; and records a maximum distance between the target portion and the camera device corresponding to the standard action And the minimum distance; Determining a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied, when the distance change condition of the physical distance between the target portion and the imaging device is once, the distance maximum value is the target portion and a maximum value when the physical distance between the imaging devices changes from increasing to decreasing, the minimum value being a change in physical distance between the target portion and the imaging device from a decrease to an increase a minimum value; determining, according to a comparison result of the distance maximum value and a maximum distance corresponding to the standard action, and a comparison result of the distance minimum value and a minimum distance corresponding to the standard action, determining an action quality of the user's body motion, and notifying To the user.

In a fifth aspect, the embodiment of the present application provides a counting device for human body motion, the device is applied to a terminal device including a camera, and the device includes:

a triggering module, configured to start the camera in response to a user-triggered instruction for turning on a motion count for a human body;

a monitoring module, configured to monitor, by the camera, a picture of the human body movement when the camera is aligned with the target portion of the user;

a counting module, configured to increase the number of times of the human body motion of the user once every time the target part meets the condition change condition of the screen, and the ratio change condition is that the target part occupies the screen The change in the proportion changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing;

The notification module is configured to notify the user of the number of times the final body movement is performed after the movement of the human body is stopped by the camera.

In a possible design, the triggering module is further configured to respond to a user-triggered instruction for recording a standard motion of the human motion;

The monitoring module is further configured to monitor, by the camera, a screen of a standard action of the user to perform the human body motion when the camera is aligned with a target portion of the user;

And a recording module, configured to record a maximum proportion and a minimum ratio of the target part of the user corresponding to the standard action to the picture;

a quality evaluation module, configured to determine a ratio maximum value and a ratio minimum value that occur when the ratio change condition of the target portion is satisfied once the target portion is satisfied, and the ratio maximum value is a maximum value at which the target portion occupies a change in the ratio of the picture from an increase to a decrease, and the minimum value of the target portion is a minimum value at which the change in the ratio of the target portion to the picture changes from decreasing to increasing; Determining a comparison result of a maximum ratio of a maximum value corresponding to a standard action, and a comparison result of a minimum ratio of the ratio minimum value and a standard action, determining an action quality of the human body motion of the user;

The notification module is further configured to notify the user of the motion quality of the user's human motion.

In a sixth aspect, the embodiment of the present application provides a counting device for moving a human body, and the device is applied to a terminal device including an imaging device, including:

a triggering module, configured to start the imaging device in response to a user-triggered instruction for turning on a motion count for a human body;

a monitoring module, configured to monitor, by the imaging device, a change in a physical distance between the target portion and the imaging device when the imaging device is aligned with a target portion of the user;

a counting module, configured to determine a distance between a physical distance between the target portion and the imaging device every time When the condition is changed, the number of times of the human body movement of the user is increased once, the distance change condition is that the physical distance change between the target part and the image capturing apparatus is changed from increasing to decreasing, or the target part is changed. The physical distance change from the imaging device changes from decreasing to increasing;

The notification module is configured to notify the user of the number of times the final body movement is performed after the movement of the human body is stopped by the imaging device.

The monitoring module is further configured to: when the camera device is aligned with the target portion of the user, when the camera device monitors a standard motion of the user to perform the human body motion, the target portion and the camera device The distance between them changes;

The device also includes:

a recording module, configured to record a maximum distance and a minimum distance between the target part corresponding to the standard action and the imaging device;

a quality evaluation module, configured to determine a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied, each time a distance change condition that satisfies a physical distance between the target portion and the imaging device is determined The maximum distance is a maximum value when the physical distance between the target portion and the imaging device changes from increasing to decreasing, and the minimum value is a physical distance between the target portion and the imaging device. Determining the minimum value when the change is changed from decreasing to increasing; determining the user according to a comparison result of the maximum distance of the distance maximum value corresponding to the standard action, and a comparison result of the minimum distance of the distance minimum value and the standard action The quality of the movement of the human body;

In a seventh aspect, the embodiment of the present application provides a computer readable storage medium, where the software program is stored in a computer readable storage medium, and the software program can implement the above when being read and executed by one or more processors method.

DRAWINGS

FIG. 1 is a schematic structural diagram of a mobile phone according to an embodiment of the present application;

2 is a flowchart of a first human body motion counting method according to an embodiment of the present application;

3 is a flowchart of a first push-up counting method according to an embodiment of the present application;

4 is a schematic diagram of performing push-up counting by using a terminal device according to an embodiment of the present application;

FIG. 5A is a schematic diagram of a screen collected by a camera corresponding to a in FIG. 4 according to an embodiment of the present application; FIG.

FIG. 5B is a schematic diagram of a screen collected by a camera corresponding to b in FIG. 4 according to an embodiment of the present application; FIG.

FIG. 6 is a schematic diagram of a proportion change of a target part in a screen when a user performs push-ups according to an embodiment of the present application;

FIG. 7 is a flowchart of a method for evaluating a quality of a first push-up motion according to an embodiment of the present application;

FIG. 8 is a flowchart of a second human body motion counting method according to an embodiment of the present application;

FIG. 9 is a flowchart of a second method for counting push-ups according to an embodiment of the present application;

FIG. 10 is a schematic diagram showing changes in physical distance between a target portion and an imaging device when a user performs push-ups according to an embodiment of the present application;

FIG. 11 is a flowchart of a method for evaluating quality of a second push-up motion according to an embodiment of the present application;

FIG. 12 is a schematic diagram of a human body motion counting device according to an embodiment of the present application;

FIG. 13 is a schematic diagram of another human motion counting device according to an embodiment of the present application.

detailed description

The user is doing body exercises (such as push-ups, sit-ups, and high-lifting legs), and some parts of the body have ups and downs in certain points in the space. In some sports, some parts of the body have ups and downs on the ground. For example, when doing push-ups, the upper part of the face or head is close to the ground--away; for example, when raising legs, legs and feet Close to the ground-circulating approach -> away. For example, when doing sit-ups, the upper part of the face or head is close to the head area that the user sits down->away.

Through the above-mentioned discovery rule, the applicant captures the proximity and distance of the target part of the target part of the image of the target part of the body through the camera on the terminal device to realize the body movement count. In addition, you can also do a standard action before counting, and then evaluate the quality of the motion action by comparing each motion action with the standard action when actually doing the exercise.

Based on this, the embodiment of the present application provides a counting method and device for human body motion, which realizes human body motion counting through a terminal device, and provides an automated human body motion counting method, which is compared with manual counting. If the person counting is not focused, it is easy to count the error and reduce the counting error rate to some extent. The method and the device are based on the same inventive concept. Since the principles of the method and the device for solving the problem are similar, the implementation of the device and the method can be referred to each other, and the repeated description is not repeated.

The counting scheme for human motion in the embodiments of the present application may be implemented using various terminal devices having a camera, including but not limited to a personal computer, a server computer, a handheld or laptop device, a mobile device (such as a mobile phone, Mobile phones, tablets, personal digital assistants, media players, etc.), consumer electronics, small computers, mainframe computers, and more. The solution provided by the embodiment of the present application is specifically described below by taking a mobile phone as an example.

Referring to FIG. 1 , it is a schematic diagram of a hardware structure of a mobile phone applied to an embodiment of the present application. As shown in FIG. 1, the mobile phone 100 includes a display device 110, a processor 120, and a memory 130. The memory 130 can be used to store software programs and data, and the processor 120 executes various functional applications and data processing of the mobile phone 100 by running software programs and data stored in the memory 130. The memory 130 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as an image collection function, etc.), and the like; and the storage data area may be stored according to the use of the mobile phone 100. The created data (such as audio data, phone book, exchangeable image file EXIF, etc.). Moreover, memory 130 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The processor 120 is a control center of the mobile phone 100, and connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions and processing data of the mobile phone 100 by running or executing software programs and/or data stored in the memory 130. In order to monitor the mobile phone as a whole. The processor 120 may include one or more general-purpose processors, and may also include one or more DSPs (Digital Signal Processors) for performing related operations to implement the technical solutions provided by the embodiments of the present application.

The mobile phone 100 also includes a camera 160 for taking a photo or video, and the camera 160 monitors the user's picture of the human body movement. The camera 160 can be a normal camera or a focus camera.

The mobile phone 100 may also include an input device 140 for receiving input digital information, character information or contact touch/contactless gestures, and generating signal inputs related to user settings and function control of the handset 100, and the like. Specifically, in the embodiment of the present application, the input device 140 may include a touch panel 141. Touch panel 141, also called For the touch screen, a touch operation on or near the user can be collected (such as the user using a finger, a stylus, or the like on any suitable object or accessory on the touch panel 141 or on the touch panel 141), and according to a preset The program drives the corresponding connection device. Optionally, the touch panel 141 may include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 120 is provided and can receive commands from the processor 120 and execute them. For example, the user clicks an icon or a legend for opening the push-up count on the touch panel 141 with a finger, the touch detection device detects the signal brought by the click, and then transmits the signal to the touch controller. The touch controller then converts this signal into coordinates and sends it to the processor 120. The processor 120 determines the operation (on) for the icon or legend based on the coordinates and the type of the signal (click or double click), and then determines The memory space required for the operation is performed. If the occupied memory space is smaller than the free memory, the interface after the camera is started is displayed on the display panel 111 included in the display device in full screen, thereby implementing the push-up counting.

The touch panel 141 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 141, the input device 140 may further include other input devices 142, which may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like. One or more of them.

The display device 110 includes a display panel 111 for displaying information input by the user or information provided to the user, and various menu interfaces of the mobile phone 100, etc., which are mainly used to display the camera collected in the mobile phone 100 in the embodiment of the present application. Picture. Optionally, the display panel can be configured by using a liquid crystal display (English: Liquid Crystal Display, LCD for short) or OLED (Organic Light-Emitting Diode). In some other embodiments, the touch panel 141 can cover the display panel 111 to form a touch display screen.

In addition to the above, the handset 100 can also include a power source 150 for powering other modules. The handset 100 may also include one or more sensors 170, such as an accelerometer, a light sensor, a GPS sensor, an infrared sensor, a laser sensor, a position sensor or a lens pointing angle sensor, and the like. The mobile phone 100 may further include a radio frequency (RF) circuit 180 for performing network communication with the wireless network device, and may further include a WiFi module 190 for performing WiFi communication with other devices, and may further include a speaker 210 for Playing music, voice prompts or sounding prompts, etc., may also include ranging aid 220, which may be a laser transmitter, an infrared emitter, or the like.

The counting method for the human body motion provided by the embodiment of the present application may be implemented in the storage software program shown in FIG. 1 , and may be specifically executed by the processor 120 , and the terminal device may include a camera.

The following methods for counting human motion are provided in the embodiments of the present application:

The first type: through the target tracking technology, according to the proportion of the target part of the screen changes, so as to know the body's landing point, to achieve counting.

The second type: through the autofocus camera, capture the change in the distance between the target part and the terminal device, know the body's landing point, and achieve counting.

The third type: through the camera and the ranging aid, capture the change in the distance between the target part and the terminal device, know the body's landing point, and achieve counting.

For the first type, as shown in FIG. 2, the method for counting human motion provided by the embodiment of the present application includes:

S201. The terminal device starts the camera in response to a user-triggered instruction for turning on a motion count for a human body.

The instructions in the embodiment of the present application may be an instruction triggered by a user clicking a counting icon of a human motion, or an instruction generated by a user for a button for triggering a human body motion counting, and the like. The specific user may trigger an instruction for counting the movement of the human body triggered by the input device 140 or other input device 142.

S202. The terminal device monitors, by the camera, a picture of the user's body movement when the camera is aligned with the target part of the user.

Specifically, the terminal device is manually placed to align the camera with the target portion of the user.

S203. The terminal device increases the number of times of the human body motion of the user once when determining that the target part occupies a proportional change condition of the screen.

The proportional change condition is that the change in the proportion of the target portion in the picture changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing.

S204: After detecting, by the camera, the terminal device stops the movement of the human body, and notifies the user of the number of times the body movement is finally performed.

In addition, after the terminal device monitors that the movement of the human body is stopped by the camera, the user can immediately notify the user of the number of times of the final body movement, and can also save the first time, and receive an instruction triggered by the user for viewing the number of times of the human body movement. By giving the user. It is also possible to notify the user of the number of times the human body moves, set the time, and when the set time is reached, pass the number of human movements to the user, for example, every night at 10 o'clock.

In the following, the user performs push-ups as an example, and the first counting method is specifically described, as shown in FIG.

S301. The terminal device starts the camera in response to a user-triggered instruction for turning on a push-up count.

S302: The user manually places the terminal device to align the camera with the target portion of the user. See Figure 4. The embodiment of the present application takes the target part as a head as an example. The target part may also be a pattern on the face, lips, or blouse, and the like. The target part may be preset or may be selected by the user in the picture captured by the camera.

S303. The terminal device monitors, by using the camera, a picture of a user doing push-ups.

S304. The terminal device increases the number of times the user performs push-ups once the distance change condition of the picture is occupied every time the head is occupied.

The proportional change condition is that the change in the ratio of the head to the picture changes from increasing to decreasing, or the change in the proportion of the head occupying the picture changes from decreasing to increasing.

Referring to FIG. 5A and FIG. 5B, when the user's body is in the form of a in FIG. 4, the screen collected by the camera in the terminal device is as shown in FIG. 5A, and the user's body is in the form of b in FIG. The picture captured by the camera in the device is shown in Figure 5B. It can be seen from FIG. 5A and FIG. 5B that as the form of the user's body changes from the form of a in FIG. 4 to the form of a, the cycle is repeated, and the ratio of the head in the picture to the entire picture is determined by The increase becomes a decrease and then becomes an increase... The change in the proportion of the head in the specific picture to the entire picture is shown in the curve in FIG. When counting, it can be recorded once for each peak, that is, the ratio of the head in the picture to the entire picture is counted once from increasing to decreasing, and can also be recorded once for each trough, that is, the head in the picture. It is recorded once when the proportion of the entire screen changes from decreasing to increasing.

S305. The terminal device monitors, after the user stops performing the push-up by the camera, and performs the push-up of the end user. The number of times is recorded.

When it is determined that the condition for notifying the user is reached, the user is notified of the number of times the user does push-ups. The condition for notifying the user may be the set time, or an instruction to receive the number of times the user inquires about the push-ups, and the like.

In one possible design, the terminal device can also estimate the quality of the action that the user does for each push-up. Specifically, it can be implemented as follows, as shown in FIG. 7.

S701. The terminal device responds to a user-triggered instruction for recording a standard action of push-ups.

S702. The terminal device monitors, by the camera, a screen for performing a standard action of the push-up by the camera when the camera is aligned with the head of the user.

The user manually places the terminal device so that the camera is aimed at the user's head.

S703. The terminal device records a maximum proportion and a minimum ratio of a head of the user corresponding to the standard action to the screen.

S704. The terminal device determines, when each time the head meets a proportional change condition of the picture, determines a maximum value and a minimum value that occur when the proportional change condition is satisfied. The maximum value of the ratio is a maximum value when the ratio of the head to the picture changes from increasing to decreasing, and the minimum value of the ratio is that the proportion of the head in the picture changes from decreasing to increasing. The minimum value of the big time.

S705. The terminal device determines, according to a comparison result of the maximum ratio of the proportional maximum value corresponding to the standard action, and a comparison result of the minimum ratio of the proportional minimum value and the standard action, determining the motion quality of the user for performing push-ups. And notify the user.

For example, if the ratio of the head in the specific picture to the entire picture changes to the curve in FIG. 6, it is determined that the values of the adjacent peaks and troughs are respectively compared with the maximum ratio and the minimum ratio corresponding to the standard motion, thereby estimating the user. The quality of the movement of the human body. For example, the absolute value of the difference between the maximum ratio corresponding to the standard action and the standard action is not greater than the first threshold, and the absolute value of the difference between the minimum ratio of the proportional minimum and the standard action is not greater than the second threshold. Then it is judged as pass, otherwise it is judged as unqualified. For example, the first threshold and the second threshold are both 5%. When the user performs a push-up for a certain time, the maximum and minimum values determined by the terminal device are 48% and 13%, respectively. The maximum proportion and the minimum ratio corresponding to the standard action are 50% and 10%, respectively, and it is determined that the push-up is qualified.

Among them, it is estimated that the user's action quality for each push-up and the operation for counting the push-ups can be performed when the user performs push-ups.

For the second method, as shown in FIG. 8 , the method for counting human motion provided by the embodiment of the present application includes:

S801. The terminal device starts the focus camera in response to a user-triggered instruction for turning on a count of push-ups.

S802. The terminal device monitors, by the focus camera, a change in a physical distance between the target portion and the focus camera when the focus camera is aligned with a target portion of the user.

S803. The terminal device increases the number of times of the human body motion of the user once when determining a distance change condition that satisfies a physical distance between the target portion and the focus camera. The distance change condition is that a change in a physical distance between the target portion and the focus camera is changed from an increase to a decrease, or a change in a physical distance between the target portion and the focus camera is changed from a decrease to a decrease Increase.

S804, the terminal device notifies the user of the number of times the final body movement is performed after the movement of the human body is stopped by the camera.

The following also takes the user's push-ups as an example, and specifically describes the second counting method, as shown in FIG.

S901. The terminal device starts the focus camera in response to a user-triggered instruction for turning on a push-up count.

S902. The terminal device monitors, by the focus camera, a change in a physical distance between the target portion and the focus camera when the focus camera is aligned with a target portion of the user. In the embodiment of the present application, the target portion is a neck portion as an example.

S903. The terminal device increases the number of times the user performs push-ups once when determining a distance change condition that satisfies the physical distance between the neck and the focus camera. The distance change condition is that the physical distance change between the neck and the focus camera is changed from increasing to decreasing, or the physical distance change between the neck and the focus camera is changed from decreasing to Increase.

For example, when the user's body is in the form of a in FIG. 4, the focus camera in the terminal device determines that the physical distance between the neck and the focus camera is 55 cm, and the user's body is in the form of b in FIG. The focus camera in the middle determines the physical distance between the neck and the focus camera is 35 cm. As the user's body changes from the form of a in FIG. 4 to the form of b and then changes to the form of a, this cycle reciprocates, and it is determined that the physical distance between the neck and the focus camera changes from decreasing to increasing and then changing. Decrease..., see the curve in Figure 10 for the physical distance change between the specific neck and the focus camera. When counting, it can be recorded once for each peak, that is, when the physical distance between the neck and the focus camera is changed from increasing to decreasing, and once for each trough, that is, the neck and the focusing camera. The physical distance between them changes from decreasing to increasing.

S904. The terminal device records, after the user stops doing push-ups by the camera, records the number of final push-ups.

In one possible design, the terminal device can also estimate the quality of the action that the user does for each push-up. Specifically, it can be implemented as follows, as shown in FIG.

S1101: The terminal device responds to a user-triggered instruction to record a standard action of the user doing push-ups.

S1102. When the focus camera is aligned with the neck of the user, the terminal device monitors, between the neck and the focus camera, a standard motion of the user to perform the push-up by the focus camera. Distance changes.

S1103. The terminal device records a maximum distance and a minimum distance between the neck corresponding to the standard motion and the focus camera.

S1104. The terminal device determines, when each time the distance change condition of the physical distance between the neck and the focus camera is satisfied, determines a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied. The maximum distance is a maximum value when the physical distance between the neck and the focus camera changes from increasing to decreasing, and the minimum value is between the neck and the focusing camera. The change in physical distance changes from decreasing to increasing.

S1105. The terminal device determines, according to a comparison result of the distance maximum value and a maximum distance corresponding to the standard action, and a comparison result of the distance minimum value and a minimum distance corresponding to the standard action, determining, by the user, the push-up motion. Make quality and notify the user.

For example, the physical distance between the specific neck and the focusing camera is the curve in FIG. 10, and then the values of the adjacent peaks and troughs are respectively compared with the maximum distance and the minimum distance corresponding to the standard motion, thereby estimating the user's The quality of the movement of the human body. For example, the absolute value of the difference between the maximum distance corresponding to the standard action and the maximum distance is not greater than the third threshold, and the absolute value of the difference between the minimum distance and the minimum distance corresponding to the standard action is not greater than the fourth threshold. Then it is judged as pass, otherwise it is judged as unqualified. The third threshold and the fourth threshold may be the same or different. For example, if the third threshold and the fourth threshold are both 5 cm, the maximum and minimum distances determined by the terminal device are 54 cm and 38 cm, respectively, when the user performs a push-up. The maximum distance and the minimum distance corresponding to the standard motion are 55 cm and 35 cm, respectively, and it is determined that the push-up is qualified.

For the third and second counting, the counting method is the same, but the difference is that the capturing distance is changed from the focusing camera to the normal camera and the ranging aid. Therefore, for the third counting method, see Figure 8~ The counting method for the second type described in FIG. 10 will not be described again for the third type.

Based on the same inventive concept as the method embodiment, the embodiment of the present application further provides a counting device for human body motion, which is applied to a terminal device including a camera, and may be implemented by a processor 320 in the smart phone 300. As shown in FIG. 12, the apparatus may include:

The triggering module 1201 is configured to start the camera in response to a user-triggered instruction for turning on the counting of the human body motion;

The monitoring module 1202 is configured to monitor, by the camera, a picture of the user performing body motion when the camera is aligned with the target portion of the user;

The counting module 1203 is configured to increase the number of times of the human body motion of the user once every time the target part meets the proportional change condition of the screen, and the ratio change condition is that the target part accounts for the The change in the proportion of the picture changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing;

The notification module 1204 is configured to notify the user of the number of times the final body movement is performed after the movement of the human body is stopped by the camera.

In a possible implementation, the triggering module 1201 is further configured to: in response to a user-triggered instruction to record a standard motion of the human motion;

The monitoring module 1202 is further configured to monitor, by the camera, a screen of a standard action of the user to perform the human body motion when the camera is aligned with a target portion of the user;

The method further includes a recording module 1205, configured to record a maximum proportion and a minimum ratio of the target part of the user corresponding to the standard action to the screen;

The quality evaluation module 1206 is configured to determine, when each of the target parts meets the condition change condition of the screen, determine a maximum value and a minimum value that occur when the proportional change condition is satisfied, and the maximum value is a maximum value when the target portion occupies a change in the ratio of the screen from an increase to a decrease, and the ratio minimum value is a minimum value at which the target portion occupies a change in the ratio of the screen from a decrease to an increase; a comparison result of the maximum ratio of the proportional maximum value corresponding to the standard action, and a comparison result of the minimum ratio of the proportional minimum value and the standard action, determining the motion quality of the human body motion of the user;

The notification module 1204 is further configured to notify the user of the motion quality of the human body motion of the user.

The division of the modules in the embodiment of the present application is schematic, and is only a logical function division. In actual implementation, there may be another division manner. In addition, each functional module in each embodiment of the present application may be integrated into one processing. In the device, it can also be physically existed alone, or two or more modules can be integrated into one module. Integrated above The module can be implemented in the form of hardware or in the form of software functional modules.

When implemented in hardware, the hardware implementation of the terminal can be referred to FIG. 1 and its related description.

The camera 160 is configured to collect a picture of a user doing body motion;

The processor 120 is configured to start the camera in response to a user-triggered instruction for turning on a motion count for a human body; and monitor the user through the camera when the camera is aligned with a target portion of the user a picture of the movement of the human body; the number of times of the human body movement of the user is increased once, each time the target portion is satisfied to meet the condition change condition of the screen, and the ratio change condition is that the target part occupies the picture The change in the proportion changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing; after the camera detects that the movement of the human body is stopped, the human body motion is finally The number of times is notified to the user.

Wherein, when the number of times the body movement is finally notified to the user, the user may be notified to the user through the interface displayed by the display device 110, or may be voiced to the user through the speaker 210, or a prompt tone may be presented to the user.

The processor 120 is further configured to: in response to a user-triggered instruction to record a standard motion of the human motion, before the user monitors a screen of the human motion by the camera; the camera is aligned with the user When the target part is used, the user monitors the screen of the standard action of the user to perform the human body movement; records the maximum proportion and the minimum ratio of the target part of the user corresponding to the standard action; and determines that each time the content is satisfied When the target portion occupies the condition change condition of the picture, determining a maximum value of the ratio and a ratio minimum value that occur when the ratio change condition is satisfied, and the ratio maximum value is an increase in the proportion of the target portion in the picture. Changing to a maximum value at the time of decrease, the ratio minimum value being a minimum value when the target portion accounts for a change in the proportion of the picture from a decrease to an increase; according to the maximum ratio of the proportional maximum value corresponding to the standard action Comparing the result, and a comparison result of the minimum ratio of the ratio minimum value to the standard action, determining the user of the user Operation of the quality movement, and notifies the user.

When the quality of the motion of the human body motion is notified to the user, the user may be notified by the interface displayed by the display device 110, or may be voiced to the user through the speaker 210, or a prompt tone may be presented to the user.

Based on the same inventive concept as the method embodiment, the embodiment of the present application further provides a counting device for human body motion, which is applied to a terminal device including an imaging device, and may be implemented by the processor 120 in the mobile phone 100. The camera device can be a focus camera. Or a normal camera and a range finder. As shown in FIG. 13, the apparatus may include:

The triggering module 1301 is configured to start the imaging device in response to a user-triggered instruction for turning on the counting of the human body motion;

The monitoring module 1302 is configured to monitor, by the imaging device, a change in a physical distance between the target portion and the imaging device when the imaging device is aligned with a target portion of the user;

The counting module 1303 is configured to increase the number of times of the human body motion of the user once every time the distance change condition of the physical distance between the target part and the imaging device is satisfied, the distance change condition is a change in physical distance between the target portion and the imaging device is changed from increasing to decreasing, or a change in physical distance between the target portion and the imaging device is changed from decreasing to increasing;

The notification module 1304 is configured to notify the user of the number of times the final body movement is performed after the motion of the human body is stopped by the imaging device.

Optionally, the triggering module 1301 is further configured to: in response to a user-triggered instruction to record a standard motion of the human body motion;

The monitoring module 1302 is further configured to: when the camera device is aligned with a target portion of the user, When the imaging device monitors a standard action of the user to perform the human body motion, a distance between the target portion and the imaging device changes;

The device also includes:

a recording module 1305, configured to record a maximum distance and a minimum distance between the target part corresponding to the standard action and the imaging device;

a quality evaluation module 1306, configured to determine a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied, each time a distance change condition of the physical distance between the target portion and the imaging device is satisfied The maximum value of the distance is a maximum value when the physical distance between the target portion and the imaging device changes from increasing to decreasing, and the minimum value is the physical state between the target portion and the imaging device. Determining the minimum value when the distance change is changed from decreasing to increasing; determining the result according to a comparison result of the maximum distance of the distance maximum value corresponding to the standard action, and a comparison result of the distance minimum value and the minimum distance corresponding to the standard action The quality of the user's movement of the human body;

The notification module 1304 is further configured to notify the user of the motion quality of the user's human motion.

The division of the modules in the embodiment of the present application is schematic, and is only a logical function division. In actual implementation, there may be another division manner. In addition, each functional module in each embodiment of the present application may be integrated into one processing. In the device, it can also be physically existed alone, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

When implemented in hardware, the hardware implementation of the terminal device can refer to FIG. 1 and its related description.

The imaging device is configured to monitor a physical distance change between a target portion of the user and the imaging device.

The camera device can be a focus camera. Or the imaging device includes a normal camera and a ranging aid 220.

The processor 120 is configured to start the imaging device in response to an instruction triggered by a user for turning on a counting of a human body motion; and monitoring, by the imaging device, when the imaging device is aligned with the target portion a change in a physical distance between the target portion and the imaging device; and an increase in the number of times the human body movement of the user is increased each time a distance change condition of the physical distance between the target portion and the imaging device is satisfied Once, the distance change condition is that the physical distance change between the target portion and the imaging device is changed from increasing to decreasing, or the physical distance between the target portion and the imaging device is decreased by When the movement of the human body is stopped by the imaging device, the number of times the final movement of the human body is notified is notified to the user.

In a possible implementation, the processor 120 is further configured to: in response to a user-triggered instruction to record a standard motion of the human motion; when the imaging device is aligned with a target portion of the user When the camera device monitors a standard action of the user to perform the human body motion, a distance between the target portion and the image capturing device changes; and a record between the target portion corresponding to the standard action and the camera device is recorded a maximum distance and a minimum distance; determining a distance maximum condition and a distance minimum value that occur when the distance change condition is satisfied, each time a distance change condition that satisfies a physical distance between the target portion and the imaging device is determined The maximum distance is a maximum value when the physical distance between the target portion and the imaging device changes from increasing to decreasing, and the minimum value is a physical distance between the target portion and the imaging device. The minimum value when the change is changed from decreasing to increasing; the comparison result of the maximum distance corresponding to the standard action according to the maximum value of the distance, and From the comparison result of the minimum value and the minimum distance corresponding to the standard operation, the operation of determining the mass of the body movement of the user, and notifies the user.

Wherein, when the motion quality of the human body motion is notified to the user, the boundary displayed by the display device 110 can be displayed. The user is notified to the user, or the user is voiced through the speaker 210, or a prompt tone is presented to the user.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

It is apparent that those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, it is intended that the present invention cover the modifications and variations of the embodiments of the present invention.

Claims

A method for counting human motion, characterized in that the method is applied to a terminal device including a camera, comprising:

The terminal device starts the camera in response to an instruction triggered by the user for turning on the counting of the movement of the human body;

When the camera is aligned with the target part of the user, the terminal device monitors, by the camera, a picture of the user doing body motion;

The terminal device increases the number of times of the human body motion of the user once every time the target portion meets the condition change condition of the screen, and the ratio change condition is that the target portion occupies the screen The change in the ratio changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing;

After the terminal device detects that the human body motion stops by the camera, the terminal device notifies the user of the number of times the body motion is finally performed.
The method according to claim 1, wherein the method further comprises: before the terminal device monitors, by the camera, a screen of a human body movement, the method further comprising:

The terminal device is responsive to a user-triggered instruction to record a standard motion of the human body motion;

The terminal device monitors, by the camera, a screen of a standard action of the user to perform the human body motion when the camera is aligned with a target portion of the user;

The terminal device records a maximum proportion and a minimum ratio of the target part of the user corresponding to the standard action to the screen;

Determining, by the terminal device, a ratio maximum value and a ratio minimum value that are generated when the ratio change condition of the target portion is satisfied, and determining a ratio change condition that satisfies the proportional change condition, wherein the maximum value is the target portion a maximum value when the proportion change of the picture changes from an increase to a decrease, and the minimum value of the ratio is a minimum value when the target portion accounts for a change in the proportion of the picture from a decrease to an increase;

Determining, by the terminal device, the action quality of the human body motion according to a comparison result of the maximum ratio of the proportional maximum value corresponding to the standard action and a comparison result of the minimum ratio of the proportional minimum value and the standard action, and Notify the user.
A method for counting human motion, wherein the method is applied to a terminal device including an imaging device, including:

The terminal device starts the imaging device in response to an instruction triggered by the user for turning on the counting of the motion of the human body;

The terminal device monitors, by the imaging device, a change in a physical distance between the target portion and the imaging device when the imaging device is aligned with a target portion of the user;

The terminal device increases the number of times of the human body motion of the user once every time the distance change condition of the physical distance between the target portion and the imaging device is satisfied, and the distance change condition is the target portion a change in physical distance from the imaging device is changed from an increase to a decrease, or a change in a physical distance between the target portion and the image pickup device is changed from a decrease to an increase;

After the terminal device detects that the human body motion stops by the imaging device, the terminal device notifies the user of the number of times the human body motion is finally performed.
The method according to claim 3, wherein said image pickup device is a focus camera, or The imaging device includes a camera and a ranging aid.
The method according to claim 3 or 4, wherein the method further comprises: before the terminal device monitors a change in a physical distance between the target portion and the image capturing device by the image capturing device, the method further comprising:

The terminal device is responsive to a user-triggered instruction to record a standard motion of the human body motion;

When the imaging device is aligned with the target portion of the user, the terminal device monitors a distance between the target portion and the imaging device when the user performs a standard motion of the human body motion through the imaging device. Variety;

The terminal device records a maximum distance and a minimum distance between the target part corresponding to the standard action and the imaging device;

Determining, by the terminal device, a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied, each time the distance change condition that satisfies the physical distance between the target part and the imaging apparatus is determined, the distance being the largest a value is a maximum value when the physical distance between the target portion and the imaging device changes from increasing to decreasing, and the minimum value is a change in physical distance between the target portion and the imaging device. Reduce the minimum value when it changes to increase;

Determining, by the terminal device, a motion quality of the user's body motion according to a comparison result of the distance maximum value and a maximum distance corresponding to the standard motion, and a comparison result of the distance minimum value and a minimum distance corresponding to the standard motion, and Notify the user.
A counting device for human body movement, comprising: a camera and a processor;

The camera is configured to collect a picture of a user doing body motion;

The processor is configured to start the camera in response to a user-triggered instruction for turning on a motion count for a human body; and monitor the user to perform a human body through the camera when the camera is aligned with a target portion of the user a screen of motion; determining, once each time the target portion meets a condition change ratio of the screen, increasing the number of times of movement of the user's body, the ratio change condition being that the target portion occupies the screen The change in the ratio changes from increasing to decreasing, or the change in the proportion of the target portion in the picture changes from decreasing to increasing; after the camera detects that the movement of the human body is stopped, the movement of the human body is finally Notify the user of the number of times.
The device according to claim 6, wherein the processor is further configured to:

An instruction to record a standard motion of the human motion in response to a user trigger before monitoring, by the camera, a screen in which the user performs a human motion;

When the camera is aligned with the target portion of the user, the camera monitors a screen of the standard motion of the user to perform the human motion; and records the maximum proportion of the target portion of the user corresponding to the standard motion. And the minimum ratio;

Determining, when each of the target parts accounts for a ratio change condition of the screen, determining a maximum value and a ratio minimum value that occur when the proportional change condition is satisfied, wherein the maximum value is the target part occupying the screen a change in the ratio of the change from an increase to a decrease, the minimum value being a minimum value when the target portion accounts for a change in the ratio of the picture from a decrease to an increase;

The action quality of the human body motion of the user is determined according to a comparison result of the maximum ratio of the proportional maximum value corresponding to the standard action and a comparison result of the minimum ratio of the proportional minimum value and the standard action, and is notified to the user.
A counting device for human body movement, characterized in that it comprises an imaging device and a processor;

The imaging device is configured to monitor a physical distance change between a target part of the user and the imaging device;

The processor is configured to start the photographing in response to a user-triggered instruction for turning on a counting of a human body motion The image device monitors a change in a physical distance between the target portion and the image pickup device when the image pickup device is aligned with the target portion; and determines that the target portion is satisfied once each time When the distance of the physical distance between the imaging devices changes, the number of times of the human body movement of the user is increased once, and the distance change condition is that the physical distance between the target portion and the imaging device changes by an increase. Changing to decrease, or a change in physical distance between the target portion and the imaging device is changed from decreasing to increasing; after the imaging device detects that the movement of the human body is stopped, the human body is finally moved. Notify the user of the number of times.
The apparatus according to claim 8, wherein said image pickup apparatus is a focus camera, or said image pickup apparatus comprises a camera and a distance measuring assisting means.
The device according to claim 8 or 9, wherein the processor is further configured to:

An instruction to record a standard action of the human motion in response to a user trigger;

When the camera device is aligned with the target portion of the user, when the camera device monitors a standard action of the user to perform the body motion, a distance between the target portion and the camera device changes;

Recording a maximum distance and a minimum distance between the target portion corresponding to the standard action and the imaging device;

Determining, for each time a distance change condition that satisfies a physical distance between the target portion and the imaging device, determining a distance maximum value and a distance minimum value that occur when the distance change condition is satisfied, the distance maximum value being a maximum value when the physical distance between the target portion and the imaging device changes from increasing to decreasing, the minimum value being a change in physical distance between the target portion and the imaging device from decreasing to increasing The minimum value of the time;

And determining, according to a comparison result of the distance maximum value and a maximum distance corresponding to the standard action, and a comparison result of the distance minimum value and a minimum distance corresponding to the standard action, determining an action quality of the human body motion of the user, and notifying the user.
A computer readable storage medium, wherein the computer readable storage medium stores a software program that, when read and executed by one or more processors, implements any of claims 1 to 5 The method described in the item.