CN113378713A - Skip counting method and device, terminal equipment and storage medium - Google Patents

Skip counting method and device, terminal equipment and storage medium Download PDF

Info

Publication number
CN113378713A
CN113378713A CN202110649785.5A CN202110649785A CN113378713A CN 113378713 A CN113378713 A CN 113378713A CN 202110649785 A CN202110649785 A CN 202110649785A CN 113378713 A CN113378713 A CN 113378713A
Authority
CN
China
Prior art keywords
key point
count
state
video image
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110649785.5A
Other languages
Chinese (zh)
Other versions
CN113378713B (en
Inventor
魏萍
庄伯金
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Priority to CN202110649785.5A priority Critical patent/CN113378713B/en
Publication of CN113378713A publication Critical patent/CN113378713A/en
Application granted granted Critical
Publication of CN113378713B publication Critical patent/CN113378713B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computational Linguistics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Evolutionary Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Television Signal Processing For Recording (AREA)
  • Measurement Of Unknown Time Intervals (AREA)
  • Image Analysis (AREA)

Abstract

The application is applicable to the technical field of artificial intelligence, and provides a jump counting method, a jump counting device, terminal equipment and a storage medium, wherein the method comprises the following steps: acquiring a rope skipping video image according to a preset image acquisition period, extracting key point coordinates of a target key point from the rope skipping video image, and storing the key point coordinates into a key point coordinate set, wherein the abscissa of the key point coordinates is the acquisition time of the rope skipping video image, and the ordinate is the longitudinal height value of the target key point in the rope skipping video image; in response to the preset fitting condition, fitting by using the key point coordinates in the key point coordinate set to generate a parabola, and obtaining target parameters of the parabola; and according to the value of the target parameter, determining the adding state of the skip count, and updating the value of the skip count according to the adding state, wherein the adding state comprises a count increasing state and a count unchanging state. In addition, the application also relates to a block chain technology.

Description

Skip counting method and device, terminal equipment and storage medium
Technical Field
The present application relates to the field of artificial intelligence technologies, and in particular, to a skip counting method and apparatus, a terminal device, and a storage medium.
Background
The skipping rope is a relatively hot exercise at present, is a whole-body exercise integrating upper limbs, lower limbs, waist and hip exercise, and can effectively burn heat and reduce fat. When the rope skipping is carried out by teenagers, the strength of bones can be increased, the growth of bone cells is promoted, and the growth of high can be promoted.
In practical application, a user can shoot a rope skipping video through a shooting device, such as a mobile phone, and then count jumps in the rope skipping video in a mode of watching the rope skipping video by naked eyes. The skipping counting in the skipping rope video is counted in a mode of being observed by naked eyes, the efficiency is low, and errors are easy to occur.
Disclosure of Invention
In view of this, embodiments of the present application provide a skip counting method, an apparatus, a terminal device, and a storage medium, so as to solve the problems that in the related art, the skip counting in a skipping rope video is counted in a manner of being viewed by naked eyes, the efficiency is low, and errors are easy to occur.
A first aspect of an embodiment of the present application provides a hop count method, including:
acquiring a rope skipping video image according to a preset image acquisition period, extracting key point coordinates of a target key point from the rope skipping video image, and storing the key point coordinates into a key point coordinate set, wherein the abscissa of the key point coordinates is the acquisition time of the rope skipping video image, and the ordinate is the longitudinal height value of the target key point in the rope skipping video image;
in response to the preset fitting condition, fitting by using the key point coordinates in the key point coordinate set to generate a parabola, and obtaining target parameters of the parabola;
and according to the value of the target parameter, determining the adding state of the skip count, and updating the value of the skip count according to the adding state, wherein the adding state comprises a count increasing state and a count unchanging state.
Further, extracting the key point coordinates of the target key point from the rope skipping video image comprises the following steps:
inputting the skipping rope video image into a pre-trained key point prediction model to obtain a key point set aiming at the skipping rope video image;
and taking the acquisition time of the rope skipping video image as an abscissa, and taking the longitudinal height value of the target key point in the key point set in the rope skipping video image as an ordinate to obtain the key point coordinate of the target key point.
Further, determining the adding state of the skip count according to the value of the target parameter includes:
if the value of the target parameter belongs to a preset range and the target parameter is the target parameter of the parabola obtained by first fitting, determining that the adding state is a counting increasing state;
and if the value of the target parameter belongs to the preset range and the target parameter is a target parameter of a parabola obtained by non-first fitting, determining that the adding state is a counting increasing state when the polarity of the value of the target parameter obtained by fitting at the last moment is opposite to the polarity of the value of the target parameter.
Further, updating the value of the skip count according to the adding state, including:
if the adding state is a count increasing state, the value of the skip count is increased by 1, and if the adding state is a count unchanged state, the value of the skip count is unchanged.
Further, the method further comprises:
and updating the coordinate set of the key point according to the adding state of the skip count.
Further, updating the set of keypoint coordinates according to the status of addition of the hop count comprises:
if the adding state of the skip count is a count increasing state, clearing the coordinate set of the key point;
and if the adding state of the skip count is the count unchanged state, deleting the earliest stored key point coordinate in the key point coordinate set.
Further, fitting conditions are preset, and include at least one of the following: receiving a fitting instruction; reaching a fitting period; the number of the key point coordinates in the key point coordinate set is greater than or equal to a preset number, and the preset number is greater than or equal to three.
A second aspect of an embodiment of the present application provides a skip counting apparatus, including:
the system comprises an information acquisition unit, a rope skipping video image acquisition unit and a key point coordinate acquisition unit, wherein the information acquisition unit is used for acquiring a rope skipping video image according to a preset image acquisition period, extracting a key point coordinate of a target key point from the rope skipping video image and storing the key point coordinate into a key point coordinate set, the abscissa of the key point coordinate is the acquisition time of the rope skipping video image, and the ordinate of the key point coordinate is the longitudinal height value of the target key point in the rope skipping video image;
the information fitting unit is used for generating a parabola by adopting key point coordinate fitting in the key point coordinate set in response to the preset fitting condition, so as to obtain target parameters of the parabola;
and the count updating unit is used for determining the adding state of the skip count according to the value of the target parameter and updating the value of the skip count according to the adding state, wherein the adding state comprises a count increasing state and a count unchanging state.
A third aspect of embodiments of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the terminal device, where the processor implements the steps of the hop counting method provided in the first aspect when executing the computer program.
A fourth aspect of the embodiments of the present application provides a storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of the skip counting method provided in the first aspect.
The jump counting method, the jump counting device, the terminal equipment and the storage medium have the following beneficial effects that: in the process of rope skipping, each time of skipping is approximately a parabola with a downward opening along with the change of time, target key points of a rope skipping person, such as shoulder key points, are fitted with part or all of key point coordinates of a corresponding key point coordinate set to generate the parabola, so that the rope skipping process can be accurately described, the increase condition of the skipping count is determined by analyzing target parameters of the parabola obtained by fitting, and the skipping count can be quickly and accurately performed.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the embodiments or the related technical descriptions will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a flowchart of an implementation of a skip counting method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a theoretical hopping waveform provided by an embodiment of the present application;
FIG. 3 is a schematic diagram of an actual skip waveform provided by an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating a distribution of key points of a human body according to an embodiment of the present disclosure;
fig. 5 is a block diagram illustrating a structure of a skip counting apparatus according to an embodiment of the present disclosure;
fig. 6 is a block diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The hop count method according to the embodiment of the present application may be executed by a control device or a terminal (hereinafter referred to as a "terminal device"). When the jump counting method is executed by the terminal device, the execution subject is the terminal device.
Referring to fig. 1, fig. 1 shows a flowchart of an implementation of a skip counting method according to an embodiment of the present application, including:
step 101, acquiring a rope skipping video image according to a preset image acquisition period, extracting key point coordinates of a target key point from the rope skipping video image, and storing the key point coordinates into a key point coordinate set.
The key point coordinates are, in general, coordinates of the target key point. The abscissa of the key point coordinate is the acquisition time of the rope skipping video image, and the ordinate is the longitudinal height value of the target key point in the rope skipping video image.
The preset image capturing period is generally a preset period for capturing an image. In practice, since the duration of one jump period is usually short, the preset image capturing period is usually small, and may be 0.1 second, 0.05 second, etc. It should be noted that, since each person can jump at about 100-.
The target key points are usually preset human key points. As an example, the target key point may be a hip key point, a shoulder key point, or the like.
The execution main body can acquire the skipping rope video image from the skipping rope video which is currently recorded or the skipping rope video which is recorded according to the preset image acquisition period. Then, the executing body may extract the key point coordinates of the target key point from the rope skipping video image. As an example, if the target key point is a shoulder key point, the shoulder of the rope skipping person may wear a specific object, such as a red cloth head, so that the execution subject may recognize the worn red cloth head, recognize the target key point from the rope skipping video image, and extract the key point coordinates of the target key point. Finally, the execution subject may store the extracted key point coordinates into a key point coordinate set.
And 102, in response to the preset fitting condition, fitting by using the key point coordinates in the key point coordinate set to generate a parabola, and obtaining target parameters of the parabola.
The preset fitting condition is generally a preset condition for triggering the fitting operation.
Optionally, the preset fitting condition may include, but is not limited to, at least one of the following three items:
first, a fitting instruction is received.
Second, a fitting period is reached. The fitting period is usually a predetermined period value.
Here, the fitting period is generally greater than the preset image capturing period and less than one rope skipping period.
And thirdly, the number of the key point coordinates in the key point coordinate set is greater than or equal to a preset number, and the preset number is greater than or equal to three.
The target parameters are usually preset parameters, and in practice, the parameters of the parabola are usually three, namely a parameter a, a parameter b and a parameter c. The target parameter of the parabola is typically the parameter a.
In practical application, when a rope skipping person skips a rope, each skipping is approximately a downward opening parabola along with the change of time, for example, y is equal to at2+ bt + c, where a, b and c are parameters of parabolas. Theoretically, if one person keeps the same frequency and the same height and steadily jumps, the jumping waveform corresponding to the change of the jumping height along with the time is similar to the parabola shown in fig. 2. In practice, however, as the jumping force is consumed, the height of each rope jump is different, and the actual jumping waveform is shown in fig. 3.
Fig. 2 is a theoretical jump waveform provided in an embodiment of the present application, and fig. 3 is an actual jump waveform provided in an embodiment of the present application.
As can be seen from fig. 2 and fig. 3, in an actual application scenario, a peak corresponding to each jump may change significantly, and a distance between every two peaks may also change significantly. And the opening size of the parabola corresponding to each wave is almost the same, namely, the value of the parameter a of the parabola is basically the same. In fact, since the gravitational acceleration applied during the jumping process is kept unchanged, the values of the parameter a in the parabola corresponding to each wave are also approximately equal theoretically. Therefore, the parameter a is taken as the target parameter of the parabola, and the jump counting increasing condition is determined by analyzing the target parameter, so that the jump counting can be rapidly and accurately carried out.
Here, when the preset fitting condition is reached, the executing entity may generate a parabola by fitting using part or all of the coordinates of the key points in the set of key point coordinates, so that the target parameter in the parabola may be obtained.
And 103, determining the adding state of the skip count according to the value of the target parameter, and updating the value of the skip count according to the adding state.
Wherein the adding state comprises a count increasing state and a count unchanging state.
Here, since the value of the target parameter of the parabola corresponding to each jump is substantially unchanged and the values of the target parameters corresponding to each rope jump are substantially the same when skipping the rope, the execution main body may determine the adding state of the jump count by analyzing the values of the target parameters. For example, if the value of the target parameter is significantly greater than the value of the target parameter corresponding to the rope skipping action, the adding state of the skip count may be determined to be a count-unchanged state.
In the method provided by the embodiment, in the process of rope skipping, each skipping is nearly a parabola with a downward opening along with the change of time, and the target key points of the rope skipping person, such as the shoulder key points, and part or all of the key point coordinates of the corresponding key point coordinate set are fitted to generate the parabola, so that the accurate description of the rope skipping process can be realized, therefore, the target parameters of the parabola obtained by fitting are analyzed to determine the skip count increase condition, and the skip count can be quickly and accurately performed.
In some optional implementations of this embodiment, extracting the key point coordinates of the target key point from the rope skipping video image includes:
firstly, inputting a skipping rope video image into a pre-trained key point prediction model to obtain a key point set aiming at the skipping rope video image. Namely, a set of coordinates of each key point in the skipping rope video image is obtained.
The key point prediction model can be used for analyzing the corresponding relation between the image and the human posture key points. In practice, the keypoint prediction model may be a model obtained by training an initial model (e.g., a Convolutional Neural Network (CNN), a residual error Network (ResNet), etc.) by using a machine learning method based on a training sample.
Fig. 4 is a schematic distribution diagram of key points of a human body according to an embodiment of the present application. As shown in fig. 4, there may be 17 key points, which may be numbered 0-16 in sequence, and the positions indicated by 0-16 may be: 0-nose, 1-left eye, 2-right eye, 3-left ear, 4-right ear, 5-left shoulder, 6-right shoulder, 7-left elbow, 8-right elbow, 9-left wrist, 10-right wrist, 11-left crotch joint, 12-right crotch joint, 13-left knee, 14-right knee, 15-left ankle, 16-right ankle.
Here, the rope skipping video image is input to the key point prediction model, and a key point set for the rope skipping video image can be obtained. In the set of keypoints, 17 keypoints may be included.
And then, taking the acquisition time of the rope skipping video image as an abscissa, and taking the longitudinal height value of the target key point in the rope skipping video image in the key point set as an ordinate to obtain the key point coordinate of the target key point.
Here, the target keypoints may be shoulder keypoints, e.g., may be the keypoints numbered 5 as shown in fig. 4. The execution main body can directly take the acquisition time of the rope skipping video image as an abscissa and take the longitudinal height value of the target key point in the rope skipping video image as an ordinate to obtain the key point coordinate of the target key point.
In the implementation mode, the key point prediction model is a pre-trained neural network model, the rope skipping video image is directly input into the key point prediction model to carry out key point detection, then the longitudinal height value corresponding to the longitudinal coordinate of one key point obtained through detection is directly used as a longitudinal coordinate, the acquisition time of the rope skipping video image is used as a horizontal coordinate, and therefore the key point coordinate of the target key point is obtained. The method can be used for directly extracting the key point coordinates of the target key points from the rope skipping video image, and is convenient, practical and high in accuracy.
In some optional implementation manners of this embodiment, determining an addition state of the skip count according to a value of the target parameter includes: and if the value of the target parameter belongs to the preset range and the target parameter is the target parameter of the parabola obtained by first fitting, determining that the adding state is a counting increasing state. And if the value of the target parameter belongs to the preset range and the target parameter is a target parameter of a parabola obtained by non-first fitting, determining that the adding state is a counting increasing state when the polarity of the value of the target parameter obtained by fitting at the last moment is opposite to the polarity of the value of the target parameter.
The preset range is generally a value range of a target parameter of a parabola obtained by fitting the rope skipping action. In practice, the values of the target parameters are usually small. In practice, when the abscissa of the key point is measured in milliseconds and the ordinate is the number of pixels, the preset range may be 2 × 10-3To 4X 10-3
Here, if the value of the currently obtained target parameter belongs to a preset range and the target parameter is the first target parameter obtained by fitting the rope skipping video, the adding state is determined to be a count increasing state.
In addition, if the value of the currently obtained target parameter belongs to the preset range, but the target parameter is not the first target parameter obtained by fitting, the polarity of the value of the target parameter obtained by fitting at the last moment is continuously analyzed. The adding state is determined to be a count increasing state only when the polarity of the value of the target parameter at the previous moment is opposite to the polarity of the value of the target parameter at the current moment.
For example, if the polarity of the value of the target parameter at the previous time is positive, the polarity of the value of the target parameter at the current time is negative, and the polarities of the values are opposite to each other, at this time, it may be determined that the adding state is a count increasing state. On the contrary, if the polarity of the value of the target parameter at the previous time is negative, the polarity of the value of the target parameter at the current time is negative, and the polarities of the value of the target parameter at the current time and the polarity of the value of the target parameter at the current time are the same, at this time, it can be determined that the adding state is a count-unchanged state.
It should be noted that, since the parabola generated by fitting the point of the last jump descending stage and the current jump starting stage is usually open upward, the polarity of the value of the parameter a is positive. And when the value polarity of the last parameter a is positive and the value polarity of the current parameter a is negative, the last jump is finished and a new jump is started, and at the moment, the adding state is determined as a counting increasing state, so that the jump counting can be more accurately carried out.
In an optional implementation manner of each embodiment of the present application, the updating, according to the addition state, a value of the skip count may include: if the adding state is a count increasing state, the value of the skip count is increased by 1, and if the adding state is a count unchanged state, the value of the skip count is unchanged.
Here, the skip count is updated according to the addition state, and accurate skip counting can be realized.
In an optional implementation manner of various embodiments of the present application, the method for counting hops may further include: and updating the coordinate set of the key point according to the adding state of the skip count.
Here, the execution body may update the key point coordinate set according to the addition state of the skip count, thereby realizing more accurate skip count.
Optionally, the updating the coordinate set of the key point according to the adding state of the skip count may include: and if the adding state of the skip count is a count increasing state, clearing the coordinate set of the key point. And if the adding state of the skip count is the count unchanged state, deleting the earliest stored key point coordinate in the key point coordinate set.
Here, when the addition state is the count-up state, indicating that it is currently one jump, it is currently necessary to increase the jump count. At this point, the set of keypoint coordinates may be emptied and recording may be resumed. When the adding state is the count unchanged state, the adding state indicates that the adding state cannot be recorded as one jump at present, at this time, the earliest stored key point coordinate in the key point coordinate set can be deleted, the key point coordinate at the current moment is added, and the analysis is continued until the increase of the jump count is met. More accurate skip counting is realized.
In all embodiments of the application, the terminal device may collect the rope skipping video image according to a preset image collection period, extract the key point coordinates of the target key point from the rope skipping video image, and store the key point coordinates into the key point coordinate set. The abscissa of the key point coordinate is the acquisition time of the rope skipping video image, and the ordinate is the longitudinal height value of the target key point in the rope skipping video image. And then, in response to the preset fitting condition, fitting by using the key point coordinates in the key point coordinate set to generate a parabola, so as to obtain target parameters of the parabola. And finally, determining the adding state of the skip count according to the value of the target parameter, and updating the value of the skip count according to the adding state. Wherein the adding state comprises a count increasing state and a count unchanged state. The terminal equipment can upload the finally obtained value of the hop count to the block chain, so that the safety and the fair transparency to the user can be ensured. The user equipment may download the data information from the blockchain to verify whether the data information is tampered. The blockchain referred to in this example is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, encryption algorithm, and the like. The block chain (Blockchain), which is essentially a decentralized storage server, is a string of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, which is used for verifying the validity (anti-counterfeiting) of the information and generating a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
Referring to fig. 5, fig. 5 is a block diagram illustrating a skip counting apparatus 500 according to an embodiment of the disclosure. The skip counting device in this embodiment comprises units for performing the steps in the corresponding embodiment of fig. 1. Please refer to fig. 1 and related descriptions in the embodiment corresponding to fig. 1. For convenience of explanation, only the portions related to the present embodiment are shown. Referring to fig. 5, the skip counting apparatus 500 includes:
the information acquisition unit 501 is configured to acquire a rope skipping video image according to a preset image acquisition period, extract a key point coordinate of a target key point from the rope skipping video image, and store the key point coordinate into a key point coordinate set, where an abscissa of the key point coordinate is acquisition time of the rope skipping video image, and a ordinate of the key point coordinate is a longitudinal height value of the target key point in the rope skipping video image;
the information fitting unit 502 is configured to generate a parabola by fitting the key point coordinates in the key point coordinate set in response to reaching a preset fitting condition, and obtain target parameters of the parabola;
the count updating unit 503 is configured to determine an addition state of the skip count according to the value of the target parameter, and update the value of the skip count according to the addition state, where the addition state includes a count increase state and a count invariance state.
As an embodiment of the present application, the information collecting unit 501 is specifically configured to:
inputting the skipping rope video image into a pre-trained key point prediction model to obtain a key point set aiming at the skipping rope video image;
and taking the acquisition time of the rope skipping video image as an abscissa, and taking the longitudinal height value of the target key point in the key point set in the rope skipping video image as an ordinate to obtain the key point coordinate of the target key point.
As an embodiment of the present application, the count updating unit 503 is specifically configured to:
if the value of the target parameter belongs to a preset range and the target parameter is the target parameter of the parabola obtained by first fitting, determining that the adding state is a counting increasing state;
and if the value of the target parameter belongs to the preset range and the target parameter is a target parameter of a parabola obtained by non-first fitting, determining that the adding state is a counting increasing state when the polarity of the value of the target parameter obtained by fitting at the last moment is opposite to the polarity of the value of the target parameter.
As an embodiment of the present application, the count updating unit 503 is specifically configured to:
if the adding state is a count increasing state, the value of the skip count is increased by 1, and if the adding state is a count unchanged state, the value of the skip count is unchanged.
As an embodiment of the present application, the apparatus may further include a data updating unit (not shown in the figure). And the data updating unit is used for updating the coordinate set of the key point according to the adding state of the skip count.
As an embodiment of the present application, the data updating unit is specifically configured to:
if the adding state of the skip count is a count increasing state, clearing the coordinate set of the key point;
and if the adding state of the skip count is the count unchanged state, deleting the earliest stored key point coordinate in the key point coordinate set.
As an embodiment of the present application, the preset fitting condition includes at least one of the following: receiving a fitting instruction; reaching a fitting period; the number of the key point coordinates in the key point coordinate set is greater than or equal to a preset number, and the preset number is greater than or equal to three.
According to the device provided by the embodiment, in the process of rope skipping, each skipping is nearly a parabola with a downward opening along with the change of time, the target key points of a rope skipping person, such as the shoulder key points, and part or all of the key point coordinates of the corresponding key point coordinate set are fitted to generate the parabola, so that the accurate description of the rope skipping process can be realized, therefore, the target parameters of the parabola obtained through fitting are analyzed to determine the skip count increasing condition, and the skip count can be quickly and accurately performed.
It should be understood that, in the structural block diagram of the skip counting apparatus shown in fig. 5, each unit is used to execute each step in the embodiment corresponding to fig. 1, and each step in the embodiment corresponding to fig. 1 has been explained in detail in the above embodiment, and please refer to fig. 1 and the related description in the embodiment corresponding to fig. 1 specifically, which is not described again here.
Fig. 6 is a block diagram of a terminal device according to another embodiment of the present application. As shown in fig. 6, the terminal device 600 of this embodiment includes: a processor 601, a memory 602, and a computer program 603, such as a program of the jump counting method, stored in the memory 602 and executable on the processor 601. The processor 601, when executing the computer program 603, implements the steps in the embodiments of the jump counting methods described above, such as the steps 101 to 103 shown in fig. 1. Alternatively, when the processor 601 executes the computer program 603, the functions of the units in the embodiment corresponding to fig. 5, for example, the functions of the units 501 to 503 shown in fig. 5, are implemented, and please refer to the related description in the embodiment corresponding to fig. 5, which is not described herein again.
Illustratively, the computer program 603 may be partitioned into one or more units, which are stored in the memory 602 and executed by the processor 601 to complete the present application. One or more of the units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 603 in the terminal device 600. For example, the computer program 603 may be divided into an information acquisition unit, an information fitting unit, and a count update unit, each unit having the above specific functions.
The terminal device may include, but is not limited to, a processor 601, a memory 602. Those skilled in the art will appreciate that fig. 6 is merely an example of a terminal device 600 and does not constitute a limitation of terminal device 600 and may include more or less components than shown, or combine certain components, or different components, e.g., a turntable device may also include input output devices, network access devices, buses, etc.
The Processor 601 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 602 may be an internal storage unit of the terminal device 600, such as a hard disk or a memory of the terminal device 600. The memory 602 may also be an external storage device of the terminal device 600, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the terminal device 600. Further, the memory 602 may also include both internal and external memory units of the terminal device 600. The memory 602 is used to store computer programs and other programs and data required by the turntable device. The memory 602 may also be used to temporarily store data that has been output or is to be output.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated module, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. The computer readable storage medium may be non-volatile or volatile. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution media, and the like. It should be noted that the computer readable storage medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable storage media that does not include electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
The above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims (10)

1. A hop counting method, characterized in that the method comprises:
acquiring a rope skipping video image according to a preset image acquisition period, extracting a key point coordinate of a target key point from the rope skipping video image, and storing the key point coordinate into a key point coordinate set, wherein the abscissa of the key point coordinate is the acquisition time of the rope skipping video image, and the ordinate is the longitudinal height value of the target key point in the rope skipping video image;
in response to the preset fitting condition, fitting by using the key point coordinates in the key point coordinate set to generate a parabola, and obtaining target parameters of the parabola;
and determining the adding state of the skip count according to the value of the target parameter, and updating the value of the skip count according to the adding state, wherein the adding state comprises a count increasing state and a count unchanging state.
2. The skip counting method of claim 1, wherein said extracting key point coordinates of target key points from said skipping rope video image comprises:
inputting the skipping rope video image into a pre-trained key point prediction model to obtain a key point set aiming at the skipping rope video image;
and taking the acquisition time of the rope skipping video image as an abscissa, and taking the longitudinal height value of the target key point in the key point set in the rope skipping video image as an ordinate to obtain the key point coordinate of the target key point.
3. The hop counting method according to claim 1, wherein the determining the adding state of the hop count according to the value of the target parameter comprises:
if the value of the target parameter belongs to a preset range and the target parameter is a target parameter of a parabola obtained by first fitting, determining that the adding state is a counting increasing state;
and if the value of the target parameter belongs to a preset range and the target parameter is a target parameter of a parabola obtained by non-first fitting, determining that the adding state is a counting increasing state when the polarity of the value of the target parameter obtained by fitting at the last moment is opposite to the polarity of the value of the target parameter.
4. The hop count method according to claim 1, wherein said updating a value of the hop count according to the addition status comprises:
and if the adding state is a count increasing state, adding 1 to the value of the skip count, and if the adding state is a count unchanged state, keeping the value of the skip count unchanged.
5. The hop counting method according to claim 1, characterized in that the method further comprises:
and updating the coordinate set of the key point according to the adding state of the skip count.
6. The hop counting method according to claim 3, wherein said updating the set of keypoint coordinates according to the status of addition of the hop count comprises:
if the adding state of the skip count is a count increasing state, clearing the key point coordinate set;
and if the adding state of the skip count is a count-unchanged state, deleting the earliest stored key point coordinate in the key point coordinate set.
7. The hop counting method according to any one of claims 1 to 6, wherein the preset fitting conditions comprise at least one of: receiving a fitting instruction; reaching a fitting period; the number of the key point coordinates in the key point coordinate set is greater than or equal to a preset number, and the preset number is greater than or equal to three.
8. A hop counting device, characterized in that said device comprises:
the system comprises an information acquisition unit, a rope skipping video image acquisition unit and a key point coordinate acquisition unit, wherein the information acquisition unit is used for acquiring a rope skipping video image according to a preset image acquisition cycle, extracting a key point coordinate of a target key point from the rope skipping video image and storing the key point coordinate into a key point coordinate set, the abscissa of the key point coordinate is the acquisition time of the rope skipping video image, and the ordinate of the key point coordinate is the longitudinal height value of the target key point in the rope skipping video image;
the information fitting unit is used for generating a parabola by adopting the key point coordinate fitting in the key point coordinate set in response to the fact that a preset fitting condition is reached, and obtaining target parameters of the parabola;
and the count updating unit is used for determining the adding state of the skip count according to the value of the target parameter and updating the value of the skip count according to the adding state, wherein the adding state comprises a count increasing state and a count unchanging state.
9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
CN202110649785.5A 2021-06-10 2021-06-10 Skip counting method, device, terminal equipment and storage medium Active CN113378713B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110649785.5A CN113378713B (en) 2021-06-10 2021-06-10 Skip counting method, device, terminal equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110649785.5A CN113378713B (en) 2021-06-10 2021-06-10 Skip counting method, device, terminal equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113378713A true CN113378713A (en) 2021-09-10
CN113378713B CN113378713B (en) 2023-08-29

Family

ID=77573783

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110649785.5A Active CN113378713B (en) 2021-06-10 2021-06-10 Skip counting method, device, terminal equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113378713B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115282589A (en) * 2022-08-31 2022-11-04 深圳十米网络科技有限公司 Somatosensory game method based on rope skipping action
CN115361438A (en) * 2022-10-19 2022-11-18 山东远联信息科技有限公司 Service processing method and system for cloud computing and big data positioning

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103386181A (en) * 2013-07-25 2013-11-13 Tcl通讯(宁波)有限公司 Mobile terminal and rope skipping counting method adopting same
CN109737952A (en) * 2018-12-12 2019-05-10 安徽华米信息科技有限公司 Rope skipping data processing method, device and wearable device
WO2019244153A1 (en) * 2018-06-21 2019-12-26 Baseline Vision Ltd. Device, system, and method of computer vision, object tracking, image analysis, and trajectory estimation
US20200302187A1 (en) * 2015-07-17 2020-09-24 Origin Wireless, Inc. Method, apparatus, and system for people counting and recognition based on rhythmic motion monitoring
CN112634400A (en) * 2020-12-21 2021-04-09 浙江大华技术股份有限公司 Rope skipping counting method, terminal and computer readable storage medium thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103386181A (en) * 2013-07-25 2013-11-13 Tcl通讯(宁波)有限公司 Mobile terminal and rope skipping counting method adopting same
US20200302187A1 (en) * 2015-07-17 2020-09-24 Origin Wireless, Inc. Method, apparatus, and system for people counting and recognition based on rhythmic motion monitoring
WO2019244153A1 (en) * 2018-06-21 2019-12-26 Baseline Vision Ltd. Device, system, and method of computer vision, object tracking, image analysis, and trajectory estimation
CN109737952A (en) * 2018-12-12 2019-05-10 安徽华米信息科技有限公司 Rope skipping data processing method, device and wearable device
CN112634400A (en) * 2020-12-21 2021-04-09 浙江大华技术股份有限公司 Rope skipping counting method, terminal and computer readable storage medium thereof

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115282589A (en) * 2022-08-31 2022-11-04 深圳十米网络科技有限公司 Somatosensory game method based on rope skipping action
CN115361438A (en) * 2022-10-19 2022-11-18 山东远联信息科技有限公司 Service processing method and system for cloud computing and big data positioning
CN115361438B (en) * 2022-10-19 2023-02-28 山东远联信息科技有限公司 Service processing method and system for cloud computing and big data positioning

Also Published As

Publication number Publication date
CN113378713B (en) 2023-08-29

Similar Documents

Publication Publication Date Title
CN113378713A (en) Skip counting method and device, terminal equipment and storage medium
CN111815754B (en) Three-dimensional information determining method, three-dimensional information determining device and terminal equipment
CN107590473B (en) Human face living body detection method, medium and related device
CN111667420B (en) Image processing method and device
CN109803109B (en) Wearable augmented reality remote video system and video call method
CN106419821B (en) A kind of method and apparatus that joint inner structure is measured under arthroscope
KR20210027899A (en) Arrangement method for orthodontic treatment and orthodontic CAD system therefor
CN112101123B (en) Attention detection method and device
CN101165706B (en) Image processing apparatus and image acquisition method
CN109167922A (en) Image processing method, device and electronic equipment
CN108499111A (en) Game difficulty method of adjustment and Related product
CN107492074A (en) Image acquisition and processing method, device and terminal device
US8526673B2 (en) Apparatus, system and method for recognizing objects in images using transmitted dictionary data
KR20200042143A (en) Dancing room service system and method thereof
CN115227468B (en) Training method of intelligent artificial limb, intelligent artificial limb and storage medium
CN114470719B (en) Full-automatic posture correction training method and system
CN113678147A (en) Search method and information processing system
CN108053031A (en) A kind of deep learning system and deep learning recognition methods
CN115035608A (en) Living body detection method, device, equipment and system
CN114004974A (en) Method and device for optimizing images shot in low-light environment
CN109146471B (en) Code scanning payment method and device and intelligent equipment
CN113569606A (en) Motion signal processing method, motion signal processing device, computer equipment and readable storage medium
Kumar et al. Flaap: An open human activity recognition (har) dataset for learning and finding the associated activity patterns
CN110855891A (en) Method and device for adjusting camera shooting angle based on human body posture and robot
CN113658083B (en) Eyeball image noise elimination method, system, device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant