CN110102040B - Audio skipping rope counting method based on cross-correlation coefficient method - Google Patents
Audio skipping rope counting method based on cross-correlation coefficient method Download PDFInfo
- Publication number
- CN110102040B CN110102040B CN201910443779.7A CN201910443779A CN110102040B CN 110102040 B CN110102040 B CN 110102040B CN 201910443779 A CN201910443779 A CN 201910443779A CN 110102040 B CN110102040 B CN 110102040B
- Authority
- CN
- China
- Prior art keywords
- audio
- rope
- skipping
- cross
- correlation coefficient
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B5/00—Apparatus for jumping
- A63B5/20—Skipping-ropes or similar devices rotating in a vertical plane
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/17—Counting, e.g. counting periodical movements, revolutions or cycles, or including further data processing to determine distances or speed
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/806—Video cameras
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/808—Microphones
Abstract
The invention discloses an audio skipping rope counting method based on a cross-correlation coefficient method, which belongs to the technical field of intelligent fitness sports and comprises the following steps: 1) acquiring video data of rope skipping actions, and extracting audio data from the video data; 2) extracting the sampling frequency of the audio, and drawing an audio waveform diagram with time as an abscissa; 3) selecting sample sound, and calculating rope skipping times by adopting a cross-correlation coefficient method; 4) and outputting and displaying the counting result. The whole rope skipping process including rope skipping people can be recorded from a certain angle and a proper distance by utilizing high-definition video recording equipment (such as a smart phone). After a relatively stable video image is obtained, the audio information in the video image is analyzed and processed. The method achieves the purpose of judging the rope skipping times by identifying the sound of the rope contacting the ground, is not only accurate, but also has good application value because the video can be reproduced.
Description
Technical Field
The invention relates to the technical field of intelligent fitness sports equipment, in particular to an audio skipping rope counting method based on a cross-correlation coefficient method.
Background
The skipping rope is used as aerobic exercise suitable for both children and adults, can well exercise all joints of the whole body, and is also used as a necessary examination subject for physical examination of primary and secondary school students. At present, although a skipping rope capable of automatically counting exists, the counting times may be more than once in a short time, and in addition, the turning direction of the rope cannot be correctly judged, so that invalid scores in the skipping rope process cannot be automatically eliminated.
Chinese patent publication No. CN106512285A discloses a skipping rope and a skipping rope counting method, the skipping rope comprises a first handle, a second handle and a rope, the first handle comprises a handheld portion, a rotating mechanism, a speed sensor, a processor, an infrared emitter and an infrared receiver, a supporting portion for supporting the infrared receiver is arranged in the handheld portion, and the infrared emitter emits infrared beams towards the infrared receiver. The processor judges whether the rotating mechanism rotates for a circle according to the rotating speed data of the rotating mechanism, if the rotating mechanism rotates for a circle, whether the direction of the rotating mechanism for continuously cutting the infrared beam in the rotating process is consistent with the preset direction is continuously judged, if the direction is consistent, the rotating speed data is valid, and if the direction is opposite, the rotating speed data is invalid. Although the invention can realize accurate counting in the rope skipping process, the problems of inaccurate counting, incapability of counting reversely, incapability of lasting service time and the like exist.
Chinese patent publication No. CN109758716A discloses a rope skipping counting method based on sound information, which uses the pulse extreme point after sound filtering generated by the contact between the rope and the ground to calculate the rope skipping frequency, and there is a case where the counting error is caused by the sound interference of the contact between the shoes and the ground.
Disclosure of Invention
The invention aims to provide a rope skipping counting method based on sound information, which realizes automatic and accurate counting of rope skipping by applying mechanism analysis of auditory sense to human in the rope skipping counting process and analyzing and judging audio information by adopting a cross-correlation coefficient method.
In order to achieve the purpose, the audio skipping rope counting method based on the cross-correlation coefficient method provided by the invention comprises the following steps:
1) acquiring video data of rope skipping actions, and extracting audio data from the video data;
2) extracting the sampling frequency of the audio, and drawing an audio waveform diagram with time as an abscissa;
3) selecting sample sound, and calculating rope skipping times by adopting a cross-correlation coefficient method;
4) and outputting and displaying the counting result.
In the technical scheme, the whole rope skipping process including rope skipping people can be recorded from a certain angle and a proper distance by utilizing high-definition shooting and recording equipment (such as a smart phone and the like). After a relatively stable video image is obtained, the audio information in the video image is analyzed and processed. The method achieves the purpose of judging the rope skipping times by identifying the sound of the rope contacting the ground, is not only accurate, but also has good application value because the video can be reproduced.
Preferably, in step 2), the step of extracting the sampling frequency of the audio and drawing the audio waveform diagram with time as an abscissa comprises: and extracting the audio information of the rope skipping video as the tested audio to obtain a time domain oscillogram of the tested audio.
Preferably, in step 3), the step of selecting sample sounds and calculating the rope skipping times by using a cross-correlation coefficient method comprises the following steps:
3-1) taking an audio fragment of a single impact between a skipping rope and the ground as a sample audio x, taking an audio sequence in a skipping rope video as a tested audio y, and calculating a cross-correlation coefficient between the sample audio x and the tested audio y, wherein the calculation method of the cross-correlation function is as follows:
where N is the length of the longer signal sequence in x, y, and the asterisks indicate complex conjugation. m represents the number of sampling points in translation;
representing the result of point-by-point corresponding multiplication of the two sequences after the sequence x is kept still and the sequence y is shifted to the left by m sampling points;
and (4) representing the result of point-by-point corresponding multiplication of the two sequences after the sequence y is kept still and the sequence x is shifted to the left by m sampling points. The cross-correlation function is used for representing the correlation degree between the values of two signals x and y at any two different moments, and is an important judgment standard for judging whether the two signals x and y are correlated in a frequency domain. The cross-correlation coefficient is obtained by normalizing the result of the cross-correlation operation of the two signals x and y. A larger cross-correlation coefficient indicates a higher degree of correlation between the two signals.
3-2) selection of sample audio; in the selection of the sample audio, the sound fragment of single impact of the rope skipping and the ground is taken as the sample audio without the falling sound of people, so that the value of the cross-correlation coefficient corresponding to the falling sound in the cross-correlation coefficient method is small, and the influence of different sounds generated by different rope skiers when falling on the ground on the final rope skipping counting is eliminated;
considering the interference of various random sounds in the rope skipping process, when the sample audio is selected, n times of rope skipping and the sound segment of a single impact on the ground are randomly taken for weighted average, and n is equal to 3.
3-3) drawing a cross-correlation coefficient graph, setting a proper cross-correlation coefficient threshold (the threshold can be set to be 0.1), and counting the number n of times that the cross-correlation coefficient exceeds the set threshold, wherein n is the number of rope skipping.
Preferably, the minimum data number interval between two rope skipping counts is set. According to experience, the record of 1 minute rope skipping by a single person is 300, namely, each rope skipping period is more than 0.2s, and the sampling frequency of audio is Fs 44100, namely, at least 0.2X 44100-8820 data should be separated between two rope skipping counts.
Compared with the prior art, the invention has the beneficial effects that:
the audio skipping rope counting method based on the cross-correlation coefficient method can realize automatic accurate counting without manual work, can count immediately and play back videos, and particularly has stronger practicability along with the wide application of mobile video recording equipment.
Drawings
FIG. 1 is a flowchart of an audio rope skipping counting method according to an embodiment of the present invention;
FIG. 2 is a graph of audio waveforms plotted against time in accordance with an embodiment of the present invention;
FIG. 3 is a time domain waveform of a sample audio in an embodiment of the present invention;
FIG. 4 is a graph of the correlation coefficient between the sample audio and the measured audio according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described with reference to the following embodiments and accompanying drawings.
Examples
Referring to fig. 1 to 4, the audio skipping rope counting method based on the cross-correlation coefficient method of the embodiment includes the following steps:
and step S1, acquiring original video data of rope skipping action through the video equipment, inputting the original video data, and starting timing.
In step S2, sound data is extracted from the video data, the sampling frequency of the audio is extracted, and an audio waveform diagram with time as the abscissa is drawn. The time domain waveform diagram is obtained as shown in fig. 2.
And step S3, selecting sample sounds, and calculating the rope skipping times by adopting a cross correlation coefficient method. Firstly, the audio fragment of a single impact between 3 times of rope skipping and the ground is weighted and averaged to be used as a sample audio x, the time domain waveform of the sample audio x is shown in fig. 3, the audio sequence in the rope skipping video is used as the tested audio y, and the cross correlation coefficient between the sample audio x and the tested audio y is calculated. Then, a cross-correlation coefficient graph is drawn, as shown in fig. 4, a proper cross-correlation coefficient threshold (in this example, the threshold is set to 0.1) is set, and the number n of times that the cross-correlation coefficient exceeds the set threshold is counted, so that n is the number of rope skips.
Step S4, determine whether the rope is a valid skipping. According to experience, the record of 1 minute rope skipping by a single person is 300, namely, each rope skipping period is more than 0.2s, and the sampling frequency of audio is 44100, namely, at least 0.2 x 44100-8820 data should be separated between two rope skipping counts to be effective rope skipping.
In step S5, if the number of effective rope skips is positive, the count is increased by 1, and if the number of effective rope skips is not positive, the count is not positive.
And step S6, judging whether the counting time is exceeded, if so, ending the counting, otherwise, repeating the steps S2 to S12 for the next reference image.
In step S7, the count result is output and displayed.
Claims (4)
1. An audio skipping rope counting method based on a cross correlation coefficient method is characterized by comprising the following steps:
1) acquiring video data of rope skipping actions, and extracting audio data from the video data;
2) extracting the sampling frequency of the audio, and drawing an audio waveform diagram with time as an abscissa;
3) selecting sample sound, and calculating rope skipping times by adopting a cross-correlation coefficient method;
4) outputting and displaying a counting result;
in step 3), selecting sample sound, and calculating the rope skipping times by adopting a cross-correlation coefficient method, wherein the steps are as follows:
3-1) taking an audio fragment of a single impact between a skipping rope and the ground as a sample audio x, taking an audio sequence in a skipping rope video as a tested audio y, and calculating a cross-correlation coefficient between the sample audio x and the tested audio y;
3-2) taking a sound fragment of single impact of the skipping rope and the ground as sample audio; randomly taking the sound segments of the n-time rope skipping and the single impact on the ground for weighted average;
3-3) drawing a 'cross correlation coefficient' graph, setting a cross correlation coefficient threshold value, and counting the times m that the cross correlation coefficient exceeds the set threshold value, wherein m is the number of rope skipping;
in step 3-1), the cross-correlation function of the sample audio x and the tested audio y is:
wherein N is the length of the longer signal sequence in x, y, and the asterisks indicate complex conjugation; m represents the number of sampling points in translation;
representing the result of point-by-point corresponding multiplication of the two sequences after the sequence x is kept still and the sequence y is shifted to the left by m sampling points;
and (4) representing the result of point-by-point corresponding multiplication of the two sequences after the sequence y is kept still and the sequence x is shifted to the left by m sampling points.
2. The audio frequency skipping rope counting method according to claim 1, wherein in the step 3-2), n is 3.
3. The audio skipping rope counting method according to claim 1, wherein in step 3-3), the threshold value of the cross-correlation coefficient is set to 0.1.
4. The audio skipping rope counting method of claim 1, wherein at least 8820 data are set between two skipping rope counts.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910443779.7A CN110102040B (en) | 2019-05-24 | 2019-05-24 | Audio skipping rope counting method based on cross-correlation coefficient method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910443779.7A CN110102040B (en) | 2019-05-24 | 2019-05-24 | Audio skipping rope counting method based on cross-correlation coefficient method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110102040A CN110102040A (en) | 2019-08-09 |
| CN110102040B true CN110102040B (en) | 2020-06-30 |
Family
ID=67492352
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910443779.7A Active CN110102040B (en) | 2019-05-24 | 2019-05-24 | Audio skipping rope counting method based on cross-correlation coefficient method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110102040B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110975269B (en) * | 2019-12-18 | 2021-03-30 | 杭州电子科技大学 | Skipping rope counting table and counting method based on vibration waveform |
| CN111701216B (en) * | 2020-06-29 | 2021-07-23 | 广东小天才科技有限公司 | Rope skipping counting implementation method and system, wrist wearable device and storage medium |
| CN112044046B (en) * | 2020-08-28 | 2021-06-25 | 浙江大学 | Skipping rope counting method based on deep learning |
| CN115120926B (en) * | 2022-07-21 | 2023-11-03 | 九江学院 | A intelligent rope skipping ware for physical training |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108479042B (en) * | 2018-02-06 | 2019-06-18 | 浙江大学 | A kind of method of counting of bouncing the ball based on audio-frequency information |
| CN109758716B (en) * | 2019-03-26 | 2020-12-01 | 林叶蓁 | Rope skipping counting method based on sound information |
-
2019
- 2019-05-24 CN CN201910443779.7A patent/CN110102040B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110102040A (en) | 2019-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110102040B (en) | Audio skipping rope counting method based on cross-correlation coefficient method | |
| US11202594B2 (en) | Stimulus information compiling method and system for tests | |
| CN110152273B (en) | Rope skipping counting method based on intelligent target identification | |
| CN109758716B (en) | Rope skipping counting method based on sound information | |
| US9877661B2 (en) | Aural heart monitoring apparatus and method | |
| CN109939432B (en) | Intelligent rope skipping counting method | |
| CN107369359B (en) | A kind of vocal music pronunciation training system | |
| US20130006583A1 (en) | Sensor-Based Athletic Activity Measurements | |
| CN101589358A (en) | The adjusting gear of brain wave identification method, method and computer program | |
| CN109876416B (en) | Skipping rope counting method based on image information | |
| CN107358280B (en) | Book reading detection method and device for children | |
| CN107247974B (en) | Body-building exercise identification method and system based on multi-source data fusion | |
| JP2021518942A (en) | Skipping rope counting method | |
| CN112308037A (en) | Facial paralysis detection method based on visual perception and audio information | |
| CN112185191A (en) | Intelligent digital teaching model | |
| JP2006239132A (en) | Method of evaluating hitting sound of golf club head, program making computer execute the method, and system of evaluating hitting sound of golf club head | |
| Sindik | Performance indicators of the top basketball players: relations with several variables | |
| CN115798718B (en) | Cognitive test evaluation method and system | |
| US9148732B2 (en) | Method for testing hearing aids | |
| US11386917B1 (en) | Audio-based repetition counter system and method | |
| CN108479042B (en) | A kind of method of counting of bouncing the ball based on audio-frequency information | |
| US20150317647A1 (en) | Method And Apparatus For Correlating Biometric Responses To Analyze Audience Reactions | |
| Maheedhar et al. | StayFit: A wearable application for Gym based power training | |
| Fujita et al. | Auditory information reduces response time for ball rotation perception, increasing counterattack performance in table tennis | |
| Lesser et al. | Clap detection and discrimination for rhythm therapy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |