CN110102040A - A kind of audio rope skipping method of counting based on cross-correlation coefficient method - Google Patents

A kind of audio rope skipping method of counting based on cross-correlation coefficient method Download PDF

Info

Publication number
CN110102040A
CN110102040A CN201910443779.7A CN201910443779A CN110102040A CN 110102040 A CN110102040 A CN 110102040A CN 201910443779 A CN201910443779 A CN 201910443779A CN 110102040 A CN110102040 A CN 110102040A
Authority
CN
China
Prior art keywords
audio
rope
cross
correlation coefficient
counting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910443779.7A
Other languages
Chinese (zh)
Other versions
CN110102040B (en
Inventor
林峰
贺宇泽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201910443779.7A priority Critical patent/CN110102040B/en
Publication of CN110102040A publication Critical patent/CN110102040A/en
Application granted granted Critical
Publication of CN110102040B publication Critical patent/CN110102040B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B5/00Apparatus for jumping
    • A63B5/20Skipping-ropes or similar devices rotating in a vertical plane
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/17Counting, e.g. counting periodical movements, revolutions or cycles, or including further data processing to determine distances or speed
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/806Video cameras
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/808Microphones

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
  • Maintenance And Inspection Apparatuses For Elevators (AREA)

Abstract

The audio that the invention discloses a kind of based on cross-correlation coefficient method is skipped rope method of counting, belongs to intelligent body-building Motion Technology field, comprising: 1) video data for obtaining rope skipping movement extracts audio data from video data;2) sample frequency for extracting audio, draws using the time as the audio volume control figure of abscissa;3) sample audio is selected, rope skipping number is calculated using cross-correlation coefficient method;4) output and display counting result.The entire rope skipping process including rope skipping people is recorded from certain angle, suitable distance using high definition camera-shooting and recording device (such as: smart phone).After obtaining metastable video image, audio-frequency information therein is analyzed and processed.This method contacts the sound on ground by identification rope to reach the number of judgement rope skipping, and not only accurately, but also video can return modeling, has good application value.

Description

A kind of audio rope skipping method of counting based on cross-correlation coefficient method
Technical field
The present invention relates to intelligent body-building sports equipment technical fields, specifically, being related to a kind of based on cross-correlation coefficient method Audio skip rope method of counting.
Background technique
The rope skipping aerobic exercise suitable for people of all ages as one, can be such that each joint of whole body is taken exercise well, together When be also used as students in middle and primary schools' Physical Examination must examine subject.Although currently, having the rope skipping that can be counted automatically, due to the short time Interior counts can not correctly may judge the steering of rope more than once in addition, cause rope skipping during invalid achievement without Method excludes automatically.
Publication No. is that the Chinese patent literature of CN106512285A discloses a kind of rope skipping and method of counting of skipping rope, the rope skipping Including first handle, second handle and rope, first handle includes hand-held part, rotating mechanism, speed sensor, processor, red External transmitter and infrared remote receiver, are provided with the support portion for being used to support infrared remote receiver in hand-held part, and infrared transmitter is towards red Outer receiver emits infrared beams.Wherein, speed sensor is used to detect the revolving speed of rotating mechanism, and processor is according to rotating mechanism Rotary speed data judge whether rotating mechanism rotates a circle, if rotating a circle, continue to judge rotating mechanism during rotation Constantly whether the direction of cutting infrared beams and preset direction are consistent, if direction is consistent, the rotary speed data is effective, if direction On the contrary, then the rotary speed data is invalid.Although the present invention can be realized the accurate metering of rope skipping process, often exists and count not The problems such as it is accurate to reach, and is unable to counting in reverse, cannot be permanent using the time.
Publication No. is a kind of rope skipping counting side based on acoustic information disclosed in the Chinese patent literature of CN109758716A Method calculates rope skipping number using the filtered pulse extreme point of sound that rope and ground face contact generate, exists by shoes The case where causing miscount with the sound interference of ground face contact.
Summary of the invention
It is an object of the present invention to provide a kind of rope skipping method of counting based on acoustic information, this method is by jumping people The Analysis on Mechanism that sense of hearing sense organ is used in counting process of restricting is analyzed and determined audio-frequency information using cross-correlation coefficient method, come It realizes and automatic and accurate counting is carried out to rope skipping.
To achieve the goals above, it is provided by the invention based on cross-correlation coefficient method audio rope skipping method of counting include with Lower step:
1) video data for obtaining rope skipping movement, extracts audio data from video data;
2) sample frequency for extracting audio, draws using the time as the audio volume control figure of abscissa;
3) sample audio is selected, rope skipping number is calculated using cross-correlation coefficient method;
4) output and display counting result.
In above-mentioned technical proposal, using high definition camera-shooting and recording device (such as: smart phone), from certain angle, suitably Distance records the entire rope skipping process including rope skipping people.After obtaining metastable video image, to therein Audio-frequency information is analyzed and processed.This method contacts the sound on ground to reach the number of judgement rope skipping, no by identification rope It is only accurate, and video can return modeling, have good application value.
Preferably, extracting the sample frequency of audio in step 2), draw using the time as the audio volume control figure of abscissa Step are as follows: extract the audio-frequency information of rope skipping video as tested audio, obtain its time domain waveform.
Preferably, the step of selecting sample audio in step 3), calculating rope skipping number using cross-correlation coefficient method are as follows:
3-1) using the audio fragment hit with ground single of skipping rope as sample audio x, with the audio in video of skipping rope Sequence calculates the cross-correlation coefficient of sample audio x and tested audio y as tested audio y, and the calculation method of cross-correlation function is said It is bright as follows:
Wherein N is x, and the length of longer signal sequence in y, asterisk indicates complex conjugate.M indicates the sampled point of translation Number;Indicate that sequence x is remained stationary, after sequences y is moved to left m sample point, two sequences correspond to the knot being multiplied point by point Fruit;Indicate that sequences y remains stationary, after sequence x is moved to left m sample point, two sequences correspond to the knot being multiplied point by point Fruit.Cross-correlation function is for characterizing the degree of correlation of two signals x, y between the value of any two different moments, it is Two signals x, y in frequency domain whether a relevant important judgment criteria.Cross-correlation coefficient is to make mutual to two signals x, y What the result after closing operation was normalized.Cross-correlation coefficient is bigger, shows that the degree of correlation of two signals is higher.
3-2) sample audio is selected;In the selection of sample audio, with the sound clip hit with ground single of skipping rope As sample audio, and do not include people landing sound, can make in cross correlation counting method, with landing sound corresponding to The value very little of cross-correlation coefficient, the influence that the sound difference generated when so that different rope skipping persons being landed counts last rope skipping It excludes;
In view of the interference of the various random sounds during rope skipping, in selected sample audio, take at random n times rope skipping with The sound clip that ground single is hit is weighted and averaged, and can use n=3.
" cross-correlation coefficient " figure 3-3) is drawn out, is arranged suitable cross-correlation coefficient threshold value (threshold value can be set as 0.1), is counted Cross-correlation coefficient is more than the frequency n of setting threshold value, then n is number of skipping rope.
Preferably, the minimum data number interval between setting rope skipping counting twice.Rule of thumb, one skips rope for 1 minute Be recorded as 300, i.e., each rope skipping period be greater than 0.2s, and the sample frequency of audio be Fs=44100, i.e., twice rope skipping meter 0.2*44100=8820 data should be at least spaced between number.
Compared with prior art, the invention has the benefit that
The present invention is based on the audio of cross-correlation coefficient method rope skipping method of counting not to need that automatic precision can be realized using artificial It really counts, can not only count immediately, playing back videos can also be carried out, it, should especially as being widely used for mobile camera-shooting and recording device Method will have stronger practicability.
Detailed description of the invention
Fig. 1 is the flow chart of the audio rope skipping method of counting of the embodiment of the present invention;
Fig. 2 is in the embodiment of the present invention using the time as the audio volume control figure of abscissa;
Fig. 3 is the time domain waveform of sample audio in the embodiment of the present invention;
Fig. 4 is the cross-correlation coefficient figure of sample audio and tested audio in the embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, with reference to embodiments and its attached drawing is to this hair It is bright to be described further.
Embodiment
Referring to Fig. 1 to Fig. 4, the audio rope skipping method of counting based on cross-correlation coefficient method of the present embodiment includes following step It is rapid:
Step S1, the original video data of rope skipping movement is obtained by video recording equipment, and original video data is inputted, and is opened Beginning timing.
Step S2, extracts voice data from video data, extracts the sample frequency of audio, draws with the time as horizontal seat Target audio volume control figure.It is as shown in Figure 2 to obtain its time domain waveform.
Step S3 selectes sample audio, calculates rope skipping number using cross-correlation coefficient method.First with 3 rope skippings and ground It is used as sample audio x after the audio fragment weighted average that certain single is hit, time domain waveform is as shown in figure 3, in video of skipping rope Tonic train as tested audio y, calculate the cross-correlation coefficient of sample audio x and tested audio y.Then it draws out " mutually Relationship number " figure counts cross-correlation coefficient as shown in figure 4, suitable cross-correlation coefficient threshold value (this example threshold value is set as 0.1) is arranged More than the frequency n of setting threshold value, then n is number of skipping rope.
Step S4 judges whether it is effective rope skipping.Rule of thumb, what one skipped rope for 1 minute is recorded as 300, i.e., each The period skip rope greater than 0.2s, and the sample frequency of audio is Fs=44100, i.e., should at least be spaced 0.2* between rope skipping counting twice 44100=8820 data, just effectively to skip rope.
Step S5, if it is effective rope skipping number, then count is incremented, is not effective skip rope then without counting.
Step S6 judges whether to be more than gate time, if so, terminating to count, otherwise repeat next reference picture Step S2 to step S12.
Count results are exported and are shown by step S7.

Claims (6)

  1. The method of counting 1. a kind of audio based on cross-correlation coefficient method is skipped rope, which comprises the following steps:
    1) video data for obtaining rope skipping movement, extracts audio data from video data;
    2) sample frequency for extracting audio, draws using the time as the audio volume control figure of abscissa;
    3) sample audio is selected, rope skipping number is calculated using cross-correlation coefficient method;
    4) output and display counting result.
  2. The method of counting 2. audio according to claim 1 is skipped rope, which is characterized in that in step 3), select sample audio, adopt The step of calculating rope skipping number with cross-correlation coefficient method are as follows:
    3-1) using the audio fragment hit with ground single of skipping rope as sample audio x, with the tonic train in video of skipping rope As tested audio y, the cross-correlation coefficient of sample audio x and tested audio y are calculated;
    3-2) using the sound clip that rope skipping is hit with ground single as sample audio;N times rope skipping is taken to touch with ground single at random The sound clip hit is weighted and averaged;
    " cross-correlation coefficient " figure 3-3) is drawn out, cross-correlation coefficient threshold value is set, statistics cross-correlation coefficient is more than setting threshold value Number m, then m is number of skipping rope.
  3. The method of counting 3. audio according to claim 2 is skipped rope, which is characterized in that step 3-1) in, sample audio x and quilt The cross-correlation function of acoustic frequency y are as follows:
    Wherein N is x, and the length of longer signal sequence in y, asterisk indicates complex conjugate;M indicates the number of sampling points of translation;Indicate that sequence x is remained stationary, after sequences y is moved to left m sample point, two sequences correspond to the result being multiplied point by point;Indicate that sequences y remains stationary, after sequence x is moved to left m sample point, two sequences correspond to the result being multiplied point by point.
  4. The method of counting 4. audio according to claim 2 is skipped rope, which is characterized in that step 3-2) in, n value is 3.
  5. The method of counting 5. audio according to claim 2 is skipped rope, which is characterized in that step 3-3) in, cross correlation is set Number threshold value is 0.1.
  6. The method of counting 6. audio according to claim 1 is skipped rope, which is characterized in that between setting rope skipping counting twice at least 8820 data.
CN201910443779.7A 2019-05-24 2019-05-24 Audio skipping rope counting method based on cross-correlation coefficient method Active CN110102040B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910443779.7A CN110102040B (en) 2019-05-24 2019-05-24 Audio skipping rope counting method based on cross-correlation coefficient method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910443779.7A CN110102040B (en) 2019-05-24 2019-05-24 Audio skipping rope counting method based on cross-correlation coefficient method

Publications (2)

Publication Number Publication Date
CN110102040A true CN110102040A (en) 2019-08-09
CN110102040B CN110102040B (en) 2020-06-30

Family

ID=67492352

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910443779.7A Active CN110102040B (en) 2019-05-24 2019-05-24 Audio skipping rope counting method based on cross-correlation coefficient method

Country Status (1)

Country Link
CN (1) CN110102040B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110975269A (en) * 2019-12-18 2020-04-10 杭州电子科技大学 Skipping rope counting table and counting method based on vibration waveform
CN111701216A (en) * 2020-06-29 2020-09-25 广东小天才科技有限公司 Rope skipping counting implementation method and system, wrist wearable device and storage medium
CN112044046A (en) * 2020-08-28 2020-12-08 浙江大学 Skipping rope counting method based on deep learning
CN115120926A (en) * 2022-07-21 2022-09-30 九江学院 A intelligent rope skipping ware for physical training

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108479042A (en) * 2018-02-06 2018-09-04 浙江大学 A kind of method of counting of bouncing the ball based on audio-frequency information
CN109758716A (en) * 2019-03-26 2019-05-17 林叶蓁 A kind of rope skipping method of counting based on acoustic information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108479042A (en) * 2018-02-06 2018-09-04 浙江大学 A kind of method of counting of bouncing the ball based on audio-frequency information
CN109758716A (en) * 2019-03-26 2019-05-17 林叶蓁 A kind of rope skipping method of counting based on acoustic information

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110975269A (en) * 2019-12-18 2020-04-10 杭州电子科技大学 Skipping rope counting table and counting method based on vibration waveform
CN111701216A (en) * 2020-06-29 2020-09-25 广东小天才科技有限公司 Rope skipping counting implementation method and system, wrist wearable device and storage medium
CN112044046A (en) * 2020-08-28 2020-12-08 浙江大学 Skipping rope counting method based on deep learning
CN112044046B (en) * 2020-08-28 2021-06-25 浙江大学 Skipping rope counting method based on deep learning
CN115120926A (en) * 2022-07-21 2022-09-30 九江学院 A intelligent rope skipping ware for physical training
CN115120926B (en) * 2022-07-21 2023-11-03 九江学院 A intelligent rope skipping ware for physical training

Also Published As

Publication number Publication date
CN110102040B (en) 2020-06-30

Similar Documents

Publication Publication Date Title
CN110102040A (en) A kind of audio rope skipping method of counting based on cross-correlation coefficient method
CN110152273B (en) Rope skipping counting method based on intelligent target identification
CN109522854A (en) A kind of pedestrian traffic statistical method based on deep learning and multiple target tracking
US9807283B1 (en) Method and system for synchronizing multiple data feeds associated with a sporting event
CN109758716B (en) Rope skipping counting method based on sound information
Büthe et al. A wearable sensing system for timing analysis in tennis
Herbst et al. A comparison of different methods to measure the EGG contact quotient
US20160073961A1 (en) Method and system for characterizing sporting activitiy
CN110286368A (en) A kind of Falls Among Old People detection method based on ULTRA-WIDEBAND RADAR
US7899307B1 (en) System, method and computer program product for measuring basketball player performance characteristics during instant replay of video and live sports games
US20080136907A1 (en) Method and measuring device for motional performance
JP2005110850A (en) Body movement evaluating method, swing motion evaluating method, and body movement measuring system
CN109876416B (en) Skipping rope counting method based on image information
JP7057873B2 (en) Skipping rope counting method
CN110309799A (en) Judgment method of speaking based on camera
JP2794018B2 (en) Operation diagnostic device
CN113117284A (en) Rope skipping counting method and counter based on acoustic signals
Franks The need for feedback
CN114882591A (en) Badminton match action analysis system based on deep learning
JP2006239132A (en) Method of evaluating hitting sound of golf club head, program making computer execute the method, and system of evaluating hitting sound of golf club head
JP2009005715A (en) Golf system
Sindik Performance indicators of the top basketball players: relations with several variables
CN111563443A (en) Continuous motion action accuracy evaluation method
CN108479042B (en) A kind of method of counting of bouncing the ball based on audio-frequency information
US11386917B1 (en) Audio-based repetition counter system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant