CN102305925A - Robot continuous sound source positioning method - Google Patents

Robot continuous sound source positioning method Download PDF

Info

Publication number
CN102305925A
CN102305925A CN201110207551A CN201110207551A CN102305925A CN 102305925 A CN102305925 A CN 102305925A CN 201110207551 A CN201110207551 A CN 201110207551A CN 201110207551 A CN201110207551 A CN 201110207551A CN 102305925 A CN102305925 A CN 102305925A
Authority
CN
China
Prior art keywords
robot
signal
sound source
angle
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201110207551A
Other languages
Chinese (zh)
Inventor
沈苗
刘宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Original Assignee
Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University filed Critical Peking University
Priority to CN201110207551A priority Critical patent/CN102305925A/en
Publication of CN102305925A publication Critical patent/CN102305925A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
  • Manipulator (AREA)

Abstract

The invention discloses a robot continuous sound source positioning method which comprises the following steps of: (1) acquiring a sound source signal by adopting a microphone array consisting of at least two pairs of microphones, converting the signal into a digital signal and storing the signal by a robot; and (2) carrying out effective audio signal detection on the acquired signal and carrying out sound source positioning operation on the signal containing effective audio frequency to obtain the position of a sound source relative to the robot. The method disclosed by the invention can divide the frequency domain signal obtained after Fourier transformation as for different application scenes and the frequency characteristic and noise characteristic of the sound source when the method is applied into a sound source positioning system of the robot and the calculating capability of the robot is limited, and thereby, the positioning operation time of the robot is greatly reduced, and the positioning speed is high. Meanwhile, as for the characteristic of movement of the robot, after the displacement angle is subjected to motion modification, the accuracy and instantaneity of positioning are greatly improved.

Description

The continuous sound localization method of a kind of robot
Technical field
The present invention relates to a kind of robot field's auditory localization treatment technology, especially based on the continuous sound localization method in the robot that is applied in of microphone array.
Background technology
The world that robot is faced with is the world that information complicated and changeable can be provided; Make that robot is that human service just needs it that various applied environments are all had corresponding information obtain manner and disposal route, also needs it to make different decision-makings according to the variation of environment simultaneously.And robot generally imports external environmental information through sensor, and most important is exactly vision sensor and hearing transducer two big information input sources.In recent years, the robot vision technology had had significant progress, expanded the range of application of robot greatly, had improved the work efficiency of robot.But visually-perceptible is subjected to the restriction of factors such as illumination, barrier and visibility, and under or the situation that barrier stops relatively poor in light condition, visually-perceptible will lose efficacy.Auditory system can not be subjected to above-mentioned these factor affecting fully as the important component part of human sense organ, just for the research of robot cognition technology new field is provided.The robotic vision and the sense of hearing simultaneously can combine, and learning from other's strong points to offset one's weaknesses provides service for human society jointly.
General robot auditory localization technology is through the simulation to human auditory system mechanism; Utilize robot on one's body or the sensor devices such as microphone array that are placed among the robot environment receive sound wave; Because microphone is in the same environment; Certainly existing certain correlativity between the voice signal that these microphones collect; Through electronic installation or algorithm; Utilize this correlativity that acoustical signal is handled, thereby realize that sound source position is surveyed, speech recognition or the location and the tracking of target.This technology receives noise and reverberation influence in the robot environment of living in, receive robot motion's body Effects of Noise and receive sound source through barrier the reflection and the influence of refraction and some environmental parameters, make sound source accurately located to become very difficult.The restriction of the maximum that self had of mobile robot is exactly high to the rate request of auditory localization in addition.Robot is positioned at current certain position; A sounds; Suppose that robot is with linear uniform motion; Movement velocity is v; Be t positioning time, in air, do not propagate the time that is spent robot has produced v*t between actual sound source and the robot when obtaining positioning result displacement even if do not consider sound; This situation requires careful consideration, particularly when robot and sound source position have relative motion.
Existing sound localization method adopts the mistiming technology that arrives more.At first, the microphone in the microphone array model is divided into per two one group, it is several right to be divided into, right for each microphone, calculates the mistiming of voice signal from two microphones of sound source arrival, poor according to this mistiming computed range; Utilize topological structure parameter, the range difference of microphone array, the speed of sound transmission to estimate the position of sound source then.The core of this method is exactly to calculate sound to arrive the right mistiming of each microphone.Fig. 1 is based on time delay and estimates the location algorithm schematic diagram.Here adopt that (Cross-power spectrum phase, CSP) the time delay algorithm for estimating calculates based on a kind of cross-power spectrum phase place.This method is to utilize the phase information of cross-power spectrum to come estimation time delay, and it to the weighting function of signal cross-power spectrum is:
W csp ( ω ) = 1 | G 12 ( ω ) | - - - ( 1 )
G wherein 12(ω) be the cross-spectral density function of signal
The signal that the sound that sends from sound source arrives two microphones can be expressed as:
x 1(t)=s 1(t)+n 1(t) (2)
x 2(t)=αs 1(t+τ)+n 2(t) (3)
X wherein 1(t), x 2(t),, a microphone is expressed as s if being received the sound that sound source sends for arriving the voice signal of two microphones respectively at moment t 1(t), then we can receive an other microphone sound that sound source sends and be expressed as α s 2(t+ τ), n 1(t), n 2(t) be two noises that microphone receives respectively, τ is the mistiming that sound that sound source is sent arrives two microphones, and α is an attenuation coefficient.Known the mistiming τ that arrives; Distance D 1 between while two microphones is known value; Can calculate the sound source position right with respect to this microphone; But only calculating two mistimings between the microphone will obtain an eligible bi-curved information on three dimensions; Can not be with the sound source accurate in locating; Therefore in practical application, adopt many forms to collect voice signal to microphone array; Calculate sound source with respect to the hyperboloid of every pair of microphone on three dimensions, with many be exactly the accurate position of sound source to the corresponding respectively bi-curved point of crossing of microphone.
CSP method difference computing time τ step is following:
1. at first the signal of microphone collection is carried out analog to digital conversion, convert digital signal into, again digital signal is carried out the computing of simple crosscorrelation at frequency domain.
2. two paths of signals is carried out Fourier transform respectively, the result to the Fourier transform of calculating two paths of signals carries out computing cross-correlation then:
S ( ω ) = Σ m = 1 N x [ n ] exp ( - jwm ) - - - ( 4 )
R ′ x 1 x 2 ( ω ) S ( ω 1 ) S ( ω 2 ) * - - - ( 5 )
X[n wherein] be the sampled signal of time domain, S (ω) for time-domain signal through the frequency-region signal after the Fourier transform.
3. for a series of Effect of Environmental such as the reflection that reduces ground unrest, sound, refraction, reverberation, improve bearing accuracy, signal is carried out carrying out whole weighted at frequency domain before the computing cross-correlation, promptly
R ′ x 1 x 2 ( ω ) = W n ( ω ) S ( ω 1 ) S ( ω 2 ) * - - - ( 6 )
W wherein n(ω) be weighting function, S (ω 1), S (ω 2) *Be respectively the frequency-region signal that two paths of signals obtains through Fourier transform.
4. result of calculation is carried out inverse Fourier transform and transform to time domain again, the result of inverse transformation is searched for peaked position, can confirm the mistiming τ of two paths of signals.
Existing method has only been considered a series of Effect of Environmental such as ground unrest, reverberation, does not consider the characteristic of sound source itself.Existing simultaneously method is all carried out correlation operation to all Frequency points, and complexity is high, and has wasted a large amount of assessing the cost and the time.And in the continuous auditory localization process of robot, continuous meaning is the sound source position that real-time positioning is correct.In the continuous sonic location system of robot, topmost problem is a real-time, therefore needs robot can calculate azimuth information fast, therefore just need improve existing algorithm, reduces the complexity of algorithm, and arithmetic speed is accelerated.
A problem of prior art existence is in addition; The mobile robot is when having relative motion with sound source; Because the existence of calculation delay; Suppose that calculation delay is Td; Then current position of calculating is the relative position of mobile robot and sound source Td times prior; Can not reflect truly that this problem was more unobvious when the arithmetic capability of relative position, particularly robot of current robot and sound source was high.
Summary of the invention
To the shortcoming that prior art exists, we have proposed a kind of method of new auditory localization, have overcome shortcoming of the prior art, and have obtained good effect.
Core concept of the present invention is that the signal that Fourier transform is later carries out the frequency spectrum fragment process; Only the frequency chip to part carries out correlation operation; And different bursts is added different weight processing, and irrelevant frequency chip is changed to zero, do not carry out correlation operation.The characteristics that have a relative motion to mobile robot and sound source are estimated the motion of robot simultaneously, and according to prediction result current position location are compensated.
In fact, the thought of this method comes from the calculating of signal to noise ratio (S/N ratio), is different through calculating the signal to noise ratio (S/N ratio) of finding the different frequency sheet; When particularly the sound that sends of sound source was voice, experimental observation was thought, when the signal to noise ratio (S/N ratio) of signal is higher than certain threshold value; It is a voice signal, otherwise is noise.Therefore; We find; The different frequency sheet also is different carrying out computing cross-correlation time institute role; Be that its signal energy value of the higher frequency chip of signal to noise ratio (S/N ratio) is big more; The cross-spectral density function more can characterize the characteristic of voice signal part, so this part frequency chip just needs the weighting function of increasing.
Method of the present invention is:
1) the robot microphone array that adopts at least two pairs of microphones to constitute is gathered sound-source signal, and is to store after the digital signal with conversion of signals;
2) signal of gathering is carried out effective sound signal and detect, the signal that will include effective audio frequency carries out Fourier transform, converts frequency domain into from time domain;
3) signal that converts frequency domain into is carried out fragment process, the signal data that the every pair of microphone is obtained carries out correlation calculations respectively, and the result of correlation calculations is carried out inverse Fourier transform, is transformed into time domain from frequency domain;
4) carry out the maximum value position search, obtain sound source to the right mistiming τ of each microphone;
7) calculate the position of sound source with respect to robot according to angle θ and mistiming τ, wherein θ is initial point and the line of sound source and the angle between the coordinate system x axle forward of microphone array coordinate system of living in.
Specifically describe step involved in the present invention below:
1, the robot microphone array that adopts at least two pairs of microphones to constitute is gathered sound-source signal, and is to store after the digital signal with conversion of signals;
2, the signal of gathering is carried out effective sound signal and detect, the signal that comprises effective audio frequency is carried out the auditory localization computing, obtain the position of sound source with respect to robot.If do not have effective sound signal to exist then do not position computing.Operational method is following:
A) signal that will include effective audio frequency carries out Fourier transform, converts frequency domain into from time domain:
S ( ω ) = Σ m = 1 N x [ n ] exp ( - jwm ) ; - - - ( 7 )
X[n wherein] be the signal of time domain, ω is a frequency variable, and j representes a unit of imaginary part, and m is a variable, the number of expression from 1 to n, S (ω) is the signal through the frequency field that obtains after the Fourier transform.
B) signal that converts frequency domain into is carried out fragment process,, does not carry out the computing of correlativity the extraneous data zero setting of setpoint frequency:
S ′ ( ω ) = Σ m = a b x [ n ] exp ( - jwm ) - - - ( 8 )
A~b is meant the setpoint frequency scope.
C) the frequency-region signal data that respectively every pair of microphone obtained are carried out correlation calculations:
R ′ x 1 x 2 ( ω ) = W csp ( ω ) S ′ ( ω 1 ) S ′ ( ω 2 ) * - - - ( 9 )
Wherein, W Csp(ω) be weighting function
W csp ( ω ) = 1 | G x 1 x 2 ( ω ) | - - - ( 1 )
Figure BDA0000077939380000045
for the cross-power spectral density function
G x 1 x 2 ( ω ) = Σ ω = 0 n f ( ω ) α x 1 α x 2 S ′ ( ω ) S ′ * ( ω ) exp - jωτ
Wherein τ is that signal is to the right mistiming of microphone.F (ω) is the weighted value of each frequency chip.ω is divided into different sheets, and for different sheets, f (ω) gets different values.
D) result to the correlation calculations of c step carries out inverse Fourier transform, is transformed into time domain from frequency domain:
x ′ [ n ] = 1 2 π ∫ - ∞ ∞ R ′ x 1 x 2 ( ω ) e jωt dω
The time-domain signal that obtains for inverse Fourier transform of x ' [n] wherein, t is constantly.
E) result of calculation of d step is carried out the maximum value position search, can obtain sound source to the right mistiming τ of said microphone.
F) calculate the angle θ of sound source with respect to microphone array, θ is initial point and the line of sound source and the angle between the coordinate system x axle forward of microphone array coordinate system of living in, and θ is the angle on the space.
G) calculate the position of sound source according to angle θ and mistiming τ with respect to robot.
When said robot and sound source have relative motion; Because the calculating sound source needs the regular hour with respect to the angle of microphone array; And at this moment in the process; Between robot and the sound source also relative motion is taking place; Therefore, also need according to the computing interval robot and sound source to the angular velocity of motion to f) the angle θ that calculates revises.
The method that current angle θ is revised is:
A, transfer angle when preceding the N time computing acquisition of time auditory localization computing;
B, acquisition are as the angle of time computing and the differential seat angle Ad of preceding the N time computing, and the angular velocity Ad/ (N*Tf) of calculating sound source and robot relative motion, and Tf is for working as the mistiming of time computing and preceding the N time computing;
C, change Td*Ad/ (N*Tf) with the angle between sound source in the Td time and the robot and revise current angle, that is, the angle of current calculating adds that the angle of correction is real angle θ, i.e. θ+Td*Ad/ (N*Tf).Wherein θ is f) angle that calculates, Td is that robot calculates the needed time of angle at every turn.
Effective audio signal data that said auditory localization computing whenever collects set amount in time domain just carries out the computing of an auditory localization.
Said effective audio signal data is a speech data.
The data of said set amount are the data of frame length size.
Said robot can be the mobile robot, also can be the stationary machines people.
Said sound source can be stationary sound source, also can be for moving sound source.
Said Fourier transform can be Fast Fourier Transform (FFT).
The microphone array of said robot can be the array of cruciform array, triangular array, circular array, linear array or other types.
Described fragment process is that all Frequency points after the Fourier transform are divided into different groups, divides into groups according to the frequency range of effective sound signal.
What of effective sound signal of being comprised are relevant in said f (ω) and each group, the frequency band that useful signal is concentrated, and the weight of f (ω) weighting is big, the frequency band that useful signal is few, the weight of f (ω) weighting is little.
Technique effect of the present invention:
In the sonic location system of robot, when particularly the robot computing power is limited.To different application scenes, the frequency-region signal that the frequency characteristic of sound source and the characteristic of noise can be later with Fourier transform carries out burst, and the frequency spectrum of different sheets is carried out different processing, has significantly reduced the location operation time of robot, and locating speed is fast.Simultaneously to the characteristics of robot movement, to its move the parallactic angle degree move revise after, the accuracy that has significantly improved the location is with real-time.
Description of drawings
Fig. 1 is based on time delay and estimates the location algorithm schematic diagram;
Fig. 2 is a microphone array model synoptic diagram;
Fig. 3 is the floor map of robot and point source of sound;
The practical implementation method
According to specific embodiment and Figure of description method of the present invention is described in detail below.
1, to gather sound-source signal respectively and carry out analog to digital conversion be digital signal to two pairs of microphone arrays, and storage.
2,1 digital signal of gathering is carried out effective sound signal and detect, the signal that comprises effective audio frequency is carried out the auditory localization computing, obtain the position of sound source with respect to robot.Effectively sound signal detects and is prior art; Can detect according to the characteristic of sound-source signal, in this embodiment, effectively sound signal detects and is the sound end detection; If have voice to exist then begin to carry out the auditory localization computing, if do not have voice to exist then do not position computing.The voice signal of gathering is carried out the branch frame in time domain handle, promptly whenever collect the computing that a certain amount of data (data of frame length size) are just carried out an auditory localization
3, the acquired signal after handling in 2 is carried out Fast Fourier Transform (FFT)
S ( ω ) = Σ m = 1 N x [ n ] exp ( - jwm ) - - - ( 7 )
4, the signal in 3 is carried out fragment process in frequency field, to the frequency characteristic of sound source, only get the data of the frequency chip in the setpoint frequency scope and carry out correlation operation, the computing of correlativity is not carried out in the extraneous data zero setting of setpoint frequency
S ′ ( ω ) = Σ m = a b x [ n ] exp ( - jwm ) - - - ( 8 )
A~b is meant the setpoint frequency scope.
5, different frequency chips is carried out the correlation calculations that different weights is handled:
R ′ x 1 x 2 ( ω ) = W csp ( ω ) S ′ ( ω 1 ) S ′ ( ω 2 ) * - - - ( 9 )
Wherein, W Csp(ω) be weighting function
W csp ( ω ) = 1 | G x 1 x 2 ( ω ) | - - - ( 1 )
for the cross-power spectral density function
G x 1 x 2 ( ω ) = Σ ω = 0 n f ( ω ) α x 1 α x 2 S ′ ( ω ) S ′ * ( ω ) exp - jωτ
Wherein τ is that signal is to the right mistiming of microphone.F (ω) is the weighted value of each frequency chip.ω is divided into different sheets, and for different sheets, f (ω) gets different values.Signal carries out fragment process in frequency field and is meant according to different application scenes; With after the Fourier transform be divided into different groups a little; A point after the Fourier transform is represented a frequency; Burst is exactly that different points is divided into different groups; Group unit minimum is a point; Maximum is whole point, handles not carrying out different weights on the same group.The principle of burst weighting is to classify according to the frequency range of useful signal in the signal, the frequency band that useful signal is concentrated more, and the weight of weighting is big more; The frequency band that useful signal is few more; The weight of weighting is more little, reduces the influence of non-useful signal to integral body like this, improves signal to noise ratio (S/N ratio).(for example: if when sound source is voice; Generally concentrate on the frequency band of 100-4kHz at the frequency field valid data; But major part all concentrates on 200-1200Hz; Therefore can simply be divided into 100-200Hz; 200-1200Hz; Three groups of 1200-4000Hz carry out different weighted to every group).
6, the result of calculation in 5 is carried out inverse fast Fourier transform, result of calculation is transformed to time domain.
x ′ [ n ] = 1 2 π ∫ - ∞ ∞ R ′ x 1 x 2 ( ω ) e jωt dω
The time-domain signal that obtains for inverse Fourier transform of x ' [n] wherein.
7, the result of calculation in 6 is searched for peaked position, can obtain sound source to the right mistiming τ of microphone
8, obtain the angle θ with respect to microphone array respectively according to the result of calculation of step 7, θ is initial point and the line of sound source and the angle between the coordinate system x axle forward of microphone array coordinate system of living in.
9, when between robot and the sound source relative motion taking place, need revise angle theta
The a} sound end detects when sound is arranged, and stores N frame before the current location respectively to every pair of microphone, below the angle of (being designated as F5) is described as an example with 5 frames.
B} calculates the poor Ad of angle of angle and the F5 of present frame (F0), and according to the object of which movement characteristics of stationarity in short-term, we think that F5 is mild to the motion of these continuous 6 frames of F0.Calculate the poor of these two angles, if the mistiming between two frames is Tf, the angular velocity of then predicting current sound source and robot relative motion is Ad/ (5*Tf).
C) the needed time of angle of calculating every frame is Td, then Td in the time angle between sound source and the robot be changed to Td*Ad/ (5*Tf)
D) carry out above-mentioned computing to two groups of microphones respectively, and revise the relative angle of current sound source and robot with it.
Revise later angles according to two and obtain the position of sound source, and can be directed against different application, the frequency chip of voice signal is carried out different processing with respect to microphone array.
In mobile robot's sonic location system, to the characteristics of robot movement, to its move the parallactic angle degree move revise after, the accuracy that has significantly improved the location is with real-time, when particularly the robot computing power is limited.To different application scenes, the frequency characteristic of sound source and the characteristic of noise can be carried out different processing to different frequency spectrum sheets.Protection scope of the present invention is not limited to following instance.
The microphone array model is a cruciform array that is made up of four microphones, and like Fig. 2, each all is 40cm to the distance between the microphone on the cross, is fixed on the shoulder apart from the robot of ground 100cm, constitutes a planar array model.Experimental situation is the room of a 8m*8m*3m, and as reference field, Fig. 3 is the floor map of robot and point source of sound, the position of the clear direction of figure acceptance of the bid and robot and sound source with the plane at microphone array model place.Robot at first stands in the central authorities in room; Draw on the floor and be used for the people that stands as 72 positions at 72 o'clock; Be the position of test sound source point; Being set to whenever at a distance from 15 of 72 points ± be a Sounnd source direction; Totally 24 directions; On each direction according to distance microphone array center 1m, 2m and 3m three places, totally 72 point sources of sound.People and robot can do relative motion.Ask for help and just can pronounce when being positioned on the point shown in Figure 3, purpose is to make things convenient for test result.
In the experiment to 28 groups of speech datas of each point source of sound station acquisition; Totally 2016 groups, each distance has 672 groups of data, for the basic improved CSP method of weighting function of not carrying out; It directly utilizes original weighting function when calculating, experiment finds that the effect of this location algorithm is better than the CSP method.Experimental data is seen table 1.
The experimental data comparison sheet of table 1 CSP method and the inventive method
Figure BDA0000077939380000081

Claims (10)

1. the continuous sound localization method of robot comprises the steps:
1) the robot microphone array that adopts at least two pairs of microphones to constitute is gathered sound-source signal, and is to store after the digital signal with conversion of signals;
2) signal of gathering is carried out effective sound signal and detect, the signal that will include effective audio frequency carries out Fourier transform, converts frequency domain into from time domain;
3) signal that converts frequency domain into is carried out fragment process, the signal data that the every pair of microphone is obtained carries out correlation calculations respectively, and the result of correlation calculations is carried out inverse Fourier transform, is transformed into time domain from frequency domain;
4) carry out the maximum value position search, obtain sound source to the right mistiming τ of each microphone;
5) calculate the position of sound source with respect to robot according to angle θ and mistiming τ, wherein θ is initial point and the line of sound source and the angle between the coordinate system x axle forward of microphone array coordinate system of living in.
2. the continuous sound localization method of robot according to claim 1 is characterized in that, when said robot and sound source have relative motion, to f) the angle θ that calculates of step revises, and modification method is:
A, transfer angle when preceding the N time computing acquisition of time auditory localization computing;
B, obtain to calculate the angular velocity Ad/ (N*Tf) of sound source and robot relative motion as the angle θ of time computing and the poor Ad of the angle of preceding the N time computing, Tf is the mistiming of working as inferior computing and preceding the N time computing;
C, the current angle of correction are:
θ+Td*Ad/(N*Tf)
Wherein, Td is that robot calculates the needed time of angle at every turn.
3. the continuous sound localization method of robot according to claim 1 and 2 is characterized in that, effective audio signal data that said auditory localization computing whenever collects set amount in time domain just carries out the computing of an auditory localization.
4. the continuous sound localization method of robot according to claim 3 is characterized in that said effective audio signal data is a speech data.
5. the continuous sound localization method of robot according to claim 4 is characterized in that, the data of said set amount are the data of frame length size.
6. the continuous sound localization method of robot according to claim 1 and 2 is characterized in that, said machine people is mobile robot or stationary machines people.
7. the continuous sound localization method of robot according to claim 1 and 2 is characterized in that, said sound source is stationary sound source or mobile sound source.
8. the continuous sound localization method of robot according to claim 1 and 2 is characterized in that said Fourier transform is Fast Fourier Transform (FFT).
9. the continuous sound localization method of robot according to claim 1 and 2 is characterized in that the microphone array of said robot is classified cruciform array, triangular array, circular array or linear array as.
10. the continuous sound localization method of robot according to claim 1 and 2 is characterized in that, described fragment process is that all Frequency points after the Fourier transform are divided into different groups.
CN201110207551A 2011-07-22 2011-07-22 Robot continuous sound source positioning method Pending CN102305925A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110207551A CN102305925A (en) 2011-07-22 2011-07-22 Robot continuous sound source positioning method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110207551A CN102305925A (en) 2011-07-22 2011-07-22 Robot continuous sound source positioning method

Publications (1)

Publication Number Publication Date
CN102305925A true CN102305925A (en) 2012-01-04

Family

ID=45379801

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110207551A Pending CN102305925A (en) 2011-07-22 2011-07-22 Robot continuous sound source positioning method

Country Status (1)

Country Link
CN (1) CN102305925A (en)

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102901949A (en) * 2012-10-13 2013-01-30 天津大学 Two-dimensional spatial distribution type relative sound positioning method and device
CN103176167A (en) * 2013-03-21 2013-06-26 徐华中 Phase-locked-amplifier-based sound location method under strong disturbance
CN103364761A (en) * 2013-07-12 2013-10-23 哈尔滨工业大学 Positioning system of indoor sound source and method using positioning system to position indoor sound source
CN103760479A (en) * 2014-01-10 2014-04-30 三峡大学 Portable corona positioning instrument
CN104181506A (en) * 2014-08-26 2014-12-03 山东大学 Sound source locating method based on improved PHAT weighting time delay estimation and implementation system thereof
CN104240606A (en) * 2014-08-22 2014-12-24 京东方科技集团股份有限公司 Display device and display device watching angle adjusting method
CN104422922A (en) * 2013-08-19 2015-03-18 中兴通讯股份有限公司 Method and device for realizing sound source localization by utilizing mobile terminal
CN104535965A (en) * 2014-12-29 2015-04-22 江苏科技大学 Parallelized sound source positioning system based on embedded GPU system and method
CN104754471A (en) * 2013-12-30 2015-07-01 华为技术有限公司 Microphone array based sound field processing method and electronic device
CN104936091A (en) * 2015-05-14 2015-09-23 科大讯飞股份有限公司 Intelligent interaction method and system based on circle microphone array
CN104991573A (en) * 2015-06-25 2015-10-21 北京品创汇通科技有限公司 Locating and tracking method and apparatus based on sound source array
CN105163209A (en) * 2015-08-31 2015-12-16 深圳前海达闼科技有限公司 Voice receiving processing method and voice receiving processing device
CN105225173A (en) * 2015-10-12 2016-01-06 江苏木盟智能科技有限公司 Catering service system
CN105467455A (en) * 2015-11-20 2016-04-06 北京瑞芯谷科技有限公司 Method for searching underground facility by using underground electronic identifier precisely
CN105538311A (en) * 2016-02-02 2016-05-04 北京云迹科技有限公司 Intelligent robot sound positioning method and system
CN105551495A (en) * 2015-12-15 2016-05-04 青岛海尔智能技术研发有限公司 Sound noise filtering device and method
CN105629202A (en) * 2016-03-23 2016-06-01 浙江工业大学 Method for umbrella-type reconfigurable three-dimensional microphone array to recognize three-dimensional coordinates of sound source
CN106205106A (en) * 2016-06-29 2016-12-07 北京智能管家科技有限公司 Intelligent mobile device based on acoustics and moving method, location moving method
CN106291469A (en) * 2016-10-18 2017-01-04 武汉轻工大学 A kind of three dimensions source of sound localization method and system
WO2017000775A1 (en) * 2015-06-30 2017-01-05 芋头科技(杭州)有限公司 Robot voice direction-seeking turning system and method
CN106772246A (en) * 2017-01-20 2017-05-31 浙江大学 Unmanned plane real-time detection and alignment system and method based on acoustic array
CN106847298A (en) * 2017-02-24 2017-06-13 海信集团有限公司 A kind of sound pick-up method and device based on diffused interactive voice
CN106908765A (en) * 2017-02-27 2017-06-30 广东小天才科技有限公司 A kind of space-location method based on ultrasonic signal, system and VR equipment
WO2017190552A1 (en) * 2016-05-03 2017-11-09 深圳光启合众科技有限公司 Robot and determination method and device for sound source position
CN107490127A (en) * 2017-07-27 2017-12-19 广东美的制冷设备有限公司 Air conditioner air blowing control method, electronic equipment and computer-readable recording medium
CN107685334A (en) * 2017-09-27 2018-02-13 歌尔股份有限公司 A kind of service robot charging method and service robot
WO2018045973A1 (en) * 2016-09-08 2018-03-15 南京阿凡达机器人科技有限公司 Sound source localization method for robot, and system
CN107940681A (en) * 2017-11-17 2018-04-20 广东美的制冷设备有限公司 Air conditioner air blowing control method, electronic equipment and computer-readable recording medium
CN108332063A (en) * 2018-01-29 2018-07-27 中国科学院声学研究所 A kind of pipeline leakage positioning method based on cross-correlation
CN108398675A (en) * 2018-03-01 2018-08-14 英华达(上海)科技有限公司 Positioning system and localization method
CN108766457A (en) * 2018-05-30 2018-11-06 北京小米移动软件有限公司 Acoustic signal processing method, device, electronic equipment and storage medium
CN108956863A (en) * 2018-05-21 2018-12-07 中国科学院地球化学研究所 A kind of detection method of the Genes For Plant Tolerance karst drought ability based on inorganic nitrogen utilization efficiency
WO2018223639A1 (en) * 2017-06-06 2018-12-13 歌尔股份有限公司 Microphone array sound source positioning method and device
US20190115042A1 (en) * 2015-06-30 2019-04-18 Yutou Technology (Hangzhou) Co., Ltd. System for robot to eliminate own sound source
CN109920443A (en) * 2019-03-22 2019-06-21 网易有道信息技术(北京)有限公司 A kind of speech processes machine
US10343287B2 (en) 2015-06-30 2019-07-09 Yutou Technology (Hangzhou) Co., Ltd. Robot voice direction-seeking turning system and method
CN110095755A (en) * 2019-04-01 2019-08-06 北京云知声信息技术有限公司 A kind of sound localization method
CN110297215A (en) * 2019-06-19 2019-10-01 东北电力大学 A kind of circular array auditory localization visualization system and method
CN110390947A (en) * 2018-04-23 2019-10-29 北京京东尚科信息技术有限公司 Determination method, system, equipment and the storage medium of sound source position
CN110428850A (en) * 2019-08-02 2019-11-08 深圳市无限动力发展有限公司 Voice pick-up method, device, storage medium and mobile robot
CN110470379A (en) * 2019-08-23 2019-11-19 武汉理工大学 A kind of substation's movable-type intelligent noise continuous collecting system
CN110837077A (en) * 2018-08-16 2020-02-25 杭州海康威视系统技术有限公司 Sound source position verification method and device
CN111381211A (en) * 2020-03-02 2020-07-07 北京声智科技有限公司 Sound source positioning method and device
CN111624554A (en) * 2019-02-27 2020-09-04 北京京东尚科信息技术有限公司 Sound source positioning method and device
CN111730641A (en) * 2020-07-01 2020-10-02 珠海格力智能装备有限公司 Method and device for determining noise source, processor and electronic device
CN112198498A (en) * 2020-09-11 2021-01-08 海创半导体科技(深圳)有限公司 Method for measuring distance by using intelligent voice module
CN112946578A (en) * 2021-02-02 2021-06-11 上海头趣科技有限公司 Novel double-ear positioning method
CN115174816A (en) * 2022-08-15 2022-10-11 广州伏羲智能科技有限公司 Environmental noise sound source directional snapshot method and device based on microphone array
CN117388644A (en) * 2023-06-27 2024-01-12 国网宁夏电力有限公司电力科学研究院 Power equipment partial discharge positioning method and system

Cited By (68)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102901949B (en) * 2012-10-13 2014-04-16 天津大学 Two-dimensional spatial distribution type relative sound positioning method and device
CN102901949A (en) * 2012-10-13 2013-01-30 天津大学 Two-dimensional spatial distribution type relative sound positioning method and device
CN103176167A (en) * 2013-03-21 2013-06-26 徐华中 Phase-locked-amplifier-based sound location method under strong disturbance
CN103364761A (en) * 2013-07-12 2013-10-23 哈尔滨工业大学 Positioning system of indoor sound source and method using positioning system to position indoor sound source
CN104422922A (en) * 2013-08-19 2015-03-18 中兴通讯股份有限公司 Method and device for realizing sound source localization by utilizing mobile terminal
CN104754471A (en) * 2013-12-30 2015-07-01 华为技术有限公司 Microphone array based sound field processing method and electronic device
CN103760479A (en) * 2014-01-10 2014-04-30 三峡大学 Portable corona positioning instrument
CN103760479B (en) * 2014-01-10 2016-11-02 三峡大学 Portable corona position finder
CN104240606A (en) * 2014-08-22 2014-12-24 京东方科技集团股份有限公司 Display device and display device watching angle adjusting method
US9690262B2 (en) 2014-08-22 2017-06-27 Boe Technology Group Co., Ltd. Display device and method for regulating viewing angle of display device
CN104181506A (en) * 2014-08-26 2014-12-03 山东大学 Sound source locating method based on improved PHAT weighting time delay estimation and implementation system thereof
CN104181506B (en) * 2014-08-26 2016-08-17 山东大学 A kind of based on improving the sound localization method of PHAT weighting time delay estimation and realizing system
CN104535965A (en) * 2014-12-29 2015-04-22 江苏科技大学 Parallelized sound source positioning system based on embedded GPU system and method
CN104936091A (en) * 2015-05-14 2015-09-23 科大讯飞股份有限公司 Intelligent interaction method and system based on circle microphone array
CN104936091B (en) * 2015-05-14 2018-06-15 讯飞智元信息科技有限公司 Intelligent interactive method and system based on circular microphone array
CN104991573A (en) * 2015-06-25 2015-10-21 北京品创汇通科技有限公司 Locating and tracking method and apparatus based on sound source array
US10343287B2 (en) 2015-06-30 2019-07-09 Yutou Technology (Hangzhou) Co., Ltd. Robot voice direction-seeking turning system and method
WO2017000775A1 (en) * 2015-06-30 2017-01-05 芋头科技(杭州)有限公司 Robot voice direction-seeking turning system and method
US20190115042A1 (en) * 2015-06-30 2019-04-18 Yutou Technology (Hangzhou) Co., Ltd. System for robot to eliminate own sound source
CN105163209A (en) * 2015-08-31 2015-12-16 深圳前海达闼科技有限公司 Voice receiving processing method and voice receiving processing device
US10306360B2 (en) 2015-08-31 2019-05-28 Cloudminds (Shenzhen) Technologies Co., Ltd. Method and device for processing received sound and memory medium, mobile terminal, robot having the same
CN105225173A (en) * 2015-10-12 2016-01-06 江苏木盟智能科技有限公司 Catering service system
CN105467455A (en) * 2015-11-20 2016-04-06 北京瑞芯谷科技有限公司 Method for searching underground facility by using underground electronic identifier precisely
CN105551495A (en) * 2015-12-15 2016-05-04 青岛海尔智能技术研发有限公司 Sound noise filtering device and method
CN105538311A (en) * 2016-02-02 2016-05-04 北京云迹科技有限公司 Intelligent robot sound positioning method and system
CN105538311B (en) * 2016-02-02 2017-08-25 北京云迹科技有限公司 A kind of intelligent robot is followed the sound the method and system of positioning
CN105629202A (en) * 2016-03-23 2016-06-01 浙江工业大学 Method for umbrella-type reconfigurable three-dimensional microphone array to recognize three-dimensional coordinates of sound source
CN105629202B (en) * 2016-03-23 2017-12-29 浙江工业大学 Umbrella shape can recombinate three-dimensional microphone array identification sound source three-dimensional and sit calibration method
WO2017190552A1 (en) * 2016-05-03 2017-11-09 深圳光启合众科技有限公司 Robot and determination method and device for sound source position
CN106205106A (en) * 2016-06-29 2016-12-07 北京智能管家科技有限公司 Intelligent mobile device based on acoustics and moving method, location moving method
WO2018045973A1 (en) * 2016-09-08 2018-03-15 南京阿凡达机器人科技有限公司 Sound source localization method for robot, and system
CN106291469A (en) * 2016-10-18 2017-01-04 武汉轻工大学 A kind of three dimensions source of sound localization method and system
CN106291469B (en) * 2016-10-18 2018-11-23 武汉轻工大学 A kind of three-dimensional space source of sound localization method and system
CN106772246A (en) * 2017-01-20 2017-05-31 浙江大学 Unmanned plane real-time detection and alignment system and method based on acoustic array
CN106772246B (en) * 2017-01-20 2019-04-05 浙江大学 Unmanned plane real-time detection and positioning system and method based on acoustic array
CN106847298A (en) * 2017-02-24 2017-06-13 海信集团有限公司 A kind of sound pick-up method and device based on diffused interactive voice
CN106908765B (en) * 2017-02-27 2019-07-09 广东小天才科技有限公司 A kind of space-location method based on ultrasonic signal, system and VR equipment
CN106908765A (en) * 2017-02-27 2017-06-30 广东小天才科技有限公司 A kind of space-location method based on ultrasonic signal, system and VR equipment
US10848865B2 (en) 2017-06-06 2020-11-24 Weifang Goertek Microelectronics Co., Ltd. Method and device for sound source positioning using microphone array
WO2018223639A1 (en) * 2017-06-06 2018-12-13 歌尔股份有限公司 Microphone array sound source positioning method and device
CN107490127B (en) * 2017-07-27 2020-08-04 广东美的制冷设备有限公司 Air conditioner air supply control method, electronic device and computer readable storage medium
CN107490127A (en) * 2017-07-27 2017-12-19 广东美的制冷设备有限公司 Air conditioner air blowing control method, electronic equipment and computer-readable recording medium
CN107685334B (en) * 2017-09-27 2024-04-02 歌尔股份有限公司 Service robot charging method and service robot
CN107685334A (en) * 2017-09-27 2018-02-13 歌尔股份有限公司 A kind of service robot charging method and service robot
CN107940681A (en) * 2017-11-17 2018-04-20 广东美的制冷设备有限公司 Air conditioner air blowing control method, electronic equipment and computer-readable recording medium
CN108332063A (en) * 2018-01-29 2018-07-27 中国科学院声学研究所 A kind of pipeline leakage positioning method based on cross-correlation
CN108398675A (en) * 2018-03-01 2018-08-14 英华达(上海)科技有限公司 Positioning system and localization method
CN110390947B (en) * 2018-04-23 2024-04-05 北京京东尚科信息技术有限公司 Method, system, device and storage medium for determining sound source position
CN110390947A (en) * 2018-04-23 2019-10-29 北京京东尚科信息技术有限公司 Determination method, system, equipment and the storage medium of sound source position
CN108956863A (en) * 2018-05-21 2018-12-07 中国科学院地球化学研究所 A kind of detection method of the Genes For Plant Tolerance karst drought ability based on inorganic nitrogen utilization efficiency
US10798483B2 (en) 2018-05-30 2020-10-06 Beijing Xiaomi Mobile Software Co., Ltd. Audio signal processing method and device, electronic equipment and storage medium
CN108766457A (en) * 2018-05-30 2018-11-06 北京小米移动软件有限公司 Acoustic signal processing method, device, electronic equipment and storage medium
CN110837077B (en) * 2018-08-16 2021-11-19 杭州海康威视系统技术有限公司 Sound source position verification method and device
CN110837077A (en) * 2018-08-16 2020-02-25 杭州海康威视系统技术有限公司 Sound source position verification method and device
CN111624554A (en) * 2019-02-27 2020-09-04 北京京东尚科信息技术有限公司 Sound source positioning method and device
CN109920443A (en) * 2019-03-22 2019-06-21 网易有道信息技术(北京)有限公司 A kind of speech processes machine
CN110095755B (en) * 2019-04-01 2021-03-12 云知声智能科技股份有限公司 Sound source positioning method
CN110095755A (en) * 2019-04-01 2019-08-06 北京云知声信息技术有限公司 A kind of sound localization method
CN110297215A (en) * 2019-06-19 2019-10-01 东北电力大学 A kind of circular array auditory localization visualization system and method
CN110428850A (en) * 2019-08-02 2019-11-08 深圳市无限动力发展有限公司 Voice pick-up method, device, storage medium and mobile robot
CN110470379A (en) * 2019-08-23 2019-11-19 武汉理工大学 A kind of substation's movable-type intelligent noise continuous collecting system
CN111381211A (en) * 2020-03-02 2020-07-07 北京声智科技有限公司 Sound source positioning method and device
CN111730641A (en) * 2020-07-01 2020-10-02 珠海格力智能装备有限公司 Method and device for determining noise source, processor and electronic device
CN112198498A (en) * 2020-09-11 2021-01-08 海创半导体科技(深圳)有限公司 Method for measuring distance by using intelligent voice module
CN112946578A (en) * 2021-02-02 2021-06-11 上海头趣科技有限公司 Novel double-ear positioning method
CN115174816A (en) * 2022-08-15 2022-10-11 广州伏羲智能科技有限公司 Environmental noise sound source directional snapshot method and device based on microphone array
CN117388644A (en) * 2023-06-27 2024-01-12 国网宁夏电力有限公司电力科学研究院 Power equipment partial discharge positioning method and system
CN117388644B (en) * 2023-06-27 2024-04-16 国网宁夏电力有限公司电力科学研究院 Power equipment partial discharge positioning method and system

Similar Documents

Publication Publication Date Title
CN102305925A (en) Robot continuous sound source positioning method
CN110383284B (en) Gesture recognition based on ultrasonic waves
CN103308889B (en) Passive sound source two-dimensional DOA (direction of arrival) estimation method under complex environment
CN104991573A (en) Locating and tracking method and apparatus based on sound source array
CN1952684A (en) Method and device for localization of sound source by microphone
CN102411138A (en) Method for positioning sound source by robot
CN103278801A (en) Noise imaging detection device and detection calculation method for transformer substation
CN103901395B (en) Coherent signal direction of arrival Dynamic Tracking under a kind of impulsive noise environment
WO2020024816A1 (en) Audio signal processing method and apparatus, device, and storage medium
CN102147458B (en) Method and device for estimating direction of arrival (DOA) of broadband sound source
CN105044676A (en) Energy-based sound source localization method
CN103792513B (en) A kind of thunder navigation system and method
CN105223551A (en) A kind of wearable auditory localization tracker and method
CN110534126B (en) Sound source positioning and voice enhancement method and system based on fixed beam forming
CN109212481A (en) A method of auditory localization is carried out using microphone array
CN105607042A (en) Method for locating sound source through microphone array time delay estimation
CN109541548A (en) A kind of air sonar localization method based on Matched Field
CN103854660A (en) Four-microphone voice enhancement method based on independent component analysis
CN103760520A (en) Monolingual sound source DOA estimation method based on AVS and sparse representation
WO2017216999A1 (en) Wave source direction estimation apparatus, wave source direction estimation system, wave source direction estimation method, and wave source direction estimation program
CN109254265A (en) A kind of whistle vehicle positioning method based on microphone array
CN112720448B (en) Positioning robot for self-recognition and positioning system thereof
CN111239691B (en) Multi-sound-source tracking method for restraining main sound source
CN204795569U (en) Portable pair of microphone sound source is discerned and positioner
Reddy et al. Robotics audition using kinect

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120104