CN103064061A - Sound source localization method of three-dimensional space - Google Patents

Sound source localization method of three-dimensional space Download PDF

Info

Publication number
CN103064061A
CN103064061A CN2013100014601A CN201310001460A CN103064061A CN 103064061 A CN103064061 A CN 103064061A CN 2013100014601 A CN2013100014601 A CN 2013100014601A CN 201310001460 A CN201310001460 A CN 201310001460A CN 103064061 A CN103064061 A CN 103064061A
Authority
CN
China
Prior art keywords
microphone array
microphone
minitype
acoustic target
angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013100014601A
Other languages
Chinese (zh)
Other versions
CN103064061B (en
Inventor
杨鹏
徐勤奇
孙昊
祖丽楠
郑昀
尹哲
吴秀谦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hebei University of Technology
Original Assignee
Hebei University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hebei University of Technology filed Critical Hebei University of Technology
Priority to CN201310001460.1A priority Critical patent/CN103064061B/en
Publication of CN103064061A publication Critical patent/CN103064061A/en
Application granted granted Critical
Publication of CN103064061B publication Critical patent/CN103064061B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Circuit For Audible Band Transducer (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

A sound source localization method of a three-dimensional space adopts a movable small microphone array and a sound source localization technology based on time delay estimation. The small microphone array is used for collecting a period of target sound source signals, a mutual correlation algorithm is used for calculating time differences between the microphones of the small microphone array, the time differences are substituted into computational formulas of azimuth and elevation to get the azimuth and the elevation of the target sound source, and then the small microphone array is moved for some distance along a certain azimuth, and the operations are repeated to get the azimuth and the elevation of the target sound source at the moment. Through measuring the azimuth and the elevation of the target sound source twice, the distance of the target sound source is calculated. The method of measuring target sound source is a passive method. The small microphone array is moved during the measuring process, and the defects that accuracy of the sound source target distance measuring of the prior art is low, and cost is high and safety is not ensured due to the fact that an active method is adopted to measure the sound source target distance are overcome.

Description

The three dimensions sound localization method
Technical field
Technical scheme of the present invention relates to uses the device that sound wave is located by the cooperation of determining a plurality of directions, specifically three dimensions sound localization method.
Background technology
Now, along with the continuous expansion of bionics techniques application, become gradually the important topic of numerous research fields such as Mobile Robotics Navigation, voice signal enhancing and submarine target perception based on the Auditory Perception technology of microphone array.Can say, the sense of hearing is one of important symbol of New Generation of Intelligent robot, is to realize " people-machine-environment " mutual important means.Because sound has the characteristic of cut-through thing, the sense of hearing can match with vision in many information acquisition systems, thereby remedies the limitation that the visual field of vision is limited and can not pass non-printing opacity barrier.In addition, can not only the localization of sound source target in " auditory scene ", can also obtain more valuable information by the modern signal processing technology.Therefore, design high-precision sound source locating device and have important theory significance and using value in medical treatment, service and military field.
Microphone sound source locating device of the prior art and method can only localization of sound source orientation angle, accurately orientation distances.For example, CN201010191634.1 disclosed " a kind of sound source locating device ", the method of the location spatial sound source that adopts is: gather one section acoustic target signal, then mistiming between each microphone be can obtain by said apparatus and its method for calculating and locating, deflection, the elevation angle and distance calculated according to mistiming and array geometry model.The deflection that the method calculates and elevation accuracy are very high, but the precision of distance is just relatively poor.The measuring distance method of using in this patented technology is passive means, and in the whole measuring process of the method, microphone array is not moved.The shortcoming of this prior art is that the precision of orientation distance is not high enough.The sound localization method that document " based on the object locating system of orthopyramid battle array " was mentioned in (Southeast China University's journal the 5th phase of the 25th volume) is: gather one section acoustic target signal, then can obtain mistiming between each microphone by said system and algorithm, then can only calculate deflection and the elevation angle according to mistiming and array geometry model, and not calculate distance this moment.And the measuring method of this piece article middle distance is: in array center the device that can launch sound is set, after audio emission is gone out, can be reflected back when arriving acoustic target, this moment, array received was to sound, during sound and receive mistiming in these two moment when reflecting sound, calculate the distance of acoustic target according to emission.The measuring distance method that this piece article uses is active method, and in the process of measuring distance, array is not moved yet.The shortcoming of the method is to come measuring distance with active method, so just needs the equipment of extra additional emission sound, has increased the cost of system.Also have potential safety hazard if be used in addition military aspect, for example be used in the submarine detection, need to launch voice signal when at this moment using active method, this signal is easily found by the other side and is received, thereby exposed oneself, the generation potential safety hazard.
Summary of the invention
Technical matters to be solved by this invention is: the three dimensions sound localization method is provided, and is to adopt the movable small microphone array and carry out the three dimensions sound localization method based on the auditory localization technology that time delay is estimated.The method of the measurement acoustic target that the inventive method adopts is passive means, the middle-size and small-size microphone array of measuring process moves, and has overcome the measurement acoustic target range accuracy of prior art low and adopt active method to measure the high and unsafe shortcoming of acoustic target distance costs.
The present invention solves this technical problem the technical scheme that adopts: the three dimensions sound localization method is to adopt the movable small microphone array and carry out the three dimensions sound localization method based on the auditory localization technology that time delay is estimated,
A. the used device of the method
Comprise minitype microphone array, power supply conditioning device, data collecting card and host computer, wherein minitype microphone array is made of four summits that four independences and the identical microphone of characteristic lay respectively at positive tetrahedron, comprises in the host computer that time-delay calculation model, position angle calculate model, elevation angle computation model and apart from computation model; Each microphone needs the data line of a BNC connector to be connected with the power supply conditioning device, the data line of power supply conditioning device by 4 BNC connectors is connected with whole microphone array and thinks that the latter powers, the power supply conditioning device also is connected with data collecting card by the data line of 4 BNC connectors, and data collecting card is connected a usb data line and connects with host computer;
The step of B. carrying out the three dimensions sound localization method with said apparatus is:
The three dimensions auditory localization comprises that the position angle B, the elevation angle F that determine acoustic target, acoustic target are from the horizontal range d of the central point of microphone array bottom surface 2With the distance D of acoustic target to the central point of minitype microphone array bottom surface,
The first step is measured the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves
Minitype microphone array is positive tetrahedron, and the center of establishing the positive tetrahedron bottom surface is true origin O, and the microphone of position, true origin O dead ahead is S1, the microphone of true origin O location right is S2, the microphone of true origin O left position is S3, and the microphone of true origin O top position is S4
(1) carrying out the time delay that each microphone is relative in the minitype microphone array by the time-delay calculation model in the host computer estimates
A position of selecting according to the mensuration environmental baseline, gathering a period of time with minitype microphone array is the target sound signal of 10ms~30ms, voice signal passes to host computer by data collecting card, the relative time that host computer at first calculates between four microphones that voice signal arrives four summits laying respectively at positive tetrahedron is poor, be that voice signal arrives the time delay value between the moment of microphone S2, microphone S3 and microphone S4 and moment that voice signal arrives microphone S1, concrete grammar is as follows:
The coordinate of supposing the discrete event signal model of two microphones reception voice signals is:
X 1(t)=a 1s(t)+n 1(t),x 2(t)=a 2s(t-τ 12)+n 2(t) (1)
In the following formula, α iBe the attenuation coefficient of sound-source signal, s (t) is the acoustic target signal, x i(t) voice signal that gathers for microphone, n i(t) be the additional noise signal of sound source, τ 1,2Be two time delays that microphone picks up voice signal, i.e. time delay,
With the voice signal x that gathers i(t), i=1,2 by Fourier transform, changes into frequency domain signal X by time domain i(ω), its cross-power spectrum function is:
G X 1 X 2 ( ω ) = X 1 ( ω ) X 2 * ( ω ) - - - ( 2 )
Its cross correlation function is:
R x 1 x 2 ( τ ) = ∫ 0 π G X 1 X 2 ( ω ) e jωτ dω - - - ( 3 )
Carry out at last peak value and detect, the point of the horizontal ordinate that the peak value of cross correlation function is corresponding is exactly time delay value t 21, using the same method to calculate time delay value t 31And t 41, the time delay value that finally draws between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21, t 31, t 41
(2) calculate the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
If Q is the acoustic target point, coordinate is Q (x, y, z), true origin O is r to the distance of acoustic target point Q, and OQ is projected as OQ ' XOY plane, and definition OQ ' is α with the angle of X-axis, the angle of OQ and Z axis is that β supposes that S1 is a to the distance of true origin O, and then the coordinate of four microphones is respectively: S 1=(a, 0,0), S 2 = ( - a / 2 , 3 a / 2,0 ) , S 3 = ( - a / 2 , - 3 a / 2,0 ) , S 4 = ( 0,0 , 2 a ) ,
Obtaining the time delay value that voice signal arrives between the moment of microphone S2, microphone S3 and microphone S4 and moment that voice signal arrives microphone S1 from above-mentioned (1) is respectively: t 21, t 31, t 41,
At this moment the position angle formula that draws sound source is:
α ≈ arctsn 3 t 31 - t 21 t 21 + t 31 - - - ( 4 )
The angle of the α that above-mentioned formula (4) calculates is not necessarily in the regulation azimuth coverage, because the problem of quadrant, the range of results that formula (4) Arctan calculates is that-90 degree are to 90 degree, and needed regulation position angle range of results is that-180 degree are to 180 degree, this just need to divide quadrant to process, via following position angle quadrant processing procedure, draw and for the first time measure the position angle A of acoustic target before minitype microphone array moves and be:
When result of calculation α>0, and t 310 o'clock, position angle A=α,
When result of calculation α>0, and t 31<0 o'clock, position angle A=-180+ α,
When result of calculation α<0, and t 210 o'clock, position angle A=α,
When result of calculation α<0, and t 21<0 o'clock, position angle A=180+ α,
At this moment the elevation angle formula that draws sound source is:
β ≈ arccot t 21 + t 31 - 3 t 41 2 2 t 21 2 + t 31 2 - t 21 t 31 - - - ( 5 ) ,
Above-mentioned formula (5) calculates the angle of β not necessarily in the regulation elevation coverage, because the problem of quadrant, the range of results that formula (5) Arccot calculates is that-90 degree are to 90 degree, and the regulation elevation angle range of results that needs is that 0 degree is to 180 degree, according to the geometric model that calculates, here divide quadrant to process, via following elevation angle quadrant processing procedure, draw and measure the elevation angle E of acoustic target before minitype microphone array moves for the first time and be:
When result of calculation β>0, elevation angle E=β
When result of calculation β<0, elevation angle E=180+ β
Second step, mobile minitype microphone array
After the first step is finished, clockwise rotating χ-A degree by the mobile robot original place realizes minitype microphone array is clockwise rotated χ-A degree, 0 degree<χ<180 degree also is that the mobile robot dead ahead moves forward distance L with minitype microphone array along array orientation angle 0 degree direction again;
In the 3rd step, measure the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves
After second step operation is finished, on the position that after minitype microphone array moves, arrives, repeat operation and calculating with the first step, the result is,
(1) carrying out the time delay that each microphone is relative in the minitype microphone array by the time-delay calculation model in the host computer estimates
The time delay value that finally draws between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21, t 31, t 41
(2) calculate the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Draw and for the second time measure the position angle B of acoustic target after minitype microphone array moves and be:
When result of calculation α>0, and t 310 o'clock, position angle B=α,
When result of calculation α>0, and t 31<0 o'clock, position angle B=-180+ α,
When result of calculation α<0, and t 210 o'clock, position angle B=α,
When result of calculation α<0, and t 21<0 o'clock, position angle B=180+ α,
Draw and for the second time measure the elevation angle F of acoustic target after minitype microphone array moves and be:
When result of calculation β>0, elevation angle F=β
When result of calculation β<0, elevation angle F=180+ β
In the 4th step, calculate acoustic target to the horizontal range of the central point of microphone array bottom surface
By calculating acoustic target to the horizontal range of the central point of microphone array bottom surface apart from computation model in the host computer, computing formula is:
d 2=L*sin(χ)/sin(180-χ-δ) (6)
d 2Be the horizontal range of acoustic target to the central point of microphone array bottom surface;
In the 5th step, calculate acoustic target to the distance of the central point of minitype microphone array bottom surface
By calculating acoustic target to the distance of the central point of minitype microphone array bottom surface apart from computation model in the host computer, computing formula is:
D=d 2/sin(F) (7)
D is that acoustic target is to the distance of the central point of minitype microphone array bottom surface;
The 6th step, the demonstration output of three dimensions auditory localization data
By the peripheral hardware of computing machine, namely display shows or outputs to the elevation angle F, acoustic target of the position angle B that shows the output acoustic target on other computer, acoustic target to the horizontal range d of the central point of microphone array bottom surface by network interface card 2With the distance D of acoustic target to the central point of minitype microphone array bottom surface, finish thus the three dimensions auditory localization.
Above-mentioned three dimensions sound localization method, the bottom surface circumradius of the positive tetrahedron of described minitype microphone array is 10 centimetres.
Above-mentioned three dimensions sound localization method, using software in the described host computer is matlab.
Above-mentioned three dimensions sound localization method, the scope of described L is preferably 0.5~1.5m.
Above-mentioned three dimensions sound localization method, the scope of described χ are preferably 45 degree~135 degree.
Above-mentioned three dimensions sound localization method, described mobile minitype microphone array are by manually moving with minitype microphone array or being moved with minitype microphone array by the mobile robot.
Above-mentioned three dimensions sound localization method, used microphone are the MPA201 microphones that Beijing Sheng Wang Acoustic-Electric (BSWA) Technology Co., Ltd. produces, and consist of the MPA201 microphone array by four these microphones; The power supply conditioning device is the microphone power supply conditioning device MC104 that Beijing popularity company produces; Data collecting card is the NI9215A data collecting card that American National instrument and equipment (NI) is produced, host computer is general PC, after host computer has been installed the NIDAQ driving, just can write the Matlab program, read the data that the NI data collecting card collects, can also use the filter function of matlab to realize filtering.
The invention has the beneficial effects as follows: compared with prior art, the outstanding substantive distinguishing features of three dimensions sound localization method of the present invention is to adopt the movable small microphone array and carry out the three dimensions auditory localization based on the auditory localization technology that time delay is estimated, namely adopting minitype microphone array to gather a period of time is the acoustic target signal of 10ms~30ms, carrying out the mistiming draws the orientation angles and the elevation angle first time of acoustic target after calculating, after this this minitype microphone array moves a segment distance along certain orientation, and then collection a period of time is the acoustic target signal of 10ms~30ms, carrying out the mistiming draws the orientation angles and the elevation angle second time of acoustic target after calculating again, just can calculate the distance of acoustic target by twice position angle of acoustic target and measurement and the position angle that this minitype microphone array moves and the distance that moves at the elevation angle, thereby finish the three dimensions auditory localization.
Compared with prior art, significant progressive being of three dimensions sound localization method of the present invention, calculated amount is little, precision is high, can be in three dimensions localization of sound source target accurately, the method of the measurement acoustic target that the inventive method adopts is passive means, and the middle-size and small-size microphone array of measuring process moves, and has overcome prior art and has adopted active method to measure the high also unsafe shortcoming of acoustic target distance costs.
Description of drawings
The present invention is further described below in conjunction with drawings and Examples.
Fig. 1 is the formation of the used device of the inventive method and consists of each several part connected mode schematic block diagram.
Fig. 2 is that the minitype microphone array in the used device of the inventive method consists of schematic diagram.
Fig. 3 is the algorithm principle figure of position angle, the elevation angle and distance of the calculating acoustic target of the inventive method.
Fig. 4 is that the calculating acoustic target of the inventive method is to the schematic diagram calculation of the horizontal range of the central point of minitype microphone array bottom surface.
Among the figure, 1. microphone, 2. minitype microphone array, 3. acoustic target.
Embodiment
Embodiment illustrated in fig. 1 showing, the used device of the inventive method comprises minitype microphone array, power supply conditioning device, data collecting card and host computer, and wherein minitype microphone array is made of four summits that four independences and the identical microphone of characteristic lay respectively at positive tetrahedron; The power supply conditioning device is connected with whole microphone array by the data line of 4 BNC connectors, the power supply conditioning device also is connected with data collecting card by the data line of 4 BNC connectors, data collecting card is connected a usb data line and connects with host computer, the power supply conditioning device is connected with the 220v AC power by wire.
Embodiment illustrated in fig. 2 showing, the minitype microphone array 2 in the used device of three dimensions sound localization method of the present invention is to be made of four summits that four independences and the identical microphone 1 of characteristic lay respectively at positive tetrahedron.
Embodiment illustrated in fig. 3 showing, the algorithm principle of calculating acoustic target orientation angles, the elevation angle and the distance of the inventive method is:
Minitype microphone array is positive tetrahedron, and S1, S2, S3, S4 are respectively four microphones, and O both had been true origin, also be the center of positive tetrahedron bottom surface simultaneously, establishing Q is the acoustic target point, and coordinate is Q (x, y, z), true origin O is r to the distance of acoustic target point Q, and OQ is projected as OQ ' XOY plane, definition OQ ' is α with the angle of X-axis, the angle of OQ and Z axis is β, supposes that S1 is a to the distance of true origin O, and then the coordinate of four microphones is respectively: S 1=(a, 0,0), S 2 = ( - a / 2 , 3 a / 2,0 ) , S 3 = ( - a / 2 , 3 a / 2,0 ) , S 4 = ( 0 , 0 , 2 a ) ,
Time delay value between the moment of voice signal arrival microphone S2, S3 and S4 and the moment that voice signal arrives microphone S1 is respectively: t 21, t 31, t 41, the position angle formula that at this moment draws sound source is:
α ≈ arctsn 3 t 31 - t 21 t 21 + t 31
Owing to will carry out twice azimuthal measurement that minitype microphone array moves front and back in the inventive method, each measurement all is that computer azimuth angle is carried out in the position angle publicity above having used, calculate for the first time the position angle A of acoustic target before minitype microphone array moves, calculate the position angle B of acoustic target after minitype microphone array moves for the second time.α is azimuthal general designation.The relation of α and position angle A or B is as follows:
When result of calculation α>0, and t 310 o'clock, position angle A or B=α
When result of calculation α>0, and t 31<0 o'clock, position angle A or B=-180+ α
When result of calculation α<0, and t 210 o'clock, position angle A or B=α
When result of calculation α<0, and t 21<0 o'clock, position angle A or B=180+ α
At this moment the elevation angle formula that draws sound source is:
β ≈ arccot t 21 + t 31 - 3 t 41 2 2 t 21 2 + t 31 2 - t 21 t 31
Owing to will carry out the measurement that minitype microphone array moves twice elevation angle of front and back in the inventive method, each measurement all is that the elevation angle is calculated in the elevation angle publicity above having used, calculate for the first time the elevation angle E of acoustic target before minitype microphone array moves, calculate the elevation angle F of acoustic target after minitype microphone array moves for the second time.β is the general designation at the elevation angle.The relation of β and elevation angle E or F is as follows:
When result of calculation β>0, elevation angle E or elevation angle F=β.
When result of calculation β<0, elevation angle E or elevation angle F=180+ β.
Apart from computing formula:
r=OQ′/sin(β)
R is that acoustic target is to the general designation of the distance of the central point of microphone array bottom surface.Because will carry out minitype microphone array in the inventive method moves, before and after twice acoustic target distance to the horizontal range of the central point of minitype microphone array bottom surface and twice acoustic target to the central point of minitype microphone array bottom surface is arranged, wherein, after minitype microphone array moves acoustic target to the horizontal range d of the central point of minitype microphone array bottom surface 2Represent, acoustic target represents with alphabetical D to the distance of the central point of minitype microphone array bottom surface after minitype microphone array moves.
Draw thus the central point O of bottom surface of the positive tetrahedron of the orientation angles α, the elevation angle β that measure acoustic target 3 and the minitype microphone array after minitype microphone array 2 moves 2 2And the distance of acoustic target 3 between the projection Z on the plane, place of positive tetrahedron bottom surface is d 2, the central point O of the bottom surface of the positive tetrahedron of the minitype microphone array 2 after minitype microphone array 2 moves 2And the distance between the acoustic target 3 is D.
Embodiment illustrated in fig. 4 showing, the calculating acoustic target of the inventive method to the Computing Principle of the horizontal range of the central point of minitype microphone array bottom surface is:
O among this figure 1The central point of bottom surface of the positive tetrahedron of the minitype microphone array 2 of minitype microphone array 2 when not moving, O 2Be the central point of the bottom surface of the positive tetrahedron of minitype microphone array 2 behind the minitype microphone array 2 displacement L, Z is that acoustic target 3 is in the projection on the plane, place of positive tetrahedron bottom surface.Black arrow represents the direction of position angle 0 degree of minitype microphone array 2, O 1Place's black arrow and O 1The angle of Z is A, O 2Place's black arrow and O 2The angle of Z is B.
The central point O of the bottom surface of the positive tetrahedron of the minitype microphone array 2 when minitype microphone array 2 does not move 1And the distance of acoustic target 3 between the projection Z on the plane, place of positive tetrahedron bottom surface is d 1, the central point O of the bottom surface of the positive tetrahedron of the minitype microphone array 2 after minitype microphone array 2 moves 2And the distance of acoustic target 3 between the projection Z on the plane, place of positive tetrahedron bottom surface is d 2, the distance that minitype microphone array 2 moves is L, the moving direction O of minitype microphone array 2 1O 2The direction O of the acoustic target 3 before not mobile with minitype microphone array 2 1The angle of Z is χ, the opposite direction O of the moving direction of minitype microphone array 2 2O 1The direction O of the acoustic target 3 after moving with minitype microphone array 2 2The angle of Z is δ, the central point O of the bottom surface of the positive tetrahedron of the minitype microphone array 2 after moving by following computing formula calculating 2And acoustic target 3 between the projection Z on the plane, place of positive tetrahedron bottom surface apart from d 2For:
d 2=L*sin(χ)/sin(180-χ-δ)
Embodiment 1
A. the used device of the present embodiment
PC after comprising minitype microphone array MPA201 microphone array, power supply conditioning device MC104, NI9215A data collecting card and the NIDAQ driving being installed, this minitype microphone array is that the bottom surface circumradius is 10 centimetres positive tetrahedron, used microphone is the MPA201 microphone that Beijing Sheng Wang Acoustic-Electric (BSWA) Technology Co., Ltd. produces, use software matlab in the host computer, mainly comprise time-delay calculation model, orientation angles computation model, elevation angle computation model in the host computer and apart from computation model; Each microphone needs the data line of a BNC connector to be connected with the power supply conditioning device, the data line of power supply conditioning device by 4 BNC connectors is connected with whole microphone array and thinks that the latter powers, the power supply conditioning device also is connected with data collecting card by the data line of 4 BNC connectors, and data collecting card is connected a usb data line and connects with host computer.
B. this enforcement with the step that said apparatus carries out the three dimensions sound localization method is:
The three dimensions auditory localization comprises that the position angle B, the elevation angle F that determine acoustic target, acoustic target are from the horizontal range d of the central point of microphone array bottom surface 2With the distance D of acoustic target to the central point of minitype microphone array bottom surface,
The first step is measured the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves
Minitype microphone array is positive tetrahedron, and the center of establishing the positive tetrahedron bottom surface is true origin O, and the microphone of position, true origin O dead ahead is S1, the microphone of true origin O location right is S2, the microphone of true origin O left position is S3, and the microphone of true origin O top position is S4
(1) carrying out the time delay that each microphone is relative in the minitype microphone array by the time-delay calculation model in the host computer estimates
A position of selecting according to the mensuration environmental baseline, gathering a period of time with minitype microphone array is the target sound signal of 10ms, voice signal passes to host computer by data collecting card, the relative time that host computer at first calculates between four microphones that voice signal arrives four summits laying respectively at positive tetrahedron is poor, be that voice signal arrives the time delay value between the moment of microphone S2, microphone S3 and microphone S4 and moment that voice signal arrives microphone S1, concrete grammar is as follows:
The coordinate of supposing the discrete event signal model of two microphones reception voice signals is:
x 1(t)=a 1s(t)+n 1(t),x 2(t)=a 2s(t-τ 12)+n 2(t) (1)
In the following formula, a iBe the attenuation coefficient of sound-source signal, s (t) is the acoustic target signal, x i(t) voice signal that gathers for microphone, n i(t) be the additional noise signal of sound source, τ 1,2Be two time delays that microphone picks up voice signal, i.e. time delay,
With the voice signal x that gathers i(t), i=1,2 by Fourier transform, changes into frequency domain signal X by time domain i(ω), its cross-power spectrum function is:
G X 1 X 2 ( ω ) = X 1 ( ω ) X 2 * ( ω ) - - - ( 2 )
Its cross correlation function is:
R x 1 x 2 ( τ ) = ∫ 0 π G X 1 X 2 ( ω ) e jωτ dω - - - ( 3 )
Carry out at last peak value and detect, the point of the horizontal ordinate that the peak value of cross correlation function is corresponding is exactly time delay value t 21, using the same method to calculate time delay value t 31And t 41
The result that the time delay that gained is relative is estimated is: microphone S2 is 29 with respect to the mistiming of microphone S1, and microphone S3 is 49 with respect to the mistiming of microphone S1, and microphone S4 is 28 with respect to the mistiming of microphone 1.
Because capture card is 100k, therefore real times of 29 representatives here are 29 sampling periods, are 29*10 -5Second; The real time of 49 representatives here is 49 sampling periods, is 49*10 -5Second; The real time of 28 representatives here is 28 sampling periods, is 28*10 -5Second.
The time delay value that is derived as between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21=29, t 31=49, t 41=28;
(2) calculate the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Microphone array is classified positive tetrahedron as, establishes S1, S2, S3, S4 are respectively four microphones, and O had been true origin both, also be the center of positive tetrahedron bottom surface simultaneously, establishing Q is the acoustic target point, and coordinate is Q (x, y, z), true origin O is r to the distance of acoustic target point Q, and OQ is projected as OQ ' XOY plane, definition OQ ' is α with the angle of X-axis, the angle of OQ and Z axis is β, supposes that S1 is a to the distance of true origin O, and then the coordinate of four microphones is respectively: S 1=(a, 0,0), S 2 = ( - a / 2 , 3 a / 2,0 ) , S 3 = ( - a / 2 , 3 a / 2,0 ) , S 4 = ( 0 , 0 , 2 a ) ,
Obtaining the time delay value that voice signal arrives between the moment of microphone S2, microphone S3 and microphone S4 and moment that voice signal arrives microphone S1 from above-mentioned (1) is respectively: t 21, t 31, t 41
At this moment the position angle formula that draws sound source is:
α ≈ arctsn 3 t 31 - t 21 t 21 + t 31 - - - ( 4 )
Calculate α=29 degree, divide the quadrant problem to get according to the front about the position angle: the A=29 degree.
At this moment drawing elevation angle formula is:
β ≈ arccot t 21 + t 31 - 3 t 41 2 2 t 21 2 + t 31 2 - t 21 t 31 - - - ( 5 )
Calculate β=-87 degree, divide the quadrant problem to get according to the front about the elevation angle: E=180+(-87)=93 degree, namely elevation angle E is 93 degree.
Draw thus and measure for the first time the position angle A=29 degree of acoustic target that acoustic target calculates before minitype microphone array moves and calculate the elevation angle E=93 degree of acoustic target before minitype microphone array moves;
Second step, mobile minitype microphone array
After the first step is finished, clockwise rotating the 90-29 degree by the mobile robot original place realizes minitype microphone array is clockwise rotated the 90-29 degree, χ=90 degree also is that the robot dead ahead moves forward distance L=1 meter with minitype microphone array along array orientation angle 0 degree direction again;
In the 3rd step, measure the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves
After the second step operation is finished, on the position that minitype microphone array arrives, repeat the operation of the first step,
(1) carrying out the time delay that each microphone is relative in the minitype microphone array by the time-delay calculation model in the host computer estimates
The result that the time delay that gained is relative is estimated is: microphone S2 is 49 with respect to the mistiming of microphone S1, and microphone S3 is-13 with respect to the mistiming of microphone S1, and microphone S4 is-20 with respect to the mistiming of microphone S1.
Because capture card is 100k, therefore real times of-49 representatives here are-49 sampling periods, are-49*10 -5Second; The real time of-13 representatives here is-13 sampling periods, is-13*10 -5Second; The real time of-20 representatives here is-20 sampling periods, is-20*10 -5Second.
The time delay value that draws between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21=-49, t 31=-13, t 41=-20;
(2) calculate the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Drawing the result who measures acoustic target for the second time is:
α=-45.1630 degree, the position angle B=180+(-45.1630 of acoustic target after minitype microphone array moves)=-134.8370 degree;
β=-88.1577 degree, the elevation angle F=180+(-88.1577 of acoustic target after minitype microphone array moves)=91.8423 degree.
In the 4th step, calculate acoustic target from the horizontal range of the central point of microphone array bottom surface
Computing formula is:
d 2=L*sin(χ)/sin(180-χ-δ) (6)
The above-mentioned the data obtained of substitution draws the horizontal range d of the central point of sound source distance microphone array bottom surface 2For:
d 2=1*sin(90)/sin(180-90-(180-134.837))=1.4183;
In the 5th step, calculate acoustic target to the distance D of the central point of minitype microphone array bottom surface
Computing formula is:
D=d 2/sin(F) (7)
The above-mentioned the data obtained of substitution draws acoustic target:
D=1.4183/sin(91.8423)=1.4187
The 6th step, the demonstration output of three dimensions auditory localization data
Peripheral hardware by computing machine, be that display shows or outputs to the concrete outcome that shows the auditory localization of output the present embodiment three dimensions on other computer by network interface card and is: the position angle B=-134.8370 degree of acoustic target, the elevation angle F=91.8423 degree of acoustic target, acoustic target is from the horizontal range d of the central point of microphone array bottom surface 2=1.4183 and acoustic target to the distance D of the central point of minitype microphone array bottom surface=1.4187, finish thus the three dimensions auditory localization.
Embodiment 2
A. the used device of the method
With embodiment 1.
B. this enforcement with the step that said apparatus carries out the three dimensions sound localization method is:
Herein with embodiment 1.
The first step is measured the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves
Herein with embodiment 1.
(1) be that other are with embodiment 1 the target sound signal of 20ms except gathering a period of time with minitype microphone array.
The result that the time delay that gained is relative is estimated is: microphone S2 is 36 with respect to the mistiming of microphone S1, and microphone S3 is 49 with respect to the mistiming of microphone S1, and microphone S4 is 28 with respect to the mistiming of microphone S1.
Because capture card is 100k, therefore real times of 36 representatives here are 36 sampling periods, are 36*10 -5Second; The real time of 49 representatives here is 49 sampling periods, is 49*10 -5Second; The real time of 28 representatives here is 28 sampling periods, is 28*10 -5Second.
The time delay value that draws between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21=36, t 31=49, t 41=28
(2) calculate the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Herein with embodiment 1.
Calculate α=14.8370 degree, calculate β=89.0786 degree;
Draw thus and measure for the first time the position angle A=14.8370 degree of acoustic target that acoustic target calculates before minitype microphone array moves and calculate the elevation angle E=89.0786 degree of acoustic target before minitype microphone array moves;
Second step, mobile minitype microphone array
After the first step is finished, clockwise rotating the 45-14.8370 degree by the mobile robot original place realizes minitype microphone array is clockwise rotated the 45-14.8370 degree, χ=45 degree also is that the robot dead ahead moves forward distance L=0.5 meter with minitype microphone array along array orientation angle 0 degree direction again;
In the 3rd step, measure the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves
After the second step operation is finished, on the position that minitype microphone array arrives, repeat the operation of the first step,
(1) result that the time delay that gained is relative is estimated is: microphone S2 is-45 with respect to the mistiming of microphone S1, and microphone S3 is-3 with respect to the mistiming of microphone S1, and microphone S4 is-17 with respect to the mistiming of microphone S1.
Because capture card is 100k, therefore real times of-45 representatives here are-45 sampling periods, are-45*10 -5Second; The real time of-3 representatives here is-3 sampling periods, is-3*10 -5Second; The real time of-17 representatives here is-17 sampling periods, is-17*10 -5Second.
The time delay value that is derived as between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21=-45, t 31=-3, t 41=-17;
(2) calculate the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Drawing the result who measures acoustic target for the second time is:
α=-56.5820 degree, the position angle B=123.4180 degree of acoustic target after minitype microphone array moves;
β=88.6057 degree, the elevation angle F=88.6057 degree of acoustic target after minitype microphone array moves.
In the 4th step, calculate acoustic target from the horizontal range of the central point of microphone array bottom surface
Computing formula is:
d 2=L*sin(χ)/sin(180-χ-δ) (6)
The horizontal range d of the central point of the above-mentioned the data obtained sound source of substitution distance microphone array bottom surface 2For:
d 2=0.5*sin(45)/sin(180-45-(180-123.4180))=0.3609;
In the 5th step, calculate acoustic target to the distance D of the central point of minitype microphone array bottom surface
Computing formula is:
D=d 2/sin(F) (7)
The above-mentioned the data obtained of substitution draws acoustic target:
D=0.3609/sin(88.6057)=0.3610
The 6th step, the demonstration output of three dimensions auditory localization data
Peripheral hardware by computing machine, be that display shows or outputs to the concrete outcome that shows the auditory localization of output the present embodiment three dimensions on other computer by network interface card and is: the position angle B=123.4180 degree of acoustic target, the elevation angle F=88.6057 degree of acoustic target, acoustic target is from the horizontal range d of the central point of microphone array bottom surface 2=0.3609 and acoustic target to the distance D of the central point of minitype microphone array bottom surface=0.3610, finish thus the three dimensions auditory localization.
Embodiment 3
B. this enforcement with the step that said apparatus carries out the three dimensions sound localization method is:
Herein with embodiment 1.
The first step is measured the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves
Herein with embodiment 1.
(1) be that other are with embodiment 1 the target sound signal of 30ms except gathering a period of time with minitype microphone array.
The result that the time delay that gained is relative is estimated is: microphone S2 is 39 with respect to the mistiming of microphone S1, and microphone S3 is 47 with respect to the mistiming of microphone S1, and microphone S4 is 28 with respect to the mistiming of microphone S1.
Because capture card is 100k, therefore real times of 39 representatives here are 39 sampling periods, are 39*10 -5Second; The real time of 47 representatives here is 47 sampling periods, is 47*10 -5Second; The real time of 28 representatives here is 28 sampling periods, is 28*10 -5Second.
The time delay value that is derived as between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21=39, t 31=47, t 41=28
(2) calculate the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Herein with embodiment 1.
Calculate α=9.1529 degree, calculate β=88.1403 degree,
Draw thus and measure for the first time the position angle A=9.1529 degree of acoustic target that acoustic target calculates before minitype microphone array moves and calculate the elevation angle E=88.1403 degree of acoustic target before minitype microphone array moves;
Second step, mobile minitype microphone array
After the first step is finished, clockwise rotating the 135-9.1529 degree by the mobile robot original place realizes minitype microphone array is clockwise rotated the 135-9.1529 degree, χ=135 degree also is that the robot dead ahead moves forward distance L=1.5 meter with minitype microphone array along array orientation angle 0 degree direction again;
In the 3rd step, measure the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves
After the second step operation is finished, on the position that minitype microphone array arrives, repeat the operation of the first step,
(1) result that the time delay that gained is relative is estimated is: microphone S2 is-13 with respect to the mistiming of microphone S1, and microphone S3 is-9 with respect to the mistiming of microphone S1, and microphone S4 is-8 with respect to the mistiming of microphone S1.
Because capture card is 100k, therefore real times of-13 representatives here are-13 sampling periods, are-13*10 -5Second; The real time of-9 representatives here is-9 sampling periods, is-9*10 -5Second; The real time of-8 representatives here is-8 sampling periods, is-8*10 -5Second.
The time delay value that is derived as between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21=-13, t 31=-9, t 41=-8
(2) calculate the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Drawing the result who measures acoustic target for the second time is:
α=-17.4802 degree, the position angle B=162.5198 degree of acoustic target after minitype microphone array moves;
β=86.4914 degree, the elevation angle F=86.4914 degree of acoustic target after minitype microphone array moves.
In the 4th step, calculate acoustic target from the horizontal range of the central point of microphone array bottom surface
Computing formula is:
d 2=L*sin(χ)/sin(180-χ-δ) (6)
The horizontal range d of the central point of the above-mentioned the data obtained sound source of substitution distance microphone array bottom surface 2For:
d 2=1.5*sin(135)/sin(180-135-(180-162.5198))=2.2955;
In the 5th step, calculate acoustic target to the distance D of the central point of minitype microphone array bottom surface
Computing formula is:
D=d 2/sin(F) (7)
The above-mentioned the data obtained of substitution draws acoustic target:
D=2.2955/sin(86.4914)=2.2998
The 6th step, the demonstration output of three dimensions auditory localization data
Peripheral hardware by computing machine, be that display shows or outputs to the concrete outcome that shows the auditory localization of output the present embodiment three dimensions on other computer by network interface card and is: the position angle B=162.5198 degree of acoustic target, the elevation angle F=86.4914 degree of acoustic target, acoustic target is from the horizontal range d of the central point of microphone array bottom surface 2=2.2955 and acoustic target to the distance D of the central point of minitype microphone array bottom surface=2.2998, finish thus the three dimensions auditory localization.
Components and parts used among above-mentioned all embodiment are all by commercially available.

Claims (5)

1. three dimensions sound localization method is characterized in that: be to adopt the movable small microphone array and carry out the three dimensions sound localization method based on the auditory localization technology that time delay is estimated,
A. the used device of the method
Comprise minitype microphone array, power supply conditioning device, data collecting card and host computer, wherein minitype microphone array is made of four summits that four independences and the identical microphone of characteristic lay respectively at positive tetrahedron, comprises in the host computer that time-delay calculation model, position angle calculate model, elevation angle computation model and apart from computation model; Each microphone needs the data line of a BNC connector to be connected with the power supply conditioning device, the data line of power supply conditioning device by 4 BNC connectors is connected with whole microphone array and thinks that the latter powers, the power supply conditioning device also is connected with data collecting card by the data line of 4 BNC connectors, and data collecting card is connected a usb data line and connects with host computer;
The step of B. carrying out the three dimensions sound localization method with said apparatus is:
The three dimensions auditory localization comprises that the position angle B, the elevation angle F that determine acoustic target, acoustic target are from the horizontal range d of the central point of microphone array bottom surface 2With the distance D of acoustic target to the central point of minitype microphone array bottom surface,
The first step is measured the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves
Minitype microphone array is positive tetrahedron, and the center of establishing the positive tetrahedron bottom surface is true origin O, and the microphone of position, true origin O dead ahead is S1, the microphone of true origin O location right is S2, the microphone of true origin O left position is S3, and the microphone of true origin O top position is S4
(1) carrying out the time delay that each microphone is relative in the minitype microphone array by the time-delay calculation model in the host computer estimates
A position of selecting according to the mensuration environmental baseline, gathering a period of time with minitype microphone array is the target sound signal of 10ms~30ms, voice signal passes to host computer by data collecting card, the relative time that host computer at first calculates between four microphones that voice signal arrives four summits laying respectively at positive tetrahedron is poor, be that voice signal arrives the time delay value between the moment of microphone S2, microphone S3 and microphone S4 and moment that voice signal arrives microphone S1, concrete grammar is as follows:
The coordinate of supposing the discrete event signal model of two microphones reception voice signals is:
x 1(t)=a 1s(t)+n 1zt),x 2(t)=a 2s(t-t 12)+n 2(t) (1)
In the following formula, α iBe the attenuation coefficient of sound-source signal, s (t) is the acoustic target signal, x i(t) voice signal that gathers for microphone, n i(t) be the additional noise signal of sound source, τ 1,2Be two time delays that microphone picks up voice signal, i.e. time delay,
With the voice signal x that gathers i(t), i=1,2 by Fourier transform, changes into frequency domain signal X by time domain i(ω), its cross-power spectrum function is:
G X 1 X 2 ( ω ) = X 1 ( ω ) X 2 * ( ω ) - - - ( 2 )
Its cross correlation function is:
R x 1 x 2 ( τ ) = ∫ 0 π G X 1 X 2 ( ω ) e jωτ dω - - - ( 3 )
Carry out at last peak value and detect, the point of the horizontal ordinate that the peak value of cross correlation function is corresponding is exactly time delay value t 21, using the same method to calculate time delay value t 31And t 41, the time delay value that finally draws between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21, t 31, t 41
(2) calculate the position angle A of acoustic target before minitype microphone array moves and the elevation angle E before minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
If Q is the acoustic target point, coordinate is Q (x, y, z), true origin O is r to the distance of acoustic target point Q, and OQ is projected as OQ ' XOY plane, definition OQ ' is α with the angle of X-axis, the angle of OQ and Z axis is β, supposes that S1 is a to the distance of true origin O, and then the coordinate of four microphones is respectively: S 1=(a, 0,0), S 2 = ( - a / 2 , 3 a / 2,0 ) , S 3 = ( - a / 2 , - 3 a / 2,0 ) , S 4 = ( 0,0 , 2 a ) ,
Obtaining the time delay value that voice signal arrives between the moment of microphone S2, microphone S3 and microphone S4 and moment that voice signal arrives microphone S1 from above-mentioned (1) is respectively: t 21, t 31, t 41,
At this moment the position angle formula that draws sound source is:
α ≈ arctsn 3 t 31 - t 21 t 21 + t 31 - - - ( 4 )
The angle of the α that above-mentioned formula (4) calculates is not necessarily in the regulation azimuth coverage, because the problem of quadrant, the range of results that formula (4) Arctan calculates is that-90 degree are to 90 degree, and needed regulation position angle range of results is that-180 degree are to 180 degree, this just need to divide quadrant to process, via following position angle quadrant processing procedure, draw and for the first time measure the position angle A of acoustic target before minitype microphone array moves and be:
When result of calculation α>0, and t 310 o'clock, position angle A=α,
When result of calculation α>0, and t 31<0 o'clock, position angle A=-180+ α,
When result of calculation α<0, and t 210 o'clock, position angle A=α,
When result of calculation α<0, and t 21<0 o'clock, position angle A=180+ α,
At this moment the elevation angle formula that draws sound source is:
β ≈ arccot t 21 + t 31 - 3 t 41 2 2 t 21 2 + t 31 2 - t 21 t 31 - - - ( 5 ) ,
Above-mentioned formula (5) calculates the angle of β not necessarily in the regulation elevation coverage, because the problem of quadrant, the range of results that formula (5) Arccot calculates is that-90 degree are to 90 degree, and the regulation elevation angle range of results that needs is that 0 degree is to 180 degree, according to the geometric model that calculates, here divide quadrant to process, via following elevation angle quadrant processing procedure, draw and measure the elevation angle E of acoustic target before minitype microphone array moves for the first time and be:
When result of calculation β>0, elevation angle E=β,
When result of calculation β<0, elevation angle E=180+ β,
Second step, mobile minitype microphone array
After the first step is finished, clockwise rotating χ-A degree by the mobile robot original place realizes minitype microphone array is clockwise rotated χ-A degree, 0 degree<χ<180 degree also is that the mobile robot dead ahead moves forward distance L with minitype microphone array along array orientation angle 0 degree direction again;
In the 3rd step, measure the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves
After second step operation is finished, on the position that after minitype microphone array moves, arrives, repeat operation and calculating with the first step, the result is,
(1) carrying out the time delay that each microphone is relative in the minitype microphone array by the time-delay calculation model in the host computer estimates
The time delay value that finally draws between microphone S2, microphone S3 and microphone S4 and the microphone S1 is respectively: t 21, t 31, t 41
(2) calculate the position angle B of acoustic target after minitype microphone array moves and the elevation angle F after minitype microphone array moves by the calculating model of the position angle in the host computer and elevation angle computation model
Draw and for the second time measure the position angle B of acoustic target after minitype microphone array moves and be:
When result of calculation α>0, and t 310 o'clock, position angle B=α,
When result of calculation α>0, and t 31<0 o'clock, position angle B=-180+ α,
When result of calculation α<0, and t 210 o'clock, position angle B=α,
When result of calculation α<0, and t 21<0 o'clock, position angle B=180+ α,
Draw and for the second time measure the elevation angle F of acoustic target after minitype microphone array moves and be:
When result of calculation β>0, elevation angle F=β,
When result of calculation β<0, elevation angle F=180+ β,
In the 4th step, calculate acoustic target to the horizontal range of the central point of microphone array bottom surface
By calculating acoustic target to the horizontal range of the central point of microphone array bottom surface apart from computation model in the host computer, computing formula is:
d 2=L*sin(χ)/sin(180-χ-δ) (6)
d 2Be the horizontal range of acoustic target to the central point of microphone array bottom surface;
In the 5th step, calculate acoustic target to the distance of the central point of minitype microphone array bottom surface
By calculating acoustic target to the distance of the central point of minitype microphone array bottom surface apart from computation model in the host computer, computing formula is:
D=d 2/sin(F) (7)
D is that acoustic target is to the distance of the central point of minitype microphone array bottom surface;
The 6th step, the demonstration output of three dimensions auditory localization data
By the peripheral hardware of computing machine, namely display shows or outputs to the elevation angle F, acoustic target of the position angle B that shows the output acoustic target on other computer, acoustic target to the horizontal range d of the central point of microphone array bottom surface by network interface card 2With the distance D of acoustic target to the central point of minitype microphone array bottom surface, finish thus the three dimensions auditory localization.
2. described three dimensions sound localization method according to claim 1, it is characterized in that: the bottom surface circumradius of the positive tetrahedron of described minitype microphone array is 10 centimetres.
3. described three dimensions sound localization method according to claim 1, it is characterized in that: using software in the described host computer is matlab.
4. described three dimensions sound localization method according to claim 1, it is characterized in that: the scope of described L is 0.5~1.5m.
5. described three dimensions sound localization method according to claim 1, it is characterized in that: the scope of described χ is 45 degree~135 degree.
CN201310001460.1A 2013-01-05 2013-01-05 Sound source localization method of three-dimensional space Active CN103064061B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310001460.1A CN103064061B (en) 2013-01-05 2013-01-05 Sound source localization method of three-dimensional space

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310001460.1A CN103064061B (en) 2013-01-05 2013-01-05 Sound source localization method of three-dimensional space

Publications (2)

Publication Number Publication Date
CN103064061A true CN103064061A (en) 2013-04-24
CN103064061B CN103064061B (en) 2014-06-11

Family

ID=48106765

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310001460.1A Active CN103064061B (en) 2013-01-05 2013-01-05 Sound source localization method of three-dimensional space

Country Status (1)

Country Link
CN (1) CN103064061B (en)

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104360315A (en) * 2014-10-16 2015-02-18 河北工业大学 LabVIEW-based (laboratory virtual instrumentation engineering workbench based) microphone array sound source localization method and device
CN104459625A (en) * 2014-12-14 2015-03-25 南京理工大学 Sound source positioning device and method based on track moving double microphone arrays
CN104809259A (en) * 2014-01-23 2015-07-29 腾讯科技(深圳)有限公司 Method and device for positioning in three-dimensional space by reverberation
CN104991573A (en) * 2015-06-25 2015-10-21 北京品创汇通科技有限公司 Locating and tracking method and apparatus based on sound source array
CN105163209A (en) * 2015-08-31 2015-12-16 深圳前海达闼科技有限公司 Voice receiving processing method and voice receiving processing device
CN105204001A (en) * 2015-10-12 2015-12-30 Tcl集团股份有限公司 Sound source positioning method and system
CN105227752A (en) * 2014-12-16 2016-01-06 维沃移动通信有限公司 Find method and the mobile terminal of mobile terminal
CN105451151A (en) * 2014-08-29 2016-03-30 华为技术有限公司 Method and apparatus for processing sound signal
WO2016058393A1 (en) * 2014-10-16 2016-04-21 华为技术有限公司 Acoustic image direction sense processing method and device
CN105548998A (en) * 2016-02-02 2016-05-04 北京地平线机器人技术研发有限公司 Sound positioning device based on microphone array and method
CN105798917A (en) * 2016-04-29 2016-07-27 深圳市神州云海智能科技有限公司 Community safety alarm method and patrol robot
CN105807261A (en) * 2016-04-26 2016-07-27 深思考人工智能机器人科技(北京)有限公司 Device and method for distinguishing position by listening to sound
CN106303810A (en) * 2015-05-13 2017-01-04 青岛通产智能机器人有限公司 Sound bearing based on directional sound sensor judgment means and method
WO2017000775A1 (en) * 2015-06-30 2017-01-05 芋头科技(杭州)有限公司 Robot voice direction-seeking turning system and method
CN106448693A (en) * 2016-09-05 2017-02-22 华为技术有限公司 Speech signal processing method and apparatus
CN107003676A (en) * 2014-12-16 2017-08-01 罗伯特·博世有限公司 Method and work implement for the working region that recognizes utonomous working utensil
CN107894595A (en) * 2017-11-06 2018-04-10 上海航天测控通信研究所 A kind of delay time estimation method under non-gaussian SaS impulsive noise environments
CN107991670A (en) * 2017-11-21 2018-05-04 宇龙计算机通信科技(深圳)有限公司 Air navigation aid and mobile terminal
CN108802689A (en) * 2018-06-14 2018-11-13 河北工业大学 Space microphone localization method based on acoustic source array
CN108802684A (en) * 2018-03-29 2018-11-13 南京信息工程大学 Thunder 3-D positioning method based on inversion algorithm
CN108806684A (en) * 2018-06-27 2018-11-13 Oppo广东移动通信有限公司 Position indicating method, device, storage medium and electronic equipment
CN109100685A (en) * 2018-07-12 2018-12-28 南京信息工程大学 A kind of passive acoustic direction blending algorithm of two-sided quaternary cross battle array
CN109471145A (en) * 2018-10-17 2019-03-15 中北大学 A kind of alliteration positioning and orientation method based on acoustic passive location array with four sensors platform
CN109782225A (en) * 2019-01-18 2019-05-21 杭州微萤科技有限公司 A kind of localization method of base station coordinates
CN109831717A (en) * 2017-11-23 2019-05-31 深圳市优必选科技有限公司 A kind of noise reduction process method, system and terminal device
US10343287B2 (en) 2015-06-30 2019-07-09 Yutou Technology (Hangzhou) Co., Ltd. Robot voice direction-seeking turning system and method
CN110085029A (en) * 2019-05-31 2019-08-02 重庆交通大学 Highway cruising inspection system and method based on rail mounted crusing robot
CN110333541A (en) * 2019-07-09 2019-10-15 中科传启(苏州)科技有限公司 A kind of life body detecting method, equipment and automobile data recorder
CN110333540A (en) * 2019-07-09 2019-10-15 中科传启(苏州)科技有限公司 A kind of life body detecting method, equipment and automobile data recorder
WO2020192525A1 (en) * 2019-03-22 2020-10-01 成都信息工程大学 Irradiance-based radiation source orientation method
CN112684414A (en) * 2020-12-21 2021-04-20 广西大学 Unmanned aerial vehicle counter-braking method and device
CN112964256A (en) * 2019-12-13 2021-06-15 佛山市云米电器科技有限公司 Indoor positioning method, intelligent household appliance and computer readable storage medium
CN113317781A (en) * 2021-04-12 2021-08-31 中国人民解放军总医院第六医学中心 Audiometric system and method for testing sound source positioning capability
CN114034380A (en) * 2021-11-11 2022-02-11 上汽大众汽车有限公司 One-dimensional acoustic positioning method for engine pedestal
WO2022088437A1 (en) * 2020-10-28 2022-05-05 苏州触达信息技术有限公司 Method for positioning person in water, and wearable device
CN114624689A (en) * 2022-05-12 2022-06-14 杭州兆华电子股份有限公司 Near-field focusing sound source distance calculation method and system based on acoustic imaging instrument
TWI779561B (en) * 2021-03-11 2022-10-01 新加坡商鴻運科股份有限公司 Three-dimensional sound localization method, electronic device and computer readable storage

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1089092A1 (en) * 1999-10-01 2001-04-04 Baggermaatschappij Boskalis B.V. Method and apparatus for measuring physical parameters from the phase and amplitude histories of an acoustic signal
US20090279714A1 (en) * 2008-05-06 2009-11-12 Samsung Electronics Co., Ltd. Apparatus and method for localizing sound source in robot
CN101855914A (en) * 2007-11-13 2010-10-06 Akg声学有限公司 Position determination of sound sources
CN101957442A (en) * 2010-06-04 2011-01-26 河北工业大学 Sound source positioning device
US20120288124A1 (en) * 2011-05-09 2012-11-15 Dts, Inc. Room characterization and correction for multi-channel audio

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1089092A1 (en) * 1999-10-01 2001-04-04 Baggermaatschappij Boskalis B.V. Method and apparatus for measuring physical parameters from the phase and amplitude histories of an acoustic signal
CN101855914A (en) * 2007-11-13 2010-10-06 Akg声学有限公司 Position determination of sound sources
US20090279714A1 (en) * 2008-05-06 2009-11-12 Samsung Electronics Co., Ltd. Apparatus and method for localizing sound source in robot
CN101957442A (en) * 2010-06-04 2011-01-26 河北工业大学 Sound source positioning device
US20120288124A1 (en) * 2011-05-09 2012-11-15 Dts, Inc. Room characterization and correction for multi-channel audio

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
DIRK BECHLER等: "RELIABILITY MEASUREMENT OF TIME DIFFERENCE OF ARRIVAL ESTIMATIONS FOR MULTIPLE SOUND SOURCE LOCALIZATION", 《17TH ANNUAL MEETING OF THE IAR》 *
KAMEN Y等: "Learning-Based Three Dimensional Sound Localization Using a Compact Non-Coplanar Array of Microphones", 《PROC. AAAI SPRING SYMPOSIUM ON INTELLIGENT》 *
徐向前等: "基于声达时间差的多声源目标定位系统", 《中南大学学报(自然科学版)》 *
杨鹏等: "基于BP 神经网络的正四面体阵列声源定向研究", 《传感器与微系统》 *
谷岳等: "移动机器人三维空间听觉定位系统设计", 《计算机仿真》 *

Cited By (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809259A (en) * 2014-01-23 2015-07-29 腾讯科技(深圳)有限公司 Method and device for positioning in three-dimensional space by reverberation
CN105451151A (en) * 2014-08-29 2016-03-30 华为技术有限公司 Method and apparatus for processing sound signal
CN104360315A (en) * 2014-10-16 2015-02-18 河北工业大学 LabVIEW-based (laboratory virtual instrumentation engineering workbench based) microphone array sound source localization method and device
US9866983B2 (en) 2014-10-16 2018-01-09 Huawei Technologies Co., Ltd. Sound image direction sense processing method and apparatus
WO2016058393A1 (en) * 2014-10-16 2016-04-21 华为技术有限公司 Acoustic image direction sense processing method and device
CN104459625A (en) * 2014-12-14 2015-03-25 南京理工大学 Sound source positioning device and method based on track moving double microphone arrays
CN104459625B (en) * 2014-12-14 2017-07-21 南京理工大学 The sound source locating device and method of two-microphone array are moved based on track
CN105227752B (en) * 2014-12-16 2019-03-05 维沃移动通信有限公司 Find the method and mobile terminal of mobile terminal
CN107003676A (en) * 2014-12-16 2017-08-01 罗伯特·博世有限公司 Method and work implement for the working region that recognizes utonomous working utensil
CN105227752A (en) * 2014-12-16 2016-01-06 维沃移动通信有限公司 Find method and the mobile terminal of mobile terminal
CN106303810B (en) * 2015-05-13 2021-09-10 青岛通产智能机器人有限公司 Sound source direction judgment device and method based on directional sound sensor
CN106303810A (en) * 2015-05-13 2017-01-04 青岛通产智能机器人有限公司 Sound bearing based on directional sound sensor judgment means and method
CN104991573A (en) * 2015-06-25 2015-10-21 北京品创汇通科技有限公司 Locating and tracking method and apparatus based on sound source array
WO2017000775A1 (en) * 2015-06-30 2017-01-05 芋头科技(杭州)有限公司 Robot voice direction-seeking turning system and method
US10343287B2 (en) 2015-06-30 2019-07-09 Yutou Technology (Hangzhou) Co., Ltd. Robot voice direction-seeking turning system and method
CN105163209A (en) * 2015-08-31 2015-12-16 深圳前海达闼科技有限公司 Voice receiving processing method and voice receiving processing device
US10306360B2 (en) 2015-08-31 2019-05-28 Cloudminds (Shenzhen) Technologies Co., Ltd. Method and device for processing received sound and memory medium, mobile terminal, robot having the same
CN105204001A (en) * 2015-10-12 2015-12-30 Tcl集团股份有限公司 Sound source positioning method and system
CN105548998A (en) * 2016-02-02 2016-05-04 北京地平线机器人技术研发有限公司 Sound positioning device based on microphone array and method
CN105548998B (en) * 2016-02-02 2018-03-30 北京地平线机器人技术研发有限公司 Sound positioner and method based on microphone array
CN105807261A (en) * 2016-04-26 2016-07-27 深思考人工智能机器人科技(北京)有限公司 Device and method for distinguishing position by listening to sound
CN105807261B (en) * 2016-04-26 2018-04-10 深思考人工智能机器人科技(北京)有限公司 A kind of audition distinguishes the device and method of position
CN105798917B (en) * 2016-04-29 2019-02-15 深圳市神州云海智能科技有限公司 A kind of Community Safety alarm method and patrol robot
CN105798917A (en) * 2016-04-29 2016-07-27 深圳市神州云海智能科技有限公司 Community safety alarm method and patrol robot
CN106448693B (en) * 2016-09-05 2019-11-29 华为技术有限公司 A kind of audio signal processing method and device
CN106448693A (en) * 2016-09-05 2017-02-22 华为技术有限公司 Speech signal processing method and apparatus
CN107894595A (en) * 2017-11-06 2018-04-10 上海航天测控通信研究所 A kind of delay time estimation method under non-gaussian SaS impulsive noise environments
CN107991670A (en) * 2017-11-21 2018-05-04 宇龙计算机通信科技(深圳)有限公司 Air navigation aid and mobile terminal
CN109831717A (en) * 2017-11-23 2019-05-31 深圳市优必选科技有限公司 A kind of noise reduction process method, system and terminal device
CN108802684B (en) * 2018-03-29 2022-02-22 南京信息工程大学 Thunder three-dimensional positioning method based on inversion algorithm
CN108802684A (en) * 2018-03-29 2018-11-13 南京信息工程大学 Thunder 3-D positioning method based on inversion algorithm
CN108802689A (en) * 2018-06-14 2018-11-13 河北工业大学 Space microphone localization method based on acoustic source array
CN108806684A (en) * 2018-06-27 2018-11-13 Oppo广东移动通信有限公司 Position indicating method, device, storage medium and electronic equipment
CN109100685A (en) * 2018-07-12 2018-12-28 南京信息工程大学 A kind of passive acoustic direction blending algorithm of two-sided quaternary cross battle array
CN109471145A (en) * 2018-10-17 2019-03-15 中北大学 A kind of alliteration positioning and orientation method based on acoustic passive location array with four sensors platform
CN109471145B (en) * 2018-10-17 2022-12-06 中北大学 Double-sound positioning attitude determination method based on quaternary acoustic array platform
CN109782225A (en) * 2019-01-18 2019-05-21 杭州微萤科技有限公司 A kind of localization method of base station coordinates
WO2020192525A1 (en) * 2019-03-22 2020-10-01 成都信息工程大学 Irradiance-based radiation source orientation method
CN110085029A (en) * 2019-05-31 2019-08-02 重庆交通大学 Highway cruising inspection system and method based on rail mounted crusing robot
CN110085029B (en) * 2019-05-31 2020-08-04 重庆交通大学 Highway inspection system and method based on rail type inspection robot
CN110333541A (en) * 2019-07-09 2019-10-15 中科传启(苏州)科技有限公司 A kind of life body detecting method, equipment and automobile data recorder
CN110333540A (en) * 2019-07-09 2019-10-15 中科传启(苏州)科技有限公司 A kind of life body detecting method, equipment and automobile data recorder
CN112964256A (en) * 2019-12-13 2021-06-15 佛山市云米电器科技有限公司 Indoor positioning method, intelligent household appliance and computer readable storage medium
CN112964256B (en) * 2019-12-13 2024-02-27 佛山市云米电器科技有限公司 Indoor positioning method, intelligent household appliance and computer readable storage medium
WO2022088437A1 (en) * 2020-10-28 2022-05-05 苏州触达信息技术有限公司 Method for positioning person in water, and wearable device
CN112684414A (en) * 2020-12-21 2021-04-20 广西大学 Unmanned aerial vehicle counter-braking method and device
TWI779561B (en) * 2021-03-11 2022-10-01 新加坡商鴻運科股份有限公司 Three-dimensional sound localization method, electronic device and computer readable storage
US11750971B2 (en) 2021-03-11 2023-09-05 Nanning Fulian Fugui Precision Industrial Co., Ltd. Three-dimensional sound localization method, electronic device and computer readable storage
CN113317781A (en) * 2021-04-12 2021-08-31 中国人民解放军总医院第六医学中心 Audiometric system and method for testing sound source positioning capability
CN114034380A (en) * 2021-11-11 2022-02-11 上汽大众汽车有限公司 One-dimensional acoustic positioning method for engine pedestal
CN114034380B (en) * 2021-11-11 2023-11-17 上汽大众汽车有限公司 One-dimensional acoustic positioning method for engine rack
CN114624689A (en) * 2022-05-12 2022-06-14 杭州兆华电子股份有限公司 Near-field focusing sound source distance calculation method and system based on acoustic imaging instrument

Also Published As

Publication number Publication date
CN103064061B (en) 2014-06-11

Similar Documents

Publication Publication Date Title
CN103064061B (en) Sound source localization method of three-dimensional space
CN104035065A (en) Sound source orienting device on basis of active rotation and method for applying sound source orienting device
CN104865555A (en) Indoor sound source localization method based on sound position fingerprints
CN104991573A (en) Locating and tracking method and apparatus based on sound source array
Schillebeeckx et al. Biomimetic sonar: Binaural 3D localization using artificial bat pinnae
CN1952684A (en) Method and device for localization of sound source by microphone
CN106774901B (en) Remote PC body-sensing input method based on localization by ultrasonic
Tellakula Acoustic source localization using time delay estimation
Tervo et al. Acoustic reflection localization from room impulse responses
CN108037410B (en) Partial discharge ultrasonic positioning method and device based on controllable response power
Tuma et al. Sound source localization
CN110161458A (en) A kind of sonic location system based on Optical Fiber Michelson Interferometer
Ogiso et al. Robust indoor localization in a reverberant environment using microphone pairs and asynchronous acoustic beacons
CN109597021A (en) A kind of Wave arrival direction estimating method and device
Paulose et al. Acoustic source localization
KR20090128221A (en) Method for sound source localization and system thereof
Al-Sheikh et al. Sound source direction estimation in horizontal plane using microphone array
Kneip et al. Binaural model for artificial spatial sound localization based on interaural time delays and movements of the interaural axis
Thakur et al. Sound source localization of harmonic sources in entire 3D space using just 5 acoustic signals
CN116299182A (en) Sound source three-dimensional positioning method and device
Kossyk et al. Binaural bearing only tracking of stationary sound sources in reverberant environment
Lo Flight parameter estimation using time delay and intersensor multipath delay measurements from a small aperture acoustic array
Wu et al. Passive sonic detection and ranging for locating sound sources
Kunin et al. 3D direction of arrival estimation and localization using ultrasonic sensors in an anechoic chamber
Yang et al. A data complementary method for sound source localization based on four-element microphone array groups

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant