WO2019178802A1 - Method and device for estimating direction of arrival and electronics apparatus - Google Patents
Method and device for estimating direction of arrival and electronics apparatus Download PDFInfo
- Publication number
- WO2019178802A1 WO2019178802A1 PCT/CN2018/079993 CN2018079993W WO2019178802A1 WO 2019178802 A1 WO2019178802 A1 WO 2019178802A1 CN 2018079993 W CN2018079993 W CN 2018079993W WO 2019178802 A1 WO2019178802 A1 WO 2019178802A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- microphones
- arrival
- bands
- pair
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
- H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
- H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
- H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
- H04R3/005—Circuits for transducers for combining the signals of two or more microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
- H04R2430/21—Direction finding using differential microphone array [DMA]
Definitions
- the present invention relates to the technical field of microphone, and more specifically, to a method for estimating direction of arrival, a device for estimating direction of arrival and an electronics apparatus.
- Estimation of direction of arrival is widely used in microphone technology. For example, it can be used for uplink noise cancellation.
- the aim of estimating direction of arrival is to determine from which angular direction a single audio point source is located relative to a microphone array.
- the direction of arrival is represented by an angle of arrival, which is an angle between an impinging direction and a normal direction of the plane of the microphones.
- One object of an embodiment is to provide a new technical solution for estimating direction of arrival.
- a method for estimating direction of arrival comprising: digitalizing input audio signals from a pair of microphones in a microphone array within a certain time frame; buffering the digitalized signals; extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth; calculating phrase shift in each of the multiple sub-bands for the pair of microphones; performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; and calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
- a device for estimating direction of arrival comprising: an A/D converter, which converts input audio signals from a pair of microphones in a microphone array within a certain time frame into digitalized signals; a buffer, which buffers the digitalized signals; and a processing device, which performs the following processes: extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth; calculating phrase shift in each of the multiple sub-bands for the pair of microphones; performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; and calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
- an electronics apparatus including a device for estimating direction of arrival according to an embodiment.
- computing resources for estimating direction of arrival can be reduced.
- Fig. 1 is a schematic diagram showing time difference of arrival from a sound source to a microphone array.
- Fig. 2 is a schematic graph showing the relationship between frequency components and the phase differences.
- Fig. 3 is a schematic flow chart of a method for estimating direction of arrival according to an embodiment.
- Fig. 4. is a schematic graph showing the relationship coefficients between frequency components and the phase differences.
- Fig. 5 is a schematic diagram showing an exemplary processing of estimating direction of arrival.
- Fig. 6 is a schematic block diagram of a device for estimating direction of arrival according to another embodiment.
- Fig. 7 is a schematic diagram of an electronics apparatus to which the solution of an embodiment can be applied.
- the waves impinging the microphone array are considered as parallel.
- the frequency content of the impinging signal is assumed to be wideband (in the sense of the superposition of several frequencies covering a wide spectrum range) .
- the micro array can be a linear microphone array.
- the time difference of arrival between two microphones of the microphone array is directly correlated to a phase shift with respect to each frequency component of the impinging signal.
- Fig 1 the sound source S emits sound waves, which impinge the microphone array.
- the microphone array includes microphones mic1, mic2, ..., micN.
- the angle of arrival at time t is ⁇ (t) .
- D is the distance between the sound source S and a microphone array
- d is the distance between two consecutive microphones of the microphone array.
- the time difference of arrival ⁇ between two consecutive microphones can be expressed as follow:
- the time difference of arrival ⁇ can be expressed as a phase shift difference. Let be the phase of the frequency component ⁇ at the time t of the sound signal input from the k-th microphone and let be the phase of the frequency component ⁇ at the time t of the sound signal input from the k+1-th microphone.
- the first order phase difference can be then expressed as:
- Fig. 3 is a schematic flow chart of a method for estimating direction of arrival between a sound source and a microphone array according to an embodiment.
- Step S1100 digitalizing input audio signals from a pair of microphones in a microphone array within a certain time frame
- Step S1200 buffering the digitalized signals
- Step S1300 extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth
- Step S1400 calculating phrase shift in each of the multiple sub-bands for the pair of microphones
- Step S1500 performing linear regression according to the phrase shifts and the frequencies of the sub-bands to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones;
- Step S1600 calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones in a microphone array.
- the solution in this embodiment provides a new solution for calculating an angle of arrival.
- a signal from a pair of microphones in a microphone array is divided into multiple sub-bands.
- the obtained from respective sub-bands are linearly fitted, to obtain a fitted relationship coefficient.
- the angle of arrival for the microphone can directly be derived form one single inverse sine transform, without performing inverse sine transforms for every sub-bands and taking mean of the obtained angles of them as an optimized angle of arrival.
- This approach is relatively simple in computation and has a relatively low amount of data processing. The efficiency of this approach is relatively high.
- step S1100 input audio signals from a pair of microphones in a microphone array within a certain time frame are digitalized.
- the two microphones of the pair of microphones are consecutive.
- the certain time frame may be in a range of 10 ⁇ 20 ms.
- step S1200 the digitalized signals are buffered.
- step S1300 multiple sub-bands are extracted from each of the buffered signals, which covers a predefined bandwidth.
- a filter-bank may be used to extract the N sub-bands.
- the filter-bank is a well-known overlap-adding FFT based method, for example, with 40%, 50%or 60%overlapping.
- the filter-bank is an array of band-pass filters that that separates the input signal into multiple components, each one carrying a single frequency sub-band of the original signal.
- N is a power of 2.
- N can be chosen to be a value of the closest power of 2 (e.g. 2, 4, 8, 16, 32%) that will cover the 10-20 milliseconds time frame.
- the FFT algorithm will be more efficient if N is a power of 2.
- the phase can be derived, where k ⁇ [0, M-1] , M is the number of microphones in the microphone array, ⁇ [ ⁇ 0 , ⁇ N-1 ] covering a predefined bandwidth, and N is the number of sub-bands. It will be appreciated by a person skilled in the art that the sub-bands are narrow enough so that frequencies ⁇ can be used to represent them, respectively, in practice.
- the selection of the predefined bandwidth may depend on the application of the solution and on the microphone array topology such as the number of microphones, inter-element distance and so on.
- the application of the solution is speech.
- a speech is contained in the bandwidth from 150Hz to 7000Hz for a high intelligibility.
- Most of the speech energy is in the low-frequency part of this bandwidth.
- low frequencies are less directional than high frequencies. In other words, it is more difficult to find out from which direction the low frequencies are coming than the high frequencies.
- the plane waves propagating to adjacent microphones create delays in the microphone’s channels. These delays are translated into phase shifts for every individual frequencies of which the signals of interest are composed.
- the distance between two microphones determines the lowest frequency whose phase shift can be measured. The closer is the distance, the smaller is the phase shift.
- the predefined bandwidth is selected so that the distance d between the two microphones of the pair of microphones is less than half of the wavelength of the highest frequency in the N sub-bands, i.e. d ⁇ 0.5*wavelength of the highest frequency measured.
- the distance between the two microphone is then a trade-off between the lowest frequency and highest frequency which the signal of interest contains.
- phase shift ⁇ 1 sample time Ts 1/Fs, where Fs is the sampling rate.
- the selection of the predefined bandwidth shall be a trade-off between microphone distance and sampling rate.
- the predefined bandwidth is a relatively high part of the effective bandwidth of the input audio signals.
- the effective bandwidth of the input audio signals contains effective energy of the signal, and the relatively high part is used to make the detection of the direction of arrival more accurate.
- the effective bandwidth is in a range from 150 Hz to 7000 Hz.
- phrase shift in each of the multiple sub-bands for the pair of microphones is calculated.
- two adjacent microphones may be selected to derive for each of the N sub-bands.
- This phase shift may also be called as a 1st order phase difference.
- the phrase shifts of the N sub-bands produce a scatter of points in the plane of and ⁇ .
- the and ⁇ are in a linear relationship.
- the regression line between the axis and ⁇ axis is an ideal distribution of the phase shifts, and the derived are around the regression line.
- step S1500 linear regression is performed according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones.
- the linear regression is performed according to the phrase shifts and frequencies of the sub-bands based on Least Mean Square LMS or Normalized Least Mean Square NLMS, to estimate the estimated relationship coefficient.
- the linear regression is performed to estimate the estimated relationship coefficient based on the following relationships:
- phase shift of each of the N sub-bands is the frequency of each of the N sub-bands is and the estimated relationship coefficient is
- a linear regression algorithm based on a LMS or NLMS regulation control is used here in order to estimate the relationship coefficient such that the estimation will minimize the variance of the scattered points along the regression line (the line surrounded by the points in Fig. 4) .
- an estimated relationship coefficient between frequency component and the phase shift may be obtained.
- the estimated relationship coefficient can be deemed as the slope of the regression line.
- the direction of arrival is calculated through the estimated relationship coefficient for the pair of microphones.
- the direction of arrival is calculated based on the speed of sound in the air, the distance between the two microphones of the pair of microphones and the estimated relationship coefficient.
- the direction of arrival is an estimated angle of arrival which is an angle between an impinging direction and a normal direction of the plane of the pair of microphones.
- the direction of arrival can be calculated through the following relationship:
- C is the speed of sound in the air
- d is the distance between the two microphones of the pair of microphones
- the sign of will determine whether is a positive or a negative angle.
- the estimated relationship coefficient contains the angle information inherently, many other approaches, other than the angle of arrival, may be used to represent the direction of arrival based on the relationship coefficient.
- a linear regression is used to take advantage of the linear relationship between the phase shift and the frequency.
- the proportionality coefficient is first estimated and optimized and then only one single inverse sine transform is made to obtain an estimated angle of arrival Compared with the prior art, this embodiment is computationally more optimal and is also more robust to diffuse noise as explained above.
- the microphone array includes at least two pairs of microphones.
- Angles of arrival of the at least two pairs of microphones can be estimated as above and are The estimated angles of arrival are placed into a histogram to obtain an optimized estimated angle of arrival.
- the histogram can be used for statistical analysis in order to ensure an angular region whose resolution is to be defined by the application and the microphone array characteristics.
- the estimated angles of arrival obtained from the pairs of microphones are statistically processed to select the most likely angle of arrival or a scope for angle of arrival, as the direction of arrival with respect to the microphone array.
- Fig. 5 is a schematic diagram showing an exemplary processing of estimating direction of arrival.
- the microphone array includes three microphones mic1, mic2 and mic3.
- the impinging waves are received by the three microphones and then are passed as input signal to the processing unit A1, A2 and A3, in which they are digitalized and buffered.
- N sub-bands are extracted from the input signals in A1, A2 and A3.
- phases of the N sub-bands are calculated. Based on the phases of the N sub-bands, phase shifts of the two corresponding sub-bands for mic1 and mic2, of the N sub-bands are obtained.
- phase shifts of consecutive microphones are obtained, it will be appreciated by a person skilled in the art that phase shift of other microphones is also possible, for example, the phase shift between the first microphone mic1 and the third microphone mic3.
- an estimated relationship coefficient is obtained through linear regression based on LMS or NLMS. Likewise, an estimated relationship coefficient is also obtained.
- Estimated angles of arrival can be derived from the coefficients
- Fig. 6 is a schematic block diagram of a device for estimating direction of arrival according to another embodiment. As shown in Fig. 6, the device 20 for estimating direction of arrival is connected to a microphone array 10 and receives input audio signals from the microphone array 10.
- the device 20 for estimating direction of arrival comprises: an A/D converter 21, a buffer 22, and a processing device 23.
- the A/D converter 21 receives input audio signals from a pair of microphones in a microphone array within a certain time frame and converts them into digitalized signals.
- the buffer 22 buffers the digitalized signals.
- the pair of microphones includes two adjacent microphones in the microphone array.
- the certain time frame may be in a range of 10 ⁇ 20 ms.
- the processing device 23 extracts multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth.
- the predefined bandwidth is a relatively high part of the effective bandwidth of the input audio signals and the effective bandwidth is in a range from 150 Hz to 7000 Hz.
- the predefined bandwidth is selected so that the distance d between the two microphones of the pair of microphones is less than half of the wavelength of the highest frequency in the N sub-bands.
- the predefined bandwidth may be a relatively high part of the effective bandwidth of the input audio signals.
- N may be a power of 2..
- the processing device 23 calculates phrase shift in each of the multiple sub-bands for the pair of microphones.
- the processing device 23 performs linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones.
- the linear regression is performed according to the phrase shifts and frequencies of the sub-bands based on Least Mean Square LMS or Normalized Least Mean Square NLMS, to estimate the estimated relationship coefficient.
- the linear regression is performed to estimate the estimated relationship coefficient based on the following relationships:
- phase shift of each of the N sub-bands is the frequency of each of the N sub-bands is and the estimated relationship coefficient is
- the processing device 23 calculates the direction of arrival through the estimated relationship coefficient for the pair of microphones. For example, the processing device 23 further performs the following process: calculating the direction of arrival based on the speed of sound in the air, the distance between the two microphones of the pair of microphones and the estimated relationship coefficient.
- the direction of arrival is an estimated angle of arrival which is an angle between an impinging direction and a normal direction of the plane of the pair of microphones, wherein the processing device 23 calculates the direction of arrival based on the following relationship:
- C is the speed of sound in the air
- d is the distance between the two microphones of the pair of microphones and is the estimated relationship coefficient
- the microphone array includes at least two pairs of microphones.
- the processing device 23 produces estimated angles of arrival of the at least two pairs of microphones, respectively.
- the device 20 for estimating direction of arrival further comprises a histogram unit, which receives and places them into a histogram to obtain an optimized estimated angle of arrival.
- the components 21-23 may be implemented along or separately by software, hardware or a combination thereof.
- a computing unit such as a CPU or a MPU and a memory storing instructions for controlling the computing unit to implement the respective functions during the running thereof.
- a computing unit such as a CPU or a MPU and a memory storing instructions for controlling the computing unit to implement the respective functions during the running thereof.
- they can be implemented in a programmable logic circuitry, field-programmable gate arrays (FPGA) , programmable logic arrays (PLA) , or an application-specific integrated circuit (ASIC) .
- FPGA field-programmable gate arrays
- PLA programmable logic arrays
- ASIC application-specific integrated circuit
- Fig. 7 is a schematic diagram of an electronics apparatus to which the solution of an embodiment can be applied.
- the electronics apparatus 30 includes a device for estimating direction of arrival as above.
- an earphone 30 is shown, and it includes a control box 31.
- the device for estimating direction of arrival may be placed in the control box 31.
- the electronics apparatus can be any type of electronic apparatus, such as an ear-bud, a headphone, a smart phone, a tablet, a laptop and so on.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Circuit For Audible Band Transducer (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Abstract
The present invention discloses a method and device for estimating direction of arrival and an electronics apparatus. The method comprises: digitalizing input audio signals from a pair of microphones in a microphone array within a certain time frame; buffering the digitalized signals; extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth; calculating phrase shifts in each of the multiple sub-bands for the pair of microphones; performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; and calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
Description
The present invention relates to the technical field of microphone, and more specifically, to a method for estimating direction of arrival, a device for estimating direction of arrival and an electronics apparatus.
Estimation of direction of arrival is widely used in microphone technology. For example, it can be used for uplink noise cancellation.
The aim of estimating direction of arrival is to determine from which angular direction a single audio point source is located relative to a microphone array. Generally, the direction of arrival is represented by an angle of arrival, which is an angle between an impinging direction and a normal direction of the plane of the microphones.
In the prior art, this task is performed by means of beam-forming and statistical analysis.
In this prior art, the amount of calculation is relatively high and the efficiency is relatively low.
SUMMARY OF THE INVENTION
One object of an embodiment is to provide a new technical solution for estimating direction of arrival.
According to a first aspect, there is provided a method for estimating direction of arrival, comprising: digitalizing input audio signals from a pair of microphones in a microphone array within a certain time frame; buffering the digitalized signals; extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth; calculating phrase shift in each of the multiple sub-bands for the pair of microphones; performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; and calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
According to a second aspect, there is provided a device for estimating direction of arrival, comprising: an A/D converter, which converts input audio signals from a pair of microphones in a microphone array within a certain time frame into digitalized signals; a buffer, which buffers the digitalized signals; and a processing device, which performs the following processes: extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth; calculating phrase shift in each of the multiple sub-bands for the pair of microphones; performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; and calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
According to a third aspect, there is provided an electronics apparatus, including a device for estimating direction of arrival according to an embodiment.
According to an embodiment, computing resources for estimating direction of arrival can be reduced.
Further features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments according to the present invention with reference to the attached drawings.
BRIEF DISCRIPTION OF THE DRAWINGS
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description thereof, serve to explain the principles of the invention.
Fig. 1 is a schematic diagram showing time difference of arrival from a sound source to a microphone array.
Fig. 2 is a schematic graph showing the relationship between frequency components and the phase differences.
Fig. 3 is a schematic flow chart of a method for estimating direction of arrival according to an embodiment.
Fig. 4. is a schematic graph showing the relationship coefficients between frequency components and the phase differences.
Fig. 5 is a schematic diagram showing an exemplary processing of estimating direction of arrival.
Fig. 6 is a schematic block diagram of a device for estimating direction of arrival according to another embodiment.
Fig. 7 is a schematic diagram of an electronics apparatus to which the solution of an embodiment can be applied.
DETAILED DESCRIPTION OF THE EMBODIMENTS
Various exemplary embodiments of the present invention will now be described in detail with reference to the drawings. It should be noted that the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present invention unless it is specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods and apparatus as known by one of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all of the examples illustrated and discussed herein, any specific values should be interpreted to be illustrative only and non-limiting. Thus, other examples of the exemplary embodiments could have different values.
Notice that similar reference numerals and letters refer to similar items in the following figures, and thus once an item is defined in one figure, it is possible that it need not be further discussed for following figures.
Generally, for a single point sound source located far enough (usually D >> d, for example, typically D is 10 times longer than d) , where D is the distance between the sound source and a microphone array and d is the inter-element distance between the microphones of the microphone array, the waves impinging the microphone array are considered as parallel. The frequency content of the impinging signal is assumed to be wideband (in the sense of the superposition of several frequencies covering a wide spectrum range) . Here, the micro array can be a linear microphone array.
The time difference of arrival between two microphones of the microphone array is directly correlated to a phase shift with respect to each frequency component of the impinging signal. This is illustrated in Fig 1. As shown in Fig. 1, the sound source S emits sound waves, which impinge the microphone array. The microphone array includes microphones mic1, mic2, …, micN. The phrases of frequency component ω at time t of the input sound signals from the microphones are
i=1…N, respectively. The angle of arrival at time t is θ (t) . D is the distance between the sound source S and a microphone array, and d is the distance between two consecutive microphones of the microphone array.
The time difference of arrival τ between two consecutive microphones can be expressed as follow:
where θ is the angle of arrival, and C is the speed of sound in the air. Here, because D >>d, the impinging waves are deemed to be parallel.
For each frequency component of the source signal, the time difference of arrival τ can be expressed as a phase shift difference. Let
be the phase of the frequency component ω at the time t of the sound signal input from the k-th microphone and let
be the phase of the frequency component ω at the time t of the sound signal input from the k+1-th microphone. The first order phase difference can be then expressed as:
The expression can be re-written in terms of time difference of arrival:
There exists a direct proportional relationship between the frequency component ω and the 1st order phase difference
for a given angle of arrival θ:
This relationship can be expressed as:
This direct proportional relationship is shown in Fig. 2. As shown in Fig. 2, the slope α (θ) is proportional to θ. So, θ can be derived from this relationship.
Fig. 3 is a schematic flow chart of a method for estimating direction of arrival between a sound source and a microphone array according to an embodiment.
Step S1100, digitalizing input audio signals from a pair of microphones in a microphone array within a certain time frame;
Step S1200, buffering the digitalized signals;
Step S1300, extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth;
Step S1400, calculating phrase shift in each of the multiple sub-bands for the pair of microphones;
Step S1500, performing linear regression according to the phrase shifts and the frequencies of the sub-bands to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones;
Step S1600, calculating the direction of arrival through the estimated relationship coefficient for the pair of microphones in a microphone array.
As above, the solution in this embodiment provides a new solution for calculating an angle of arrival. In this solution, a signal from a pair of microphones in a microphone array is divided into multiple sub-bands. The
obtained from respective sub-bands are linearly fitted, to obtain a fitted relationship coefficient. The angle of arrival for the microphone can directly be derived form one single inverse sine transform, without performing inverse sine transforms for every sub-bands and taking mean of the obtained angles of them as an optimized angle of arrival. This approach is relatively simple in computation and has a relatively low amount of data processing. The efficiency of this approach is relatively high.
In the below, the steps of the method will be described in more details. As shown in Fig. 3, at step S1100, input audio signals from a pair of microphones in a microphone array within a certain time frame are digitalized. For example, the two microphones of the pair of microphones are consecutive. Generally, the certain time frame may be in a range of 10~20 ms.
At step S1200, the digitalized signals are buffered.
At step S1300, multiple sub-bands are extracted from each of the buffered signals, which covers a predefined bandwidth.
Usually, a filter-bank may be used to extract the N sub-bands. The filter-bank is a well-known overlap-adding FFT based method, for example, with 40%, 50%or 60%overlapping. The filter-bank is an array of band-pass filters that that separates the input signal into multiple components, each one carrying a single frequency sub-band of the original signal.
For example, N is a power of 2. N can be chosen to be a value of the closest power of 2 (e.g. 2, 4, 8, 16, 32…) that will cover the 10-20 milliseconds time frame. Here, the FFT algorithm will be more efficient if N is a power of 2.
For example, the phase
can be derived, where k∈ [0, M-1] , M is the number of microphones in the microphone array, ω∈ [ω
0, ω
N-1] covering a predefined bandwidth, and N is the number of sub-bands. It will be appreciated by a person skilled in the art that the sub-bands are narrow enough so that frequencies ω can be used to represent them, respectively, in practice.
The selection of the predefined bandwidth may depend on the application of the solution and on the microphone array topology such as the number of microphones, inter-element distance and so on.
In one embodiment, the application of the solution is speech. Commonly, a speech is contained in the bandwidth from 150Hz to 7000Hz for a high intelligibility. Most of the speech energy is in the low-frequency part of this bandwidth. However, low frequencies are less directional than high frequencies. In other words, it is more difficult to find out from which direction the low frequencies are coming than the high frequencies.
In another aspect, the plane waves propagating to adjacent microphones create delays in the microphone’s channels. These delays are translated into phase shifts for every individual frequencies of which the signals of interest are composed.
Consequently, the distance between two microphones determines the lowest frequency whose phase shift can be measured. The closer is the distance, the smaller is the phase shift.
On the other hand, a close distance helps to detect high frequencies. Here, in order to avoid a “time aliasing” phenomena, the predefined bandwidth is selected so that the distance d between the two microphones of the pair of microphones is less than half of the wavelength of the highest frequency in the N sub-bands, i.e. d < 0.5*wavelength of the highest frequency measured.
To sum up, the closer the microphones are, the better high frequencies can be detected and the lesser low frequencies can be detected. The distance between the two microphone is then a trade-off between the lowest frequency and highest frequency which the signal of interest contains.
In addition, in order to measure the phase shift introduced into the direction of arrival, the sampling rate is considered. The higher the sampling rate is, the more accurate small phase shift can be measured, especially, when the phase shift corresponds to a fraction of a single sample, i.e. phase shift < 1 sample time Ts = 1/Fs, where Fs is the sampling rate.
In this regard, the selection of the predefined bandwidth shall be a trade-off between microphone distance and sampling rate.
So, in an example, the predefined bandwidth is a relatively high part of the effective bandwidth of the input audio signals. Here, the effective bandwidth of the input audio signals contains effective energy of the signal, and the relatively high part is used to make the detection of the direction of arrival more accurate. Here the effective bandwidth is in a range from 150 Hz to 7000 Hz.
At step S1400, phrase shift in each of the multiple sub-bands for the pair of microphones is calculated.
Here, two adjacent microphones (or consecutives microphones) may be selected to derive
for each of the N sub-bands. For example,
where ω∈ [ω
0, ω
N-1] . This phase shift may also be called as a 1st order phase difference. As shown in Fig. 4, the phrase shifts of the N sub-bands produce a scatter of points in the plane of
and ω. Generally, it is deemed that the
and ω are in a linear relationship. The regression line between the
axis and ω axis is an ideal distribution of the phase shifts, and the derived
are around the regression line.
At step S1500, linear regression is performed according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones.
For example, the linear regression is performed according to the phrase shifts and frequencies of the sub-bands based on Least Mean Square LMS or Normalized Least Mean Square NLMS, to estimate the estimated relationship coefficient.
In an example, the linear regression is performed to estimate the estimated relationship coefficient based on the following relationships:
where the phase shift of each of the N sub-bands is
the frequency of each of the N sub-bands is
and the estimated relationship coefficient is
As shown in Fig. 4, the natural presences of background noise, electronics noise and/or reverberation in real life acoustical environment tend to diffuse the distribution of those phrase shift points outside the theoretical proportionality relationship line in the plane of
and ω. In order to overcome this problem, a linear regression algorithm based on a LMS or NLMS regulation control is used here in order to estimate the relationship coefficient
such that the estimation will minimize the variance of the scattered points along the regression line (the line surrounded by the points in Fig. 4) . As shown in Fig. 4, an estimated relationship coefficient
between frequency component and the phase shift may be obtained. The estimated relationship coefficient
can be deemed as the slope of the regression line.
At step S1600, the direction of arrival is calculated through the estimated relationship coefficient for the pair of microphones.
For example, the direction of arrival is calculated based on the speed of sound in the air, the distance between the two microphones of the pair of microphones and the estimated relationship coefficient.
In an example, the direction of arrival is an estimated angle of arrival
which is an angle between an impinging direction and a normal direction of the plane of the pair of microphones.
The direction of arrival can be calculated through the following relationship:
wherein C is the speed of sound in the air , d is the distance between the two microphones of the pair of microphones, and
is the estimated relationship coefficient. The sign of
will determine whether
is a positive or a negative angle.
It will be appreciated by a person skilled in the art that since the estimated relationship coefficient contains the angle information inherently, many other approaches, other than the angle of arrival, may be used to represent the direction of arrival based on the relationship coefficient.
In the embodiment, a linear regression is used to take advantage of the linear relationship between the phase shift and the frequency. Here, the proportionality coefficient
is first estimated and optimized and then only one single inverse sine transform is made to obtain an estimated angle of arrival
Compared with the prior art, this embodiment is computationally more optimal and is also more robust to diffuse noise as explained above.
Optionally, the microphone array includes at least two pairs of microphones. Angles of arrival of the at least two pairs of microphones can be estimated as above and are
The estimated angles of arrival
are placed into a histogram to obtain an optimized estimated angle of arrival. The histogram can be used for statistical analysis in order to ensure an angular region whose resolution is to be defined by the application and the microphone array characteristics. Here, the estimated angles of arrival obtained from the pairs of microphones are statistically processed to select the most likely angle of arrival or a scope for angle of arrival, as the direction of arrival with respect to the microphone array.
Fig. 5 is a schematic diagram showing an exemplary processing of estimating direction of arrival. In Fig. 5, the microphone array includes three microphones mic1, mic2 and mic3. The impinging waves are received by the three microphones and then are passed as input signal to the processing unit A1, A2 and A3, in which they are digitalized and buffered. Then, N sub-bands are extracted from the input signals in A1, A2 and A3. Then, phases
of the N sub-bands are calculated. Based on the phases of the N sub-bands, phase shifts
of the two corresponding sub-bands for mic1 and mic2,
of the N sub-bands are obtained. Here, although the phase shifts of consecutive microphones are obtained, it will be appreciated by a person skilled in the art that phase shift of other microphones is also possible, for example, the phase shift between the first microphone mic1 and the third microphone mic3.
By using the phase shifts
of the N sub-bands, an estimated relationship coefficient
is obtained through linear regression based on LMS or NLMS. Likewise, an estimated relationship coefficient
is also obtained.
Finally, the estimated angles of arrival
are put into a histogram to obtain an optimized estimated angle of arrival
Fig. 6 is a schematic block diagram of a device for estimating direction of arrival according to another embodiment. As shown in Fig. 6, the device 20 for estimating direction of arrival is connected to a microphone array 10 and receives input audio signals from the microphone array 10.
The device 20 for estimating direction of arrival comprises: an A/D converter 21, a buffer 22, and a processing device 23.
The A/D converter 21 receives input audio signals from a pair of microphones in a microphone array within a certain time frame and converts them into digitalized signals. The buffer 22 buffers the digitalized signals. For example, the pair of microphones includes two adjacent microphones in the microphone array. The certain time frame may be in a range of 10~20 ms.
The processing device 23 extracts multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth. For example, the predefined bandwidth is a relatively high part of the effective bandwidth of the input audio signals and the effective bandwidth is in a range from 150 Hz to 7000 Hz. For example, the predefined bandwidth is selected so that the distance d between the two microphones of the pair of microphones is less than half of the wavelength of the highest frequency in the N sub-bands. The predefined bandwidth may be a relatively high part of the effective bandwidth of the input audio signals. N may be a power of 2..
The processing device 23 calculates phrase shift in each of the multiple sub-bands for the pair of microphones.
The processing device 23 performs linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones. For example, the linear regression is performed according to the phrase shifts and frequencies of the sub-bands based on Least Mean Square LMS or Normalized Least Mean Square NLMS, to estimate the estimated relationship coefficient.
In an example, the linear regression is performed to estimate the estimated relationship coefficient based on the following relationships:
where the phase shift of each of the N sub-bands is
the frequency of each of the N sub-bands is
and the estimated relationship coefficient is
The processing device 23 calculates the direction of arrival through the estimated relationship coefficient for the pair of microphones. For example, the processing device 23 further performs the following process: calculating the direction of arrival based on the speed of sound in the air, the distance between the two microphones of the pair of microphones and the estimated relationship coefficient.
For example, the direction of arrival is an estimated angle of arrival
which is an angle between an impinging direction and a normal direction of the plane of the pair of microphones, wherein the processing device 23 calculates the direction of arrival based on the following relationship:
wherein C is the speed of sound in the air , d is the distance between the two microphones of the pair of microphones and
is the estimated relationship coefficient.
Optionally, the microphone array includes at least two pairs of microphones. In such a situation, the processing device 23 produces estimated angles of arrival
of the at least two pairs of microphones, respectively. The device 20 for estimating direction of arrival further comprises a histogram unit, which receives
and places them into a histogram to obtain an optimized estimated angle of arrival.
The components 21-23 may be implemented along or separately by software, hardware or a combination thereof. For example, they can be implemented through a combination of a computing unit such as a CPU or a MPU and a memory storing instructions for controlling the computing unit to implement the respective functions during the running thereof. Alternatively, they can be implemented in a programmable logic circuitry, field-programmable gate arrays (FPGA) , programmable logic arrays (PLA) , or an application-specific integrated circuit (ASIC) . Under the teaching of this disclosure, all there implementations are feasible. It will be understood by a person skilled in the prior art that a software is equivalent to a hardware except for some of the mechanical components such a speaker, a microphone and so on. In this regard, a person skilled in the art can conceive, under the teaching of this disclosure that the implementations of hardware manner, software manner and/or combination thereof are equivalent. In this regard, this disclosure will not limit the implementation manners of the components 21-23. A person skilled in the art can choose the implementation manners under the teaching of this disclosure in consideration of the cost, the market availability and so on.
Fig. 7 is a schematic diagram of an electronics apparatus to which the solution of an embodiment can be applied.
In Fig. 7, the electronics apparatus 30 includes a device for estimating direction of arrival as above. In Fig. 7, an earphone 30 is shown, and it includes a control box 31. The device for estimating direction of arrival may be placed in the control box 31. It would be appreciated by a person skilled in the art that the electronics apparatus can be any type of electronic apparatus, such as an ear-bud, a headphone, a smart phone, a tablet, a laptop and so on.
Although some specific embodiments of the present invention have been demonstrated in detail with examples, it should be understood by a person skilled in the art that the above examples are only intended to be illustrative but not to limit the scope of the present invention.
Claims (19)
- A method for estimating direction of arrival, comprising:digitalizing input audio signals from a pair of microphones in a microphone array within a certain time frame;buffering the digitalized signals;extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth;calculating phrase shift in each of the multiple sub-bands for the pair of microphones;performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; andcalculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
- The method according to claim 1, wherein performing linear regression further comprises:performing linear regression according to the phrase shifts and frequencies of the sub-bands based on Least Mean Square LMS or Normalized Least Mean Square NLMS, to estimate the estimated relationship coefficient.
- The method according to claim 1 or 2, wherein performing linear regression further comprises:performing linear regression to estimate the estimated relationship coefficient based on the following relationships:
- The method according to claim 1 or 2, wherein calculating the direction of arrival further comprises:calculating the direction of arrival based on the speed of sound in the air, the distance between the two microphones of the pair of microphones and the estimated relationship coefficient.
- The method according to claim 4, wherein the direction of arrival is an estimated angle of arrival which is an angle between an impinging direction and a normal direction of the plane of the pair of microphones,wherein calculating the direction of arrival further comprises:calculating the direction of arrival based on the following relationship:
- The method according to claim 5, wherein the predefined bandwidth is selected so that d is less than half of the wavelength of the highest frequency in the N sub-bands.
- The method according to claim 1, wherein the pair of microphones includes two adjacent microphones in the microphone array.
- The method according to claim 1, wherein the predefined bandwidth is a relatively high part of the effective bandwidth of the input audio signals and the effective bandwidth is in a range from 150 Hz to 7000 Hz.
- A device for estimating direction of arrival, comprising:an A/D converter, which converts input audio signals from a pair of microphones in a microphone array within a certain time frame into digitalized signals;a buffer, which buffers the digitalized signals; anda processing device, which performs the following processes:extracting multiple sub-bands from each of the buffered signals, which covers a predefined bandwidth;calculating phrase shift in each of the multiple sub-bands for the pair of microphones;performing linear regression according to the phrase shifts and frequencies of the sub-bands, to estimate an estimated relationship coefficient between the phrase shifts and the frequencies of the sub-bands corresponding to the pair of microphones; andcalculating the direction of arrival through the estimated relationship coefficient for the pair of microphones.
- The device according to claim 10, wherein the processing device further performs the following process:performing linear regression according to the phrase shifts and frequencies of the sub-bands based on Least Mean Square LMS or Normalized Least Mean Square NLMS, to estimate the estimated relationship coefficient..
- The device according to claim 10 or 11, wherein the processing device further performs the following process:performing linear regression to estimate the estimated relationship coefficient based on the following relationships:
- The device according to claim 10 or 11, wherein the processing device further performs the following process:calculating the direction of arrival based on the speed of sound in the air, the distance between the two microphones of the pair of microphones and the estimated relationship coefficient.
- The device according to claim 10 or 11, wherein the direction of arrival is an estimated angle of arrival which is an angle between an impinging direction and a normal direction of the plane of the pair of microphones, and the processing device further performs the following process:calculating the direction of arrival based on the following relationship:
- The device according to claim 14, wherein the predefined bandwidth is selected so that d is less than half of the wavelength of the highest frequency in the N sub-bands.
- The device according to claim 14, further comprising a histogram unit,wherein the microphone array includes at least two pairs of microphones and the processing device produces estimated angles of arrival of the at least two pairs of microphones respectively,
- The device according to claim 10, wherein the pair of microphones includes two adjacent microphones in the microphone array.
- The device according to claim 10, wherein the predefined bandwidth is a relatively high part of the effective bandwidth of the input audio signals and the effective bandwidth is in a range from 150 Hz to 7000 Hz.
- An electronics apparatus, including a device for estimating direction of arrival according to any of claims 10-18.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2018/079993 WO2019178802A1 (en) | 2018-03-22 | 2018-03-22 | Method and device for estimating direction of arrival and electronics apparatus |
| CN201880000943.0A CN108702558B (en) | 2018-03-22 | 2018-03-22 | Method and device for estimating direction of arrival and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2018/079993 WO2019178802A1 (en) | 2018-03-22 | 2018-03-22 | Method and device for estimating direction of arrival and electronics apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019178802A1 true WO2019178802A1 (en) | 2019-09-26 |
Family
ID=63841618
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2018/079993 Ceased WO2019178802A1 (en) | 2018-03-22 | 2018-03-22 | Method and device for estimating direction of arrival and electronics apparatus |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108702558B (en) |
| WO (1) | WO2019178802A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019178802A1 (en) * | 2018-03-22 | 2019-09-26 | Goertek Inc. | Method and device for estimating direction of arrival and electronics apparatus |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007109840A1 (en) * | 2006-03-28 | 2007-10-04 | Immersion Technology Property Limited | Improved multi-band loudspeaker system |
| CN106031197A (en) * | 2014-02-17 | 2016-10-12 | 歌拉利旺株式会社 | Acoustic treatment equipment, acoustic treatment method and acoustic treatment program |
| CN106714026A (en) * | 2015-07-30 | 2017-05-24 | 惠州市德赛西威汽车电子股份有限公司 | Multi-output sound source recognition method and vehicle-mounted multi-sound-source system based on method |
| EP3267697A1 (en) * | 2016-07-06 | 2018-01-10 | Oticon A/s | Direction of arrival estimation in miniature devices using a sound sensor array |
| CN108702558A (en) * | 2018-03-22 | 2018-10-23 | 歌尔股份有限公司 | Method and device and electronic device for estimating direction of arrival |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1344276B1 (en) * | 2000-12-23 | 2018-01-24 | Nokia Technologies Oy | Base station, base station module and method for direction of arrival estimation |
| JP5229053B2 (en) * | 2009-03-30 | 2013-07-03 | ソニー株式会社 | Signal processing apparatus, signal processing method, and program |
| US20130088395A1 (en) * | 2010-06-19 | 2013-04-11 | Nokia Corporation | Method and apparatus for estimating direction of arrival |
| EP2565667A1 (en) * | 2011-08-31 | 2013-03-06 | Friedrich-Alexander-Universität Erlangen-Nürnberg | Direction of arrival estimation using watermarked audio signals and microphone arrays |
| US9549253B2 (en) * | 2012-09-26 | 2017-01-17 | Foundation for Research and Technology—Hellas (FORTH) Institute of Computer Science (ICS) | Sound source localization and isolation apparatuses, methods and systems |
| US9609141B2 (en) * | 2012-10-26 | 2017-03-28 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Loudspeaker localization with a microphone array |
| DK3285500T3 (en) * | 2016-08-05 | 2021-04-26 | Oticon As | BINAURAL HEARING SYSTEM CONFIGURED TO LOCATE AN SOURCE SOURCE |
-
2018
- 2018-03-22 WO PCT/CN2018/079993 patent/WO2019178802A1/en not_active Ceased
- 2018-03-22 CN CN201880000943.0A patent/CN108702558B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007109840A1 (en) * | 2006-03-28 | 2007-10-04 | Immersion Technology Property Limited | Improved multi-band loudspeaker system |
| CN106031197A (en) * | 2014-02-17 | 2016-10-12 | 歌拉利旺株式会社 | Acoustic treatment equipment, acoustic treatment method and acoustic treatment program |
| CN106714026A (en) * | 2015-07-30 | 2017-05-24 | 惠州市德赛西威汽车电子股份有限公司 | Multi-output sound source recognition method and vehicle-mounted multi-sound-source system based on method |
| EP3267697A1 (en) * | 2016-07-06 | 2018-01-10 | Oticon A/s | Direction of arrival estimation in miniature devices using a sound sensor array |
| CN108702558A (en) * | 2018-03-22 | 2018-10-23 | 歌尔股份有限公司 | Method and device and electronic device for estimating direction of arrival |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108702558A (en) | 2018-10-23 |
| CN108702558B (en) | 2020-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8654990B2 (en) | Multiple microphone based directional sound filter | |
| US8942976B2 (en) | Method and device for noise reduction control using microphone array | |
| US10123113B2 (en) | Selective audio source enhancement | |
| CN106664486B (en) | Method and apparatus for wind noise detection | |
| KR101456866B1 (en) | Method and apparatus for extracting a target sound source signal from a mixed sound | |
| US8861745B2 (en) | Wind noise mitigation | |
| EP3185243B1 (en) | Voice processing device, voice processing method, and program | |
| US10515650B2 (en) | Signal processing apparatus, signal processing method, and signal processing program | |
| EP1370112B1 (en) | Method for adaptive multi-sensor arrays as well as respective digital processor and program storage device | |
| US20030185410A1 (en) | Orthogonal circular microphone array system and method for detecting three-dimensional direction of sound source using the same | |
| US20180115855A1 (en) | Method and system for acoustic source enhancement using acoustic sensor array | |
| CN101779476A (en) | Omnidirectional dual microphone array | |
| JP2003195882A (en) | Signal processing system and method | |
| EP3320311B1 (en) | Estimation of reverberant energy component from active audio source | |
| US8639499B2 (en) | Formant aided noise cancellation using multiple microphones | |
| CN106031196A (en) | Signal processing device, method and program | |
| Calamia et al. | Blind estimation of the direct-to-reverberant ratio using a beta distribution fit to binaural coherence | |
| WO2019178802A1 (en) | Method and device for estimating direction of arrival and electronics apparatus | |
| CN115932733A (en) | Sound source localization and speech enhancement method and device | |
| EP1913591B1 (en) | Enhancement of speech intelligibility in a mobile communication device by controlling the operation of a vibrator in dependance of the background noise | |
| JP2001045592A (en) | Noise canceling microphone array | |
| Čmejla et al. | Independent vector analysis exploiting pre-learned banks of relative transfer functions for assumed target’s positions | |
| Wuth et al. | A unified beamforming and source separation model for static and dynamic human-robot interaction | |
| JP2010152107A (en) | Device and program for extraction of target sound | |
| Corey et al. | Relative transfer function estimation from speech keywords |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18911197 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18911197 Country of ref document: EP Kind code of ref document: A1 |