CN103024629A - Processing signals - Google Patents
Processing signals Download PDFInfo
- Publication number
- CN103024629A CN103024629A CN2012103771153A CN201210377115A CN103024629A CN 103024629 A CN103024629 A CN 103024629A CN 2012103771153 A CN2012103771153 A CN 2012103771153A CN 201210377115 A CN201210377115 A CN 201210377115A CN 103024629 A CN103024629 A CN 103024629A
- Authority
- CN
- China
- Prior art keywords
- signal
- mobile device
- motion
- receives
- shaper
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Circuit For Audible Band Transducer (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
Mobile device, method and computer program product for processing signals at the mobile device. The signals are received at a plurality of signal sensors of the mobile device. Motion of the mobile device is sensed and the received signals are processed using beamforming means at the mobile device, in dependence upon their direction of arrival at the plurality of signal sensors and in dependence upon the sensed motion of the mobile device.
Description
Technical field
The present invention relates to processing signals.Specifically, the present invention relates to use the beam-shaper processing signals.
Background technology
Equipment can have can be in order to receive the input link of the signal that sends from surrounding environment.For example, can have can be in order to the audio frequency input link such as microphone from the surrounding environment received audio signal for equipment.For example, the microphone of subscriber equipment can receive main audio signal (Tathagata is from user's voice) and other audio signal.Described other audio signal may be the interference tones signal that receives at the microphone place of equipment, and can receive or can be on every side background noise or microphone self noise from interference source.The interference tones signal may be bothered the main audio signal that receives at the equipment place.Described equipment can be used for many different purposes with received audio signal.For example, in the situation of the audio signal that receives for the voice signal that receives from the user, described voice signal can be by device processes to be used for communication event, for example by via network voice signal being sent to another user-dependent another equipment with communication event.Perhaps, or in addition, the audio signal that receives can be used for other purpose, as known in the art.
In other example, equipment can have the receiving member for the transmitted signal (such as radar signal, Sonar Signal, aerial signal, radio wave, microwave and common broadband signal or narrow band signal) that receives other type.Identical situation may appear in the transmitted signal for these other types, receives whereby the interference signal at main signal and receiving member place.Below description is main and provides relatively at equipment place received audio signal, but same principle will be applicable to receive at the equipment place transmitted signal of other type, such as above-mentioned common broadband signal, common narrow band signal, radar signal, Sonar Signal, aerial signal, radio wave and microwave.
In order (for example to improve the audio signal that receives, the voice signal of be used for calling out that receives from the user) quality, need to be suppressed at the interference tones signal that the microphone place of subscriber equipment receives (for example, background noise and the interference tones signal that receives from the interference tones source).
A plurality of microphones become more common as the stereophony microphone of single audio frequency input link work and the use of other microphone array.Use a plurality of microphones so that except the information that can extract from the audio signal that is received by single microphone, also can use the spatial information that extracts from the audio signal that receives at the equipment place.When using these equipment, a kind of method for suppressing the interference tones signal is that beam-shaper is applied to the audio signal that received by a plurality of microphones.Beam forming is to process to concentrate the audio signal that received by microphone array to strengthen the process from the particular audio signal of one or more required directions that receives at the microphone array place by using signal.For simplicity, we will describe the situation that only has single required direction at this paper, but same procedure will be suitable for when having a plurality of concern direction.Beam forming is to realize by the angle of at first estimating to receive at the microphone place required audio signal (so-called arrival direction (" DOA ") information).The adaptive beamforming device is processed the audio signal that received by a plurality of microphones to form " wave beam " with DOA information, use high-gain and use low gain along other direction along the direction that is received required audio signal by microphone whereby.
Although beam-shaper will attempt to suppress the unwanted audio signal from unwanted direction, but the shape of the quantity of microphone and microphone array and size will limit the effect of beam-shaper, although and therefore unwanted audio signal is suppressed, and may still can hear.In described equipment, can further process according to the mode that can process the audio signal that receives from single microphone the output of beam-shaper, for example, be used for being transferred to another equipment as the part of communication event.For example, the output of beam-shaper can be supplied to the echo elimination stage in the equipment, at least one the processing stage that automatic gain being controlled (AGC) and in the single channel reducing noise stage as input signal.
Beam-shaper can be controlled to concentrate on the specific direction of expecting to receive main audio signal.For example, microphone array can be positioned over the ad-hoc location on the table, and the user can sit ad-hoc location on the table usually, so that trend towards arriving microphone array with approximately uniform arrival direction (" main arrival direction ") from user's voice signal.Beam-shaper can be controlled so as to towards this main arrival direction, concentrates on whereby the voice signal from the user that the microphone array place receives, and will be applied to the audio signal from other direction that receives at the microphone array place than the high attenuation level.Beam-shaper can adaptively change its focussing direction, and is with the arrival direction of main audio signal during use of coupling better, consuming time but this may be process and the adaptive generation meeting of calculation of complex.Therefore, it can be favourable before using waveshaper correctly being controlled to main arrival direction in advance.
Summary of the invention
In recent years, the size of electronic building brick, weight and cost reduce, thereby so that now many equipment to be embodied as mobile device be feasible.Mobile device can have the microphone that is implemented on wherein with received audio signal.For example, mobile phone, notebook computer, panel computer and other mobile device can be carried by the user, and can implement the microphone for received audio signal.As mentioned above, the enforcement of a plurality of microphones makes it possible to use beam-forming method.The inventor recognizes, implementing beam-shaper in mobile device will be for favourable, but the beam-shaper that correct control is implemented in the mobile device may have problems, because mobile device is planned inherently for mobile.Specifically, the inventor recognizes, when mobile device is moved, adjust impose on the beam-shaper coefficient of audio signal by beam-shaper will be for useful.In this way, even when mobile device is moved, the beam pattern of beam-shaper also can be concentrated (a plurality of) that received by microphone main audio signal.In order to be used for mobile device, the whenever new situation of tracking that beam-forming method preferably can be moved at equipment.
The inventor also recognizes, can implement motion sensor in mobile device, and described motion sensor can be in order to the motion of sensing movement equipment.For example, can in mobile device, implement gyroscope and accelerometer, with rotation and the linear movement of sensing movement equipment.Output from motion sensor can be used by beam-shaper, adjusts the beam-shaper coefficient considering the motion of mobile device, thereby so that when mobile device is moved beam-shaper concentrate on (a plurality of) main audio signal.This allows beam-shaper to be implemented in the mobile device in successful mode.Smart phone and panel computer computer are the examples that usually has the mobile device of gyroscope, accelerometer and a plurality of microphones.In addition, may there be more notebook computers to be equipped with similar hardware in future.
According to a first aspect of the invention, provide a kind of mobile device, comprising: a plurality of signal transducers that are used for receiving signal; The beam forming member, its direction that is used for depending on that signal arrives described a plurality of signal transducers is processed the signal that receives; The motion sensor member, it is used for the motion of sensing movement equipment and is used for the indication of the motion that senses of mobile device is offered the beam forming member, and wherein said beam forming member is arranged to depend on that the indication of the motion that senses of mobile device processes the signal that receives.
Described signal can be audio signal, and signal transducer can be the microphone for received audio signal.Described signal may instead be the transmitted signal of any other type, such as common broadband signal, common narrow band signal, radar signal, Sonar Signal, aerial signal, radio wave and microwave.
Advantageously, because the beam forming member uses the indication of the motion that senses of mobile device, so the beam forming member can be when mobile device be moved the beam pattern of beam forming member is controlled to be more accurately towards main (or " required ") signal, Tathagata is from user's voice signal.
Described signal can comprise: (i) respectively have at least one main signal of at least one main arrival direction at a plurality of signal transducers place, and (ii) have the interference signal that each disturbs arrival direction at a plurality of signal transducers place.In addition, the beam forming member can comprise the member that beam pattern is applied to the signal that receives, whereby will higher inhibition level to be applied to disturb the signal that arrival direction receives rather than the signal that receives with at least one main arrival direction.
The beam forming member can be configured to follow the trail of the interference arrival direction with the indication of the motion that senses of mobile device, and correspondingly adjust beam-shaper coefficient (and changing whereby beam pattern), sentence the interference signal of disturbing arrival direction to receive to be suppressed at whereby signal transducer.Similarly, the beam forming member can be configured to follow the trail of at least one main arrival direction with the indication of the motion that senses of mobile device, and correspondingly adjust beam-shaper coefficient (and changing whereby beam pattern), to strengthen whereby each at least one main signal that receives with at least one main arrival direction at the signal transducer place.
The motion sensor member can comprise for the gyroscope of the motion of sensing movement equipment and at least one of accelerometer.Gyroscope can be used for rotatablely moving of sensing movement equipment, and accelerometer can be used for the acceleration of sensing movement equipment.When equipment is moved, for example, when mobile device user carried mobile device when walking, the arrival direction of following the trail of interference source with gyroscope and accelerometer information can help the beam forming member more quickly decay to be applied to the audio signal that is received from interference source by a plurality of signal transducers.The motion that senses indication from the mobile device of motion sensor member is particularly useful for follow the trail of the static interference source when mobile device is moved, but useful equally for the interference source of following the trail of non-static state, because the motion of mobile device can be indicated to explain by the motion that senses, simplify whereby the task of the motion of following the trail of non-static interference source.
According to a second aspect of the invention, provide a kind of method of managing signal at mobile device everywhere, described method comprises: a plurality of signal transducers place at mobile device receives signal; The motion of sensing movement equipment; With use the beam forming member at the mobile device place, depend on signal at the arrival direction at a plurality of signal transducers place and depend on that the motion that senses of mobile device processes the signal that receives.
According to a third aspect of the present invention, a kind of computer program of the signal that receives for the treatment of a plurality of signal transducers place at mobile device is provided, and described computer program is recorded on the nonvolatile computer-readable media and carries out following steps when being configured on being executed in the processor of mobile device: receive the indication of the motion that senses of mobile device from the motion sensing member of mobile device; With implement the beam forming member, to depend on signal at the arrival direction at a plurality of signal transducers place and to depend on that the indication of the motion that senses of mobile device processes the signal that receives.
Description of drawings
In order to understand better the present invention and to show the present invention is put into practice, now will be by exemplary reference the following drawings, in the accompanying drawing:
Fig. 1 illustrates the schematic diagram according to the mobile device of preferred embodiment;
Fig. 2 illustrates the system according to preferred embodiment;
Fig. 3 illustrates the functional-block diagram according to the mobile device of preferred embodiment;
Fig. 4 is the flow chart according to the process of the audio signal of preferred embodiment; With
Fig. 5 illustrates the figure how expression estimates to arrive directional information in one embodiment.
Embodiment
To only by example the preferred embodiments of the present invention be described now.Embodiment described below relates to the situation that signal is audio signal.Yet other embodiment relates to signal and is the situation of the transmitted signal (such as common broadband signal, common narrow band signal, radar signal, Sonar Signal, aerial signal, radio wave and microwave) of other type.
In following examples of the present invention, following technology is described: with motion sensor the motion of mobile device indication is offered beam-shaper, thereby so that the beam-shaper coefficient is adjusted in motion that can movement-based equipment.Even this allows beam-shaper to be implemented in the mobile device and helps beam-shaper also to concentrate on required audio signal when mobile device is moved.
At first with reference to figure 1, Fig. 1 illustrates the schematic diagram of mobile device 102.Mobile device 102 is portable sets.Mobile device 102 comprises CPU 104, be used for received audio signal microphone array 106, be used for the motion of sensing movement equipment 102 motion sensor 108, be used for output audio signal loud speaker 110, be used for user to mobile device 102 export vision data such as the display 112 of screen and be used for storage data storage device 114 and be connected to CPU 104.
With reference now to Fig. 2,, Fig. 2 illustrates the example context 200 that mobile device 102 works in.
The audio signal that the microphone array 106 of mobile device receives from environment 200.For example, as shown in Figure 2, microphone array 106 receives audio signal from user 202, and (Fig. 2 middle finger is shown d
1), (Fig. 2 middle finger is shown d from another user's 204 audio signal
2), (Fig. 2 middle finger is shown d from the audio signal of fan 206
3) and from user 202 the audio signal that is reflected back from wall 208 (Fig. 2 middle finger is shown d
4).It should be apparent to those skilled in the art that microphone array 106 can receive other audio signal different from signal shown in Figure 2.Under sight shown in Figure 2, be required vision signal from user 202 audio signal, and all other vision signals that receive at microphone array 106 places are interference tones signals.In other embodiments, the audio signal more than one that receives at microphone array 106 places can be thought " required " audio signal, but for simplicity, in embodiment described herein, only have a required audio signal (it is the audio signal from user 202), and other audio signal is considered to disturb.Fig. 2 illustrates interference source for another user 204, fan 206 with from the reflection of wall 208.Other undesired noise signal source can comprise for example air-conditioning system and the just equipment of music playing.
When after microphone array 106 places receive audio signal, it being processed, identify (a plurality of) required audio signal.During processing, identify required audio signal based on the detection of similar phonetic feature, and the principal direction of definite main loudspeaker.In Fig. 2, main loudspeaker (user 202) is illustrated as from principal direction d
1Arrive the source of the required audio signal of microphone array 106.
With reference now to Fig. 3,, Fig. 3 illustrates the functional representation of mobile device 102.Microphone array 106 comprises a plurality of microphones 302
1, 302
2With 302
3 Mobile device 102 also comprises beam-shaper 304.Beam-shaper 304 can be embodied in the software that is executed on the CPU 104, perhaps is implemented in the hardware in the mobile device 102.The output of each microphone in the microphone array 106 is couple to each input of beam-shaper 304.Beam-shaper 304 has the beam pattern that can be applied to the audio signal that receives.Beam-shaper 304 can be adapted and change whereby beam pattern.It will be apparent to those skilled in the art that needs a plurality of inputs to implement beam forming.Microphone array 106 is shown to have three microphones (302 in Fig. 3
1, 302
2With 302
3), but will understand, this number of microphone only is example and never in any form restriction.
Beam-shaper 304 comprises for the processing member that receives and process from the audio signal of the microphone of microphone array 106.For example, beam-shaper 304 can comprise that speech activity detector (VAD) and DOA estimate piece.At work, beam-shaper 304 is confirmed the character of the audio signal that received by microphone array 106, and based on the detection of being estimated the quality of the similar voice that piece detects by VDA and DOA, determines one or more principal directions of (a plurality of) main loudspeaker.In example shown in Figure 2, the direction (d of the audio signal that receives from user 202
1) be confirmed as principal direction.Beam-shaper 304 usefulness DOA information exchanges are crossed the formation wave beam and are come audio signal, and described wave beam is along receive the principal direction (d that wants signal at microphone array 106 places
1) direction have high-gain and taking office the what direction of its signal source (for example, d
1, d
2And d
3) have a low gain.Although above description beam-shaper 304 can be determined the principal direction of any number, but the number of determined principal direction affects the attribute of beam-shaper, for example, for a large amount of principal directions, beam-shaper 304 will be than the situation of only determining the single primary direction, and the signal that receives from other (not wanting) direction at the microphone array place applies less decay.The output of beam-shaper 304 is provided to the further processing member of mobile device 102 by the form with pending individual channel.Can be with many multi-form for mobile device 102 such as the output that will it will be apparent for a person skilled in the art that beam-shaper 304.For example, the output of beam-shaper 304 can be used as user 202 part of the communication event of mobile device 102 participations.
The output of beam-shaper 304 can stand further signal and process (for example, automatic gain control and noise suppression).The details that this type of further signal is processed exceeds scope of the present invention, and therefore this paper does not provide the details that further signal is processed, but one skilled in the art will know that the mode that can process the output of beam-shaper 304 in mobile device 102.
As shown in Figure 3, the output of motion sensor 108 for example is provided to beam-shaper 304(, uses CPU 104).The motion of motion sensor 108 sensing movement equipment 102.The motion of mobile device 102 will affect the direction that receives audio signal at microphone array 106 places, therefore and will affect beam-shaper 304 and should be applied to the audio signal that receives audio signal is correctly focused in the principal direction (for example, d1) beam pattern.Beam-shaper 304 can use the indication from the motion sensor 108 of the motion of the sensing of mobile device 102, correspondingly to adjust the beam-shaper coefficient of beam-shaper 304.A kind of method for control beam-shaper 304 (for example, take the motion that detects of compensation mobile device 102 as purpose) is for employing direction Normalization Technique.The direction Normalization Technique can relate in the audio signal that receives at beam-shaper 304 places and comprise regular noise, to adjust the beam-shaper coefficient of beam-shaper 304, adjust whereby by beam-shaper 304 and be applied to have inhibition in the audio signal of the specific arrival directional information at microphone array 106 places.For example, beam-shaper 304 can be by comprising that in the audio signal that receives arrival direction corresponding to the direction of coupling interference tones signal is (for example, from direction d
2, d
3And d
4) the regular noise of higher level revise the audio signal that receives, wherein come subsequently the filter coefficient of compute beam former 304 based on amended audio signal.When mobile device 102 moves, can be in order to the arrival direction of following the trail of the interference tones signal (for example, from direction d from the signal of motion sensor 108
2, d
3And d
4), so that regular noise correctly is included in the audio signal that receives, thereby so that when mobile device 102 moves the beam-shaper coefficient of beam-shaper 304 correctly adjusted to suppress whereby the interference tones signal.Motion sensor 108 may be implemented as any transducer for the motion of sensing movement equipment, for example motion sensor of gyroscope and/or accelerometer or any other type known in the art.When mobile device 102 moved, motion sensor can be in order to determine orientation and the movement of mobile device 102, to follow the trail of the arrival direction in audio signal source (for example, main audio-source 202 and interference tones source 204,206 and 208).
With reference to figure 4, a kind of method of the audio signal according to preferred embodiment is described now.At step S402, at the microphone (302 of microphone array 106
1, 302
2With 302
3) locate received audio signal.Described audio signal is to receive from user for example shown in Figure 2 202, user 204, fan 206 and wall 208.Also can be at the microphone (302 of microphone array 106
1, 302
2With 302
3) locate to receive other interference tones signal (such as background noise).Each microphone (302 by microphone array 106
1, 302
2With 302
3) audio signal that receives is passed to beam-shaper 304.
At step S404, the motion of motion sensor 108 sensing movement equipment 102.Can detect with motion sensor 108 orientation and the movement of mobile device 102.The indication of the motion that senses of mobile device 102 is provided to beam-shaper 304 from motion sensor 108.
At step S406, the microphone (302 that beam-shaper 304 is processed from microphone array 106
1, 302
2With 302
3) audio signal that receives, with the audio signal that whereby the beam-shaper coefficient is applied to receive.The beam-shaper coefficient is described conduct in the decay of the function of the angle of microphone array 106 place's received audio signals, and described decay will be by beam-shaper 304 applied audio signals.Based on as adjust beam-shaper 304 by the motion from the mobile device 102 of the input of motion sensor 108 indication that receives at beam-shaper 304 places, change whereby its beam pattern.Beam-shaper 304 can be followed the trail of the arrival direction from the audio signal of particular source.For example, the arrival direction (" main arrival direction ") that beam-shaper 304 is followed the trail of from the required audio signal of main audio-source (for example, the user 202), and adjust the beam-shaper coefficient to concentrate the audio signal of principal direction.The indication of the motion of mobile device 102 uses to follow the trail of main arrival direction by beam-shaper 304.For example, mobile device 102 moves if user 202 is static, so can be in order to follow the trail of main arrival direction from the signal of motion sensor 108.Mobile device 102 moves even user 202 is not static, also can be in order to simplify the tracking of main arrival direction by the motion of removing mobile device 102 from following the trail of calculating from the signal of motion sensor 108.This simplification can be so that tracing process be faster, more effective, computation complexity is lower and consume less power.
Beam-shaper 304 from the interference tones source (for example also can be followed the trail of, user 204, fan 206 and wall 208) the arrival direction (" interference arrival direction ") of interference tones signal, and adjust the beam-shaper coefficient the higher attenuation level is applied to from the interference tones signal that disturbs arrival direction to receive.The motion indication of mobile device 102 uses to follow the trail of the interference arrival direction by beam-shaper 304.For example, mobile device 102 moves if interference source is static, so can be in order to follow the trail of corresponding interference arrival direction from the signal of motion sensor 108.Mobile device 102 moves even interference source is not static, also can be in order to simplify the tracking of disturbing arrival direction by the motion of removing mobile device 102 from follow the trail of calculating from the signal of motion sensor 108.This simplification can be so that tracing process be faster, more effective, computation complexity is lower and consume less power.
One skilled in the art will know that can be in order to the arrival direction of following the trail of main audio signal and the technology that compensates main audio signal by the in advance control of microphone array 106.In order to compensate beam-shaper to guarantee the decay of interference tones signal, can use the normalized method of direction as previously discussed.In direction normalization method, revise the audio signal that receives by in the audio signal that receives, comprising corresponding to the regular noise that disturbs arrival direction, adjust beam-shaper 304 to change whereby the beam-shaper coefficient.Come compute beam former coefficient based on amended audio signal subsequently, sentence the audio signal of disturbing arrival direction to receive so that described beam-shaper coefficient indication beam-shaper 304 should be applied to the higher attenuation level at microphone array 106.By the motion of following the trail of mobile device 102 with motion sensor 108, employed regular noise can correctly be included in the audio signal that receives in the direction Normalization Technique, even so that unwanted audio signal is correctly decayed.Direction normalization only adapts to an example of ground decay for how beam-shaper 304 can make unwanted audio signal when mobile device 102 is moved, and can use in other embodiments of the invention for other technology that realizes this purpose.
When mobile device 102 moves, by (for example using motion sensor, gyroscope and accelerometer) information, beam-shaper 304 can predict how main source and the interference source in the environment 200 itself moves (that is, following the trail of main and interference source) with respect to mobile device 102.
For beam forming, the arrival direction in known disturbances source is favourable to apply decay along the direction from the interference tones signal of described interference source.Embodiments of the invention allow based on motion transducer (for example, gyroscope and accelerometer) information and need not to follow the trail of the extra tracking activity that changes desired beam-shaper 304 and change the beam-shaper coefficient.Therefore simplified tracking.In addition, with respect to main audio signal (for example, the input power source), the change of the beam-shaper coefficient of beam-shaper 304 may cause main audio signal and bother/distortion, and from motion sensor (for example, gyroscope and accelerometer) the use of information may help the motion of beam-shaper 304 response mobile devices 102 to adjust rapidly the beam-shaper coefficient, thereby so that can reduce by bothering/distortion that 304 pairs of main audio signals of beam-shaper cause.In one example, beam-shaper 304 is the undistorted response of minimum variance (MVDR) beam-shaper, and it sentences the energy that minimizes the output of beam-shaper 304 under (a plurality of) main distortionless restriction of audio signal that (a plurality of) main arrival direction receives making at microphone array 106.The MVDR beam-shaper is for to use the information from motion sensor 108 to compensate the only example of main loudspeaker by controlling in advance microphone array.The MVDR beam-shaper will adapt to any change of interference source subsequently.If with for example above-mentioned direction normalization Combination of Methods, whole beam patterns of beam-shaper can implicitly be proofreaied and correct (by changing the beam-shaper coefficient) so, to compensate all known required or unwanted sources.
Arrival direction (DOA) the estimation operation of being carried out the arrival direction (for example, main arrival direction or interference arrival direction) with definite audio signal by beam-shaper 304 is described in more detail referring now to Fig. 5.
DOA information is also to use a plurality of microphones 302 about microphone array 106 by beam-shaper 304 by time delay between the audio signal of estimating to receive at a plurality of microphones place of microphone array 106 (for example, using bearing calibration)
1, 302
2With 302
3The priori of position estimate that audio signal source estimates.
As example, Fig. 5 illustrates from the microphone 302 of main audio-source 202 microphone array 106 of received audio signal on two independent input channels
1With 302
2For the ease of understanding, Fig. 5 illustrates point source 202, and its medium wave 202 blazes abroad with circus movement from the source.This is in real-life situation, but below the equation supposition that illustrates at microphone 302
1With 302
2The place receives the audio signal that receives as plane wave.When point source 202 and microphone 302
1With 302
2During from " away from enough ", this is assumed to good supposition.In the situation that plane wave supposition, can use equation (1) to estimate microphone 302 at distance of separation d
1With 302
2The audio signal arrival direction at place:
Wherein
vBe the speed of sound, and
For the audio signal from interference source 204 arrives microphone 302
1With 302
2Time between poor, namely the time postpones.Be known parameters for microphone array 106 apart from d, and the speed of sound
vBe known (about 340 ms
-1).Time delay
Be obtained as maximization at microphone 302
1With 302
2The main audio signal that receives of output place between the time lag of cross-correlation.The equation (1) that provides more than can using is subsequently found out the angle that postpones corresponding to this time
θDetect characteristics of speech sounds in the audio signal that can receive in the delay with maximum cross correlation, to determine one or more principal directions of (a plurality of) main loudspeaker.
To understand, the cross-correlation of calculating signal is the common technology of signal process field, and this paper will not be described in more detail.
In above-mentioned example embodiment, microphone array 106 is microphone (302
1, 302
2With 302
3) one-dimensional array, it allows beam-shaper 304 to distinguish the audio signal that receives with the different angles in the one dimension (for example, along trunnion axis).In alternate embodiment, microphone array 106 can be two dimension or the three-dimensional microphone array of microphone, it will allow beam-shaper 304 to distinguish the audio signal that receives with different angles in two dimension or three-dimensional (for example, along level, vertical and degree of depth axle) respectively.
As mentioned above, beam-shaper 304 can be embodied in the software of carrying out on the CPU 104, perhaps is implemented in the hardware of mobile device 102.When beam-shaper 304 is implemented in the software, it can provide by the computer program that is recorded on the nonvolatile computer-readable media, carries out the function of aforesaid beam-shaper 304 when described computer program is configured on the CPU 104 that is executed in mobile device 102.
Although relating to from unique user 202, above-described embodiment receives a required audio signal (d
1) microphone array 106, but will understand, microphone array 106 can receive the audio signal from a plurality of users (for example, in videoconference), described audio signal can all be considered required audio signal.Under this sight, the audio signal of wanting in a plurality of sources arrives microphone array 106.
In addition, although with reference to preferred embodiment special exhibition and described the present invention, it will be understood by those skilled in the art that and in the situation that does not break away from the scope of the invention that is defined by the claims of enclosing, to carry out the various changes of form and details.
Claims (11)
1. a mobile device (102) comprising:
A plurality of signal transducers (302), it is used for receiving signal;
Beam forming member (304), it is used for depending on that the arrival direction that the described signal that receives is located at described a plurality of signal transducers (302) processes the described signal that receives;
Motion sensor member (108), the indication that it is used for the motion of the described mobile device of sensing (102) and is used for providing to described beam forming member (304) the described motion that senses of described mobile device (102),
Wherein said beam forming member (304) is arranged to depend on that the described indication of the described motion that senses of described mobile device (102) processes the described signal that receives.
2. mobile device as claimed in claim 1 (102), wherein said signal comprises: at least one main signal of (i) locating respectively to have at least one main arrival direction at described a plurality of signal transducers (302), (ii) locate to have the interference signal that each disturbs arrival direction at described a plurality of signal transducers (302)
Wherein said beam forming member (304) comprises the member that the beam-shaper coefficient is applied to the described signal that receives, whereby higher inhibition level is applied to the signal that receives with described interference arrival direction rather than the signal that receives with described at least one main arrival direction.
3. mobile device as claimed in claim 2 (102), wherein said beam forming member (304) is configured to use the described indication of the described motion that senses of described mobile device (102) to follow the trail of described interference arrival direction, and correspondingly adjust described beam-shaper coefficient, sentence the described interference signal that described interference arrival direction receives to be suppressed at whereby described signal transducer (302).
4. mobile device (102) as claimed in claim 2 or claim 3, wherein said beam forming member (304) is configured to use the described indication of the described motion that senses of described mobile device (102) to follow the trail of described at least one main arrival direction, and correspondingly adjust described beam-shaper coefficient, sentence described at least one main signal that described each at least one main arrival direction receives to strengthen whereby at described signal transducer (302).
5. such as the described mobile device of arbitrary aforementioned claim (102), wherein said motion sensor member (108) comprises for the gyroscope of the described motion of the described mobile device of sensing (102) and at least one of accelerometer.
6. such as the described mobile device of arbitrary aforementioned claim (102), wherein said signal is audio signal, and described signal transducer (302) is for being used for receiving the microphone of described audio signal.
7. method of managing signal everywhere at mobile device (102), described method comprises:
A plurality of signal transducers (302) at described mobile device (102) locate to receive described signal;
The motion of the described mobile device of sensing (102); With
Locate to use beam forming member (304) at described mobile device (102), depend on that the arrival direction that the described signal that receives is located at described a plurality of signal transducers (302) and the described motion that senses of depending on described mobile device (102) process the described signal that receives.
8. method as claimed in claim 7, during the step of the described motion of the described mobile device of wherein said sensing (102) may further comprise the steps at least one: (i) use rotatablely moving of the described mobile device of gyroscope sensing (102), and (ii) use the acceleration of the described mobile device of accelerometer sensing (102).
9. such as claim 7 or 8 described methods, wherein said signal is in the following signal: (i) audio signal, (ii) common broadband signal, (iii) common narrow band signal, (iv) radar signal, (v) Sonar Signal, (vi) aerial signal, (vii) radio wave and (viii) microwave.
10. computer program for the treatment of the signal of locating to receive at a plurality of signal transducers (302) of mobile device (102), described computer program are recorded on the nonvolatile computer-readable media and are configured to carry out following steps when the processor that is executed in described mobile device (102) (104) are upper:
Receive the indication of the motion that senses of described mobile device (102) from the motion sensing member (108) of described mobile device (102); With
Implement beam forming member (304), process the described signal that receives to depend on the arrival direction that the described signal that receives is located at described a plurality of signal transducers (302) and the described indication of depending on the described motion that senses of described mobile device (102).
11. the computer-readable storage medium of storage computer executable instructions on one or more its, described instruction is when being carried out by computing equipment, so that described computing equipment is realized such as any the described method among the claim 7-9.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1116848.1A GB2495131A (en) | 2011-09-30 | 2011-09-30 | A mobile device includes a received-signal beamformer that adapts to motion of the mobile device |
| GB1116848.1 | 2011-09-30 | ||
| US13/307852 | 2011-11-30 | ||
| US13/307,852 US8981994B2 (en) | 2011-09-30 | 2011-11-30 | Processing signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103024629A true CN103024629A (en) | 2013-04-03 |
| CN103024629B CN103024629B (en) | 2017-04-12 |
Family
ID=47178284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210377115.3A Active CN103024629B (en) | 2011-09-30 | 2012-10-08 | Processing signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103024629B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105580074A (en) * | 2013-09-24 | 2016-05-11 | 美国亚德诺半导体公司 | Time-frequency directional processing of audio signals |
| CN106030700A (en) * | 2014-02-19 | 2016-10-12 | 诺基亚技术有限公司 | Determination of an operational directive based at least in part on a spatial audio property |
| CN108683972A (en) * | 2014-10-20 | 2018-10-19 | 索尼公司 | sound processing system |
| CN113643682A (en) * | 2021-10-13 | 2021-11-12 | 展讯通信（上海）有限公司 | Noise reduction method, chip module and equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1835416A (en) * | 2005-03-17 | 2006-09-20 | 富士通株式会社 | Method and apparatus for direction-of-arrival tracking |
| JP2006333069A (en) * | 2005-05-26 | 2006-12-07 | Hitachi Ltd | Antenna controller and control method for mobile |
| US20080199025A1 (en) * | 2007-02-21 | 2008-08-21 | Kabushiki Kaisha Toshiba | Sound receiving apparatus and method |
| CN101278596A (en) * | 2005-09-30 | 2008-10-01 | 史克尔海德科技公司 | Directional audio capturing |
| US20100128892A1 (en) * | 2008-11-25 | 2010-05-27 | Apple Inc. | Stabilizing Directional Audio Input from a Moving Microphone Array |
| CN101828410A (en) * | 2007-10-16 | 2010-09-08 | 峰力公司 | Be used for the auxiliary method and system of wireless hearing |
-
2012
- 2012-10-08 CN CN201210377115.3A patent/CN103024629B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1835416A (en) * | 2005-03-17 | 2006-09-20 | 富士通株式会社 | Method and apparatus for direction-of-arrival tracking |
| JP2006333069A (en) * | 2005-05-26 | 2006-12-07 | Hitachi Ltd | Antenna controller and control method for mobile |
| CN101278596A (en) * | 2005-09-30 | 2008-10-01 | 史克尔海德科技公司 | Directional audio capturing |
| US20080199025A1 (en) * | 2007-02-21 | 2008-08-21 | Kabushiki Kaisha Toshiba | Sound receiving apparatus and method |
| CN101828410A (en) * | 2007-10-16 | 2010-09-08 | 峰力公司 | Be used for the auxiliary method and system of wireless hearing |
| US20100128892A1 (en) * | 2008-11-25 | 2010-05-27 | Apple Inc. | Stabilizing Directional Audio Input from a Moving Microphone Array |
Non-Patent Citations (1)
| Title |
|---|
| GOLDBERG, JASON，PÉREZ-NEIRA, A. ; LAGUNAS, MIGUEL ANGEL: "Joint direction一of-arrival and array shape tracking for multiple moving targets", 《ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 1997. ICASSP-97., 1997 IEEE INTERNATIONAL CONFERENCE ON 》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105580074A (en) * | 2013-09-24 | 2016-05-11 | 美国亚德诺半导体公司 | Time-frequency directional processing of audio signals |
| CN105580074B (en) * | 2013-09-24 | 2019-10-18 | 美国亚德诺半导体公司 | Signal processing system and method |
| CN106030700A (en) * | 2014-02-19 | 2016-10-12 | 诺基亚技术有限公司 | Determination of an operational directive based at least in part on a spatial audio property |
| CN106030700B (en) * | 2014-02-19 | 2019-12-06 | 诺基亚技术有限公司 | determining operational instructions based at least in part on spatial audio properties |
| CN108683972A (en) * | 2014-10-20 | 2018-10-19 | 索尼公司 | sound processing system |
| US11172292B2 (en) | 2014-10-20 | 2021-11-09 | Sony Corporation | Voice processing system |
| CN108683972B (en) * | 2014-10-20 | 2022-08-09 | 索尼公司 | Sound processing system |
| CN113643682A (en) * | 2021-10-13 | 2021-11-12 | 展讯通信（上海）有限公司 | Noise reduction method, chip module and equipment |
| CN113643682B (en) * | 2021-10-13 | 2022-07-15 | 展讯通信（上海）有限公司 | Noise reduction method, chip module and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103024629B (en) | 2017-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8981994B2 (en) | Processing signals | |
| US8098844B2 (en) | Dual-microphone spatial noise suppression | |
| KR101566649B1 (en) | Near-field null and beamforming | |
| US9031257B2 (en) | Processing signals | |
| US20180182370A1 (en) | Active cancellation of noise in temporal bones | |
| US9525938B2 (en) | User voice location estimation for adjusting portable device beamforming settings | |
| EP2320676A1 (en) | Method, communication device and communication system for controlling sound focusing | |
| US9838784B2 (en) | Directional audio capture | |
| CN101682809B (en) | Sound discrimination method and apparatus | |
| US8693704B2 (en) | Method and apparatus for canceling noise from mixed sound | |
| US10257611B2 (en) | Stereo separation and directional suppression with omni-directional microphones | |
| CN103117064B (en) | Method and equipment for processing signals | |
| GB2575404A (en) | Dual microphone voice processing for headsets with variable microphone array orientation | |
| US20130142355A1 (en) | Near-field null and beamforming | |
| CN107465970B (en) | Apparatus for voice communication | |
| US20120303363A1 (en) | Processing Audio Signals | |
| EP2748817A2 (en) | Processing signals | |
| CN106919225A (en) | For the acoustic processor of mobile device | |
| CN103024629A (en) | Processing signals | |
| WO2007059255A1 (en) | Dual-microphone spatial noise suppression | |
| WO2022062531A1 (en) | Multi-channel audio signal acquisition method and apparatus, and system | |
| JP3332143B2 (en) | Sound pickup method and device | |
| JP3341815B2 (en) | Receiving state detection method and apparatus | |
| CN102970638A (en) | Signal processing | |
| JP3332144B2 (en) | Target sound source area detection method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200407 Address after: Redmond, Washington, USA Patentee after: MICROSOFT TECHNOLOGY LICENSING, LLC Address before: Ai Erlandubailin Patentee before: Skype |