JP5289128B2 - Signal processing method, apparatus and program - Google Patents

Description

  The present invention relates to a signal processing method, apparatus, and program using a microphone array technique.

  Research is being actively conducted on techniques for emphasizing sound coming from a specific direction and suppressing other sounds and detecting the direction of the sound source using a plurality of arranged microphones, so-called microphone arrays. . For example, when voice recognition is performed in order to grasp what a driver (hereinafter referred to as a driver) wants in a car, in order to suppress driving noise and car audio playback sound and extract only the driver's speech In addition, a microphone array is used.

  There are various types of microphone arrays, and a typical example is the delay sum array disclosed in Non-Patent Document 1. The delay-and-sum array performs an addition process after adding a delay to the signal from each microphone, so that an acoustic signal arriving from a specific direction set in advance (for example, the direction of the driver in a car) Is based on the principle that only the sound signals coming from other directions are weakened because the phases are not aligned. According to this principle, an acoustic signal from a specific direction can be emphasized, that is, directivity can be formed in a specific direction.

  Another example of the microphone array is a Griffith-Jim type array disclosed in Non-Patent Document 2. The Griffith-Jim array uses an adaptive filter to form a directivity with a characteristic that the direction of the interference sound is low in sensitivity (hereinafter also referred to as null) and selectively remove the interference sound. It is. The number of azimuths of the interference sound that can be removed is generally N-1 (N is the number of microphones).

  The reproduction sound of the car audio that becomes an interference sound in the voice recognition in the automobile is different from the running noise of the automobile, and the sound source signal and the sound source position are known. Therefore, the reproduced sound can be suppressed by performing so-called array processing on the signals from the microphone array. For example, the reproduction sound of the car audio can be suppressed by directing the low sensitivity direction of the microphone array toward the speaker of the car audio by array processing. Since the position of the speaker is known, it is possible to suppress the noise more effectively than the surrounding interference sound whose sound source position is unknown.

JL Flanagan, JDJohnston, R. Zahn and GWElko, "Computer-steered microphone arrays for sound transduction in large rooms," J. Acoust. Soc. Am., Vol. 78, no. 5, pp. 1508-1518, 1985 L.J. Griffiths and C.W.Jim, "An Alternative Approach to Linearly Constrained Adaptive Beamforming," IEEE Trans. Antennas & Propagation, Vol. AP-30, No. 1, Jan., 1982

  When the playback sound of the car audio is stereo, the localization position differs depending on the sound source. For example, vocals are usually localized at the center, and accompaniment is often distributed to the left and right for each instrument. In this case, it is desirable that the dead angle of the microphone array is formed in the direction of all sound sources, that is, the direction of all sound sources is low sensitivity, but this is difficult when the number of microphones is small. As a result, the interference noise suppression performance decreases. In addition, when a part of the sound source of the reproduced sound is localized in the same direction as the target sound, it is very difficult to remove the reproduced sound that is a disturbing sound.

  An object of the present invention is to provide a signal processing method, apparatus, and program for effectively suppressing a reproduced sound from a speaker that becomes a disturbing sound during voice recognition or hands-free call.

  According to one aspect of the present invention, an array is provided so as to have different sensitivities for received sound signals obtained by receiving reproduced sounds of a plurality of reproduction channels with a plurality of microphones depending on the sound receiving direction of the reproduced sounds. An array processing unit that performs processing, a sound source signal generation unit that generates at least one channel of a sound source signal from a plurality of channels of audio signals, and the sensitivity relative to the sound source signal for each of the plurality of playback channels is relatively low There is provided a signal processing apparatus including a filtering unit that performs filtering so that a sound source is localized in a direction and generates a plurality of filtering signals to be supplied to the plurality of reproduction channels.

  According to the present invention, even when a microphone array composed of a small number of microphones is used, it is possible to effectively suppress reproduced sound by a multi-channel audio signal that becomes a disturbing sound during voice recognition or hands-free call.

1 is a block diagram showing a signal processing apparatus according to a first embodiment of the present invention. The figure which shows the relationship between the sound source position and microphone for demonstrating operation | movement of 1st Embodiment. The block diagram which shows the signal processing apparatus which concerns on the 2nd Embodiment of this invention. The block diagram which shows the signal processing apparatus which concerns on the 3rd Embodiment of this invention. The block diagram which shows the signal processing apparatus which concerns on the 4th Embodiment of this invention. The block diagram which shows the signal processing apparatus which concerns on the 5th Embodiment of this invention. The block diagram which shows the signal processing apparatus which concerns on the 6th Embodiment of this invention. The block diagram which shows the electronic device which concerns on the 7th Embodiment of this invention

Embodiments of the present invention will be described below.
(First embodiment)
As shown in FIG. 1, the signal processing apparatus according to the first embodiment includes an adder 103, filtering units 104-1 and 104-2, selectors 105-1 and 105-2, an array processing unit 108, and phase control. Part 109.

  Adder 103, filtering sections 104-1 and 104-2, and selectors 105-1 and 105-2 are respectively connected to audio input terminals 101-1 and 101-2 that receive a plurality of channels of audio signals, and a speaker 106- of a plurality of channels. 1, 106-2. The array processing unit 108 forms a predetermined directivity by performing signal processing on the received sound signals from the plurality of microphones 107-1 to 107-N forming the microphone array, and outputs a processed sound signal.

Next, the operation of the signal processing apparatus according to the present embodiment will be described.
Audio signals of a plurality of channels, in this example, stereo 2 channels, are input to the audio input terminals 101-1 and 101-2. The selectors 105-1 and 105-2 are, for example, changeover switches that are switched by a control signal from the control input terminal 102. When the selectors 105-1 and 105-2 are switched to the upper side, the audio signals from the audio input terminals 101-1 and 101-2 are selected. Then, the sound is radiated as sound from the speakers 106-1 and 106-2 which are a plurality of reproduction channels. Hereinafter, the sound radiated from the speakers 106-1 and 106-2 is referred to as reproduction sound. The audio signals supplied to the speakers 106-1 and 106-2 are actually amplified by the audio amplifier, but the audio amplifier is omitted in the figure.

  Audio signals from the audio input terminals 101-1 and 101-2 are also input to the adder 103, where both signals are added to form a one-channel signal, that is, a monaural signal. Hereinafter, the 1-channel signal output from the adder 103 is referred to as a sound source signal. The sound source signal output from the adder 103 is filtered by a plurality of filtering units 104-1 and 104-2. The filter characteristics of the filtering units 104-1 and 104-2 will be described later. Here, when the selectors 105-1 and 105-2 are switched to the lower side, the filtering signals from the filtering units 104-1 and 104-2 are selected, and the reproduced sound from the speakers 106-1 and 106-2, respectively. As radiated.

  Reproduced sounds from the speakers 106-1 and 106-2 are received by the plurality of microphones 107-1 to 107-N, and electric signals called sound reception signals are output from the microphones 107-1 to 107-N. Signal processing called array processing is performed on the sound reception signals from the microphones 107-1 to 107-N by the array processing unit 108, and a processed sound signal from which the interference sound is removed is output.

  In this embodiment, the array processing unit 108 performs array processing having different sensitivities depending on the sound receiving directions of the microphones 107-1 to 107-N with respect to the reproduced sound from the speakers 106-1 and 106-2. According to the present embodiment, the processed audio signal from the array processing unit 108 is an audio signal mainly composed of the utterance sound of the driver from which the interference sound is removed. The interference sound is, for example, an utterance sound from the passenger seat, a reproduction sound from the speakers 106-1 and 106-2, as will be described later. The processed voice signal from the array processing unit 108 is input to a voice recognition device (not shown), for example.

  FIG. 2 is a specific use example of the signal processing apparatus according to the present embodiment, and shows a state in which the signal processing apparatus is mounted in an automobile. In this example, there are two microphones and two speakers, and the microphones 107-1 and 107-2 are installed, for example, in the center of a room mirror or an instrument panel. The speakers 106-1 and 106-2 are often arranged, for example, at the front seat door. In addition to the front seat door part, a speaker is often arranged at the rear part.

  When a driver performs voice navigation using a voice recognition technology, for example, a high sensitivity characteristic is formed in the direction of the driver 210, and a low sensitivity characteristic (null) directivity is formed in the direction of the passenger 211. Thus, by controlling the characteristics of the microphone array, only the driver's speech can be captured accurately. Specifically, for example, when a delay sum array as described in Non-Patent Document 1 is used, the array processing unit 108 adds the signals after delaying the received sound signals from the microphones 107-1 to 107-N.

  Here, by appropriately controlling the delay time in the array processing unit 108 by the phase control unit 109, for example, only the acoustic signal that has arrived from the direction of the driver is added in the same phase and emphasized by the array processing unit 108. Array processing can be performed in which acoustic signals from directions are canceled because the phases are not aligned. That is, directivity can be formed in the direction of the driver by this array processing.

When the received sound signals from the N microphones 107-1 to 107-N are expressed as Xn (t) (n = 1,..., N), the processed sound signal Y (t) from the array processing unit 108 is Is expressed by the following equation.

However, the microphones 107-1 to 107-N are arranged at regular intervals in the order of the subscript n. Further, τ is a delay time for making the received signal X (t) from the microphones 107-1 to 107-N in-phase with the arrival direction of the target sound.

  As another example, as in the Griffith-Jim type array described in Non-Patent Document 2 above, a null is formed in the direction of the disturbing sound using an adaptive filter, and the disturbing sound is selectively removed. Also good. In that case, the direction of the interference sound that can be removed is generally N-1 (N is the number of microphones). Various other methods have been proposed, but the present embodiment does not depend on the microphone array method itself, and an arbitrary method can be used.

  As a design policy of such a microphone array, in order to accurately capture only the driver's utterance, it is natural to design so as to suppress the utterance of the passenger sitting in the passenger seat. In this case, when the disturbing sound is only the speech sound from the passenger seat, the disturbing sound can be effectively suppressed.

  However, when reproduced sound is output simultaneously from a speaker that is also an interference sound, it is difficult to suppress the reproduced sound. This is because the direction of arrival of the uttered sound from the passenger seat and the reproduced sound from the speaker are generally different. In particular, when the number of microphones is small, the number of azimuths in which nulls can be formed decreases. For example, when the number of microphones is 2, if nulls are formed in the direction of the passenger seat, nulls cannot be formed in other directions. The playback sound from the speaker cannot be suppressed.

  Furthermore, when the reproduced sound is output in stereo from the speaker, there is a possibility that various sound source directions exist at the same time, and there is a limit in the array processing using a small number of microphones. Even for a monaural signal, it is necessary to generate null in two directions together with the passenger seat, and it is difficult to use two microphones.

  In the present embodiment, when the reproduced sound from the speakers 106-1 and 106-2 is received by the microphones 107-1 to 107-N, the filtering unit 104 is arranged so that the sound source is localized in a direction in which the sensitivity is relatively low. The sound source signal from the adder 103 is filtered and processed in advance by −1 and 104-2. Specifically, for example, filtering is performed by the filtering units 104-1 and 104-2 so that the reproduced sound from the speakers 106-1 and 106-2 is observed as if it came from the direction of the passenger seat. .

  In this way, it is possible to eliminate the utterance sound from the passenger seat and the reproduction sound from the speakers 106-1 and 106-2 with one null in the same direction. That is, even when a large number of nulls cannot be formed due to the small number of microphones 107-1 to 107-N, the reproduced sound from the speakers 106-1 and 106-2 is simultaneously suppressed in addition to the spoken sound of the passenger seat. Can do. In this way, not only the utterance sound from the passenger seat but also the reproduced sound from the speakers 106-1 and 106-2 are suppressed in the processed sound signal, so that speech recognition can be performed accurately.

  In the above description, the array processing unit 108 performs array processing so that the sensitivity to a predetermined direction (for example, the direction of the passenger seat) is minimized, and the filtering units 104-1 and 104-2 perform the speaker 106-1. , 106-2, the filtering is performed so that the sound source is localized in the predetermined direction. However, depending on the method of the microphone array, it is not always necessary to perform filtering so that the reproduced sound from the speakers 106-1 and 106-2 is regarded as the same direction as the uttered sound from the passenger seat as described above.

  For example, Japanese Patent Laid-Open No. 2007-10897 discloses a method of designing the array directivity so as to generate a desired response (target signal) for each of the learning sound source positions. In this case, it is possible to design such that signals emitted from a direction range in which a driver may exist are emphasized and other signals are suppressed. In such an array, the sound receiving direction of the microphone array only needs to be outside the direction range in which the driver may be present, and does not necessarily match the direction of the uttered sound from the passenger seat.

  As described above, the array processing unit 108 performs array processing so that the sensitivity with respect to a predetermined direction range is higher than the sensitivity with respect to a direction outside the range, and the filtering units 104-1 and 104-2 perform this direction. Filtering may be performed so that the sound source is localized in a direction outside the range.

  By the way, when the filtering signals from the filtering units 104-1 and 104-2 are supplied to the speakers 106-1 and 106-2, the reproduced sound from the speakers 106-1 and 106-2 is reproduced from the original audio signal. The sound is different from the time and the stereo sense is lost. That is, the reproduced sound corresponding to the filtered signal is a sound that is uncomfortable for the listener.

  Therefore, in the present embodiment, the selectors 105-1 and 105-2 select the filtering signals from the filtering units 104-1 and 104-2 only during the driver's speech and supply them to the speakers 106-1 and 106-2. In other cases, the audio signals from the audio input terminals 101-1 and 101-2 are selected and supplied to the speakers 106-1 and 106-2 so that normal reproduction is performed. Such a sense of incongruity can be minimized.

Next, a design method for the filtering units 104-1 and 104-2 will be described.
The sound source signals supplied to the speakers 106-1 and 106-2 are monaural signals obtained by adding the stereo signals by the adder 103. When this sound source signal is filtered by the filtering units 104-1 and 104-2 and reproduced by the speakers 106-1 and 106-2 and the reproduced sound is received by the two microphones 107-1 and 107-2, The transfer function (y1, y2) from the (output terminal of the adder 103) to the microphones 107-1 and 107-2 is expressed by the following equation (2).

Here, hxy is a transfer function from the speaker y to the microphone x, and g1 and g2 are transfer functions of the filtering units 104-1 and 104-2.

  In order for the filtering units 104-1 and 104-2 to perform filtering as if the reproduced sound from the speakers 106-1 and 106-2 came from the direction of the passenger seat, (y1, y2) is from the passenger seat. The transfer functions (g1, g2) of the filtering units 104-1 and 104-2 may be designed so as to be equal to the transfer functions (a1, a2) to the microphones 107-1 and 107-2. For this purpose, (g1, g2) may be solved by substituting (a1, a2) into (y1, y2) in equation (2).

  In the case of two microphones and two speakers, since the matrix representing the transfer function between the speaker and the microphone is a square matrix, an inverse matrix can usually be calculated. Since the inverse matrix cannot be defined when the number of microphones and the number of speakers are different, it is common to use a generalized inverse matrix.

  By the way, the transfer functions (g1, g2) of the filtering units 104-1 and 104-2 are greatly different for each frequency, and the spectrum of the reproduced sound output from the speakers 106-1 and 106-2 corresponding to the filtering signal is filtered. There are cases where the spectrum of the reproduced sound corresponding to the previous audio signal is greatly different. In such a case, it is possible to adjust the magnitude of the transfer function (g1, g2) so that the spectrum of the reproduced sound corresponding to the filtered signal is the same as the spectrum of the reproduced sound corresponding to the audio signal before filtering. is there. This is because the sound volume is irrelevant in sound source localization, so even if the transfer function of the filtering units 104-1 and 104-2 is set to (A × g1, A × g2) using an arbitrary constant A, for example, This is because the localization is not affected.

  In the control input terminal 102 of FIG. 1, the audio signals from the audio input terminals 101-1 and 101-2 are directly reproduced by the speakers 106-1 and 106-2, or filtered by the filtering units 104-1 and 104-2. A control signal for switching and controlling whether or not to perform reproduction is given, and the selectors 105-1 and 105-2 are controlled by this control signal.

  As a method for giving the control signal, for example, a driver's speech section (speech section) is detected, and the filtering signals from the filtering units 104-1 and 104-2 are supplied to the speakers 106-1 and 106-2 only during the speech section. A method of controlling the selectors 105-1 and 105-2 can be given. For example, a speech section detector is used to detect the speech section. As a method of a speech section detector, a method of determining a speech section based on signal power information, a signal-to-noise ratio based on estimated noise, spectrum information, or the like has been proposed. In addition, based on statistical methods (Sohn J., Kim NS, and Sung W., "A statistical model-based voice activity detection", IEEE Signal Process. Lett., Pp.1-3, 1999, 16, (See (1)) is also often used. As another method of giving the control signal, a method of explicitly instructing the voice section from the driver can be considered.

  When performing speech recognition, the speaker often presses a button indicating the start of utterance. By using the utterance start information as the voice section information, the voice section can be reliably identified, and this can be used as the control signal. It is possible to press the key only once during the utterance, and the program may determine the end of the utterance. In this case, it is sufficient to use the information of the voice section detector for the start and the end of the utterance.

(Second Embodiment)
FIG. 3 shows a signal processing apparatus according to the second embodiment, which is a modification of the first embodiment. The control input terminal 102 and selectors 105-1 and 105-2 in FIG. The filtering signals from -1 to 104-N are supplied to the speakers 106-1 to 106-N. Thus, when it is permissible to always reproduce the filtered signal from the speakers 106-1 to 106-N, the configuration of the present embodiment is desirable from the viewpoint of simplification of the apparatus. In FIG. 3, there are M audio input terminals, filtering units, and speakers, but it is clear from the above description that M may be a plurality of two or more.

(Third embodiment)
FIG. 4 shows a signal processing apparatus according to the third embodiment modified from the first embodiment. Filtering signals from the filtering units 104-1 and 104-2 are stored in the storage units 110-1 and 110-2. The filtering signals once accumulated and read from the accumulation units 110-1 and 110-2 are supplied to the speakers 106-1 and 106-2. That is, in this embodiment, filtering is not performed online, and the waveforms of the filtering signals obtained by filtering the sound source signals in advance by the filtering units 104-1 and 104-2 are stored in the storage units 110-1 and 110-2. In addition, they are appropriately read out during actual use and reproduced by the speakers 106-1 and 106-2.

  For example, among the signals to be reproduced by the speakers 106-1 and 106-2, a signal that is determined in advance, such as a car navigation fixed message, is filtered and stored in advance rather than being filtered each time it is reproduced. It is desirable to store in 110-1 and 110-2. Then, a filtered signal waveform may be extracted from the storage units 110-1 and 110-2 during reproduction and supplied to the speakers 106-1 and 106-2.

  In many cases, the fixed message is monaural sound. In this case, it is sufficient that the same data is input to the storage units 101-1 and 101-2, and there is no problem with the same configuration as stereo data. .

(Fourth embodiment)
FIG. 5 shows a signal processing apparatus according to the fourth embodiment. In the present embodiment, a correlation reduction unit 303 is provided instead of the adder 103 in FIG. 1, and audio signals from the audio input terminals 101-1 and 101-2 are input to the correlation reduction unit 303. The correlation reduction unit 203 generates a sound source signal of a plurality of channels (two channels in this example) in which the correlation is reduced from the correlation between the audio signals of the plurality of channels (two channels in this example). Of the two-channel sound source signals from the correlation reduction unit 203, the first channel sound source signal is input to the filtering units 304-1 and 304-3, and the second channel sound source signal is input to the filtering units 304-2 and 304-4. Is input.

  Filtering signals from the filtering units 304-1 and 304-2 are added by the adder 311-1 and then supplied to the speaker 106-1 via the selector 105-1. Similarly, the filtering signals from the filtering units 304-3 and 304-4 are added by the adder 311-2 and then supplied to the speaker 106-2 via the selector 105-2.

  In this way, filtering is performed on the two-channel sound source signal from the correlation reduction unit 203 for each of the speakers 106-1 and 106-2, which are reproduction channels, and an addition signal of the filtering signals of the two channels is the speaker 106-. 1, 106-2.

When two reproduced sounds from the speakers 106-1 and 106-2 are received by the two microphones 107-1 and 107-2, the microphones 107-1 and 107-2 are received from the sound source (two output terminals of the correlation reducing unit 303). The transfer functions (y1, y3) and (y2, y4) up to are expressed by the following equations (3) and (4).

However, hxy is a transfer function from the speaker y to the microphone x, g1 and g3 are transfer functions of the filtering units 304-1 and 304-3, and g2 and g4 are transfer functions of the filtering units 304-2 and 304-4. is there. Similarly to the case where the transfer functions (g1, g2) of the filtering units 104-1 and 104-2 are obtained from the expression (2) in the first embodiment, different directions for (y1, y3) and (y2, y4). , The transfer functions g1, g3 and g2, g4 can be obtained from the equations (3) and (4).

Next, the operation principle of this embodiment will be described.
In the first embodiment, input audio signals of a plurality of channels are added by the adder 103 to be a single channel, that is, a monaural sound source signal, whereas in this embodiment, a plurality of channels (the first channel and the first channel) are added. (2 channels) sound source signal is output. As described above, the sound source signals of the plurality of channels are filtered for each of the speakers 106-1 and 106-2, and an addition signal of the filtered signals of the two channels is supplied to the speakers 106-1 and 106-2. . It should be noted that the reproduced sounds from the speakers 106-1 and 106-2 interfere with each other and are localized in a direction different from the design when received by the microphones 107-1 to 107-N. It is to end.

  In the present embodiment, in order to avoid such an adverse effect, the correlation reduction unit 303 reduces the correlation between the two-channel sound source signals. That is, since the audio signals from the audio input terminals 101-1 and 101-2 are stereo signals, the correlation is large, but the two-channel sound source signals output from the correlation reducing unit 303 are signals having a small correlation. Here, both the number of channels of the input audio signal and the number of channels of the sound source signal whose correlation is reduced are two, but the number of channels may not be the same.

  Specifically, in the correlation reducing unit 303, for example, the input two-channel audio signals are added to form a monaural signal, and then separated for each frequency band, and the low-frequency signal and the second channel are used as the first-channel sound source signal. A high frequency signal is output as a sound source signal. Also, the monaural signal obtained by adding the two-channel audio signals is separated into a number of frequency components to form so-called subbands, and each frequency component is alternately allocated to the two-channel sound source signals or randomly allocated. You can also. Further, when individual signals (parts) constituting a signal are known, such as an audio signal generated from MIDI (Musical Instrument Digital Interface) data, a two-channel sound source signal is generated separately for each part. It is also possible.

  As described above, when the filtering signal is supplied to the speakers 106-1 and 106-2, the stereo feeling of the reproduced sound from the speakers 106-1 and 106-2 is lost. According to the present embodiment, it is possible to compensate for such a reduction in the stereo feeling of the reproduced sound. That is, in this embodiment, when the microphone array has minimum values of sensitivity in a plurality of directions by the array processing unit 108, the generated multi-channel sound source signal is distributed to each minimum value to compensate for a reduction in stereo feeling. It becomes possible. When the microphone array shows high sensitivity in a specific direction range, the generated multi-channel sound source signal can be localized in a direction other than the high sensitivity direction range to compensate for the reduction between stereo. Become.

(Fifth embodiment)
FIG. 6 shows a signal processing apparatus according to the fifth embodiment. The difference from the signal processing apparatus according to the first embodiment will be described. In this embodiment, signal separation units 410-1 and 410-2 arranged immediately after the audio input terminals 101-1 and 102-2 are added. The selectors 105-1 and 105-2 in FIG. 1 are replaced with adders 312-1 and 312-2, and the input destination of the control signal from the control input terminal 102 is the selectors 105-1 and 105-2. To signal separation units 410-1 and 410-2.

  The two-channel audio signals from the audio input terminals 101-1 and 102 are added by the adder 403 in the signal separation units 410-1 and 410-2 and become a monaural sound source signal (referred to as a monaural component), It is separated into components (referred to as stereo components) that are directly output as stereo two channels.

  The former monaural component is added by the adder 403 in the same manner as in the first embodiment to obtain a monaural sound source signal. This sound source signal is filtered by filtering sections 304-1 and 304-2, and the filtered signals are input to adders 312-1 and 312-2, respectively. The latter stereo component is input to adders 312-1 and 312-2 as they are. The sound source signal and the stereo component signal are added by the adders 312-1 and 312-2, and output from the speakers 106-1 and 106-2 as reproduced sound.

  According to the present embodiment, the signals filtered by the filtering units 304-1 and 304-2 are some components of the input audio signal separated by the signal separation units 410-1 and 410-2. For example, when the sound source direction of each component of the audio signal is known in advance or each component can be separated by using a sound source separation method or the like, the filtering units 304-1 and 304-2 may Of these, it is only necessary to filter, for example, a component within the direction range of the passenger seat that may cause an utterance sound as an interference sound. The components existing outside this direction range can be suppressed by the array processing unit 108 even if they are directly output from the speakers 106-1 and 106-2.

  As described above, according to the present embodiment, only the components within the direction range in which the utterance sound that becomes the interference sound may arrive in the filtering units 304-1 and 304-2 are filtered out of the input audio signal. That's fine. Therefore, in the reproduced sound from the speakers 106-1 and 106-2 based on the input audio signal, it is possible to minimize a reduction in stereo feeling due to filtering.

  In FIG. 6, the signal separation units 410-1 and 410-2 are controlled by a control signal from the control input terminal 102. However, when control is not necessary, the input of the control signal can be omitted.

  As another specific example of the signal separation units 410-1 and 410-2, a component in a specific frequency band can be selected. For example, when the band of the input audio signal is 20 kHz and the band in which the array processing unit 109 performs the array process is 8 kHz, the component of the band of 8 kHz or more in the audio signal is irrelevant to the array process. Therefore, only the components less than 8 kHz to be subjected to the array processing are separated as the monaural components that are added by the adder 403 by the signal separators 410-1 and 410-2 and become a monaural sound source signal. In the filtering units 304-1 and 304-2, the sound source signal including only components of 8 kHz or less output from the adder 403 is filtered, and the filtered signal is input to the adders 312-1 and 312-2.

  On the other hand, the components in the band of 8 kHz or more in the input audio signal are separated as stereo components that are directly output as stereo two channels in the signal separation units 410-1 and 410-2, and adders 312-1 and 312. -2, respectively. The sound source signal and the stereo component signal are added by the adders 312-1 and 312-2, and output from the speakers 106-1 and 106-2 as reproduced sound. By doing in this way, the fall of the stereo feeling by filtering in the reproduced sound from the speakers 106-1 and 106-2 based on the input audio signal can be minimized.

(Sixth embodiment)
FIG. 7 shows a signal processing apparatus according to the sixth embodiment. The difference from the fourth embodiment shown in FIG. 5 will be described. In this embodiment, signal separation units 410-1 and 410-2 are added immediately after the audio input terminals 101-1 and 101-2 in FIG. The selectors 105-1 and 105-2 are replaced with adders 312-1 and 312-2, and the control signal input destination from the control input terminal 102 is separated from the selectors 105-1 and 105-2. It is changed to the part 410-1,410-2.

  In the present embodiment, filtering is performed on some components of the input signal as in the fourth embodiment. The filtering is performed in the fourth embodiment by the same method as in the first embodiment, but in this embodiment, the two-channel sound source signal output from the correlation reducing unit 303 is the same as in the third embodiment. To be done.

  Therefore, according to the present embodiment, in the reproduced sound from the speakers 106-1 and 106-2 based on the input audio signal as in the fifth embodiment, the reduction in stereo feeling due to filtering is minimized. Can do. In FIG. 7, the signal separation units 410-1 and 410-2 are controlled by a control signal from the control input terminal 102. However, when control is not necessary, the input of the control signal can be omitted.

(Seventh embodiment)
FIG. 8 shows an electronic apparatus 501 according to a seventh embodiment of the present invention, including a signal processing device as described in the previous embodiments. Here, the electronic device 501 is, for example, a personal computer, a portable communication terminal, or the like, and includes a display unit 502. For example, speakers 106-1 and 106-2 and microphones 107-1 and 107-2 are installed around the display unit 502 of the electronic device 501, and a speaker 503 handling the electronic device 501 is connected to the microphones 107-1 and 107-2. Voice can be input.

Next, the operation principle of this embodiment will be described.
The reproduced sound from the speakers 106-1 and 106-2 based on the output signal generated by the electronic device 501 is radiated toward the speaker 503. The reproduced sound is, for example, the voice of the other party or an audio signal including music. The speaker 503 inputs voices such as utterances to the other party and instructions to the terminal toward the microphones 107-1 to 107-N provided in the electronic device 501.

  By the way, the sound source direction observed when the microphones 107-1 and 107-2 receive the reproduced sound from the speakers 106-1 and 106-2 and the sound source observed when the speech of the speaker 503 is received. If the directions overlap, the voice of the speaker 503 and the reproduced sound from the speakers 106-1 and 106-2 are mixed in the sound reception signals output from the microphones 107-1 and 107-2. This causes an echo to occur on the other side in a call, and causes a recognition error when performing voice recognition.

  When the reproduced sound from the speakers 106-1 and 106-2 is received by the plurality of microphones 07-1 and 107-2 using the signal processing apparatus described in the first to sixth embodiments, the sound source direction Such a problem can be avoided by filtering the reproduced sound from the speakers 106-1 and 106-2 in advance so that the sound is out of the direction range where the speaker may exist. .

  The signal processing based on the embodiment of the present invention described above can be realized by hardware, but can also be executed by software using a computer such as a personal computer. Therefore, according to the present invention, it is possible to provide a program for causing a computer to function as the signal processing apparatus described above, or a computer-readable storage medium storing the program.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

108: Array processing unit 109, 109-1, 109-2 ... Phase control unit 110-1, 110-2 ... Accumulation unit 303 ... Correlation reduction unit 304-1 to 304-4 ... Filtering unit 312-1, 312-2, 403 ... adder 410-1, 410-2 ... signal separation unit 501 ... electronic device 502 ... display unit

Claims (11)

An array processing unit for performing an array process so as to have different sensitivities depending on the sound receiving direction of the reproduced sound, with respect to a received signal obtained by receiving reproduced sounds of a plurality of reproducing channels by a plurality of microphones;
A sound source signal generating unit that generates a sound source signal of at least one channel from a plurality of channels of audio signals;
Filtering for generating a plurality of filtering signals to be supplied to the plurality of reproduction channels by performing filtering so that the sound source is localized in a direction in which the sensitivity is relatively low with respect to the sound source signal for each of the plurality of reproduction channels. And
A signal processing apparatus comprising:   The signal processing apparatus according to claim 1, wherein the sound source signal generation unit generates a one-channel sound source signal by adding the plurality of channels of audio signals. The array processing unit performs the array processing so that the sensitivity with respect to a predetermined direction is a minimum value,
The signal processing apparatus according to claim 1, wherein the filtering unit performs the filtering so that a sound source is localized in the predetermined direction. The array processing unit performs the array processing so that sensitivity to a direction within a predetermined direction range is higher than sensitivity to a direction outside the direction range,
The signal processing apparatus according to claim 1, wherein the filtering unit performs the filtering so that a sound source is localized in a direction outside the direction range. The sound source signal generating unit generates a sound source signal of a plurality of channels in which a correlation is reduced from between the audio signals of the plurality of channels from the audio signals of the plurality of channels;
The signal processing apparatus according to claim 1, wherein the filtering unit performs the filtering on each of the sound source signals of the plurality of channels for each of the plurality of reproduction channels.   The signal processing apparatus according to claim 1, further comprising a selector that selects one of the plurality of channels of audio signals and the plurality of filtering signals and supplies the selected signals to the plurality of reproduction channels. The selector is a signal processing apparatus according to claim 6, characterized in that selecting the filtered signal during the utterance of the speaker, selecting the audio signal during the non-spoken. A signal separation unit that separates each of the audio signals of the plurality of channels into a first signal component used to generate the sound source signal and a second signal component other than the first signal component;
An adder for adding the second signal component to the plurality of filtering signals supplied to the plurality of reproduction channels;
The signal processing apparatus according to claim 1, further comprising: A display unit;
A plurality of microphones provided in the display unit;
A plurality of speakers provided in the display unit;
The signal processing device according to claim 1, wherein the filtering unit performs filtering so that the sound source is localized in a direction other than a direction range in which a user facing the display unit is present. An electronic apparatus comprising: Computer
An array processing unit that performs array processing so as to have different sensitivities depending on the sound receiving direction of the reproduced sound, with respect to a received signal obtained by receiving reproduced sounds of a plurality of reproducing channels by a plurality of microphones;
A sound source signal generating unit that generates a sound source signal of at least one channel from a plurality of channels of audio signals;
Filtering for generating a plurality of filtering signals to be supplied to the plurality of reproduction channels by performing filtering so that the sound source is localized in a direction in which the sensitivity is relatively low with respect to the sound source signal for each of the plurality of reproduction channels. Part,
Signal processing program to function as For the received signal obtained by receiving the reproduced sound of the plurality of reproduction channels by the plurality of microphones, an array process is performed so as to have different sensitivities depending on the sound receiving direction of the reproduced sound,
Generating a sound source signal of at least one channel from a plurality of channels of audio signals;
For each of the plurality of reproduction channels, filtering is performed so that the sound source is localized in a direction in which the sensitivity is relatively low with respect to the sound source signal, thereby generating a plurality of filtering signals to be supplied to the plurality of reproduction channels. And a signal processing method.

Images