JP2012169781A - Speech processing device and method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a speech processing device and method, and a program, capable of balancing between a centralized localization signal such as voice dominant signal and a presence sound before outputting the sound.SOLUTION: In a speech processing device, a center balance correction unit 32 and a gain control signal generation unit 33 produce a gain control signal Gv based on the average level of voice component signals and the average level of presence sound component signals. A presence sound balance correction unit 35 and a gain control signal generation unit 36 produce a gain control signal Gy based on the average level of voice component signals and the average level of presence sound component signals. A presence sound level correction gain generation unit 37 corrects the gain control signal Gy to produce a gain control signal Gs. A variable gain amplifier 24 performs a gain control over a voice dominant signal Sv using the gain control signal Gs. Variable amplifiers 25 and 26 perform a gain control over a presence sound component signal using the gain control signal Gv. The present invention can be applied for television receivers.

Description

  The present invention relates to an audio processing apparatus and method, and a program, and more particularly, to adjust the balance between a centralized localization signal and a real sound in an input audio signal so that the centralized localization signal and the real sound can be output in a balanced manner. The present invention relates to a voice processing apparatus and method, and a program.

  When a broadcast channel received by a television receiver is switched or when a plurality of input devices are switched at an AV center in an AV (Audio-Visual) system, the output volume may be large due to a level difference between contents. Changes can occur.

  In such a case, the user needs to adjust the volume by performing a volume operation in order to obtain his preferred volume, and may feel annoying.

  Also, even within the same content (for example, within the same broadcast channel or within the same broadcast program), the output volume may change due to changes in the commercial (CM) part or scene, which may be uncomfortable.

  Various sound volume correction methods for solving this problem have been proposed. A volume control method using AGC (Auto Gain Control) as an example is widely known.

  However, when the level of the input audio signal greatly fluctuates, it is difficult to completely suppress a sudden change in the audio signal gain at the level change point, and the output audio volume level fluctuates at the level change point. , The listener may feel uncomfortable in terms of hearing.

  In particular, the conventional sound volume correction method is a method in which the entire audio signal is equally controlled in the same manner, and thus there is a problem that the uncomfortable feeling with respect to the fluctuation of the sound volume level at the sudden change point is conspicuous.

  In view of this, a technique has been proposed in which, for example, an average level of a centralized localization signal or the like is obtained from the audio signal components, and gain control is performed so that the output signal becomes the average level (see cited document 1).

JP 2010-136173 A

  However, in the technique of Patent Document 1, when the center concentration localization signal is a person's voice or the like, the average level is maintained in any state, so that the voice is maintained at a constant level. The balance of the gain control level with the localization signal could not be corrected.

  The present invention has been made in view of such a situation, and in particular, can adjust and output a balance between a concentrated localization signal such as a voice main signal and a real sound.

  An audio processing device according to an aspect of the present technology performs gain control to output a first component main signal having a part of the plurality of audio components as a main component among input audio signals including a plurality of audio components. A one-component main signal gain control unit, another component signal gain control unit that performs gain control on other component signals other than the first component in the input audio signal, and an average level of the first component signal A first component signal average level detection unit for detecting the other component signal average level detection unit for detecting an average level of the other component signal, an average level of the first component signal, and the other component signal average level. Based on a first component main signal gain control signal output unit for outputting a first component gain control signal for gain control of the first component main signal, an average level of the first component signal, and The other component signal gain control signal output unit for outputting the other component gain control signal for gain control of the other component signal based on the other component signal average level, and the first component main signal gain control unit includes: Of the input audio signals composed of the plurality of audio components, gain control is performed on a first component main signal whose main component is a part of the plurality of audio components based on the first component main signal gain control signal. The other component signal gain control unit outputs the other component signal other than the first component as the other component output signal by performing gain control based on the other component signal gain control signal. To do.

  The first component main signal gain control signal output unit corrects by adding a signal obtained by multiplying the average level of the other component signal by a first predetermined amplification factor to the average level of the first component signal. The first component signal gain control so that the one signal component average level correction unit and the first component output signal have the average level of the first component signal corrected by the first signal component average level correction unit. A first component signal gain control signal generating unit that generates a signal, and the other component signal gain control signal output unit includes the other component signal at an average level of the first component signal. A first signal component average level correction unit that corrects by adding a signal obtained by multiplying an average level by a second predetermined amplification factor, and the other component output signal is corrected by the first signal component average level correction unit. The to an average level of the first component signal, can be made to include the other component signal gain control signal generator for generating said other component signal gain control signal.

  The first component main signal gain control signal output section generates a first component gain control signal for generating a first component signal gain control signal so that the first component output signal is at the first signal component average level. The first component signal gain control signal is corrected by correcting the first component signal gain control signal by multiplying by a generation unit and a first amplification factor set in association with the average level of the other component signals The other component signal gain control signal output unit outputs the other component output signal at the first signal component average level. As described above, the other component gain control signal generation unit for generating the other component signal gain control signal, the second amplification factor set in association with the other component signal average level, It can be corrected component signal gain control signal, so as to include the other signal components mean level correction unit which outputs the other component signal gain control signal corrected.

  The first component gain control signal generation unit and the other component signal gain control signal output unit can be common, the first component gain control signal generated by the first component gain control signal generation unit, The other component signal gain control signal generated by the other component signal gain control signal output unit can be the same.

  An other signal component signal gain control signal correction unit that corrects the other component signal gain control signal output from the other component signal gain control signal output unit can be included.

  The first component signal may be a center concentrated localization signal.

  It is possible to further include addition means for adding the output signal obtained by adding the first component output signal and the other component output signal to the sound output signal after the volume correction.

  According to an audio processing method of one aspect of the present technology, a first component main signal mainly including a part of the plurality of audio components among input audio signals including a plurality of audio components is output by performing gain control. A one-component main signal gain control unit, another component signal gain control unit that performs gain control on other component signals other than the first component in the input audio signal, and an average level of the first component signal A first component signal average level detection unit for detecting the other component signal average level detection unit for detecting an average level of the other component signal, an average level of the first component signal, and the other component signal average level. Based on a first component main signal gain control signal output unit for outputting a first component gain control signal for gain control of the first component main signal, an average level of the first component signal, and The other component signal gain control signal output unit for outputting the other component gain control signal for gain control of the other component signal based on the other component signal average level, and the first component main signal gain control unit includes: Of the input audio signals composed of the plurality of audio components, gain control is performed on a first component main signal whose main component is a part of the plurality of audio components based on the first component main signal gain control signal. The other component signal gain control unit outputs the other component signal other than the first component as the other component output signal by performing gain control based on the other component signal gain control signal. An audio processing method in the audio processing device for performing the input audio signal comprising the plurality of audio components in the first component main signal gain control unit A first component main signal gain control step of gain-controlling and outputting a first component main signal whose main component is a part of the plurality of audio components; and the input audio in the other component signal gain control unit Of the signals, the other component signal gain control step for gain-controlling and outputting other component signals other than the first component, and the average level of the first component signal in the first component signal average level detection unit A first component signal average level detecting step for detecting; an other component signal average level detecting step for detecting an average level of the other component signal in the other component signal average level detecting unit; and the first component main signal gain control signal. Based on the average level of the first component signal and the average level of the other component signal in the output unit, the first component main A first component main signal gain control signal output step for outputting a first component gain control signal for gain control of the body signal, an average level of the first component signal in the other component signal gain control signal output unit, and the other A component signal gain control signal output step of outputting another component gain control signal for gain control of the other component signal based on the component signal average level, and the processing of the first component main signal gain control step includes: Of the input audio signals composed of the plurality of audio components, gain control is performed on a first component main signal whose main component is a part of the plurality of audio components based on the first component main signal gain control signal. The first component output signal is output, and the processing of the other component signal gain control step is the other component signal other than the first component. , Based on other component signal gain control signal, and outputs it as the other component output signal and gain control.

  A program according to an aspect of the present technology is a first component that performs gain control and outputs a first component main signal that mainly includes a part of the plurality of audio components, among input audio signals including a plurality of audio components. A main signal gain control unit, an other component signal gain control unit that outputs the other component signals other than the first component in the input audio signal by performing gain control, and an average level of the first component signal is detected. Based on the first component signal average level detecting unit, the other component signal average level detecting unit for detecting the average level of the other component signal, the average level of the first component signal, and the other component signal average level. A first component main signal gain control signal output unit for outputting a first component gain control signal for gain control of the first component main signal; an average level of the first component signal; The other component signal gain control signal output unit for outputting the other component gain control signal for gain control of the other component signal based on the other component signal average level, the first component main signal gain control unit, A first component main signal having a part of the plurality of audio components as a main component among input audio signals composed of a plurality of audio components is gain-controlled based on the first component main signal gain control signal. The other component signal gain control unit outputs the other component signal other than the first component as the other component output signal by performing gain control based on the other component signal gain control signal. Among the input audio signals composed of the plurality of audio components in the first component main signal gain controller in the computer that controls the audio processing device, A first component main signal gain control step for gain-controlling and outputting a first component main signal whose main component is a part of the plurality of audio components; and the other component signal gain control unit Among them, the other component signal gain control step for gain-controlling and outputting other component signals other than the first component, and detecting the average level of the first component signal in the first component signal average level detecting unit. A first component signal average level detection step; an other component signal average level detection step for detecting an average level of the other component signal in the other component signal average level detection unit; and the first component main signal gain control signal output unit. , The first component main signal based on the average level of the first component signal and the average level of the other component signal A first component main signal gain control signal output step for outputting a first component gain control signal for gain control, an average level of the first component signal in the other component signal gain control signal output unit, and the other component signal Processing of the first component main signal gain control step is executed by executing a process including an other component gain control signal output step of outputting an other component gain control signal for gain control of the other component signal based on the average level. Is a first component main signal having a part of the plurality of audio components as a main component of the input audio signal composed of the plurality of audio components based on the first component main signal gain control signal. And output as a first component output signal, and the processing of the other component signal gain control step is other than the first component. Minute signal, based on other component signal gain control signal, and outputs it as the other component output signal and gain control.

  An electronic device of the present technology includes the audio processing device according to any one of claims 1 to 7.

  In one aspect of the present technology, a first component main signal including a part of the plurality of sound components as a main component among input sound signals including a plurality of sound components is output with gain control, and the input sound Among the signals, other component signals other than the first component are output after gain control, the average level of the first component signal is detected, the average level of the other component signal is detected, and the first component is detected. A first component gain control signal for gain control of the first component main signal is output based on an average level of the signal and the other component signal average level, and the average level of the first component signal and the other component Based on the average signal level, an other component gain control signal for gain control of the other component signal is output, and among the input audio signals composed of the plurality of audio components, A first component main signal whose main component is a part of the audio component is gain-controlled based on the first component main signal gain control signal and is output as a first component output signal. The other component signal is gain-controlled based on the other component signal gain control signal and output as the other component output signal.

  The voice processing apparatus of the present invention may be an independent apparatus or a block that performs voice processing.

  According to one aspect of the present technology, it is possible to perform sound correction by adjusting a balance between a component including the center concentration localization signal and other components in the input sound signal.

It is a block diagram for demonstrating the example of the electronic device to which the volume correction apparatus by this technique is applied. It is a block diagram for demonstrating 1st Embodiment of the volume correction apparatus by this technique. It is a block diagram which shows the structural example of the center concentration localization signal generation part in embodiment of FIG. It is a block diagram which shows the other structural example of the center concentration localization signal generation part in embodiment of FIG. FIG. 5 is a block diagram for explaining a configuration example of a part of a center concentration localization signal generation unit in the example of FIG. 4. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. FIG. 6 is a diagram used for explaining each part of the configuration example of FIG. 5. It is a figure used in order to demonstrate the example of a structure of the realistic sound average level detection part of FIG. It is a figure used in order to demonstrate the example of a structure of the center balance correction | amendment part of FIG. It is a figure used in order to demonstrate the example of a structure of the realistic sound balance correction | amendment part of FIG. It is a figure used in order to demonstrate the example of a structure of the realistic sound level correction gain production | generation part of FIG. It is a figure used in order to demonstrate the example of a structure of the realistic sound level correction gain production | generation part of FIG. 3 is a flowchart used for explaining volume correction processing by the volume correction apparatus of FIG. 2. FIG. 3 is a flowchart used to explain a live sound level correction gain control signal generation process by the volume correction apparatus of FIG. 2. FIG. It is a block diagram for demonstrating 2nd Embodiment of the volume correction apparatus by this technique. It is a figure used in order to demonstrate operation | movement of the balance correction gain production | generation part of FIG. It is a figure used in order to demonstrate the example of a structure of the realistic sound average level detection part of FIG. It is a figure used in order to demonstrate the example of a structure of the center balance correction | amendment part of FIG. FIG. 21 is a flowchart used for explaining volume correction processing by the volume correction apparatus of FIG. 20. FIG. It is a block diagram for demonstrating the modification of 2nd Embodiment of the volume correction apparatus by this technique. It is a block diagram for demonstrating 3rd Embodiment of the volume correction apparatus by this technique. It is a flowchart used in order to demonstrate the volume correction process by the volume correction apparatus of FIG. It is a block diagram for demonstrating 3rd Embodiment of the volume correction apparatus by this technique. It is a flowchart used in order to demonstrate the volume correction process by the volume correction apparatus of FIG. And FIG. 11 is a diagram illustrating a configuration example of a general-purpose personal computer.

Hereinafter, modes for carrying out the invention (hereinafter referred to as embodiments) will be described. The description will be given in the following order.
1. First embodiment (an example in the case of performing balance correction before generating a gain control signal)
2. Second Embodiment (an example of balance correction after generating a gain control signal)
3. Modification 4 Third embodiment (an example in the case where the live sound level correction gain generation unit is deleted in the first embodiment)
5. Fourth embodiment (an example in the case where the live sound level correction gain generation unit is deleted in the second embodiment)

<1. First Embodiment>
[Example configuration of a television receiver]
Hereinafter, an embodiment of a sound volume correction device which is a sound processing device according to the present technology will be described with reference to the drawings. The embodiment of the volume correction device described below shows a case where the volume correction device is used for an audio output unit of a television receiver. However, the embodiment of the sound volume correction device is not limited to this, and can be applied to other devices as long as they output sound.

  In other words, FIG. 1 is a block diagram illustrating a configuration example of a television receiver. The television receiver in the example of FIG. 1 includes a control unit 10 that includes a microcomputer. A remote control receiving unit 11 is connected to the control unit 10, and the remote control receiving unit 11 receives a remote control signal from the remote control transmitter 12 and transmits it to the control unit 10. The control unit 10 executes processing control according to the received remote control signal.

  The control unit 10 supplies a control signal to each unit of the television receiver, and executes a process of receiving a television broadcast signal and reproducing its video and audio.

  The tuner unit 13 selectively extracts a broadcast channel signal designated by a channel selection control signal according to a user's remote control operation from the control unit 10 from a television broadcast wave signal. The tuner unit 13 demodulates and decodes the video signal and the audio signal from the selected broadcast channel signal, supplies the video signal to the video signal processing unit 14, and the audio signal to the audio signal processing unit 15. Supply.

  In the video signal processing unit 14, under the control of the control unit 10, a predetermined process is performed on the video signal, and the processed video signal is displayed on the display control unit 16 through a display controller 16, for example, an LCD (Liquid Crystal Display). 17 is supplied. As a result, an image of the broadcast program of the selected broadcast channel is displayed on the display 17.

  In addition, the audio signal processing unit 15 performs predetermined processing on the audio signal under the control of the control unit 10. In this embodiment, the audio signal processing unit 15 generates left and right channel audio signals SiL and SiR from the audio signal from the tuner unit 13 and supplies the processed audio signals SiL and SiR to the volume correction unit 18. To do.

  The volume correction unit 18 is a part to which the volume correction apparatus of this embodiment is applied, and the input audio signals SiL and SiR are volume-corrected and output as output audio signals SoL and SoR as described later. . Then, the output audio signals SoL and SoR from the volume correction unit 18 are supplied to the speakers 19L and 19R to be reproduced acoustically. Thereby, the sound of the broadcast program of the selected broadcast channel is emitted from the speakers 19L and 19R.

  Hereinafter, the volume correction apparatus of this embodiment will be described as a case of the volume correction unit 18.

[First Embodiment of Volume Correction Device]
FIG. 2 is a block diagram showing an example of the overall configuration of the volume correction apparatus as the first embodiment of the volume correction unit 18 of this technique.

  In the first embodiment, the input audio signal is an audio signal of two left and right channels. The first component main signal is a signal mainly including a human voice component in the left and right two-channel audio signals (hereinafter referred to as a voice main signal). The other audio components other than the first component are so-called real sounds other than the main voice signal in the two left and right channel audio signals. Hereinafter, the signal mainly composed of the live sound is referred to as a live sound main signal (or live sound signal).

  As shown in FIG. 2, in this first embodiment, the left and right channel input audio signals SiL and SiR are supplied to the separation unit 20 for the main voice signal and the main live sound signal. The separation unit 20 in this example includes a center concentration localization signal detection unit 21 and two subtraction units 22 and 23.

  The center centralized localization signal detector 21 is supplied with both left and right channel input audio signals SiL and SiR, and detects the voice main signal Sv as a center concentrated localization signal localized at the center (center) of the left and right channels. The voice main signal Sv detected by the center concentration localization signal detection unit 21 is supplied to the subtraction units 22 and 23 and the variable gain amplifier 24.

  The subtracting unit 22 subtracts the voice main signal Sv from the left channel audio signal SiL to obtain the left channel live sound main signal SsL. Further, the subtracting unit 23 subtracts the voice main signal Sv from the right channel audio signal SiR to obtain the right channel live sound main signal SsR.

  Thus, the separation unit 20 obtains the main voice signal Sv and the left and right channel main sound signals SsL and SsR from the two-channel audio signals SiL and SiR.

  The main voice signal Sv from the separation unit 20 is supplied to the addition units 27 and 28 through the variable gain amplifier 24 and also to the correction gain generation unit 30.

  In this example, the correction gain generation unit 30 includes an average level detection unit 31, a center balance correction unit 32, a gain control signal generation unit 33, an actual sound average level detection unit 34, an actual sound balance correction unit 35, and a gain control signal generation. Part 36. The average level detection unit 31 detects the average level of the voice main signal Sv and supplies the detected average level to the center balance correction unit 32 and the live sound balance correction unit 35. The live sound average level detection unit 34 detects the average level of the live sound main signal from the two-channel audio signals SiL and SiR, and supplies the detected average level to the center balance correction unit 32 and the live sound balance correction unit 35. To do.

  The center balance correction unit 32 corrects the average level of the voice main signal Sv by a predetermined process based on the average level of the live sound main signal, and supplies the corrected signal to the gain control signal generation unit 33. The live sound balance correction unit 35 corrects the average level of the voice main signal Sv by a predetermined process based on the average level of the live sound main signal, and supplies the corrected signal to the gain control signal generation unit 36.

  The gain control signal generation unit 33 is configured so that the average level of the voice main signal Sv corrected by the center balance correction unit 32 based on the average level of the live sound main signal becomes a predetermined reference level. A gain control signal Gv is generated. Then, the gain control signal generation unit 33 supplies the generated gain control signal Gv to the variable gain amplifier 24.

  The gain control signal generation unit 36 is configured so that the average level of the voice main signal Sv corrected by the real sound balance correction unit 35 based on the average level of the main sound main signal becomes a predetermined reference level. The gain control signal Gy is generated. Then, the gain control signal generation unit 36 supplies the generated gain control signal Gy to the live sound level correction gain generation unit 37.

  Therefore, in the variable gain amplifier 24, the gain control signal Gv controls the gain so that the average level of the voice main signal becomes a constant level (reference level) even if the level of the voice main signal Sv varies greatly. At this time, since the gain control signal Gv is obtained by adjusting the balance between the voice main signal and the real sound based on the real sound average level, the corrected voice main signal output from the variable gain amplifier 24 is used. The output level of Svc is set to a constant level after the balance between the actual sound and the voice main signal is adjusted. Then, the corrected main voice signal Svc having a constant level is supplied to the adding units 27 and 28.

  The live sound level correction gain generation unit 37 receives the gain control signal Gy from the gain control signal generation unit 36, performs a process based on the gain control signal Gy, and performs gain correction on the real sound main signal. Is supplied to the variable gain amplifiers 25 and 26.

  That is, the presence sound level correction gain generation unit 37 performs some processing on the gain control signal Gy, so that the gain control mode for the voice main signal Sv by the gain control signal Gv and the real sound main signal by the gain control signal Gs The gain control mode for SsL and SsR is different.

  The variable gain amplifiers 25 and 26 receive the supply of the gain control signal Gs from the live sound level correction gain generation unit 37, and based on the gain control signal Gs, the live sound main signals SsL and SsR are Gain control different from that of the voice main signal Sv is performed.

  The adder 27 adds the corrected left channel main sound signal SsLc and the corrected voice main signal Svc, and outputs a volume-corrected left channel output audio signal SoL as the addition output.

  Further, the adder 28 adds the corrected right channel live sound main signal SsRc and the corrected voice main signal Svc, and outputs the output sound signal SoR of the right channel whose volume is corrected as the addition output.

  By the way, the gain control signal Gy is obtained by adjusting the balance between the live sound and the voice main signal based on the live sound average level. For this reason, the gain control mode for the presence sound main signals SsL and SsR determined by the gain control signal Gs based on the gain control signal Gy is set so as not to immediately follow a large level fluctuation of the input sound signal. At the same time, the balance between the actual sound and the main voice signal is adjusted. That is, the gain control mode for the voice main signal Sv immediately follows the level fluctuation of the input voice signal, and adjusts the balance between the actual sound and the voice main signal, and makes the output level constant. However, the gain control mode for the presence sound main signals SsL and SsR is different from the gain control mode in that the balance between the presence sound and the voice main signal is adjusted and the input sound signal does not immediately follow a large level fluctuation. It is said.

  Therefore, the main sound signals SsL and SsR of the left and right channels are supplied to the adders 27 and 28 after gain control by the variable gain amplifiers 25 and 26. Then, the gain control mode for the presence sound main signals SsL and SsR has a characteristic that does not immediately follow a large level fluctuation of the input sound signal while adjusting the balance between the presence sound and the sound main signal. .

  Therefore, fluctuations in the volume level at a large level change point that occur with respect to the voice main signal are suppressed while adjusting the balance of the live sound main signal and the voice main signal.

  For this reason, the output sound signals SoL and SoR of the left and right channels from the adders 27 and 28 are masked by the main sound signals SsL and SsR of the left channel and the right channel of the volume level fluctuation of the corrected voice main signal Svc. Become so. As a result, while adjusting the balance between the actual sound and the voice main signal, the fluctuation of the volume level of the voice main signal Svc becomes inconspicuous, and the uncomfortable feeling to the listener is reduced.

  With the above configuration, the voice main signal is quickly shifted to an appropriate level, so that a constant feeling of the voice level can be maintained and a voice such as a dialogue can be easily heard. Furthermore, since the presence of the presence-sound-main signal is kept constant to some extent, a sense of incongruity caused by changing the level is reduced, and thereby a more natural level transition can be realized.

  In the above example, since the audio signal is acoustically reproduced by the left and right channel speakers, the adders 27 and 28 are provided. However, when a center channel speaker is provided in addition to the left and right channel speakers, the corrected main voice signal is supplied to the center channel speaker, and the output audio signals of the variable gain amplifiers 25 and 26 are changed to the left and right channels. You may make it supply to the speaker for 2 channels. In this case, the sound output from the center channel speaker and the sound output from the left and right channel speakers are acoustically synthesized, so that the fluctuation of the volume level due to the gain control is masked and becomes conspicuous. Disappear.

[Configuration Example of Center Concentration Localization Signal Detection Unit 21]
<First example>
FIG. 3 shows a first configuration example of the center concentration localization signal detection unit 21. In this example, the center concentration localization signal detection unit 21 includes an addition unit 211 and an amplifier 212 having a fixed gain “0.5”.

  In the centralized localization signal detection unit 21 of this example, the left and right channel input audio signals SiL and SiR are added by the addition unit 211, and the addition output signal is output through the amplifier 212. An output signal of the amplifier 212 is a voice main signal Sv.

  In the case of the first example, the average value of the voice main signal Sv is equal to the average value of the sum signal of the input audio signals SiL and SiR of the left and right channels. Then, the correction gain generation unit 30 generates the gain control signal Gv so that the average value of the voice main signal Sv becomes a constant level. Therefore, in the case of the first example, the correction gain generation unit 30 adds the gain control signal so that the addition signal of the input audio signals SiL and SiR of the left and right channels, that is, the level of the entire input audio signal becomes a constant level. Gv is also generated.

<Second example>
FIG. 4 shows a second configuration example of the center concentration localization signal detection unit 21. In the second example, the output of the first example is not output as it is, but a signal corresponding to the component of only the center localization component is obtained more than the output of the first example.

  In this example, the center concentration localization signal detection unit 21 includes a gain adjustment amplifier 213 and a center concentration localization rate detection unit 214 in addition to the addition unit 211 and the fixed gain “0.5” amplifier 212 in the first example. With.

  In the center concentrated localization signal detector 21 of this example, the output signal of the amplifier 212 is supplied to the gain adjustment amplifier 213, and the output signal of the gain adjustment amplifier 213 is used as the voice main signal Sv.

  In the center concentration localization signal detector 21 of this example, the left and right channel input audio signals SiL and SiR are also supplied to the center concentration localization rate detector 214. In the center concentration localization rate detection unit 214, a gain control signal Gat for controlling the gain of the gain adjustment amplifier 213 is generated according to the ratio of the signal concentrated in the center with respect to the entire input sound.

  Then, the gain of the gain adjustment amplifier 213 is controlled by the gain control signal Gat from the center concentration localization rate detection unit 214, so that the voice main signal Sv is localized at the center among the outputs of the amplifier 212. It consists of signal components according to the rate. That is, the voice main signal Sv of the second example is a signal composed of signal components that are localized more centrally than in the first example.

  The center concentration localization rate detection unit 214 may have a configuration as shown in FIG. 5, for example.

  That is, the center concentration localization rate detection unit 214 includes band limiting filters 2141 and 2142, a localization direction detection unit 2143, a localization direction distribution measurement unit 2144, and a center gain control signal generation unit 2145.

  The left and right two-channel input audio signals SiL and SiR input to the center concentration localization rate detection unit 214 remove, in the band limiting filters 2141 and 2142, for example, frequency band components that do not feel the localization direction much, such as low frequency components. Is done.

  The two-channel input audio signals SiL and SiR band-limited by the band-limiting filters 2141 and 2142 are supplied to the localization direction detection unit 2143. The localization direction detection unit 2143 receives the two-channel input audio signals SiL and SiR at the time of detection in the localization direction every predetermined period according to the level of each of the band-limited two-channel input audio signals SiL and SiR. Detect the localization direction you have.

  That is, the localization direction detection unit 2143 samples each level (amplitude) of the band-limited input audio signals SiL and SiR of two channels at a predetermined sampling period. In this example, the localization direction detection unit 2143 detects the localization direction at the latest sampling time as the current localization direction.

  In this case, the localization direction detecting unit 2143 uses the localization direction at the latest sampling time point as the latest sampling time level and the past sampling time level for each of the input audio signals SiL and SiR. To detect.

  If the two-channel input audio signals SiL and SiR are digital audio signals, the sampling period can be made equal to the sampling period of the digital audio signal. However, the sampling period may not be equal to one sample period of the digital audio signal, but may be a plurality of sample periods. When the input audio signal of the localization direction detection unit 2143 is an analog signal, it may be converted into a digital audio signal at the input stage of the localization direction detection unit 2143.

  A method of detecting the localization direction in the localization direction detection unit 2143 will be described with reference to FIG. The distribution diagrams (A) and (B) of FIG. 6 show the coordinate space when the amplitude of the left channel input audio signal SiL is taken on the X axis and the amplitude of the right channel input audio signal SiR is taken on the Y axis. Yes.

  In the localization direction detection unit 2143, first, the respective levels of the input audio signals SiL and SiR of the two channels are acquired at the time of detection in the localization direction for each sampling period, and the corresponding coordinate points are shown in the distribution diagram of FIG. For example, P1, P2, P3, and P4 are plotted in the coordinate space of (A) and (B). In this example, it is assumed that P4 is a coordinate point at the latest detection time.

  The localization direction detection unit 2143 rotates a straight line represented by y = k · x (k is a constant) (a straight line passing through the intersection point Z between the X axis and the Y axis) by ± 90 ° about the intersection point Z. In other words, when the constant k is changed, the plotted coordinate points P1, P2, P3, and P4 move closest to which constant k straight line (which inclination angle straight line). Is calculated. That is, the constant k of the straight line having the smallest sum of the distances Da1, Da2, Da3, Da4 or the distances Db1, Db2, Db3, Db4 from the straight lines with the constant k changed to the coordinate points P1, P2, P3, P4. calculate.

  Then, the localization direction detection unit 2143 sets the inclination angle corresponding to the calculated straight line constant k as the localization direction at the current time point to be detected. In the example of FIG. 7, the angle of the X axis, that is, the localization direction (left direction) of the left channel is set to 0 °, and the angle θ (hereinafter referred to as the localization angle) θ with respect to the X axis is detected as the localization direction.

  In the example of the coordinate points P1, P2, P3, and P4 in the case of the distribution diagram (A) in FIG. 6, the localization angle is detected as θa, and the coordinate points P1, P2, and P3 in the case of the distribution diagram (B) in FIG. , P4, the localization angle is detected as θb.

  In this embodiment, in the localization direction detection unit 2143, the level of the 2-channel input audio signal at the present time (latest sampling time) and the level of the 2-channel input audio signal at the past sampling time are used with equal weights. No. In this embodiment, the localization direction detection unit 2143 is configured to increase the weight as the level of the 2-channel input audio signal at the sampling time close to the current time.

  For this reason, in the localization direction detection unit 2143, as shown in FIG. 7, with respect to the sampling value of the level of the 2-channel input audio signal, the closer to the current time (in this example, the latest sampling time tn), the greater the weight. In addition, a time window WD1 having the characteristic of an exponential function curve is used.

  In the above description, the current time that is the signal to be processed is the latest sampling time (latest sampling time). However, a delay circuit that delays by a predetermined time τ is provided on the input side of the variable gain amplifiers 24 to 26, and the current time to be processed can be set as the time delayed by τ from the input audio signals SiL and SiR. .

  In that case, the localization direction detection unit 2143 can detect the localization direction also using the two-channel input audio signals SiL and SiR after (future) the current time as the signal to be processed. . For example, in the example of FIG. 6, the current time that is the processing target signal time point may be P2 or P3.

  In that case, a time window WD2 having the characteristic of an exponential function curve as shown in FIG. 8 is used instead of the above-described time window WD1. The time window WD2 has a characteristic of an exponential function curve in which the weight is the largest at the current time tp that is the signal to be processed, and the weight becomes smaller in the past and future directions as the distance from the current time tp is increased.

  Note that the level of the current 2-channel input audio signal may be used as it is without weighting the levels of the 2-channel input audio signals SiL, SiR at the past and / or future sampling points.

  As described above, the localization direction detection unit 2143 can detect from which direction the two-channel input audio signals SiL and SiR are signals as the localization angle θ.

  However, the detected localization angle θ at the present time limits the localization direction of the input audio signal at one time point to one direction, and does not reflect the strength of the signal in each direction. Therefore, in this embodiment, in view of this point, the localization direction detection result (localization angle θ) of the two-channel input audio signals SiL and SiR detected by the localization direction detection unit 2143 at the present time is the localization direction distribution measurement unit 2144. To be supplied.

  The localization direction distribution measurement unit 2144 obtains a distribution in all directions of the localization angle θ detected by the localization direction detection unit 2143 over a predetermined time interval d, and the localization direction of the two-channel input audio signal is determined. Measure how much angle you have in which angle direction.

  In this case, the predetermined time interval d is selected from several milliseconds to several hundred milliseconds, for example, several tens of milliseconds in this example. In this embodiment, in the localization direction distribution measurement unit 2144, the localization angle θ detected by the localization direction detection unit 2143 in the predetermined time interval d is similar to the characteristic of the weighting factor in the localization direction detection unit 2143. Make weights.

  In other words, the localization direction distribution measuring unit 2144 applies a time window WD3 (see FIG. 9) that is weighted so as to increase exponentially as it approaches the current time tp (in this example, tp = tn (latest sampling time)). To weight.

  As described above, when the time window for weighting by the localization direction detection unit 2143 is set as shown in FIG. 8 by providing the delay time τ for the input audio signal, the localization direction distribution is set. The time window in the measurement unit 2144 is the same as that in FIG. The time interval d in that case is a time interval including both the future and the past from the current time tp. Note that the value may be used as it is without weighting.

FIG. 10 shows an example of the localization direction distribution P (θ), which is the distribution of the localization angle θ obtained by the localization direction distribution measuring unit 2144. The horizontal axis is based on the X axis (left channel localization direction). And the vertical axis represents the appearance degree (<1) of each localization angle. Here, in this embodiment, the localization direction distribution P (θ) is 1 when the sum is obtained for all localization angles θ, that is,
ΣP (θ) = 1
A distribution is generated so that

  Further, the relationship between the localization angle θ and the localization direction of the audio signal is as shown in FIG. Note that the front direction, the left direction, the right direction, and the like shown in FIG. 11 are direction names based on the listener.

  As described above, the localization direction distribution measurement unit 2144 obtains information on the localization direction distribution P (θ) as shown in FIG. 10 for each current time (current sampling time or current sampling time; processing target signal time). It is done.

  Information on the localization direction distribution P (θ) is supplied to the center gain control signal generation unit 2145. In the center gain control signal generation unit 2145, from the localization direction distribution P (θ) calculated by the localization direction distribution measurement unit 2144, a signal that is localized in the center has a larger gain, and in others, the center has a smaller gain. Generate a gain control signal.

  The center gain control signal generation unit 2145 includes a gain table memory (not shown). In this gain table memory, gain table information K (θ) for generating a gain control signal to be supplied to the gain adjustment amplifier 213 is stored in advance.

  The gain table information K (θ) is a gain characteristic in which weighting is performed in the center localization direction for all localization angles (−45 ° to 135 °). FIG. 12 shows an example of the gain table information K (θ).

  That is, in this example, the gain table information K (θ) has a maximum gain of “1” in the front direction (center direction; θ = 45 °) as shown in FIG. In the localization angle range (0 ° to 45 °) to the left of the center direction and the localization angle range to the left of the center direction (45 ° to 90 °), the gain decreases as the distance from the center direction increases. Gain characteristics.

  In the center gain control signal generation unit 2145, the product of the localization direction distribution P (θ) obtained by the localization direction distribution measurement unit 2144 and the gain value of the gain table information K (θ) for all localization angles. Calculate the sum of.

That is, the center gain control signal generation unit 2145
The gain control signal Gat is generated as Gat = Σ (K (θ) × P (θ)).

  The gain control signal Gat generated by the center gain control signal generation unit 2145 in this way is supplied to the gain adjustment amplifier 213 as an output of the center concentration localization rate detection unit 214.

  Therefore, from the gain adjustment amplifier 213, a voice main signal Sv composed of signal components that are localized more centrally than in the first example is obtained.

  Of course, the center concentration localization signal detection unit 21 is not limited to the first and second examples described above.

[Configuration Example of Realistic Sound Average Level Detection Unit 34]
Next, a configuration example of the live sound average level detection unit 34 will be described with reference to FIG. The live sound average level detection unit 34 includes a subtraction unit 41 and an average level detection unit 42. The subtractor 41 obtains the difference between the input audio signals SiL and SiR and supplies the difference to the average level detector 42. The average level detection unit 42 detects the average level of the difference between the input audio signals SiL and SiR as the real sound average level, and supplies the detected real sound average level to the center balance correction unit 32 and the real sound balance correction unit 35. To do. The configuration of the live sound average level detection unit 34 may be other configurations as long as a value that can be defined as the live sound average level is required. For example, the live sound main signals SsL and SsR of the left and right channels are used. It is also possible to use the difference between and.

[Configuration Example of Center Balance Correction Unit 32]
Next, a configuration example of the center balance correction unit 32 will be described with reference to FIG. The center balance correction unit 32 includes a fixed gain amplifier 51 and an addition unit 52. The fixed gain amplifier 51 adjusts the gain of the live sound average level with a fixed gain K1 and supplies it to the adder 52. The adder 52 adds the live sound average level gain-controlled by the gain K1 supplied from the fixed gain amplifier 51 and the average level of the voice main signal Sv supplied from the average level detector 31 to the center. This is supplied to the gain control signal generator 33 as the balance correction average level. The configuration of the center balance correction unit 32 may be another configuration as long as a value that can be defined as the center balance correction average level is obtained.

[Configuration example of the realistic sound balance correction unit 35]
Next, a configuration example of the live sound balance correction unit 35 will be described with reference to FIG. The live sound balance correction unit 35 includes a fixed gain amplifier 61 and an addition unit 62. The fixed gain amplifier 61 controls the gain of the live sound average level with a fixed gain K <b> 2 and supplies it to the adder 62. The adding unit 62 adds the actual sound average level gain-controlled by the gain K2 supplied from the fixed gain amplifier 61 and the average level of the voice main signal Sv supplied from the average level detecting unit 31 to the presence. This is supplied to the gain control signal generator 36 as the sound balance correction average level. In addition, about the structure of the realistic sound balance correction | amendment part 35, if the value which can be defined as a realistic sound balance correction average level is calculated | required, another structure may be sufficient.

  That is, the center balance correction unit 32 and the live sound balance correction unit 35 add the live sound average level to the average level of the voice main signal Sv with different gains K1 and K2, respectively. The average level of realistic sound balance correction is obtained. Therefore, by changing the gains K1 and K2 in various ways, the voice main signal Sv and the real sound can be changed at various ratios, and the balance between the voice main signal Sv and the real sound can be adjusted. It becomes.

[Configuration Example of Realistic Sound Level Correction Gain Generation Unit 37]
Next, a configuration example of the live sound level correction gain generation unit 37 will be described with reference to FIG.

  When the input voice signal level fluctuation or the voice main signal Sv level fluctuation is large and only the output level of the voice main signal Sv is gain-controlled to a constant level, the balance with respect to the original input voice signal deteriorates and the user feels uncomfortable There is.

  The realistic sound level correction gain generation unit 37 improves this problem. The live sound level correction gain generation unit 37 includes a gain value conversion table unit 71.

  The gain value conversion table unit 71 receives the gain control signal Gy for the voice main signal Sv as an input signal and outputs the gain control signal Gs for the real sound main signals SsL and SsR. Is omitted).

  FIG. 17 illustrates an example of gain value conversion table information stored in the gain value conversion table memory included in the gain value conversion table unit 71.

  When the level fluctuation of the voice main signal Sv is small or the level fluctuation of the entire input voice signal is small, the voice level correction gain value by the gain control signal Gy does not change largely around Gy = 1.

  In such a case, the above-described balance between the real sound main signal and the voice main signal is not greatly deviated from the original input audio signal, so that there is no sense of incongruity. Therefore, in the range where the level fluctuation is small, the live sound main signals SsL and SsR may be output through an amplifier having a fixed gain “1”.

  Therefore, in the example of FIG. 17, the gain control signal Gs for the live sound main signal is always set to a gain value of Gs = 1 in the range of 0.75 ≦ Gy ≦ 1.25.

  When the level fluctuation of the input voice signal or the level fluctuation of the voice main signal Sv deviates from such a small level fluctuation range, in this example, a predetermined ratio with respect to the gain control signal Gy is obtained. Following this, the real sound main signals SsL and SsR are gain-controlled.

  That is, in the example of FIG. 17, in the range where the input level where Gy <0.75 becomes large, the relationship from Gs / Gy = K11 (= 1 / 0.75) is obtained from the gain control signal Gy. A gain control signal Gs for the main sound signals SsL and SsR is output.

  Further, in the range where the input level where Gy> 1.25 is small, the relationship between Gs / Gy = K12 (= 2 / 2.5) and the gain control signal Gy to the main sound signals SsL, SsR. The gain control signal Gs is output.

  By doing this, even if the voice level correction gain fluctuates greatly, the realistic sound level correction gain follows the voice level correction gain with a certain ratio, so the realistic sound main signal level relative to the main voice signal level. Can be prevented from being greatly opened. Therefore, natural level transition can be realized even when the level fluctuation is large.

  The gain value conversion table unit 71 uses the value of the gain control signal Gy for the voice main signal Sv as the read address input of the gain value conversion table memory, and reads and outputs the gain control signal Gs for the corresponding real sound main signal. Can be configured.

[Volume correction processing by the volume correction apparatus of FIG. 2]
The sound volume correction device can realize the functions of each component by software processing calculation. A volume correction process performed by the volume correction apparatus shown in FIG. 2 will be described with reference to the flowchart shown in FIG.

  In step S1, the center concentration localization signal detector 21 extracts a center concentration localization signal localized at the center (center) of the left and right channels from the input audio signals SiL and SiR of the left and right channels, and detects them as a voice main signal Sv. To the subtracting units 22 and 23.

  In step S <b> 2, the subtracting unit 22 subtracts the voice main signal Sv from the left channel audio signal SiL to generate a left channel live sound main signal SsL and supplies it to the variable gain amplifier 25. Further, the subtracting unit 23 subtracts the voice main signal Sv from the right channel audio signal SiR to generate a right channel live sound main signal SsR and supplies it to the variable gain amplifier 26.

  In step S3, the average level detector 31 detects the average level of the voice main signal Sv and supplies the detected average level to the center balance corrector 32 and the live sound balance corrector 35.

  In step S4, the live sound average level detection unit 34 detects the average level of the live sound main signal from the two-channel audio signals SiL and SiR, and the detected average level of the live sound main signal is the center balance correction unit 32. And supplied to the live sound balance correction unit 35.

  In step S5, the center balance correction unit 32 corrects the average level of the live sound main signal by adding a value obtained by gain control with the predetermined gain K1 to the average level of the voice main signal Sv, thereby generating a gain control signal. To the unit 33.

  In step S6, the live sound balance correction unit 35 corrects the average level of the live sound main signal by adding a value obtained by gain control using the predetermined gain K2 to the average level of the voice main signal Sv, thereby obtaining a gain control signal. It supplies to the production | generation part 36.

  In step S7, the gain control signal generation unit 33 causes the center balance correction unit 32 to correct the average level of the voice main signal Sv, which is corrected based on the average level of the live sound main signal, to a predetermined reference level. A gain control signal Gv for generating Then, the gain control signal generation unit 33 supplies the generated gain control signal Gv to the variable gain amplifier 24.

  In step S <b> 8, the gain control signal generation unit 36 has the average level of the voice main signal Sv corrected by the real sound balance correction unit 35 based on the average level of the real sound main signal becomes a predetermined reference level. A gain control signal Gy is generated for this purpose. Then, the gain control signal generation unit 36 supplies the generated gain control signal Gy to the live sound level correction gain generation unit 37.

  In step S9, the live sound level correction gain generation unit 37 receives the gain control signal Gy from the gain control signal generation unit 36, performs live sound level correction gain control signal generation processing based on the gain control signal Gy, A gain control signal Gs, which is a live sound level correction gain, for gain correction of the live sound main signal is generated and supplied to the variable gain amplifiers 25 and 26.

[Realistic sound level correction gain control signal generation processing]
Here, the realistic sound level correction gain control signal generation processing will be described with reference to the flowchart of FIG.

  In step S21, the live sound level correction gain generating unit 37 detects the gain value of the gain control signal Gy for the input voice main signal.

  In step S <b> 21, the live sound level correction gain generation unit 37 determines whether the gain value Gy is Gy <0.75 based on the gain value conversion table unit 71. In step S21, for example, when the gain value Gy <0.75, the process proceeds to step S23.

  In step S23, the live sound level correction gain generation unit 37 performs gain control that is the live sound level correction gain for the live sound main signals SsL and SsR based on the gain value conversion table unit 71 by the calculation of Gs = K11 × Gy. The signal Gs is calculated.

  On the other hand, when it is determined in step S22 that Gy <0.75 is not satisfied, the live sound level correction gain generation unit 37 satisfies Gy> 1.25 based on the gain value conversion table unit 71 in step S24. It is determined whether or not. In step S24, for example, if Gy> 1.25, the process proceeds to step S25. In step S25, the live sound level correction gain generation unit 37 is a gain control signal that is a live sound level correction gain for the live sound main signals SsL and SsR based on the gain value conversion table unit 71 by a calculation of Gs = K12 × Gy. Gs is calculated.

  In step S24, for example, when Gy> 1.25 is not satisfied, in step S26, the live sound level correction gain generation unit 37 satisfies 0.75 ≦ Gy ≦ 1.25 based on the gain value conversion table unit 71. Confirm that Gs = 1.

  And after the process of step S23, S24, and S26 is complete | finished, a process returns to step S21 and the process after it is repeated.

  Needless to say, the numerical value of the gain value described above is merely an example, and the present invention is not limited to this. In the range where the level fluctuation around the gain value Gy = 1 is small, that is, in the range of α ≦ Gy ≦ β, 1−α = β-1 in the above example, but 1−α ≠ β Of course, it may be -1.

  Also, the ratio value K11 in the range of Gy <α and the ratio value K12 in the range of Gy> β are examples, and K11 = K12 may be used.

  Now, the description returns to the flowchart of FIG.

  In step S10, the variable gain amplifiers 25 and 26, based on the gain control signal Gs, which is the live sound level correction gain supplied from the live sound level correction gain generation unit 37, the live sound main signals SsL and SsR for the left and right channels. The gain is controlled and supplied to the adders 27 and 28, respectively.

  In step S11, the variable gain amplifier 24, the gain control signal generation unit 33 performs gain control on the voice main signal Sv based on the generated gain control signal Gv, and adds the corrected voice main signal Svc. Parts 27 and 28.

  In step S12, the adding unit 27 adds the left channel presence sound main signal SsL and the corrected voice main signal Svc, and outputs the output sound signal SoL of the left channel whose volume has been corrected as the addition output. Further, the adder 28 adds the right-channel live sound main signal SsR and the corrected voice main signal Svc, and outputs the volume-corrected right-channel output audio signal SoR as the addition output.

  With the above processing, the live sound main signal and the voice main signal can be balanced at various ratios by adjusting the gains K1 and K2, and the volume at the large level change point generated for the voice main signal. It is possible to suppress level fluctuation. As a result, while adjusting the balance between the actual sound and the voice main signal, the fluctuation of the volume level of the voice main signal Svc becomes inconspicuous, and the uncomfortable feeling for the listener is reduced.

<2. Second Embodiment>
[Second Embodiment of Volume Correction Device]
In the above, the gain control signals Gv and Gs are obtained using the average level of the corrected voice main signal Sv by performing the balance correction based on the average level of the actual sound with respect to the average level of the voice main signal Sv. Although an example of generation has been described, the signal to be corrected may be another signal as long as balance correction can be performed.

  For example, the gain control signal Gv, which is obtained by performing the balance correction based on the actual sound average level for each of the voice main signal and the real sound main signal is obtained from the gain control signal obtained based on the average level of the main voice signal Sv. Gy may be generated.

  FIG. 20 shows a gain control signal obtained based on the average level of the voice main signal Sv by correcting the balance of each of the voice main signal and the real sound main signal based on the real sound average level. The structure of the sound volume correction | amendment apparatus which produces | generates Gv and Gy is shown. In the sound volume correction apparatus in FIG. 20, the same reference numerals are given to the components having the same functions as those in the sound volume correction apparatus in FIG. 2, and the description thereof will be omitted as appropriate. 20 differs from the volume correction device of FIG. 2 in that the center balance correction unit 32, the gain control signal generation unit 33, the live sound balance correction unit 35, and the gain control signal generation unit 36 are replaced with each other. A gain control signal generation unit 101-1, a center balance correction unit 103, a gain control signal generation unit 101-2, and a live sound balance correction unit 104 are provided, and a balance correction gain generation unit 102 is further provided.

  The gain control signal generation units 101-1 and 101-2 each generate a gain control signal for the average level of the main voice signal Sv supplied from the average level detection unit 31 to be a predetermined reference level. Are supplied to the center balance correction unit 103 and the live sound balance correction unit 104, respectively.

  Based on the live sound average level supplied from the live sound average level detector 34, the balance correction gain generator 102 generates a gain control signal for setting the average level of the voice main signal Sv to a predetermined reference level. Balance correction gains K3 and K4 for correcting the balance between the voice main signal Sv and the real sound main signal are generated and supplied to the center balance correction unit 103 and the real sound balance correction unit 104, respectively. More specifically, the balance correction gain generation unit 102 stores a table of balance correction gains set according to the realistic sound average level as shown in FIG. 21, and the balance according to the realistic sound average level. Correction gains K3 and K4 are read and output. As shown in FIG. 21, the balance correction gain K3 for correcting the gain control signal for correcting the voice main signal Sv is set to increase in proportion to the actual sound average level. On the other hand, the balance correction gain K4 for correcting the gain control signal for correcting the realistic sound signals SiL and SiR is set to be smaller in proportion to the realistic sound average level. The balance correction gains K3 and K4 may be different from the relationship shown in FIG. 21 with respect to the actual sound average level. For example, the balance correction gains K3 and K4 may be Each of the actual sound average levels may have a reverse relationship to that in FIG.

  The center balance correction unit 103 corrects the gain control signal supplied from the gain control signal generation unit 101-1 with the balance correction gain K3 supplied from the balance correction gain generation unit 102 to generate the gain control signal Gv. To the variable gain amplifier 24.

  The live sound balance correction unit 104 corrects the gain control signal supplied from the gain control signal generation unit 101-2 with the balance correction gain K4 supplied from the balance correction gain generation unit 102, thereby obtaining the gain control signal Gy. Generated and supplied to the live sound level correction gain generation unit 37.

  That is, in the volume adjusting unit 18 in FIG. 2, the average level of the voice main signal Sv is balance-corrected based on the actual sound average level, and a gain control signal is generated from the corrected average level of the voice main signal Sv. It was. On the other hand, in the volume adjusting unit 18 in FIG. 20, a gain control signal is generated based on the average level of the voice main signal Sv, and the balance between the voice main signal and the real sound is based on the real sound average level. The balance is corrected with the balance correction gain set to adjust the frequency.

[Configuration Example of Center Balance Correction Unit 103]
Next, a configuration example of the center balance correction unit 103 will be described with reference to FIG. The center balance correction unit 103 includes a variable gain amplifier 121. The variable gain amplifier 121 gain-controls the gain control signal generated based on the average level of the voice main signal Sv by the balance correction gain K3 supplied from the balance correction gain generation unit 102, and generates the gain control signal Gv. Generated and supplied to the variable gain amplifier 24.

[Configuration example of the realistic sound balance correction unit 104]
Next, a configuration example of the realistic sound balance correction unit 104 will be described with reference to FIG. The live sound balance correction unit 104 includes a variable gain amplifier 131. The variable gain amplifier 131 gain-controls the gain control signal generated based on the average level of the voice main signal Sv by the balance correction gain K4 supplied from the balance correction gain generation unit 102, and generates the gain control signal Gy. Generated and supplied to the live sound level correction gain generator 37.

[Volume Correction Processing by Volume Correction Device in FIG. 20]
Also in the sound volume correction apparatus in FIG. 20, the function of each component can be realized by software processing calculation. Therefore, the volume correction processing by the volume correction apparatus of FIG. 20 will be described with reference to the flowchart of FIG. Note that the processing of steps S31 to S34 and S39 to S42 in the flowchart of FIG. 24 is the same as the processing described with reference to the flowchart of FIG.

  That is, when the average level detection unit 31 obtains the average level of the voice main signal Sv by the processing of steps S31 to S34 and the presence sound average level detection unit 34 obtains the presence sound average level, the processing proceeds to step S35. .

  In step S35, the gain control signal generation units 101-1 and 101-2 generate gain control signals for the average level of the voice main signal Sv to be a predetermined reference level, and the center balance correction unit 103, And supplied to the live sound balance correction unit 104.

  In step S36, the balance correction gain generation unit 102 gains the average level of the voice main signal Sv to a predetermined reference level based on the actual sound average level supplied from the actual sound average level detection unit 34. The control signals are generated as balance correction gains K3 and K4 for correcting the balance between the voice main signal Sv and the real sound, and are supplied to the center balance correction unit 103 and the real sound balance correction unit 104, respectively.

  In step S <b> 37, the center balance correction unit 103 performs gain control on the gain control signal supplied from the gain control signal generation unit 101-1 using the balance correction gain K <b> 3 supplied from the balance correction gain generation unit 102. The balance correction is performed to generate a gain control signal Gv, which is supplied to the variable gain amplifier 24.

  In step S <b> 38, the live sound balance correction unit 104 performs gain control on the gain control signal supplied from the gain control signal generation unit 101-2 using the balance correction gain K <b> 4 supplied from the balance correction gain generation unit 102. Then, the balance correction is performed to generate the gain control signal Gy, which is supplied to the live sound level correction gain generation unit 37.

  In step S39, the generated gain control signal Gy is subjected to the live sound level correction gain generation process by the live sound level correction gain generating unit 37, whereby the gain control signal Gs is generated, and the variable gain amplifier 25, 26. Thereby, in step S40, the variable gain amplifiers 25 and 26 correct the actual sound main signals SsL and SsR by performing gain control, respectively, and supply them to the adders 27 and 28. In step S41, the variable gain amplifier 24 performs gain control on the voice main signal Sv based on the gain control signal Gv, and supplies it to the adders 27 and 28. In step S42, the adding units 27 and 28 add the corrected main sound signals SsLc and SsRc of the left and right channels and the corrected voice main signal Svc, respectively, and the volume-corrected left and right channels as the added outputs. Output audio signals SoL and SoR.

  Through the above processing, it is possible to adjust the balance between the voice main signal Sv and the real sound main signal in various ways by variously setting the balance correction gains K3 and K4 according to the real sound average level. At the same time, a natural level transition can be realized even when the voice main signal Sv is suddenly changed, and the uncomfortable feeling to the listener can be reduced.

<3. Modification>
[Modification of Second Embodiment of Volume Correction Device]
In the volume correction apparatus of FIG. 20, the example in which the gain control signal generation units 101-1 and 101-2 are provided in the previous stage of the center balance correction unit 103 and the live sound balance correction unit 104 has been described. Since the gain control signal generation units 101-1 and 101-2 have the same configuration, the gain control signal generation unit 101 may be a common one.

  FIG. 25 shows a configuration example of a volume correction apparatus in which the gain control signal generation units 101-1 and 101-2 are made one common gain control signal generation unit 101.

  That is, as shown in FIG. 25, a gain control signal generation unit common to positions after the average level detection unit 31 and before branching to the center balance correction unit 103 and the live sound balance correction unit 104. One 101 may be provided.

  With such a configuration, the sound volume correction apparatus in FIG. 25 can achieve the same effects as those in the sound volume correction apparatus in FIG.

<4. Third Embodiment>
[Third embodiment of volume correction apparatus]
In the above, an example has been described in which the live sound level correction gain generation unit 37 that corrects the gain control signal Gy of the variable gain amplifiers 25 and 26 and generates the gain control signal Gs that is the live sound level correction gain is provided. However, even if the gain control signal Gy = the gain control signal Gs, the balance between the voice main signal and the real sound is reduced while the level is naturally shifted with respect to the change of the voice main signal Sv to reduce the sense of discomfort to the listener. Can be corrected. Therefore, even if the realistic sound level correction gain generation unit 37 is deleted, the same effect as that of the volume correction device of FIG. 2 according to the first embodiment can be obtained.

  FIG. 26 shows a configuration example of a volume correction apparatus in which the live sound level correction gain generation unit 37 is deleted from the volume correction apparatus of the first embodiment.

  26, the gain control signal Gy itself generated by the gain control signal generator 36 is supplied to the variable gain amplifiers 25 and 26 as the gain control signal Gs.

[Volume Correction Processing by Volume Correction Device in FIG. 26]
Next, the volume correction processing by the volume correction apparatus of FIG. 26 will be described with reference to the flowchart of FIG. However, steps S51 to S61 in the flowchart of FIG. 27 are the same as steps S1 to S8 and S10 to S12 in the flowchart of FIG.

  That is, even in the above processing, it is possible to adjust the balance between the voice main signal and the actual sound while reducing the sense of discomfort to the listener by naturally changing the level with respect to the change of the voice main signal Sv. .

<5. Fourth Embodiment>
[Fourth Embodiment of Volume Correction Device]
Similarly to the third embodiment, the effect can be obtained even if the live sound level correction gain generation unit 37 of the volume correction device in the second embodiment is deleted.

  FIG. 28 shows a configuration example of a volume correction apparatus in which the live sound level correction gain generation unit 37 is deleted from the volume correction apparatus of the second embodiment.

  That is, also in the sound volume correction apparatus of FIG. 28, the gain control signal Gy itself generated by the gain control signal generator 36 is supplied to the variable gain amplifiers 25 and 26 as the gain control signal Gs.

[Volume Correction Processing by Volume Correction Device in FIG. 26]
Next, the volume correction processing by the volume correction apparatus of FIG. 28 will be described with reference to the flowchart of FIG. However, steps S81 to S91 in the flowchart of FIG. 29 are the same as steps S31 to S38 and S40 to S42 in the flowchart of FIG.

  That is, even in the above processing, it is possible to adjust the balance between the real sound main signal and the real sound while reducing the sense of discomfort to the listener by naturally changing the level with respect to the change of the voice main signal Sv. is there.

  In the above description, the case where the audio signal has two channels has been described as an example. However, the present technology can also be applied to a case where more channels, that is, multi-channels are handled. That is, the center concentration localization signal is detected based on the multi-channel audio signal, the center concentration localization signal is processed in the same manner as the processing for the voice main signal described above, and the other sound signals are It can respond by processing similarly. At this time, the balance can be corrected at various ratios by adjusting the gain necessary for the balance correction described above as necessary. Also, it is possible to increase the variation of balance correction by performing processing corresponding to the realistic sound for each multi-channel. Furthermore, the multi-channel can be downmixed into two channels, and the balance can be corrected by the method described above.

  According to the present technology, among the input audio signals including a plurality of components, the level is naturally shifted with respect to the change of the first component main signal including the center concentrated low-level signal such as the voice main signal, so that the listener feels uncomfortable. While mitigating, it is possible to correct the balance with signals other than the center-concentrated low-level signal, such as the presence voice main signal.

  By the way, the series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.

  FIG. 30 shows a configuration example of a general-purpose personal computer. This personal computer incorporates a CPU (Central Processing Unit) 1001. An input / output interface 1005 is connected to the CPU 1001 via a bus 1004. A ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 are connected to the bus 1004.

  The input / output interface 1005 includes an input unit 1006 including an input device such as a keyboard and a mouse for a user to input an operation command, an output unit 1007 for outputting a processing operation screen and an image of the processing result to a display device, a program and various types A storage unit 1008 including a hard disk drive for storing data, a LAN (Local Area Network) adapter, and the like, and a communication unit 1009 for performing communication processing via a network represented by the Internet are connected. Also, a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc)), a magneto-optical disk (including an MD (Mini Disc)), or a semiconductor A drive 1010 for reading / writing data from / to a removable medium 1011 such as a memory is connected.

  The CPU 1001 is read from a program stored in the ROM 1002 or a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, installed in the storage unit 1008, and loaded from the storage unit 1008 to the RAM 1003. Various processes are executed according to the program. The RAM 1003 also appropriately stores data necessary for the CPU 1001 to execute various processes.

  In this specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series in the order described, but of course, it is not necessarily performed in time series. Or the process performed separately is included.

  20 separation unit, 21 center centralized localization signal detection unit, 24-26 variable gain amplifier, 27, 28 addition unit, 30 correction gain generation unit, 37 realistic sound level correction gain generation unit

Claims (10)

A first component main signal gain control unit that performs gain control and outputs a first component main signal having a part of the plurality of audio components as a main component among input audio signals composed of a plurality of audio components;
An other component signal gain control unit that performs gain control on the other component signals other than the first component in the input audio signal, and outputs them;
A first component signal average level detector for detecting an average level of the first component signal;
Other component signal average level detection unit for detecting an average level of the other component signal;
A first component main signal gain control signal output unit that outputs a first component gain control signal for gain control of the first component main signal based on the average level of the first component signal and the average level of the other component signals When,
An other component signal gain control signal output unit that outputs an other component gain control signal for gain control of the other component signal based on an average level of the first component signal and the other component signal average level;
The first component main signal gain control unit converts a first component main signal having a main component of a part of the plurality of audio components, out of the input audio signals including the plurality of audio components, to the first component main signal. Based on the gain control signal, gain control and output as a first component output signal,
The other component signal gain control unit performs gain control on the other component signal other than the first component based on the other component signal gain control signal, and outputs the other component signal as an other component output signal. The first component main signal gain control signal output unit is
A first signal component average level correction unit that corrects by adding a signal obtained by multiplying the other component signal average level by a first predetermined amplification factor to the average level of the first component signal;
A first component signal gain that generates the first component signal gain control signal so that the first component output signal becomes an average level of the first component signal corrected by the first signal component average level correction unit. A control signal generator,
The other component signal gain control signal output unit is
A first signal component average level correcting unit that corrects the average level of the first component signal by adding a signal obtained by multiplying the other component signal average level by a second predetermined amplification factor;
Other component signal gain control signal generation for generating the other component signal gain control signal so that the other component output signal becomes an average level of the first component signal corrected by the first signal component average level correction unit. The voice processing device according to claim 1, comprising: a unit. The first component main signal gain control signal output unit is
A first component gain control signal generation unit that generates a first component signal gain control signal so that the first component output signal has the first signal component average level;
The first component signal gain control signal is corrected by multiplying by a first amplification factor set in association with the other component signal average level, and the corrected first component signal gain control signal is output. One signal component average level correction unit,
The other component signal gain control signal output unit is
An other component gain control signal generating unit that generates an other component signal gain control signal so that the other component output signal has the first signal component average level;
Other signal component that corrects the other component signal gain control signal by multiplying by a second amplification factor set in association with the other component signal average level and outputs the corrected other component signal gain control signal The sound processing apparatus according to claim 1, further comprising an average level correction unit. The first component gain control signal generation unit and the other component signal gain control signal output unit are common,
The first component gain control signal generated by the first component gain control signal generation unit and the other component signal gain control signal generated by the other component signal gain control signal output unit are the same. Voice processing device. The audio processing apparatus according to claim 1, further comprising: an other signal component signal gain control signal correction unit that corrects the other component signal gain control signal output from the other component signal gain control signal output unit. The sound processing apparatus according to claim 1, wherein the first component signal is a center concentrated localization signal. The sound processing apparatus according to any one of claims 1 to 6, further comprising an adding unit that uses a summed output signal obtained by adding the first component output signal and the other component output signal as a sound output signal after volume correction. . A first component main signal gain control unit that performs gain control and outputs a first component main signal having a part of the plurality of audio components as a main component among input audio signals composed of a plurality of audio components;
An other component signal gain control unit that performs gain control on the other component signals other than the first component in the input audio signal, and outputs them;
A first component signal average level detector for detecting an average level of the first component signal;
Other component signal average level detection unit for detecting an average level of the other component signal;
A first component main signal gain control signal output unit that outputs a first component gain control signal for gain control of the first component main signal based on the average level of the first component signal and the average level of the other component signals When,
An other component signal gain control signal output unit that outputs an other component gain control signal for gain control of the other component signal based on an average level of the first component signal and the other component signal average level;
The first component main signal gain control unit converts a first component main signal having a main component of a part of the plurality of audio components, out of the input audio signals including the plurality of audio components, to the first component main signal. Based on the gain control signal, gain control and output as a first component output signal,
The other component signal gain control unit is a sound processing method in the sound processing apparatus that performs gain control on the other component signal other than the first component based on the other component signal gain control signal and outputs the other component signal as the other component output signal. There,
In the first component main signal gain control unit, the first component main signal mainly including a part of the plurality of audio components among the input audio signals composed of the plurality of audio components is output after gain control. A first component main signal gain control step;
In the other component signal gain control unit, other component signal gain control step of performing gain control and outputting other component signals other than the first component in the input audio signal;
A first component signal average level detection step of detecting an average level of the first component signal in the first component signal average level detector;
In the other component signal average level detection unit, other component signal average level detection step for detecting an average level of the other component signal;
A first component gain control signal for gain control of the first component main signal based on an average level of the first component signal and an average level of the other component signal in the first component main signal gain control signal output unit. A first component main signal gain control signal output step for outputting
The other component that outputs the other component gain control signal for gain control of the other component signal based on the average level of the first component signal and the average level of the other component signal in the other component signal gain control signal output unit. A signal gain control signal output step,
In the processing of the first component main signal gain control step, a first component main signal mainly including a part of the plurality of audio components among the input audio signals composed of the plurality of audio components is converted to the first component. Based on the main signal gain control signal, gain control and output as a first component output signal,
The processing of the other component signal gain control step is to perform gain control on the other component signals other than the first component based on the other component signal gain control signal and output the other component signals as other component output signals. A first component main signal gain control unit that performs gain control and outputs a first component main signal having a part of the plurality of audio components as a main component among input audio signals composed of a plurality of audio components;
An other component signal gain control unit that performs gain control on the other component signals other than the first component in the input audio signal, and outputs them;
A first component signal average level detector for detecting an average level of the first component signal;
Other component signal average level detection unit for detecting an average level of the other component signal;
A first component main signal gain control signal output unit that outputs a first component gain control signal for gain control of the first component main signal based on the average level of the first component signal and the average level of the other component signals When,
An other component signal gain control signal output unit that outputs an other component gain control signal for gain control of the other component signal based on an average level of the first component signal and the other component signal average level;
The first component main signal gain control unit converts a first component main signal having a main component of a part of the plurality of audio components, out of the input audio signals including the plurality of audio components, to the first component main signal. Based on the gain control signal, gain control and output as a first component output signal,
The other component signal gain control unit performs gain control on the other component signal other than the first component based on the other component signal gain control signal, and outputs the other component signal as the other component output signal. ,
In the first component main signal gain control unit, the first component main signal mainly including a part of the plurality of audio components among the input audio signals composed of the plurality of audio components is output after gain control. A first component main signal gain control step;
In the other component signal gain control unit, other component signal gain control step of performing gain control and outputting other component signals other than the first component in the input audio signal;
A first component signal average level detection step of detecting an average level of the first component signal in the first component signal average level detector;
In the other component signal average level detection unit, other component signal average level detection step for detecting an average level of the other component signal;
A first component gain control signal for gain control of the first component main signal based on an average level of the first component signal and an average level of the other component signal in the first component main signal gain control signal output unit. A first component main signal gain control signal output step for outputting
The other component that outputs the other component gain control signal for gain control of the other component signal based on the average level of the first component signal and the average level of the other component signal in the other component signal gain control signal output unit. A process including a signal gain control signal output step,
In the processing of the first component main signal gain control step, a first component main signal mainly including a part of the plurality of audio components among the input audio signals composed of the plurality of audio components is converted to the first component. Based on the main signal gain control signal, gain control and output as a first component output signal,
The processing of the other component signal gain control step is a program for performing gain control on the other component signal other than the first component based on the other component signal gain control signal and outputting it as an other component output signal.   An electronic device comprising the audio processing device according to claim 1.

Images