JP2013009292A5 - Mixing balance automatic adjustment device and program - Google Patents

Description

The present invention relates to a mixing balance automatic adjustment equipment you and programs, in particular, to automatically adjust the status of the mixing balance of the narration signal and the background music signal at the time of program production such as a TV or radio in the audibility of the elderly on the mixing balance automatic adjustment equipment you and program.

The present invention was made to solve such conventional problems, our mixing balance automatic adjustment equipment can be automatically adjusted to suit the state of the mixing balance of the audio signal to the hearing of the elderly And to provide a program.

An automatic mixing balance adjustment device according to the present invention detects a first level detection unit that detects a first level that is a level of a first audio signal, and detects a second level that is a level of a second audio signal. A second level detection unit that performs a first statistical value calculation unit that calculates a first statistical value that is a statistical value of the first level, and a second statistics that is a statistical value of the second level a second statistical value calculating unit for calculating a value, and a level difference calculation section that calculates a level difference which is a difference between the first level and the second level, the mixing balance in response to the first level an evaluation signal selection unit for selecting an evaluation No. signal for evaluating the evaluation signal average value calculating unit for calculating a percent evaluation signal average, which is the time rate average value of the evaluation signal, the first statistics and The threshold value determined according to the second statistical value and the evaluation A gain calculation unit for calculating a gain for the second audio signal for maintaining an appropriate mixing balance according to a signal average value; and the second audio signal multiplied by the first audio signal and the gain. An audio output unit for outputting.

In the mixing balance automatic adjustment device according to the present invention, the first statistical value calculating unit, a first average value calculating section for calculating the percent time rate average value of said first level, said first a first statistical average value calculation unit that calculates a first statistical mean of the first level based on the percent time rate average value of the first level calculated by the average value calculating unit, And outputting the first statistical average value as the first statistical value .

In the mixing balance automatic adjustment device according to the present invention, the first statistical average value calculating unit, a histogram creation unit that creates a histogram of the output of the first average value calculating section, a plurality of maxima of the histogram A dominant maximum value determining unit for determining a dominant maximum value which is the most dominant value among the values, and the first statistical average based on a parameter of a normal distribution having the dominant maximum value as a maximum value. It is good also as a structure containing the statistical average value determination part which determines a value.

In the mixing balance automatic adjustment device according to the present invention, the second statistic value calculation unit, and calculates and outputs the percent time rate average value of the second level as the second statistics.

In the mixing balance automatic adjustment device according to the present invention, prior Symbol evaluation signal selecting unit, when the output of said first level detecting portion is a first value than the predetermined, the said level difference Output as an evaluation signal, and when the output of the first level detection unit is less than a predetermined second value that is equal to or less than the first value, the output of the second level detection unit is and outputs as the evaluation signal, wherein, when the output of the first level detector is the first value below and the second value or more, the output of the first level detector is the first value It becomes the previous SL level difference when it outputs a monotonic function value as an output of the second level detector when the output of said first level detecting unit is the second value as the evaluation signal Is.

In the mixing balance automatic adjustment device according to the present invention, the gain calculation section, the mixing balance of the audio signal reading section by the loaded first speech signal contact and said second audio signal is predetermined includes a gain control section detecting unit for detecting a section deviates from the appropriate range, and the gain determination unit for determining a target gain to adapt to the detected gain control section in the gain control section detection unit, wherein the sound voice output The unit multiplies the second audio signal by the target gain and adjusts the mixing balance.

In the mixing balance automatic adjustment device according to the present invention, the sound voice output section includes a pre-processing unit for changing the gain at a first rate of change toward the target gain before the gain control section, the gain And a post-processing unit that changes the gain from the target gain at a second change rate smaller than the first change rate after the control section.

Mixing balance automatic adjustment device according to the present invention may further include an audio signal reading section to read the first voice signal contact and second audio signals of the number of frames predetermined first statistical value calculating section , the first statistic is calculated in less time than the time corresponding to the number of the frame, the second statistic value calculation unit, the second statistic in less than the time corresponding to the number of the frame time calculating a value, the audio output unit, and the first audio signal and a second audio signal obtained by multiplying the gain and outputs for each said number of frames.

In the mixing balance automatic adjustment device according to the present invention, the gain calculation section, the mixing balance of the audio signal reading section by the loaded first speech signal contact and said second audio signal is predetermined is intended to determine the target gain for returning the mixing balance within the appropriate range when departing from the proper scope as the gain, the sound voice output unit, when departing from the proper scope of the mixing balance was determined in advance The second audio signal is multiplied by the second audio signal to adjust the mixing balance, and when the mixing balance returns to a predetermined appropriate range, the second audio signal is output as it is.

The present invention calculates a gain for controlling a second audio signal based on a statistical value of the first audio signal in a relatively long time interval between a predetermined number of past frames and the current frame. Accordingly, there is provided a mixing balance automatic adjustment equipment Contact and programs can be automatically adjusted to suit the state of the mixing balance of the audio signal to the hearing of the elderly.

The block diagram which shows the structure of the mixing balance automatic adjustment apparatus which concerns on this invention The block diagram which shows the hardware constitutions of the mixing balance automatic adjustment apparatus which concerns on this invention Flowchart of mixing balance automatic adjustment program executed by CPU of mixing balance automatic adjustment device according to the present invention Detailed flowchart of NR average value calculation processing A graph schematically showing the mixture distribution when the number of mixtures is 2 Detailed flowchart of NR statistical average value calculation processing NR level average histogram Graph showing relationship between NR level and evaluation signal H Schematic diagram of NR level and BGM level, level difference, evaluation signal Detailed flowchart of gain calculation processing Graph showing threshold application range Detailed flowchart of gain control section detection processing Graph showing threshold Detailed flowchart of gain determination processing Detailed flowchart of audio output processing Waveform diagram by batch processing Detailed flowchart of gain calculation processing for real-time processing Detailed flowchart of gain determination processing for real-time processing Detailed flowchart of gain increase control Detailed flowchart of gain reduction control Detailed flowchart of gain correction processing Detailed flowchart of gain return control Waveform diagram by real-time processing

Configuration of BGM Statistical Value Calculation Unit 3 The BGM statistical value calculation unit 3 calculates a BGM average value that is a BGM level percent time rate average value and outputs a BGM average value calculation unit 31 as an output of the BGM statistical value calculation unit 3. Including.
Incidentally, BGM statistical value calculating section 3 may include a BGM statistical average calculator 3 2 for calculating the BGM statistical mean is a statistical mean of BGM relative level from the BGM average value, in this case The output of the BGM statistical value calculation unit 3 is a BGM statistical average value.

FIG. 2 is a block diagram showing a hardware configuration of the personal computer 7 used in the present embodiment. For example, a man-machine interface including a display panel 71, a keyboard 72, and a mouse 73, an arithmetic device 74, , Composed of.
The arithmetic unit 74 includes an AD converter 741 that converts an NR signal and a BGM signal into a digital audio signal with a sampling frequency of 48 kHz and a quantization bit number of 16 bits, a DA converter 742 that outputs an analog audio signal, a CPU 743, a memory 744, and a hard disk. (HDD) 745 and peripheral device I / F 746 are coupled to each other via a bus 747. The display panel 71, the keyboard 72, and the mouse 73 are connected to the peripheral device I / F 746.
In the case NR signal and BGM signal is a digital signal, it is possible to omit the AD varying exchanger 741. Further, when the output signal is a digital signal, it is possible to omit the DA converter 742.

A method of calculating the statistical average value Ns from the histogram has been proposed regardless of the above-described mixed normal distribution model, and this method is adopted in this embodiment.
FIG. 6 is a detailed flowchart of the NR statistical average value calculation process (step S13 2 ). The arithmetic unit 74 calculates the average value mg and the intermediate value md of a predetermined number of NR average values Np (step S321).

When TA = TB, the evaluation signal H becomes discontinuous, and the viewer may feel unnatural.
Therefore, when TA> TB and the NR level N is equal to or higher than TB and equal to or lower than TA (TB ≦ N ≦ TA), the evaluation signal H is changed from B (when N = TB) to (B−TA) (N = it is desirable to use a function value of a function that changes monotonically until Les value bell difference delta L) when the TA.
When a function connecting a point (TB, B) and a point (TA, B-TA) with a straight line is applied, the evaluation signal H is a value calculated by the expression in the third row of [Equation 1].

Next, the arithmetic unit 74 detects the level of the N R signal and BGM signal (step S12).
That is, 1024 sampling of the NR signal and the BGM signal is set as one frame, and the level N of the NR signal and the level B of the BGM signal are calculated for each frame.

1 Automatic mixing balance adjustment device 2 NR statistical value calculator (first statistical value calculator)
3 BGM statistical value calculator (second statistical value calculator)
5 Gain Calculation Unit 6 Audio Output Unit 20 NR Level Detection Unit (First Level Detection Unit)
21 NR average value calculator (first average value calculator)
22 NR statistical average value calculation unit (first statistical average value calculation unit)
30 BGM level detector (second level detector)
31 BGM average value calculation unit 3 2 BGM statistical average value calculation unit 41 Level difference calculation unit 42 Evaluation signal selection unit 43 Evaluation signal average value calculation unit 73 Mouse 74 Arithmetic unit (voice signal reading unit)
741 AD converter 742 DA converter 745 Hard disk 746 Peripheral device I / F
747 bus
S168 Gain control section detection processing (gain control section detection unit)
S169 Gain determination processing (gain determination unit)
S178 pre-processing (pre-processing unit)
S179 post-processing (post-processing section)
S322 Histogram creation processing (histogram creation unit)
S323 dominant local maximum determination processing (dominant local maximum determiner)
S324 statistical average value determination processing (statistical average value determination unit)

Claims (10)

A first level detector that detects a first level that is a level of the first audio signal;
A second level detection unit for detecting a second level which is a level of the second audio signal;
A first statistical value calculation unit for calculating a first statistical value that is a statistical value of the first level;
A second statistical value calculation unit for calculating a second statistical value that is a statistical value of the second level;
A level difference calculator for calculating a level difference that is a difference between the second level and the first level;
An evaluation signal selection unit for selecting an evaluation No. signal for evaluating the mixing balance in response to the first level,
An evaluation signal average value calculating unit that calculates an evaluation signal average value that is a percentage time rate average value of the evaluation signal;
A gain calculation unit that calculates a gain for the second audio signal for maintaining a proper mixing balance according to the threshold value determined according to the first statistical value and the second statistical value and the evaluation signal average value When,
And an audio output unit that outputs the second audio signal multiplied by the first audio signal and the gain. The first statistical value calculation unit includes:
A first average value calculating section for calculating the percent time rate average value of the first level,
First statistical average value for calculating the first statistical mean of the first level based on the percent time rate average value of the first level calculated by the first average value calculating section A calculation unit ,
The mixing balance automatic adjustment device according to claim 1, wherein the first statistical average value is output as the first statistical value . The first statistical average value calculation unit is:
A histogram creating unit for creating a histogram of an output of the first average value calculating unit ;
A dominant maximum value determination unit that determines a dominant maximum value that is the most dominant maximum value among a plurality of maximum values of the histogram;
The mixing balance automatic adjustment device according to claim 2, further comprising: a statistical average value determination unit that determines the first statistical average value based on a parameter of a normal distribution in which the dominant maximum value is a maximum value. The second statistic calculation unit, said any one of claims 1 to 3 and calculates and outputs the percent time rate average value of the second level as the second statistic The mixing balance automatic adjustment device described. Before Symbol evaluation signal selection unit,
When the output of said first level detecting portion is a first value than the predetermined outputs the level difference as said evaluation signal,
When the output of the first level detector is less than the second predetermined value is a value equal to or less than the first value, and outputs an output of said second level detection unit as the evaluation signal ,
Wherein when the output of the first level detector is the first value below and the second value or more, before Symbol level when the output of the first level detector is the first value becomes difference from claim 1 monotonic function value as an output of the second level detector when the output of said first level detecting unit is the second value is output as the evaluation signal The mixing balance automatic adjustment device according to claim 4. The gain calculation unit
A gain control section detector that detects a section in which a mixing balance of the first sound signal and the second sound signal deviates from a predetermined appropriate range;
A gain determining unit that determines a target gain adapted to the gain control section detected by the gain control section detecting unit;
6. The automatic mixing balance adjustment device according to claim 1, wherein the audio output unit adjusts a mixing balance by multiplying the second audio signal by the target gain . 7. The audio output unit is
A pre-processing unit that changes the gain at a first rate of change toward the target gain before the gain control section;
The mixing balance automatic adjustment device according to claim 6, further comprising: a post-processing unit that changes a gain from the target gain at a second change rate smaller than the first change rate after the gain control interval . An audio signal reading unit that reads a first audio signal and a second audio signal of a predetermined number of frames;
The first statistical value calculation unit calculates the first statistical value within a time shorter than the time corresponding to the number of frames;
The second statistical value calculation unit calculates the second statistical value within a time shorter than the time corresponding to the number of frames;
The audio output unit, and the first audio signal, to any one of claims 5 and said second audio signal multiplies the gain of claims 1 and outputs for each said number of frames The mixing balance automatic adjustment device described. The gain calculation unit
A target gain for returning the mixing balance to the appropriate range when the mixing balance of the first audio signal and the second audio signal read by the audio signal reading unit deviates from a predetermined appropriate range. Is determined as the gain,
The audio output unit is
When the mixing balance deviates from a predetermined appropriate range, the target gain is multiplied by the second audio signal to adjust the mixing balance,
9. The automatic mixing balance adjustment device according to claim 8, wherein when the mixing balance returns to a predetermined appropriate range, the second audio signal is output as it is . Computer
An audio signal reading unit for reading the first audio signal and the second audio signal;
A level detector for detecting the level of the first audio signal and the level of the second audio signal;
A first statistical value calculator for calculating a statistical value of the level of the first audio signal;
A second statistical value calculator for calculating a statistical value of the level of the second audio signal;
A level difference calculation unit that calculates a level difference that is a difference between an output of the second statistical value calculation unit and an output of the first statistical value calculation unit;
An evaluation signal selection unit that outputs an evaluation signal for evaluating a mixing balance according to the level of the first audio signal;
An evaluation signal average value calculating unit for calculating a percentage time rate average value of the evaluation signal;
It is determined according to the statistical value of the level of the first audio signal calculated by the first statistical value calculator and the statistical value of the level of the second audio signal calculated by the second statistical value calculator. A gain calculation unit that calculates a gain for the second audio signal for maintaining an appropriate mixing balance according to a threshold value and a percent time rate average value of the evaluation signal calculated by the evaluation signal average value calculation unit;
An automatic mixing balance adjustment program that functions as an audio output unit that outputs the second audio signal multiplied by the gain calculated by the first audio signal and the gain calculation unit .