JP5372643B2 - Delay adjustment system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a voice adjustment system which groups voice lines input to a voice mixing console, and saves time and effort for setting delay values by setting the amount of delay for each group. <P>SOLUTION: Video signals are output from cameras 7 in studios 6a, 6b. Voice signals are output from microphones 8. A video mixing console 4 includes a plurality of video input terminals, adjusts and selects input video signals, and outputs them as a broadcasting signal. A voice mixing console 5 includes a plurality of voice input terminals, adjusts and selects input voice signals, and outputs them as a broadcasting signal. The voice mixing console 5 is provided with: a delay group setting unit 16 which divides identification numbers and the voice signals into delay groups through user input; a delay setting unit 17 which sets delay values for each voice signal divided into the delay groups; and a line switch setting unit 19 which distributes the voice signals with the delay values set thereto into each line channel. The delay values for the delay groups can be set at once. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a system for setting a delay amount (delay value) between a video signal and an audio signal to be broadcast in order to take a shift (lip sync shift) between a video signal and an audio signal at the time of production of a program broadcast. .

  Conventionally, a video signal and an audio signal of a production facility in a broadcast program have been processed by different apparatuses, but it has become necessary to perform processing such as converting a video signal into a digital signal due to recent digitization. By performing this processing, the delay amount (delay value) of the digital signal of the video signal becomes larger than the delay amount (delay value) of the audio signal. Therefore, there is an increasing need to increase the delay amount (delay value) of the audio signal in accordance with the delay amount of the video signal.

  For example, in a virtual video, a considerable amount of the video signal is delayed because special signal processing is performed on the video shot by the camera. The delayed signal is input to video equipment such as a switcher. On the other hand, since the sound collected by the microphone is directly input to the sound equipment, there is almost no delay. Eventually, if there is a slight amount of delay (delay value) in the video signal and audio signal transmitted to the broadcast, the video will feel uncomfortable, so the audio delay amount is adjusted to match the video delay amount. This is necessary on the audio equipment side.

  As a method for preventing such a shift between the video signal and the audio signal (lip sync shift), for example, the invention described in Patent Document 1 is known. The invention described in Patent Document 1 has the configuration shown in FIG. In FIG. 10, reference numeral 1 denotes an output device for video signals and audio signals. Reference numeral 2 denotes an audio output device that inputs an audio signal output from the playback device 1 and supplies the input audio signal to a speaker. Reference numeral 3 denotes a video device that receives the audio signal and the video signal output from the playback device 1 and uses the input video signal for video display. The video device 3 specifies a time for processing the supplied video signal as a video, measures a delay amount with the supplied audio signal, and outputs the delay amount to the audio device 2 as delay control information. The audio device 2 delays the audio signal based on the input delay control information.

JP 2007-274409 A

  However, since the audio adjustment console for producing a broadcast program has a plurality of playback devices, when the invention of Patent Document 1 is used for the audio adjustment console, the delay amount of the audio signal is set in accordance with the delay of the video. In this case, it is necessary to manually set the lip sync for each playback apparatus 1. For this reason, when the number of the playback devices 1 increases, there are many items to set, and erroneous operations and setting mistakes are likely to occur. Also, in the audio adjustment console, the audio signal in each video processing output from the plurality of playback devices 1 is not a single audio line in many cases, and it is necessary to manually set the same delay amount setting for a plurality of audio input lines. There is. Repeating the same operation like this leads to a setting error.

  In addition, one broadcast program has a complicated structure, and various video signals such as delay due to video processing other than the above virtual video, and delay due to transmission from the relay station to the broadcast station when relaying from a remote location are recorded as audio. It is necessary to correct on the adjustment console.

  The present invention has been made in order to solve the above-described problems. The purpose of the present invention is to group voice lines having the same delay amount to be input to the voice control console, and to set an identification code for each group. By setting a delay amount for each identification code, it is to provide a sound adjustment system that greatly reduces the time and effort of setting a delay value.

Based on the above object, the audio adjustment system of the present invention is a delay adjustment system that includes a plurality of video input terminals, adjusts and selects an input video signal, and outputs the video signal as a video broadcast signal.
In a delay adjustment system comprising a plurality of audio input terminals and adjusting and selecting an audio signal to be input and outputting an audio signal as an audio broadcast signal.
The voice adjustment console is
A delay group setting unit that divides each audio signal input to the audio adjustment console into delay groups that have the same delay value;
A delay setting unit for setting a delay value for the audio signals collected for each delay group;
A line switching setting unit for distributing the audio signal in which the delay value is set for each line channel ;
An audio / video reference signal generator for generating an audio / video reference signal and an audio / video signal delay measurement unit;
Distributes the input audio signal to the delay group, sets the delay value of the delay group together,
The audio / video reference signal output from the audio / video reference signal generator and input to the audio / video signal delay measurement unit via the microphone / camera, and the audio / video reference signal generator directly The delay amount of the audio / video signal is measured by measuring the delay amount of the audio / video reference signal input to the signal delay amount measuring unit .

Note that the audio signal with an arbitrary identification number and name by the user is divided into delay groups having the same delay value based on the user's input, or the audio signal for each delay group for which the delay value is set. Te, delay adjustment system or not accept changes of the delay value is also an embodiment of the present invention.

  According to the present invention as described above, it is possible to group voice lines having the same delay amount and automatically adjust the delay value for each group. As a result, delay values of delay groups having the same delay value can be set at a time, so that setting errors caused by repeating the same work a plurality of times can be reduced. Further, since each delay value is automatically set, an operation error due to manual setting can be prevented.

The figure which shows the structure of the audio | voice adjustment system which sets automatically the delay amount by Example 1 of this invention. The figure which showed the internal structure of the audio | voice adjustment console in Example 1 of this invention. The control diagram of the audio | voice adjustment console in Example 1 of this invention. The figure which showed the specific example of the operation part and display part in Example 1 of this invention. The figure which showed the display displayed on the display part in Example 1 of this invention. The figure which shows the structure of the audio | voice adjustment system which sets the delay amount automatically by Example 2 of this invention. The figure which showed the internal structure of the audio | voice adjustment console in Example 2 of this invention. Control diagram of voice adjustment console in Embodiment 2 of the present invention The figure which showed the display displayed on the display part in Example 2 of this invention. The block diagram of the apparatus which prevents the shift | offset | difference (lip shift | offset | difference) of the conventional video signal and an audio signal.

  Embodiments of the present invention will be described below with reference to the drawings. In the embodiments, the same or similar components are denoted by common reference numerals, and redundant description is omitted.

[1-1. Constitution]
FIG. 1 is a block diagram showing a configuration of a sound adjustment system for automatically setting a delay amount according to the first embodiment of the present invention. FIG. 2 is a block diagram illustrating an internal configuration of the audio adjustment console of the audio adjustment system that automatically sets the delay amount according to the first embodiment.

  In FIG. 1, 6a is a general studio, in which a camera 7 and a microphone 8 are respectively installed. A video adjustment console 4 is connected to the output side of the camera 7 and is connected so that a video signal is input to an input terminal provided on the video adjustment console 4. An audio adjustment console 5 is connected to the output side of each microphone 8, and audio signals from each microphone 8 are input to a plurality of audio input terminals provided on the audio adjustment console 5.

  Reference numeral 6b denotes a virtual studio that expresses all studio sets in CG (computer graphics). Like the studio 6a, a camera 7 and a microphone 8 are installed therein. The output side of the camera 7 is connected to the virtual video signal processing unit 11, and the video output output from the camera 7 is a video of the studio expressed in CG (computer graphics) through the virtual video signal processing unit 11. Is output to the video adjustment console 4.

  The video adjustment console 4 includes a plurality of video input terminals, adjusts and selects an input video signal, and outputs it as a broadcast output. In addition to the video signals output from the cameras of the studios 6a and 6b, the video signal input to the video adjustment console 4 can use a video line via a relay line or a camera installed outside the studio.

  The audio adjustment console 5 includes a plurality of audio input terminals, adjusts and selects an input audio signal, and outputs it as a broadcast signal. In addition to the audio signal output from the microphones 8 of the studios 6a and 6b, the audio signal input to the audio adjustment console 5 can use an audio signal via a relay line or a microphone installed outside the studio. .

  FIG. 2 is a diagram showing the internal structure of the audio adjustment console 5 in FIG. The audio signal input to each input terminal of the audio adjustment console 5 is input to the line switching unit 12. On the output side of the line switching unit 12, there is an output terminal for outputting an audio signal for each line channel. Connected to the output side of the line switching unit 12 is an audio processing unit 13 for adjusting a fader for each input line channel. The audio processing unit 13 is provided with a fader 14 so that the fader level of the input audio signal can be adjusted. A mix bus MIX BUS is connected to the output side of the audio processing unit 13, and an audio signal whose fader level is adjusted for each channel is output as an audio broadcast output via the mix bus MIX BUS.

  FIG. 3 is a diagram showing a configuration for controlling the audio adjustment console 5 in FIG. Reference numeral 15 denotes a control unit that controls the audio adjustment console. The control unit 15 includes a line switching unit 12, a voice processing unit 13, an operation unit 20, and a display unit 21. The user operates the operation unit 20 and inputs instructions to the control unit 15, thereby controlling the line switching unit 12. To do.

The control unit 15 includes the following setting unit.
(1) The user assigns an arbitrary identification number and name to each audio signal input to the audio adjustment console 5, and the audio signal is divided into delay groups having the same delay value based on the user input. Delay group setting section 16
(2) Delay setting unit 17 for setting a delay value for the audio signals collected for each delay group.
(3) A delay lock unit 18 that does not accept changes in the delay value for the audio signals collected for each delay group.
(4) Line switching setting unit 19 that distributes audio signals set with delay values for each line channel.

  As described above, on the output side of the control unit 15, there is a line switching unit 12 that distributes each input audio signal to each channel according to a command from the control unit 15. An audio processing unit 13 is connected to the output side of the line switching unit 12, and an audio signal divided for each channel by the line switching unit 12 is input to the audio processing unit 13. The audio processing unit 13 is connected to a broadcast output line (the mix bus MIX BUS), and an audio signal fader-adjusted by the audio processing unit 13 is output from this output line.

  FIG. 4 is a diagram showing a specific example of the operation unit 20 and the display unit 21 of the audio adjustment console 5 in FIG. In the figure, the delay adjustment knob 22 inputs a delay value to a desired value to the control unit 15 by the user adjusting the knob. The fader 14 sets the fader level to a desired value by the user adjusting the knob. The delay display board 23 displays the delay value set in the audio signal distributed for each line channel by the line switch setting unit 19. The line name display unit 24 displays the identification number and name of the audio signal corresponding to each line channel in the line switching setting unit 19. Note that the operation unit 20 is not limited to the above-described example, and a keyboard, a mouse, or the like connected to the audio adjustment console 5 can be used for operation. Similarly, the display unit may display the results of other setting units.

[1-2. Action]
In the first embodiment having the above-described configuration, the audio signal input to the audio adjustment console 5 has the same delay value based on the user's input for the audio signal with an arbitrary identification number and name. Divide into delay groups that The user sets a delay value for the audio signals collected for each delay group. Then, the audio signal with the delay value set is distributed to each line channel, and the fader level is adjusted for each line channel. Hereinafter, the operation of the first embodiment will be described according to the display on the display unit 21 of the audio adjustment console 5.

  FIG. 5A is a display example of the display unit 21 when the audio signals input to the audio adjustment console 5 are divided into delay groups. The display unit 21 displays an identification number, name, delay group, and delay value. Among these, the name and the delay group can be arbitrarily set by the user using a keyboard, a mouse, or the like connected to the operation unit 20 or the audio adjustment console 5. The display of the identification number is a display of the identification number given for each audio signal input to the audio adjustment console 5. The name display is the name of the audio signal to which the identification number is assigned. The user can set the display of the name for each identification number in order to clarify from which location the audio signal input to the audio adjustment console 5 is the audio signal output. The display of the delay group is an indication of which number is set for each audio signal when the audio signals having the same number are grouped into one group. The user can set the audio signal to be distributed to the desired delay group by giving a delay group number to each audio signal. The display of the delay value is a display of the delay value for each audio signal input to the audio adjustment console 5. The delay value displayed here corresponds to the delay value set on the display screen shown in FIG. 5B described later, or the delay value set by the user using the delay knob provided on the operation unit 20. doing.

  FIG. 5B is a display example of the display unit 21 when the delay setting unit 17 sets a delay value for the audio signal distributed to the delay group. The display unit 21 displays a delay group, a delay value, and a delay lock. Among these, the delay value and the delay lock can be arbitrarily set by the user using the operation unit 20 or the like. The number displayed in the delay group corresponds to the delay group number set on the display screen of FIG. The delay value is displayed for each delay group, and the delay value set by the user is displayed. The display of the delay lock is a display of whether or not the delay lock is set, and the setting of whether or not to fix the delay value set for each delay group is displayed as ON or OFF. In the delay lock setting, the audio signal for which the lock setting has been performed stops accepting the change of the delay value setting by the delay knob provided in the operation unit 20. When this delay lock is set, it can be locked / released by adjusting a delay lock button provided on the operation unit 20.

  FIG. 5C is a display example of the display unit 21 when the line switching unit 12 performs setting for distributing the audio signal with the adjusted delay value for each line channel. The display unit 21 displays the line channel number, the line name output from the line switching unit 12, and the delay value. Among these, the line output from the line switching unit 12 can be arbitrarily set by the user using a keyboard, a mouse, or the like connected to the operation unit 20 or the voice adjustment console 5. The line channel number display is a line channel number output from the line switching unit 12. In the display of the line name, the identification number of the audio signal corresponding to the line channel output from the line switching unit 12 and the name set in FIG. 5A are displayed. The user can set which audio signal is output from the line switching unit 12. The audio signal distributed for each channel is input to the audio processing unit 13 for each channel, and the volume can be adjusted by a fader 14 provided in the audio processing unit 13.

[1-3. effect]
As described above, in the first embodiment, an identification number is assigned to an audio signal input to the audio adjustment console 5, the audio signal is grouped, and a delay value is set for each group. Thereby, since delay values of delay groups having the same delay value, such as during image manipulation, can be set at a time, setting errors caused by repeating the same operation a plurality of times can be reduced. Further, when changing the delay value of each audio signal during operation, it can be done by adjusting a delay knob corresponding to each audio signal. On the other hand, by providing a delay lock setting for each audio signal, stopping the acceptance of changes in the delay value by the delay knob, it is possible to erroneously change the delay value of an audio signal that does not require a setting change. Can be prevented.

  Furthermore, a delay value is set for each delay group, but when adjusting the fader, a setting is made to distribute the audio signal adjusted for the delay value for each channel. Thereby, it is possible to adjust the fader for the audio signal desired by the user without sticking to the delay group.

  In the present embodiment, when setting the delay value at the audio adjusting console 5 of the first embodiment, the time and effort for setting the delay value are eliminated.

[2-1. Constitution]
FIG. 6 is a block diagram showing the configuration of a sound adjustment system for automatically setting the delay value according to the second embodiment of the present invention. FIG. 7 is a block diagram illustrating an internal configuration of the audio adjustment console of the audio adjustment system that automatically sets the delay amount according to the first embodiment.

  In FIG. 6, 9 is a selector installed in the studio 6a. The output of the camera 7 and the video reference signal are input to the input side of the selector 9. The output side of the selector 9 is connected to the video adjustment console 4 and the audio adjustment console 5. The output side of the selector 9 of the studio 6 b is connected to the video adjustment console 4 and the audio adjustment console 5 via the virtual video signal processing unit 11.

  The relay site 6 c is a place where the relay is performed at a location away from the video adjustment console 4 and the audio adjustment console 5. The relay site 6c, the video adjustment console 4 and the audio adjustment console 5 are relayed via the relay terminal 10. The relay terminal 10 transmits and receives audio signals, video signals, audio reference signals, and video reference signals input to the relay terminals in both directions.

  Selectors 9a and 9b are installed at the relay site 6c. The output of the camera 7 and the video reference signal output from the relay terminal 10 are input to the input side of the selector 9a. The audio signal output from the microphone 8 and the audio reference signal output from the relay terminal 10 are input to the input side of the selector 9b. In FIG. 6, the microphone 8 input to the selector 9b is the MIC 3-1, but any microphone can be selected as long as the microphone 8 is in the relay site 6c.

  The audio adjustment console 5 includes a plurality of video input terminals in addition to the audio input terminals, and inputs video signals and audio signals from the studios 6a and 6b and the relay site 6c. Then, the audio signal is processed and output as an audio broadcast output. Also, audio reference signals and video reference signals are output to the studios 6a and 6b and the relay site 6c.

  FIG. 7 is a diagram showing the internal structure of the audio adjustment console 5 in FIG. The audio signal input to each input terminal of the audio adjustment console 5 is input to the line switching unit 12 and the audio signal delay amount measuring unit 27, respectively. The audio signal delay amount measuring unit 27 measures the delay amount from the audio signal and the audio reference signal. The input side of the audio signal delay measuring unit 27 is connected to an audio reference signal generating unit 25 that generates an audio reference signal. In addition to the audio signal delay amount measuring unit 27, the output side of the audio reference signal generating unit 25 is connected to a selector 9b provided at a relay site 6c provided outside the audio adjustment console 5. The video signal delay amount measuring unit 28 measures the delay amount from the video signal and the video reference signal. The input side of the video signal delay amount measuring unit 28 is connected to a video reference signal generating unit 26 that generates a video reference signal. The output side of the video reference signal generating unit 26 includes the selectors 9 and 9a provided at the studios 6a and 6b and the relay site 6c provided outside the audio control console 5 in addition to the video signal delay measuring unit 28. Connected.

FIG. 8 is a diagram showing a configuration for controlling the audio adjustment console 5 in FIG. In addition to the sound adjustment console 5 of the first embodiment shown in FIG. 3, the following part is provided.
(5) Audio / video reference signal generators 25 and 26 for generating audio / video reference signals
(6) Audio / video signal delay amount measuring units 27 and 28 for measuring the delay amount of the audio / video signal by comparing the audio / video signal with the audio / video reference signal.

[2-2. Action]
In the second embodiment having the above-described configuration, the audio signal input to the audio adjustment console 5 is divided into delay groups, and a delay value is set for each delay group. At this time, in the first embodiment, the user manually sets the delay value, but in this embodiment, the difference between the audio / video signal and the audio / video reference signal for each line is measured. Hereinafter, the operation of the second embodiment will be described in accordance with the display on the display unit 21 of the audio adjustment console 5.

  FIG. 9A is a display example of the display unit 21 when the audio signals input to the audio adjustment console 5 are divided into delay groups. The display unit 21 displays an identification number, a name, and a delay group. The display and setting of these identification numbers, names, and delay groups are the same as in the first embodiment.

  FIG. 9B is a display example of the display unit 21 when the delay setting unit 17 sets a delay value for the audio signal distributed to the delay group. The display unit 21 displays a delay group, delay value, auto delay ON / OFF, audio signal line number, video signal line number, half delay ON / OFF, and delay lock. Among these, the delay value, auto delay ON / OFF, audio signal line number, video signal line number, half delay ON / OFF, and delay lock are the keyboard or the user connected to the operation unit 20 or the audio adjustment console 5. It can be set by using a mouse or the like. The delay group display and the delay lock ON / OFF display are the same as in the first embodiment. The display of the delay value in FIG. 9B is a display of the delay value for each delay group, and the user can set the delay value for each delay group as in the first embodiment. On the other hand, the user can set the delay value automatically without setting the delay value. The auto delay display shows whether or not the delay value is set automatically for each delay group. The display of the audio / video signal number is display of the identification number of the audio / video signal to be compared with the audio / video reference signal when the delay is set automatically. In the half delay display, the setting of whether to perform the half delay when setting the delay value by the auto delay is displayed by ON or OFF.

  When the delay value is set automatically, the audio / video signal delay measurement units 22 and 23 of the control unit 15 compare the audio / video signal with the audio / video reference signal, thereby delaying the audio / video signal. Measure the amount and set the delay value according to the delay amount. As a calculation of the delay value at that time, either the formula (1) or the formula (2) can be used.

[Auto delay]
[Delay setting value] = [Delay amount of video signal] − [Delay amount of audio signal] (1)
[Half delay]
[Delay setting value] = [Delay amount of video signal] / 2- [Delay amount of audio signal] / 2 (2)

  When the above formula is used as a calculation formula, the display on the display unit 21 in FIG. 9B is set to the ON display and the half delay to the OFF display in the case of the formula (1). In the case of equation (2), the auto delay is set to ON display and the half delay is set to ON display.

  FIG. 9C is a display example of the display unit 21 when the line switching unit 12 performs setting for distributing the audio signal with the adjusted delay value for each line channel. As in the first embodiment, the display unit 21 displays the line channel number, the line name output from the line switching unit 12, and the delay value. Among these, the line output from the line switching unit 12 can be arbitrarily set by the user using a keyboard, a mouse, or the like connected to the operation unit 20 or the voice adjustment console 5.

[2-3. effect]
As described above, in the second embodiment, not only the same effects as those of the first embodiment but also when the delay value is set for each delay group, the audio / video signal is compared with the audio / video reference signal, thereby obtaining the audio. / Measure the delay amount of the video signal and set the delay value according to the difference in the delay amount. Thereby, each delay value can be set automatically, and an operation error due to manual setting can be prevented.

DESCRIPTION OF SYMBOLS 1 ... Playback apparatus 2 ... Audio apparatus 3 ... Video apparatus 4 ... Video adjustment console 5 ... Audio adjustment console 6a ... Studio 6b ... Virtual studio 6c ... Relay site 7 ... Camera 8 ... Microphone 9 ... Selector 9a ... Selector 9b ... Selector 10 ... Relay terminal 11 ... Virtual video signal processing unit 12 ... Line switching unit 13 ... Audio processing unit 14 ... Fader 15 ... Control unit 16 ... Delay group setting unit 17 ... Delay setting unit 18 ... Delay lock unit 19 ... Line switching setting unit 20 ... Operation unit 21 ... Display unit 22 ... Delay adjustment knob 23 ... Delay display board 24 ... Line name display board 25 ... Audio reference signal generation unit 26 ... Video reference signal generation unit 27 ... Audio signal delay amount measurement unit 28 ... Video signal delay amount Measurement unit

Claims (3)

A video adjustment console that includes a plurality of video input terminals, adjusts and selects a video signal to be input, and outputs the video signal as a video broadcast signal;
In a delay adjustment system comprising a plurality of audio input terminals and adjusting and selecting an audio signal to be input and outputting an audio signal as an audio broadcast signal.
The voice adjustment console is
A delay group setting unit that divides each audio signal input to the audio adjustment console into delay groups that have the same delay value;
A delay setting unit for setting a delay value for the audio signals collected for each delay group;
A line switching setting unit for distributing the audio signal in which the delay value is set for each line channel ;
An audio / video reference signal generator for generating an audio / video reference signal and an audio / video signal delay measurement unit;
Distributes the input audio signal to the delay group, sets the delay value of the delay group together,
The audio / video reference signal output from the audio / video reference signal generator and input to the audio / video signal delay measurement unit via the microphone / camera, and the audio / video reference signal generator directly Measure the delay amount of the audio / video signal by measuring the delay amount of the audio / video reference signal input to the signal delay measurement unit.
A delay adjustment system characterized by this. The delay group setting unit divides audio signals with arbitrary identification numbers and names by a user into delay groups having the same delay value based on a user input. 1. The delay adjustment system according to 1. The voice adjustment console is
The delay adjustment system according to claim 1, further comprising a delay lock unit that prevents the change of the delay value from being received for the audio signal for each delay group in which the delay value is set.

Images