JP2000152075A - Virtual secondary adjustment device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To save the space of installation and to recombine a switcher, etc. without wiring a cable for every relay of a sport program by using a virtual monitor and a virtual mixer and displaying these monitor and mixer on an HMD(head mount display) or a large display to carry out the necessary operations. SOLUTION: A virtual monitor which displays plural monitor images is used together with a switcher, a virtual switcher which displays a mixer, etc., and a virtual mixer. These monitor, switchers and mixer are displayed on the screen of an HMD or a large display to carry out the necessary operations. In this device, a display image is automatically calculated based on the program which is previously inputted to a CPU 2 or the output of an image/voice processing part 1. Based on this calculation result, 3 virtual monitor/switcher/ mixer generation part 5 generates the image signals to display those images, switchers, mixer, etc., on the screen of the HMD or the large display.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video signal of a program, which is used when a sports program is broadcasted from a site without actually providing a sub-tone (more precisely, a sub-adjustment room) equipment for a broadcast truck or a studio. The present invention relates to a virtual sub-tone device which enables switching and editing of audio signals.

[0002]

2. Description of the Related Art Conventionally, when broadcasting a large sports program such as a baseball broadcast or a soccer broadcast, a television camera,
Microphones and the like are installed and the output is input to a relay van, and switching of video signals and mixing of audio signals are performed by a switcher and a mixer in the relay van.

[0003]

However, in recent years, the scale of relay broadcasting of sports programs has become larger and larger, and not only the number of television cameras and slow VTRs has increased, but also the simultaneous production of the current NTSC system and high-definition programs has increased. There is not enough space in the OB van, and preparations have been made to rent a room in the gymnasium or build a temporary prefab to relocate the studio tones. As a result, the time and people required for preparations and withdrawals are constantly increasing.

[0004] In addition, equipment used for relay broadcasting, such as a switcher and a mixer, cannot always be used for each relay due to the relationship with other programs produced at the same time. Have been rewritten, and wiring to switchers and mixers has been performed.

It is an object of the present invention to provide the above-mentioned huge time,
In order to save people and equipment, a virtual sub-tone device that switches switchers and mixers that actually switch video signals and mix audio signals in the stadium without using a relay truck etc. and remotely controls those equipment Is to provide.

[0006]

In order to achieve the above object, a virtual subtone apparatus according to the present invention receives one or a plurality of video signals and audio signals, and receives the input video signals and audio signals. A video / audio signal processing unit to be processed, a virtual monitor, a virtual switcher, and a virtual mixer for displaying images of a virtual mixer on a display unit;
An operation for displaying the one or more video signals and audio signals input to the audio signal processing unit on the display means, and a switching and mixing control signal executed by operating the virtual switcher and the virtual mixer; At least a CPU for transmitting to a video / audio signal processing unit and outputting desired video and audio signals on an output side based on operations of the virtual switcher and the virtual mixer and operations from an operation input unit. It is characterized by becoming.

Further, in the virtual subtone apparatus according to the present invention, the display means is a head mounted display or a large display.

Further, the virtual sub-toner according to the present invention is characterized in that the CPU
Has a function of performing on-air video and audio signals from the CPU and displaying and presetting the next on-air video and audio signals on the display unit based on the script information input to the CPU. It is characterized by having.

Further, the virtual sub-toner according to the present invention is characterized in that the CPU
Has a function of operating the virtual switcher and the virtual mixer based on the operator's line of sight input to the CPU.

[0010]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below based on embodiments of the present invention with reference to the accompanying drawings. Hereinafter, the virtual secondary key device of the present invention will be described for the case of baseball broadcasting. FIG. 1 shows the configuration of an embodiment of the virtual secondary key device of the present invention. In FIG. 1, reference numeral 1 denotes a video / audio signal processing unit, 2 denotes a CPU (central control unit), 3 denotes a slow VTR, 4 denotes a telop generator, 5 denotes a virtual monitor switcher / mixer signal generation unit, and 6 denotes a touch switch. It is.

The operation will be described. First, the video / audio signal processing unit 1 is connected to a video cable from a television camera and an audio cable from a microphone arranged at various places in a baseball field such as a first base, a third base, and a back net. In the video / audio signal processing unit 1, switching and mixing are performed on output signals of the plurality of connected television cameras and microphones as described later, and a signal obtained as a result is processed by the processing unit 1. CP from output side via serial interface
Input to U2. Further, a video signal generated by the slow VTR 3 or the telop generator 4 is directly input to the CPU 2. The video / audio signal processing unit 1 is controlled by a control signal sent from the CPU via the same serial interface as described above, and performs various switching (cut, dissolve, wipe, etc.) of the video signal and mixing of the audio signal. Done.

In the above, the serial interface connects between the video / audio signal processing unit 1 and the CPU 2,
It performs bidirectional transmission of video signals, audio signals, and control signals for switching and mixing. If an optical wavelength multiplexing system is used, wiring with one optical fiber is also possible.

Next, various video signals obtained from the TV camera (not shown), the slow VTR 3, the telop generator 4, etc., various audio signals picked up by a microphone, on-air (broadcast output) video signals, audio signals In addition, the display of the switcher / mixer including the display of the operation position that performs the switching of the video and the mixing of the audio, respectively, the VU meter, the script, the on-air monitor,
The following describes how the display of the waveform monitor of the video signal is performed in the virtual sub-toning device of the present invention.

[0014] In the virtual subtone apparatus of the present invention, the display means for performing each of the above displays is provided by a head mounted display:
A head mount display (hereinafter, referred to as an HMD) or a large-sized display is used, and a display signal to these display means is generated by a virtual monitor switcher / mixer generator 5 shown in FIG. It is performed in.

That is, the program previously input by the CPU 2 or the video / audio processing unit 1 shown in FIG.
The display image is automatically calculated based on the output of the display device, and the virtual monitor / switcher / mixer generation unit 5 displays the monitor image, the switcher, the mixer, and the like on the display screen of the HMD or the large display based on the calculation result. Generate a signal.

The display may be performed on one HMD or a large display, or may be divided into a plurality of displays, or a combination of a partially see-through (transmissive) HMD and a large display. Is also possible. Further, a touch switch (described later) corresponding to a switcher or a mixer can be displayed. The CPU 2 (see FIG. 1) performs video switching and audio mixing based on the output of a touch switch and the output of a magnetic sensor, an operation input unit such as a three-dimensional mouse that can analyze human motion, and performs on-air, Generate video and audio signals for recording.

FIG. 2 shows a state in which a monitor image and the like are displayed on the HMD by enlarging the display contents by arrows. In Fig. 2, the monitor screen of various images is displayed on the upper part, the audio level (VU meter), the script, the monitor screen of the on-air image, the waveform monitor of the video signal are displayed on the upper part, and the mixer fader, switcher and video fader are displayed on the lower part. Have been.

FIG. 3 shows an overall view and display contents when the display means is constituted by a large display. In FIG. 3, as shown, the entire display means is constituted by using two single displays in the upper stage, one in the middle stage, and two single displays in the lower stage. The display contents are the same as those in the case of the HMD shown in FIG.

In the case of this example, a mixer fader, a switcher, and a video fader are displayed as touch switches at the lower stage, and the virtual hand is displayed by moving following the movement of the hand of the person with the magnetic sensor attached. By directly touching and operating this part, switching of the video signal and mixing of the audio signal can be performed. In FIG. 1, the touch switch 6 corresponds to this. In this example, the touch switch 6 is virtually displayed on a screen, but the output of the touch switch is input to the CPU 2.

FIG. 4 shows an example of a configuration in which a display unit is formed by combining a partially see-through HMD and a large display. In FIG. 4, the upper monitor image is displayed on the HMD, and the corresponding display items (same as those displayed in the corresponding columns in FIGS. 2 and 3) are displayed in the middle and lower rows of the large display, respectively. The secondary key) wears the HMD, and monitors the images of the display items on the middle and lower stages of the large display seen through the see-through portion of the HMD, together with the monitor image on the upper stage displayed on the HMD. In this case, since the lower part of the HMD is see-through, it is possible to have a conversation while looking at the face of the director sitting next to the HMD. The script monitored in the middle row can also be used to electronically page through and display the current on-air location. The display screen and the operation screen are not limited to those exemplified above, and can be arbitrarily combined according to the program. If necessary, the operation switch of the VTR, the control panel of the lighting, and the console of a so-called "weather camera" Etc. can also be displayed.

Here, the applicability of the HMD as a component of the virtual sub-tone device of the present invention will be examined. It is said that if the resolution required for the HMD is a horizontal and vertical resolution of 2000 × 2000, an image displayed on the HMD can be observed like a live image of daily life. Considering that the effective resolution of HDTV is 1920 × 1080 and its aspect ratio is 5: 3, realizing a display having a 1: 1 square aspect ratio enables high resolution of the entire human visual field. It is sufficiently possible to realize an HMD that can be displayed by. On the other hand, a commonly used 10-inch video monitor is used as a general sub-tone work environment.
When observed from a position about m away, a person with a visual acuity of 1.0 can detect about 300 scanning lines. Therefore,
With this resolution, six monitor images can be displayed side by side, and the HMD can be used sufficiently in consideration of this point.

Further, the virtual sub-tone device of the present invention is compatible with a computer system, and can correspond to a new human interface, such as switching using an electronic script, presetting, and line-of-sight operation. Hereinafter, this will be described. The script is input to the CPU 2 as script information (see FIG. 1). The CPU 2 controls the display of script information and page feed and the like, the monitor image, the on-air state on each screen of the switcher and the mixer, and the monitor image to be next aired, the display on each screen of the switcher and the mixer, and the preset. Do. This is shown in FIG.

In FIG. 5, a monitor at the time of on-air,
The positions of the mixer, switcher, and script are indicated by solid lines, and the next preset is indicated by broken lines. Actually, it is also possible to set the color on the air, such as red, and the preset green. In this way, by electronically inputting the script, the position on the script on the air (for example, a zoom ratio such as a bust shot, a television camera to be selected, a microphone for turning on a fader, a VTR, a telop, etc. is indicated). ) And the position on the script to be operated next can be automatically indicated. Based on this information, it is possible to indicate on the monitor which video input is on the air and the next video input to be selected, and the cameraman can also simultaneously send the information of the next selected camera. . That is, unlike the related art, it is not necessary for the director lying down to give an instruction such as “Next, A turtle”.

In the above, a switcher or a mixer displayed on the screen of a large display is configured as a touch switch, thereby switching video signals (processing such as cut, dissolve, wipe, etc.) and mixing audio signals. However, in the virtual secondary tone device of the present invention, instead of the above, a gaze detection device is incorporated in the HMD, or in an example combined with a large display, the gaze is detected by contactlessly on the display screen. In addition, switching and mixing based on the line of sight can be performed.

By the way, generally, two types of calibration are required to realize such an operation. One is to make the gaze detection result correspond to the absolute coordinates in the 180-degree field of view, and the other is to measure the position of the object (monitor) in the field of view and obtain the absolute angle. It is. Regarding the latter, in the present invention, the CPU 2 (see FIG. 1) directly generates the monitor image in the display image, and there is no need to measure. On the other hand, if an ordinary monitor is used, it is necessary to measure the observation distance, the size of the monitor, and the horizontal and vertical positions from the front one by one.

However, in the virtual sub-toner of the present invention, for example, the number of dots displayed on the monitor screen is known in advance, and the angle is easily converted into an angle such as how many times in the horizontal direction and how many times in the vertical direction. can do. That is, what the operator sees in the present invention is not a real object but all images generated by the CPU.
The output of the operation input unit is also input to the same CPU 2, and the calibration that needs to be performed in advance is only the line-of-sight calibration, so that the switching by the line-of-sight input can be realized very easily.

[0027]

As described above, according to the subtone apparatus of the present invention, a virtual monitor for displaying a plurality of monitor images,
Using a virtual switcher and a virtual mixer to display switchers and mixers, these can be displayed on the screen of an HMD or a large display, and the necessary operations can be performed to greatly reduce the installation space. The switcher and fader can be rearranged without laying cables.

A switcher and a mixer for inputting and switching individual video signals and audio signals, respectively, are placed in the stadium, and these are connected to a virtual switcher and a virtual mixer by a multiplexed control cable via a CPU. In addition, it is possible to largely reduce labor of wiring work.

Further, the same display is performed in the studio and the relay van to share the operation, and a more stable and flexible relay system can be realized. In addition to the above advantages, the virtual subtone apparatus of the present invention is compatible with a computer system, and can be used for electronic programming, presetting, switching by touch panel and line-of-sight operation, mixing, etc. It can also support human interface.

[Brief description of the drawings]

FIG. 1 shows a configuration of an embodiment of a virtual secondary key device of the present invention.

FIG. 2 shows a state in which a monitor image and the like are displayed on the HMD by enlarging the display contents by arrows.

FIG. 3 shows an overall view and display contents when the display means is constituted by a large display.

FIG. 4 illustrates an example of a configuration in which a display unit is formed by partially combining a see-through HMD and a large display.

FIG. 5 shows that a monitor image, a switcher, and a mixer are displayed on each screen, indicating that an on-air state is displayed and a next on-air state is displayed.

[Explanation of symbols]

 Reference Signs List 1 video / audio signal processing unit 2 CPU 3 slow VTR 4 telop generator 5 virtual monitor / switcher / mixer signal generation unit 6 touch switch

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Akio Ishikawa 1-10-11 Kinuta, Setagaya-ku, Tokyo Inside the Japan Broadcasting Corporation Broadcasting Research Institute (72) Inventor Daiichiro Kato 1-10 Kinuta, Setagaya-ku, Tokyo 11 Japan Broadcasting Corporation Broadcasting Research Institute F term (reference) 5C023 AA11 AA18 AA21 AA34 AA38 BA11 BA15 CA01 CA06 DA08 EA02

Claims (4)

[Claims] 1. A video / audio signal processing unit to which one or more video signals and audio signals are inputted, and which processes the inputted video signals and audio signals, a display means comprising a virtual monitor, a virtual switcher and A virtual monitor / switcher / mixer signal generation unit for displaying an image of the virtual mixer, and at least one or more video signals and audio signals input to the video / audio signal processing unit on the display means. , Transmission of a switching and mixing control signal executed by operation of the virtual switcher and the virtual mixer to the video / audio signal processing unit, operation of the virtual switcher and the virtual mixer, and operation from the operation input unit CPUs that output desired video and audio signals to the output side based on Virtual auxiliary pressure device characterized by comprising comprises. 2. The virtual sub-tone device according to claim 1, wherein
The display device is a head mounted display or a large display. 3. The virtual sub-toning device according to claim 1, wherein said CPU further outputs from said CPU an on-air video signal and an audio signal and a next on-air video signal and audio signal to said display means. A function of performing display and presetting based on script information input to the CPU. 4. The virtual sub-tone device according to claim 1, wherein the CPU further controls the operation of the virtual switcher and the virtual mixer based on an operator's line of sight input to the CPU. A virtual sub-tone device having a function to perform the operation.