JP2009273074A - Video display and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an audio system reflected with display positions of respective view screens of multi-view contents. <P>SOLUTION: By processing multi-channel audio data on the basis of display position information of a main view screen, the volume of main view audio output from a plurality of speakers is adjusted and the position of a sound image of the main view audio is made coincident with a center position of the main view screen. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a video display apparatus and a video display method that control the position of a sound image of audio to be reproduced when multi-view content including a plurality of videos and a plurality of sounds corresponding to the videos is displayed on a multi-screen.

  The distribution of multi-view content is regulated for operation as multi-view television (MVTV) in the ARIB standard, which is a Japanese digital broadcasting standard.

  In Non-Patent Document 1, MVTV is defined as a broadcast form that constitutes one broadcast content by a combination of a plurality of video / audio intended by a broadcaster.

  Patent Document 1 describes determining an optimal layout pattern for simultaneously displaying a plurality of videos on one screen according to a configuration pattern of a video signal group related to a plurality of videos constituting a multi-view television. ing.

  Patent Document 2 describes that display information of a plurality of images displayed on a display is detected and volume adjustment of a sound signal synchronized with each image is performed according to a display state.

In Patent Document 3, in a broadcast in which audio is transmitted using a plurality of audio channels,
It is described that the voice synthesis ratio of the voice channel is determined based on the relative distance between the reference position in the pointer displayed on the screen and the selected voice channel point.
JP 2004-128778 A JP 05-019729 A Japanese Patent Application Laid-Open No. 08-298635 ARIB TR-B14 Volume 2 Volume 4 25 Multiview TV (MVTV)

  When viewing multi-view content by multi-window (multi-screen) display on a conventional video display device, audio corresponding to the video displayed in each window is selectively output. Even when a plurality of sounds are output simultaneously, only the volume of each sound is controlled according to the display state of the image. That is, in the conventional video display device, regardless of the display position of each window in one screen, audio corresponding to each window is selectively or volume-adjusted and output from a speaker arranged in the video display device. It had been. Therefore, it is difficult to perceive the relationship between the video displayed in each window and the corresponding audio, and the realism as multi-view content is lacking.

  In order to solve the above problems, a video display device according to the present invention includes a plurality of videos including a main view video and a subview video, a main view audio corresponding to the main view video, and a subview audio corresponding to the subview video. A video display device for displaying multi-view content composed of a plurality of audios on a multi-screen consisting of a main view screen for displaying the main view video and a sub-view screen for displaying the sub-view video, The position of the sound image of the main view sound corresponds to the center position of the main view screen.

  According to the present invention, by matching the position of the sound image of the audio corresponding to the video displayed in each window of the multi-window display with the center of the window display screen, it is easy to perceive the relationship between the video and the audio. It is possible to view multi-view content with

<Example 1>
According to the ARIB standard described above, an EIT (Event Information Table) included in program information includes a flag indicating multi-view content. Whether or not the selected program is multi-view content is determined by detecting the presence or absence of this flag. Similarly, the EIT also includes a flag indicating whether each stream constituting the program data is the main view or the sub view. By referring to this flag, whether each video / audio constituting the multi-view content is video / audio corresponding to the main view (main view video / main view audio) or video / audio corresponding to the subview (subview video / audio) Sub-view sound) is identified.

  FIG. 1 is a block diagram showing a configuration of a video display device of the present invention.

  FIG. 2 is a block diagram showing buffer configurations of the video memory 7 and the audio memory 8.

  The digital broadcast signal is received by the tuner 12, and after being demodulated / demuxed by the demodulator / demux unit 10 and descrambled, is output to the video / audio decoder 6 as a video / audio stream.

  The video / audio decoder 6 decodes the video / audio stream.

  When the digital broadcast content is multi-view content, the decoded video stream is stored in the respective view video buffers 42 to 44 of the video memory 7 as video data under the control of the display processor 3.

  The video / audio decoder 6 simultaneously decodes a plurality of encoded audio streams of multi-view content. The audio processor 4 continuously writes a plurality of decoded audio streams to the corresponding audio buffers 18 to 20 of the audio memory 8 as multi-channel audio data.

  The display processor 3 reads and synthesizes the video data, background still image data, character data, and GUI data stored in the video memory 7 and outputs synthesized video data. The display unit 1 includes a display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), and an ELD (Electro-Luminescence Display). A synthesized video based on the synthesized video data is displayed on the screen on the display device.

  On the screen of the display unit 1, as shown in FIG. 1, a video is displayed as a multi-screen in which the main view screen is arranged in the center and the subview screen is arranged in the periphery. Further, the GUI screen is arranged in the peripheral portion so as not to overlap the sub-view screen.

The display processor 3 controls the display unit 1 and the video memory 7 in a coordinated manner.
The display processor 3 associates the display position information of the video displayed on the display unit 1 with the memory address information of the video memory 7 of the video data corresponding to the video, and holds each information.

  When the display position on the display screen of the display unit 1 is the position of the display rectangular area of the main view screen and the sub view screen, the video data corresponding to the memory addresses of the view video buffers 42 to 44 is based on the display position information. Read out. A main view video is displayed on the main view screen, and a sub view video is displayed on the sub view screen. The main view sound that is the sound corresponding to the main view image and the sub view sound that is the sound corresponding to the sub view image are mixed according to the layout of the view screen and output from the speaker system 2.

  Similarly, for the display area of the document screen, character data corresponding to the memory address of the character data memory area in the graphic buffer 45 is read. For the display area of the GUI screen, the GUI data corresponding to the memory address of the GUI data memory area of the graphic buffer 45 is read.

  On the display screen, a still image can be displayed as the background of the view screen, the document screen, and the GUI screen.

  Still image data is read from a still image data memory area in the graphic buffer 45.

  The display processor 3 combines video data, character data, and GUI data in association with each display position.

  In addition, the view screen, the document screen, and the GUI screen can be displayed on the display screen as an alpha blend composite image obtained by combining a background still image with a predetermined transmittance.

  The display position of the view screen, the document screen, and the GUI screen can be moved by changing the setting information of the display position information in the display processor 3.

  The audio processor 4 controls the speaker system 2 and the audio memory 8 in cooperation with each other.

  The display processor 3 outputs the display position information of the view screen from the display position information of the video displayed on the display unit 1 to the audio processor 4.

  The audio processor 4 executes localization and volume control of an audio image corresponding to each view screen from the display position information of each view screen acquired from the display processor 3. The audio processor 4 mixes the audio data read from the audio buffers 18 to 20 based on the sound image position information and the sound volume information, and outputs the mixed data to the speaker system 2.

  The sound image position corresponding to each view screen can be moved by changing the setting information of the sound image position information in the sound processor 4. The view screen layout change is immediately reflected in the sound image position layout. The sound processor 4 determines the mixing condition from the display position information of the main view screen so that the position of the sound image of the main view sound matches the center of the main view screen.

  When the main view screen is at the top of the display screen, the sound output from the speaker disposed at the top is output to each speaker so that the sound output from the speaker disposed at the bottom is larger Volume information is set.

  Similarly in the horizontal direction, the volume of sound output from the speaker arranged on the right and the speaker arranged on the left is adjusted according to the horizontal position on the display screen of the main view screen.

  Even if the position of the sound image does not necessarily coincide with the center position of the main view screen, the mixing conditions may be set in association with each other so as to fall within a predetermined range from the center of the main view screen.

  Similarly, the audio processing is performed on the sub-view screen. The audio processor 4 determines the mixing condition based on the display position information of the subview screen so that the position of the sound image of the subview audio matches with the center of the subview screen, or is associated with the predetermined range from the center of the subview screen. can do.

  The main view sound and the sub view sound may be output so as to be switchable by a user operation, or may be output simultaneously.

  When output simultaneously, the volume of the main view sound and the volume of the sub view sound may be output in association with the area of the main view screen and the area of the sub view screen, respectively. That is, the sound volume corresponding to a screen with a large area can be set to a louder volume.

  The audio memory 8 (storage means) includes an audio buffer 18 that stores audio data of main view audio and audio buffers 19 and 20 that store audio data of sub-view audio.

  Furthermore, the audio buffers 18 to 20 are each composed of five channels of speaker buffers 21 to 25, 26 to 30, and 31 to 35. That is, the main view audio data and the sub view audio data are stored for each channel. As shown in FIG. 3, the speakers include middle and high frequency speakers 48 and 4 arranged on the upper and lower left sides of the display unit 1, middle and high frequency speakers 50 and 51 arranged on the upper and lower right sides, and a low frequency arranged on the lower side of the central portion. Area speaker 52.

  Audio data corresponding to each of the speakers 48 to 52 is stored in the speaker buffers of the audio buffers 18 to 20.

  The position of the sound image of the view sound corresponding to each view screen is controlled by adjusting and outputting the size (volume) of the sound data stored in each channel in each sound buffer. When the audio data in the audio buffers 18 to 20 is transferred to the output audio buffer 36, an operation based on the mixing condition is performed, and the audio data after mixing is held in the speaker buffers 37 to 41. From each speaker 48-51, the audio | voice based on the audio | voice data hold | maintained at the speaker buffers 37-41 in the audio | voice output buffer 36 is output.

<Example 2>
Also in the present embodiment, the configuration of the video display device, the configuration of the memory, and the arrangement of the speakers are the same as in the first embodiment.

  In this embodiment, the sound image position of the main view sound is made to coincide with the center position of the main view screen, and the sound image position of the sub view sound is arranged outside the center position of the sub view screen. The sub-view screen is arranged around the main view screen.

  That is, the time difference between the arrival of the sub-view sounds to the human ears is increased. Since the time difference between the arrival of audio to both ears promotes the sense of distance of the displayed video, it is possible to view multi-view content with a richer presence.

It is more effective to arrange the sound image position of the subview sound outside the edge of the screen.
The setting of the sound image position is the same as in the first embodiment.

It is a block diagram of a video display device of the present invention. It is explanatory drawing for demonstrating the structure of the memory of this invention. It is a schematic diagram which shows the structure of the speaker system of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Display part 2 Speaker system 3 Display processor 4 Audio processor 5 Main processor 6 Video audio decoder 7 Video memory 8 Audio memory 9 Input / output processor 10 Demodulation / demax 11 Composite input / output device 12 Tuner 13 Non-volatile storage device 14 Broadcast wave 15 Internet 16 Human interface 17 Regional information processing device 18-20 Audio buffer 21-35 Speaker buffer 36 Audio output buffer 37-41 Speaker buffer 42-44 Each view video buffer 45 Graphic buffer 46 Main CPU work area 47 Video / audio decoder area 48 Mid-high range speaker 1
49 Mid-high range speaker 2
50 Mid-high range speaker 3
51 Mid-high range speaker 4
52 Low frequency speaker

Claims (8)

  A multi-view content including a plurality of videos including a main view video and a sub-view video, and a plurality of sounds including a main view audio corresponding to the main view video and a sub-view audio corresponding to the sub-view video, A video display device that displays a multi-screen including a main view screen that displays a main view video and a subview screen that displays the subview video, wherein the position of the sound image of the main view audio is the center position of the main view screen A video display device that is compatible with the above.   The video display device according to claim 1, wherein a position of a sound image of the subview sound corresponds to a center position of the subview screen.   The multi-screen is arranged such that the main view screen is in a central portion and the sub-view screen is in a peripheral portion, and the position of the sound image of the sub-view sound is located outside the center position of the sub-view screen. The video display device according to claim 1.   4. The video display device according to claim 1, wherein the main view sound and the sub view sound are output so as to be switchable.   4. The video display device according to claim 1, wherein the main view sound and the sub view sound are output simultaneously.   6. The video display device according to claim 5, wherein the volume of the main view audio and the volume of the sub view audio correspond to an area of the main view screen and an area of the sub view screen, respectively. Storage means for storing voice data corresponding to the plurality of voices;
2. The video display device according to claim 1, wherein the storage unit stores audio data corresponding to the main view audio and audio data corresponding to the sub-view audio for each of a plurality of channels. .   A multi-view content including a plurality of videos including a main view video and a sub-view video, and a plurality of sounds including a main view audio corresponding to the main view video and a sub-view audio corresponding to the sub-view video, A video display method for displaying on a multi-screen including a main view screen for displaying a main view video and a subview screen for displaying the subview video, wherein a position of a sound image of the main view audio is a center position of the main view screen A video display method characterized by being compatible with the above.

Images