JP4951148B2 - Video display device and video display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To cope with the problem that stereoscopic images of 3D images collapse on a display screen in a video display device for displaying 3D images. <P>SOLUTION: The video display device according to an embodiment comprises margin section generating means and 3D image generating means. The margin section generating means adds a margin section to the periphery of a 3D image generated based on an input 3D image signal containing depth information designed to form the 3D image. The 3D image generating means generates a protruding 3D image in the margin section based on the 3D image signal containing the depth information. <P>COPYRIGHT: (C)2012,JPO&amp;INPIT

Description

  Embodiments described herein relate generally to a video display device and a video display method for displaying a 3D image.

  Currently, in a video display device that displays a 3D image having parallax between an image for the right eye and an image for the left eye on the display surface to view a stereoscopic image, only the image for the right eye is viewed from the 3D image. The image is viewed in combination with, for example, special glasses or other 3D image selection means for allowing only the left eye image of the 3D image to reach the left eye of the viewer.

  For example, in Patent Document 1, when a 3D image corresponding to the parallax division method is displayed as it is, an unnatural image in which two slightly shifted images are alternately displayed becomes an image for the right eye and the left eye. The stereo pair image which arrange | positions left and right is output.

  However, particularly in the case of a 3D image with a 3D image connecting the image in front of the display surface, when the image exists in the vicinity of the frame of the display surface, one of the 3D images of the image cannot be displayed and the 3D image breaks down. However, there is a problem that the range in which a 3D image can be displayed is limited with respect to the size of the display surface.

  That is, there is a request to deal with the problem that the 3D image of the 3D image on the display surface fails in a video display device that displays a 3D image, but means for realizing such a request is not known.

JP 2005-252459 A

It is an object of the present invention to provide a video display device and a video display method that can cope with a problem that a stereoscopic video of a 3D image on a display surface that displays a 3D image fails.

  In order to solve the above-described problem, the video display apparatus according to the embodiment includes a blank portion generation unit and a 3D image generation unit. The margin part generation means adds a margin part around the 3D image based on the input 3D image signal including the depth information for creating the 3D image. The 3D image generation means generates a 3D image that protrudes from the margin portion based on the 3D image signal including the depth information.

The figure for demonstrating the external appearance of the digital television broadcast receiver 111 to which this invention is applied, and the network system comprised centering on this digital television broadcast receiver 111. FIG. The figure which shows the main signal processing systems of the digital television broadcast receiver. FIG. 1 is a block configuration diagram illustrating a first example of a video display device according to an embodiment. The figure which shows the example of the effect of the same embodiment. The video display apparatus of embodiment The block block diagram which shows the 2nd Example. The video display apparatus of embodiment The block block diagram which shows the 3rd Example. The video display apparatus of embodiment The block block diagram which shows the 4th Example. The block block diagram used for the Example of the conventional video display apparatus. The figure which shows the subject of the conventional video display apparatus.

Embodiments of the present invention will be described below.
(First embodiment)
A first embodiment of the present invention will be described with reference to FIGS. 1 to 4, 8, and 9.
FIG. 1 schematically shows an appearance of a digital television broadcast receiving apparatus 111 to which the video display apparatus of the present invention is applied, and an example of a network system configured around the digital television broadcast receiving apparatus 111.

  That is, the digital television broadcast receiver 111 mainly includes a thin cabinet 112 and a support base 113 that supports the cabinet 112 upright. The cabinet 112 is provided with a flat panel type video display 114 such as a liquid crystal display panel, a speaker 115, an operation unit 116, a light receiving unit 118 that receives operation information transmitted from the remote controller 117, and the like. .

The digital television broadcast receiving apparatus 111 includes a LAN (Local Area Network) terminal 122.
The LAN terminal 122 is connected to a network 132 such as the Internet via a broadband router 131 connected to the hub 126, and is used for information transmission with the content server 133, the mobile phone 134, etc. via the network 132. used.

FIG. 2 shows a main signal processing system of the digital television broadcast receiving apparatus 111 described above.
That is, the satellite digital television broadcast signal received by the BS / CS digital broadcast receiving antenna 243 is supplied to the satellite digital broadcast tuner 245 a via the input terminal 244.

  The tuner 245a selects a broadcast signal of a desired channel based on a control signal from the control unit 261, and outputs the selected broadcast signal to a PSK (Phase Shift Keying) demodulator 245b.

  The PSK demodulator 245b demodulates the broadcast signal selected by the tuner 245a according to a control signal from the control unit 261, obtains a transport stream including a desired program, and outputs the transport stream to the TS decoder 245c.

  The TS decoder 245c is obtained by performing TS decoding processing on a signal multiplexed with a transport stream (TS) by a control signal from the control unit 261, and depacking a digital video signal and an audio signal of a desired program. A PES (Packetized Elementary Stream) is output to the STD buffer 247 f in the signal processing unit 247.

Also, the TS decoder 245c outputs the section information transmitted by digital broadcasting to the section processing unit 247h in the signal processing unit 247.
The terrestrial digital television broadcast signal received by the terrestrial broadcast receiving antenna 248 is supplied to the terrestrial digital broadcast tuner 250 a via the input terminal 249.

The tuner 250a selects a broadcast signal of a desired channel based on a control signal from the control unit 261, and outputs the selected broadcast signal to an OFDM (Orthogonal Frequency Division Multiplexing) demodulator 250b.

  The OFDM demodulator 250b demodulates the broadcast signal selected by the tuner 250a based on the control signal from the control unit 261, obtains a transport stream including a desired program, and outputs the transport stream to the TS decoder 250c.

  The TS decoder 250c is obtained by performing TS decoding processing on a signal multiplexed with a transport stream (TS) by a control signal from the control unit 261, and depacking a digital video signal and an audio signal of a desired program. A PES (Packetized Elementary Stream) is output to the STD buffer 247 f in the signal processing unit 247.

In addition, the TS decoder 250c outputs section information transmitted by digital broadcasting to the section processing unit 247h in the signal processing unit 247.
Here, the signal processing unit 247 selectively performs predetermined digital signal processing on the digital video signal and the audio signal respectively supplied from the TS decoder 245c and the TS decoder 250c when watching TV. The data is output to the graphic processing unit 254 and the audio processing unit 255. The signal processing unit 247 selects a content reproduction signal input from the control unit 261 during content reproduction, performs predetermined digital signal processing, and outputs the signal to the graphic processing unit 254 and the audio processing unit 255.

  The control unit 261 receives various data for acquiring a program, electronic program guide (EPG) information, program attribute information (program genre, etc.), subtitle information (service information, SI, PSI) from the signal processing unit 247. Have been entered.

The control unit 261 performs image generation processing to display EPG and subtitles from the input information, and outputs the generated image information to the graphic processing unit 254.
The section processing unit 247h includes various data for acquiring a program, electronic program guide (EPG) information, program attribute information (program genre, etc.), subtitles from the section information input from the TS decoder 245c (250c). Information or the like (service information, SI or PSI) is output to the control unit 261.

  The graphic processor 254 includes (1) a digital video signal supplied from the AV decoder 247g in the signal processor 247, (2) an OSD signal generated by the OSD (On Screen Display) signal generator 257, ( 3) A function of synthesizing image data obtained by data broadcasting and (4) the EPG and subtitle signal generated by the control unit 261 and outputting the synthesized result to the video processing unit 258.

  Further, when displaying a caption by caption broadcasting, the graphic processing unit 254 performs a process of superimposing the caption information on the video signal based on the caption information controlled by the control unit 261.

  The digital video signal output from the graphic processing unit 254 is supplied to the video processing unit 258. The video processing unit 258 converts the input digital video signal into an analog video signal in a format that can be displayed on the video display 114, and then outputs the analog video signal to the video display 114 to display the video. 259 to the outside.

  The audio processing unit 255 converts the input digital audio signal into an analog audio signal in a format that can be reproduced by the speaker 115, and then outputs the analog audio signal to the speaker 115 for audio reproduction. Through the outside.

  Here, in the digital television broadcast receiving apparatus 111, all operations including the above-described various receiving operations are comprehensively controlled by the control unit 261. The control unit 261 includes a CPU (Central Processing Unit) or the like, receives operation information from the operation unit 116, or receives operation information sent from the remote controller 117 via the light receiving unit 118. Each part is received and controlled so that the operation content is reflected.

  In this case, the control unit 261 mainly includes a ROM (Read Only Memory) 261a that stores a control program executed by the CPU, a RAM (Random Access Memory) 261b that provides a work area for the CPU, and various setting information. And a non-volatile memory 261c in which control information and the like are stored.

  Further, the control unit 261 is connected to the LAN terminal 122 via the communication I / F 270. Accordingly, the control unit 261 can transmit information to each device (see FIG. 1) connected to the LAN terminal 122 via the communication I / F 270.

  Here, the configuration of a conventional video display device will be described. As shown in FIG. 8, the image display unit 102 includes a 3D image generation unit 101 that generates a 3D image in accordance with the display method of the image display unit, and the image display unit 102. The video display unit 102 displays the output of the 3D image generation unit 101. Of the displayed 3D images, only the right-eye image is allowed to reach the viewer's right eye, and only the left-eye image among the 3D images is viewed in combination with 3D image selection means for reaching the viewer's left eye. As this 3D image selection means, for example, glasses can be used, and circularly polarized glasses that transmit circularly polarized light in different rotation directions for the right eye and the left eye, and for the right eye and the left eye can be used. Alternately, liquid crystal shutter glasses that change between a transmissive state and a non-transmissive state are used. The 3D image generation unit 101 generates a 3D image corresponding to the video display unit 102 combined with the 3D image selection unit. In the above example, the 3D images for the right eye and the left eye are arranged in line with the circularly polarized sheets arranged on the front surface of the display unit. In the case of the liquid crystal shutter system, the shutter is synchronized with the display. It is necessary to output a signal for this synchronization from the TV.

  Next, problems with the conventional video display device will be described. As shown in FIG. 9, in the conventional video display device, one of the 3D images of the image is displayed particularly when the image is present in the vicinity of the display frame in the 3D image formed by connecting the image to the front surface from the display surface. There is a problem in that the range in which a 3D image can be displayed is limited with respect to the size of the display surface because the 3D effect is lost because the image is not fit within the frame and is lost. In particular, in an image in which the screen pans left and right, the stereoscopically viewed image suddenly loses the stereoscopic effect at the edge of the screen, which not only affects stereoscopic viewing but also affects eye fatigue.

  Therefore, in the present embodiment, a 3D image can be displayed outside the image frame by setting an image frame smaller than the display surface and generating a 3D image. A video display device that improves the limitation will be described below.

  A first configuration of the video display apparatus according to the embodiment will be described. As shown in FIG. 3, a scaling unit 201 that converts an input 3D image signal to a desired size, a margin part generation unit 202 that adds a margin part around the size-converted image signal, and the margin part generation unit 3D image generation means 203 for generating a 3D image from the output of the image and a video display unit 204 for displaying the generated 3D image. The input 3D image signal includes a 2D image signal and a parallax signal. The scaling unit 201, the margin generation unit 202, and the 3D image generation unit 203 correspond to the video processing unit 258 that operates under the control of the control unit 261 in FIG. The video display unit 204 corresponds to the video display 114.

  Next, the operation of the configuration of FIG. 3 will be described with reference to FIG. First, the data is input to the scaling means 201, and is scaled to a size in which blanks are left and right from the display surface size by the maximum parallax interval created on the display surface (the state from FIG. 4A to FIG. 4B). ). It is also necessary to reduce the parallax for this scaling. Thereafter, the margin part generation unit 202 adds a margin part to the periphery of the size-converted image signal to create an image having the same size as the display surface size (transition to the state shown in FIG. 4C). The output of the margin part generation unit is input to the 3D image generation unit 203, and the margin part is an area without parallax, and a 3D image is generated in accordance with the display method of the video display unit based on the depth information included in the 3D image signal. (Transition to the state of FIG. 4D). The created 3D image is displayed on the video display unit 204. At this time, it is assumed that the image scaling size, the size of the margin, and the display content can be arbitrarily set.

  If there is a possibility that one side of the 3D image is missing at the edge of the screen in the stereoscopic 3D image for the input 3D image signal, the image frame is narrowed with respect to the display surface in advance. Can be generated, and the stereoscopic effect is not impaired. This solves the problem of limiting the range in which 3D images can be displayed with respect to the size of the display surface, which is a problem of the conventional configuration described above.

(Second Embodiment)
Next, a second embodiment according to the present invention will be described with reference to FIGS. 1 to 2 and FIG. Description of the parts common to the first embodiment is omitted.
A second configuration of the video display apparatus according to the embodiment of FIG. 5 will be described. As shown in FIG. 5, a scaling unit 301 that converts an input 2D image signal into a desired size, a margin part generation unit 302 that adds a margin part around the size-converted image signal, and the margin part generation unit 2D / 3D image conversion means 303 for generating a 3D image signal from the output 2D image signal, 3D image generation means 304 for generating a 3D image in accordance with the display method of the video display unit from the generated 3D image, and the creation The video display unit 305 displays the 3D image.

  Next, the operation of the configuration of FIG. 5 will be described. As with the first configuration, scaling and margins are added to the input 2D image signal. The output of the margin generation unit is input to the 2D / 3D image conversion unit 303, and a 3D image signal for stereoscopic viewing is generated. For example, there is a method of calculating depth information by pattern matching from image motion information or image features. At this time, the margin is calculated as a region without parallax. The generated 3D image signal is input to the 3D image generation unit 304, and based on the depth information included in the 3D image signal, a 3D image corresponding to the video display unit combined with the 3D image selection unit as described above is generated. . The created 3D image is displayed on the video display unit 305. At this time, it is assumed that the image scaling size, the size of the margin, and the display content can be arbitrarily set. With this configuration, even in the configuration including the 2D / 3D image conversion means, the same effect as the first configuration of the proposed video display apparatus can be obtained.

(Third embodiment)
Next, a third embodiment according to the present invention will be described with reference to FIGS. 1 to 2 and FIG. Description of parts common to the first and second embodiments is omitted.
A third configuration of the video display apparatus according to the embodiment of FIG. 6 will be described. As shown in FIG. 6, a scaling unit 401 that converts an input 3D image signal to a desired size, a margin generation unit 402 that adds a margin around the size-converted image signal, and the margin generation unit 3D image generation means 403 for generating a 3D image from the output of the above, and a high-resolution video display unit video display unit 404 that displays the generated 3D image and has a higher resolution than the input image.

  Next, the operation of the configuration of FIG. 6 will be described. The high-resolution video display unit 404 is different from the first configuration of the proposed video display device. When the resolution of the input image and the resolution of the video display unit are the same, it is necessary to reduce the image by the scaling means 401 in order to add a margin, but by displaying it on the high-resolution video display unit 404, The problem that the 3D image display range is limited with respect to the size of the display surface is solved, and further, there is no resolution deterioration due to reduction scaling, and a finer image can be viewed.

(Fourth embodiment)
Next, a fourth embodiment of the present invention will be described with reference to FIGS. 1 to 2 and FIG. Description of parts common to the first to third embodiments is omitted.
The 4th structure of the video display apparatus of embodiment of FIG. 7 is demonstrated. As shown in FIG. 7, a scaling unit 501 that converts an input 2D image signal to a desired size, a margin part generation unit 502 that adds a margin part around the size-converted image signal, and the margin part generation unit 2D / 3D image conversion means 503 for generating a 3D image signal from the output 2D image signal, 3D image generation means 504 for generating a 3D image in accordance with the display method of the video display unit from the generated 3D image, and the creation The high-resolution video display unit video display unit 505 displays the 3D image that is displayed and has a higher resolution than the input image. Similar to the difference between the first configuration and the third configuration, the operation solves the problem that the range in which 3D images can be displayed is limited with respect to the second configuration, and there is no resolution degradation due to reduction scaling. You can enjoy more detailed images.

As a modification of the first to fourth embodiments described above, the image size set by the scaling means and the content of the image added as a margin can be arbitrarily set.
In a video display device that displays a 3D image having a parallax between an image for the right eye and an image for the left eye on a display surface to view a stereoscopic image, only the image for the right eye among the 3D images reaches the viewer's right eye In addition, stereoscopic viewing can be performed by combining with 3D image selection means that allows only the left eye image of the 3D image to reach the left eye of the viewer. However, in a conventional video display device, when a 3D image is formed by a 3D image that connects an image in front of the display surface, and the image exists near the frame of the display surface, one of the 3D images of the image cannot be displayed and the 3D image cannot be displayed. Since the video is broken, there is a problem that a range in which a 3D image can be displayed is limited with respect to the size of the display surface.

  Therefore, in this embodiment, a 3D image is displayed in a 3D image by setting an image frame in a size smaller than the display surface and enabling a 3D image to be displayed outside the image frame when generating a 3D image in the following manner. It is possible to improve the limit of the range that can be achieved. Furthermore, by combining a high-resolution video display unit with a resolution higher than that of the input image, it is possible to view higher-definition video without deterioration due to image size change.

(1) A scaling unit that converts an input 3D image into a desired size, a blank part generation unit that adds a blank part around the size-converted image, and an output of the blank part generation unit. A video display device comprising: 3D image generation means for generating a 3D image in accordance with a display method of the video display unit, and a video display unit for displaying the created 3D image.

(2) The video display device according to (1), wherein the input 3D image is an image composed of a 2D image and depth information.
(3) A scaling unit that converts an input 2D image into a desired size, a margin generation unit that adds a margin part around the size-converted image, and an output from the margin generation unit, the margin is a parallax 2D / 3D image conversion means for creating a 3D image signal as an area having no image, 3D image generation means for generating a 3D image from the created 3D image signal in accordance with the display method of the video display unit, and the created A video display device comprising a video display unit for displaying a 3D image.

(4) A scaling unit that converts an input 3D image into a desired size, a blank part generation unit that adds a blank part around the size-converted image, and an output of the blank part generation unit, the blank part is parallax. A 3D image generating means for generating a 3D image in accordance with the display method of the video display unit, and a high-resolution video display unit for displaying the created 3D image and having a higher resolution than the input image signal. A characteristic video display device.

(5) A scaling unit that converts an input 2D image into a desired size, a blank part generation unit that adds a blank part around the size-converted image, and an output from the blank part generation unit. 2D / 3D image conversion means for creating a 3D image signal as an area having no image, 3D image generation means for generating a 3D image from the created 3D image signal in accordance with the display method of the video display unit, and the created An image display device comprising a high-resolution image display unit that displays a 3D image and has a higher resolution than an input image signal.

  In addition, this invention is not limited to the said embodiment, In the range which does not deviate from the summary, it can implement in various modifications. For example, if there is an area where a video is not displayed on the left and right of the screen (black belt, frame) if it is 2D in the form of a pan without adding a margin, if the area is 3D without reducing the screen, A configuration may be adopted in which one of the missing 3D image signals (for the right eye or for the left eye) is displayed.

  Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements according to different embodiments may be appropriately combined.

  DESCRIPTION OF SYMBOLS 111 ... Digital television broadcast receiver, 112 ... Cabinet, 113 ... Support stand, 114 ... Video display, 115 ... Speaker, 116 ... Operation part, 117 ... Remote controller, 118 ... Light receiving part, 119 ... First memory card 120 ... second memory card 121 ... first LAN terminal 122 ... second LAN terminal 123 ... USB terminal 124 ... i. LINK terminal, 125, 127, 139 HDD, 126, 135 hub, 128, 133 content server, 129 DVD recorder, 130 analog transmission path, 131 broadband router, 132 network, 134, 136 mobile phone DESCRIPTION OF SYMBOLS 137 ... Digital camera, 138 ... Card reader / writer, 140 ... Keyboard, 141 ... AV-HDD, 142 ... D-VHS, 201 ... 3D image generation means, 202 ... 2D image extraction means, 203 ... Scaling means, 204 ... Scaling means, 205 ... image mixing means, 206 ... video display section, 301 ... 2D / 3D image conversion means, 302 ... 3D image generation means, 303 ... scaling means, 304 ... scaling means, 305 ... image mixing means, 306 ... video Display unit 401... Image selection means 4 2 ... 3D image generation means, 403 ... scaling means, 404 ... scaling means, 405 ... image mixing means, 406 ... video display unit, 501 ... 3D image generation means, 502 ... 2D image extraction means, 503 ... scaling means, 504 ... Scaling means, 505... Image mixing means, 506.

Claims (9)

Margin part generating means for adding a margin part around the 3D image based on the input 3D image signal including depth information for creating a 3D image;
A video display device comprising: 3D image generation means for generating a 3D image that protrudes from the margin portion based on the 3D image signal including the depth information.   The 2D / 3D image conversion means for converting the input 2D image signal into the 3D image signal including the depth information, and the margin generation means inputs the converted 3D image signal. The video display device described. Margin part generating means for adding a margin part around the input 2D image signal;
2D / 3D image conversion means for converting the output of the margin part generation means into a 3D image signal including depth information for creating a 3D image;
A video display device comprising: 3D image generation means for generating a 3D image that protrudes from the margin portion based on the 3D image signal including the depth information.   The video display device according to any one of claims 1 to 3, further comprising a video display unit that displays the generated 3D image.   The video display device according to claim 4, wherein the video display unit has a higher resolution than the input 2D image signal or the input 3D image signal. Adding a margin part around a 3D image signal input including depth information for creating a 3D image;
Generating a 3D image that protrudes from the margin based on the 3D image signal including the depth information. Based on a 3D image signal that is input including depth information for creating a 3D image, a 3D image that protrudes outside the display area when the 3D image signal is displayed in 2D without using the depth information is generated. 3D image generation means for
And a display means for displaying the generated 3D image including the protrusion. 2D / 3D image conversion means for converting an input 2D image signal into a 3D image signal including depth information for creating a 3D image;
3D image generation means for generating a 3D image that protrudes outside a display area when the 3D image signal is displayed in 2D based on the converted 3D image signal;
And a display means for displaying the generated 3D image including the protrusion. Area adding means for adding an area around the 3D image based on the input 3D image signal including the depth information for creating the 3D image;
And a 3D image generation unit configured to generate a 3D image protruding from the region based on the 3D image signal including the depth information.

Images