WO2011118216A1 - 映像処理装置 - Google Patents
映像処理装置 Download PDFInfo
- Publication number
- WO2011118216A1 WO2011118216A1 PCT/JP2011/001729 JP2011001729W WO2011118216A1 WO 2011118216 A1 WO2011118216 A1 WO 2011118216A1 JP 2011001729 W JP2011001729 W JP 2011001729W WO 2011118216 A1 WO2011118216 A1 WO 2011118216A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- information
- image
- stereoscopic
- eye
- Prior art date
Links
- 238000000034 method Methods 0.000 claims description 35
- 230000005540 biological transmission Effects 0.000 claims description 27
- 238000001514 detection method Methods 0.000 claims 1
- 239000000872 buffer Substances 0.000 description 20
- 238000004891 communication Methods 0.000 description 17
- 230000006835 compression Effects 0.000 description 17
- 238000007906 compression Methods 0.000 description 17
- 230000003287 optical effect Effects 0.000 description 16
- 239000011521 glass Substances 0.000 description 12
- 230000001419 dependent effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000002457 bidirectional effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000000593 degrading effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/178—Metadata, e.g. disparity information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
Definitions
- the present invention relates to a video processing apparatus that outputs stereoscopic video information that enables stereoscopic viewing.
- Patent Document 1 discloses a device that displays a stereoscopic image and can freely switch between a two-dimensional image display mode and a three-dimensional image display mode.
- a main buffer and an overlay buffer are provided in the apparatus, and the buffers are switched according to the display mode.
- the apparatus can easily switch the display mode.
- the display device uses video information (hereinafter referred to as “stereoscopic video information”) including a left-eye video presented to a human left eye and a right-eye video presented to the right eye.
- the display device controls the display so that the left eye image is visually recognized by the viewer's left eye and the right eye image is visually recognized by the viewer's right eye.
- the display device can provide the viewer with a 3D image.
- the display device selects either the left eye image or the right eye image included in the stereoscopic image information and displays only the selected image. Accordingly, the display device can provide a two-dimensional image to the viewer.
- 3D images are displayed using the parallax between the left and right eyes when a person views with both eyes.
- the left-eye video and the right-eye video have a difference depending on the parallax, but generally the images are usually very similar.
- MVC multi-view video coding
- base view one of the left-eye video and the right-eye video
- base view the other video
- dependent view not only the frames before and after the video frame to be encoded are referenced, but also the same in the base view (for example, left-eye video).
- Encoding is also performed with reference to a temporal video frame. Such encoding increases the encoding efficiency of the dependent view.
- the dependent view has a higher compression rate (that is, a lower bit rate) than the base view, but if decoded, the image quality may be lower than that of the base view.
- the stereoscopic video processing apparatus 1000 acquires and decodes the compressed and encoded stereoscopic video information (stereoscopic video encoding information).
- the video processing apparatus 1000 transmits the decoded stereoscopic video information to the video display apparatus 2000.
- the video display device 2000 displays the received stereoscopic video information.
- the video display device 2000 selects and displays either the left-eye video or the right-eye video included in the stereoscopic video information. There is a need to.
- the stereoscopic video display device 2000 cannot determine which of the left-eye video and the right-eye video received from the stereoscopic video processing device 1000 is a video with a low compression rate (base view). For this reason, there is a problem that the stereoscopic video processing apparatus 1000 erroneously displays a video that is a dependent view, that is, a video that may have low image quality.
- the present invention has been made to solve the above-described problem, and displays a stereoscopic video so that a stereoscopic video display device can display a two-dimensional video based on the three-dimensional video information without degrading the image quality. It is an object of the present invention to provide a stereoscopic video processing apparatus that provides video information to the apparatus.
- the video processing apparatus is a video processing apparatus that includes a first eye video and a second eye video on a video display device and can output stereoscopic video information that enables stereoscopic viewing.
- the video processing apparatus includes: an acquisition unit that acquires stereoscopic video information encoded using encoding methods that encode the first eye video and the second eye video at different bit rates; and a decoding that decodes the stereoscopic video information.
- transmission means for transmitting identification information indicating a video having a higher encoding bit rate of the first eye video and the second eye video to the video display device in a state associated with the decoded stereoscopic video information. And comprising.
- the video processing device can inform the video display device which of the first eye video and the second eye video is the higher quality video in a simpler manner. it can.
- the video display device can select a video with the better image quality of the first eye video and the second eye video, and the video display device displays the selected video two-dimensionally to the viewer.
- FIG. 1 Illustration for explaining the problem
- FIG. 1 Illustration for explaining the problem
- FIG. 1 The figure for demonstrating the outline of the compression encoding technique of stereo image information Diagram showing an example of a stereoscopic video stream
- the figure which shows the structural example of a three-dimensional video system The figure which shows the structural example of a three-dimensional video processing apparatus.
- the figure for demonstrating the example at the time of superimposing a caption image and a processing-device image on stereoscopic video data The figure for demonstrating the example at the time of superimposing a caption image and a processing-device image on stereoscopic video data
- the figure for demonstrating the display method of a three-dimensional image The figure for demonstrating the display method of a three-dimensional image
- the figure which shows the operation example of a three-dimensional image display The figure which shows the operation example of a three-dimensional image display
- the figure which shows the operation example of a two-dimensional image display The figure which shows the operation example of a two-dimensional image display
- region of the subtitles and processing apparatus image which are contained in a display image The figure which showed the format at the time of transmitting parallax information with the information about the field where an object is displayed
- the stereoscopic video processing apparatus described in the present embodiment acquires stereoscopic video encoded information, which is information generated by encoding stereoscopic video information, and converts it into a format that can be displayed on the stereoscopic video display apparatus. That is, the stereoscopic video processing apparatus acquires and decodes stereoscopic video encoding information.
- the stereoscopic video processing device associates the decoded stereoscopic video information with identification information indicating which of the left-eye video and the right-eye video is a video with a high average bit rate for encoding, and associates it with the stereoscopic video display device. Send.
- the 3D video display device When displaying a 2D video based on the 3D video information received from the 3D video processing device, the 3D video display device generates and displays a 2D video (left eye video or right eye video) based on the identification information.
- a 2D video left eye video or right eye video
- these processes will be described in detail.
- video content to be played back video content compression technology, video content multiplexing technology, configuration and operation of a stereoscopic video display system, and other embodiments will be described in this order.
- Video content targeted in the present embodiment includes stereoscopic video information, audio information, and data information.
- the stereoscopic video information includes left eye video data and right eye video data.
- Each of the objects included in the left eye video data and the right eye video data has parallax. The presence of this parallax allows the viewer to perceive a 3D video by controlling the video display so that the viewer can view the left eye video with the left eye and the right eye video with the right eye. it can.
- Audio information is audio information that can be output in synchronization with the stereoscopic video information (video stream).
- Data information includes subtitle data and sub-picture data.
- the sub-picture data is, for example, a privilege picture such as a bonus view or a graphics menu.
- disparity information is added to subtitle data and sub-video data in order to provide a 3D video.
- the disparity information added to the caption data is referred to as “caption disparity information”, and the disparity information added to the sub-picture data is referred to as “sub-picture disparity information”.
- caption disparity information When a caption is presented as a stereoscopic video, the caption data is superimposed on the left-eye video data and the right-eye video data using the caption parallax information. As a result, subtitles as stereoscopic images can be presented to the viewer.
- the caption parallax information corresponds to the shift amount of the display position of the caption in the horizontal direction when the caption is displayed on the display.
- the disparity information corresponding to the shift amount may be expressed by the number of pixels or may be expressed in mm.
- the amount of shift indicated by the parallax information corresponds to the display position in the depth direction of the screen when the image is displayed in 3D.
- the stereoscopic video information is compressed and encoded.
- one video for example, right-eye video
- the left-eye video constituting the stereoscopic video is converted to the other video (for example, left
- the image is compressed at a higher compression rate (lower average bit rate) than that of the eye image.
- a video having a lower compression rate is referred to as a “first eye video”
- a video having a higher compression rate is referred to as a “second eye video”. Specific examples are shown below.
- the above-described compression can be realized for stereoscopic video information by multi-view video coding (MVC).
- MVC is a technique for integrating and encoding a plurality of videos.
- the first eye video (here, the left eye video) data is encoded by performing inter-frame prediction using only the first eye video data.
- the second eye video (here, right eye video) data is encoded by performing inter-frame prediction using not only the second eye video data but also the first eye video data. That is, the first eye video (left eye video) data is composed of a P frame for performing forward prediction, a B frame for performing bidirectional prediction, and an I frame for encoding within the frame.
- the second-eye video (right-eye video) data does not have an I frame for encoding within the frame, and is configured only by a P frame for performing forward prediction and a B frame for performing bidirectional prediction.
- an image encoded using only the image data as in the first eye image is referred to as a “base view”, and as in the second eye image, the image of its own is used.
- a video encoded using not only video data but also other video data is referred to as a “Dependent View”.
- the second eye image that does not have an I frame and can be inter-frame predicted from the first eye image can be reduced in average bit rate compared to the first eye image, Highly efficient compression is possible.
- MPEG4-AVC / H. H.264 may be used for compression coding.
- compression techniques for audio information and data information are not mentioned, various known techniques can be applied to these.
- Video Content Multiplexing Technology A multiplexing technology for associating and transferring compression-coded stereoscopic video information, audio information, and data information will be described.
- 3D video information, audio information, and data information are multiplexed.
- Various specific multiplexing techniques are conceivable.
- PS program stream
- TS transport stream
- a stream generated by multiplexing stereoscopic video information, audio information, and data information is referred to as a stereoscopic video stream.
- FIG. 3 shows the configuration of the stereoscopic video stream. As shown in the figure, the stereoscopic video stream is composed of encoded data 31 and header information 33.
- Part of the header information 33 includes information (hereinafter referred to as “base view information”) indicating whether the base view of the stereoscopic video information is a right-eye video or a left-eye video.
- base view information indicating whether the base view of the stereoscopic video information is a right-eye video or a left-eye video.
- base view information indicating that the left eye video is the base view is added to the header information 33.
- the base view information is used when decoding the stereoscopic video information.
- a part of the header information 33 includes subtitle parallax information and sub-picture parallax information.
- FIG. 4 shows the configuration of the stereoscopic video display system of this embodiment.
- the stereoscopic video display system includes a stereoscopic video processing device 1 and a stereoscopic video display device 2.
- the outline of the stereoscopic video display system will be described first, and the configurations of the stereoscopic video processing device 1 and the stereoscopic video display device 2 will be described later.
- the stereoscopic video processing device 1 is connected to a stereoscopic video display device 2 that displays a stereoscopic video, a server 3 in which a stereoscopic video stream is stored, and an antenna 5.
- a stereoscopic video processing device 1 acquires a stereoscopic video stream from the server 3, the optical disk 4, the antenna 5, or the memory card 6.
- the server 3 is a network server in which stereoscopic video streams are accumulated.
- the server 3 is connected to a network, and can be connected to the stereoscopic video processing apparatus 1 placed in the home via the network.
- the server 3 can transmit a stereoscopic video stream to the stereoscopic video processing device 1 (network communication interface 13) in response to an access request from the stereoscopic video processing device 1.
- the optical disc 4 is a recording medium on which a stereoscopic video stream is recorded.
- the optical disk 4 can be inserted into the disk drive 11 of the stereoscopic video processing apparatus 1.
- the stereoscopic video processing apparatus 1 (disk drive 11) can read a stereoscopic video stream recorded on the optical disk 4.
- the antenna 5 is an antenna for receiving a broadcast wave including a stereoscopic video stream broadcast from a broadcasting device of a broadcasting station.
- the antenna 5 transmits a broadcast wave including the received stereoscopic video stream to the stereoscopic video processing device 1 (tuner 12).
- the memory card 6 is a semiconductor memory card in which a stereoscopic video stream is recorded, or a recording medium having a semiconductor memory inside.
- the memory card 6 can be inserted into the stereoscopic video processing apparatus 1 (data transmission interface 15). Note that the stereoscopic video processing apparatus 1 (data transmission interface 15) can read the stereoscopic video stream recorded on the memory card 6.
- the stereoscopic image processing apparatus 1 includes a disk drive 11, a tuner 12, a network communication interface 13, a memory device interface 14, a data transmission interface 15, a buffer memory (frame memory) 16, an HD drive 17, a flash memory 19, and an LSI 18.
- the disk drive 11 includes an optical pickup and reads a stereoscopic video stream from the optical disk 4.
- the disk drive 11 is connected to the LSI 18 and transmits a stereoscopic video stream read from the optical disk 4 to the LSI 18.
- the disc drive 11 reads a stereoscopic video stream from the optical disc 4 and transmits it to the LSI 18 in accordance with the control from the LSI 18.
- the tuner 12 acquires a broadcast wave including a stereoscopic video stream received by the antenna 5.
- the tuner 12 extracts a stereoscopic video stream having a frequency specified by the LSI 18 from the acquired broadcast wave.
- the tuner 12 is connected to the LSI 18 and transmits the extracted stereoscopic video stream to the LSI 18.
- the network communication interface 13 performs control for connecting to the network.
- the stereoscopic video processing device 1 can be connected to the server 3 via the network communication interface 13 and the network.
- the network communication interface 13 acquires the stereoscopic video stream transmitted from the server 3.
- the memory device interface 14 is an interface for mounting the memory card 6 and can receive a stereoscopic video stream from the mounted memory card 6.
- the memory device interface 14 transmits the stereoscopic video stream read from the memory card 6 to the LSI 18.
- the HD drive 17 incorporates a recording medium such as a hard disk, and transmits data read from the recording medium to the LSI 18.
- the HD drive 17 records the data received from the LSI 18 on a recording medium.
- the data transmission interface 15 is an interface for transmitting data transmitted from the LSI 18 to the external stereoscopic video display device 2.
- the data transmission interface 15 is configured to be able to transmit and receive data signals and control signals to and from the stereoscopic video display device 2.
- the LSI 18 can control the stereoscopic video display device 2 via the data transmission interface 15.
- the data transmission interface 15 implements communication in conformity with, for example, HDMI (High-Definition Multimedia Interface).
- the data transmission interface 15 is connected to the stereoscopic video display device 2 via an HDMI cable.
- the HDMI cable includes a data line and a control line.
- the data transmission interface 15 may have any configuration as long as it can transmit a data signal to the stereoscopic video display device 2.
- the buffer memory 16 functions as a work memory for processing of the LSI 18.
- the buffer memory 16 can be realized by, for example, a DRAM or an SRAM.
- the flash memory 19 stores device image data of the stereoscopic video processing device 1 in advance.
- the device image is, for example, an image including an image indicating channel information and volume information, information for adjusting display brightness, contrast amount, color temperature, and the like, and information for adjusting the image quality of the playback device.
- the LSI 18 can display the device image read from the flash memory 19 on the stereoscopic video display device 2 by superimposing it on the video data. As a result, the LSI 18 can present the information of the stereoscopic video processing device 1 to the viewer.
- the LSI 18 controls to display a setting screen.
- the LSI 18 can also accept settings from the viewer on the setting screen.
- the LSI 18 is a system controller that controls each part of the stereoscopic image processing apparatus 1 and can be realized by a microcomputer or a hard-wired circuit.
- the LSI 18 is mounted with a CPU 181, a stream controller 182, a decoder 183, an AV input / output circuit 184, a system bus 185, and a memory controller 186.
- the CPU 181 controls the entire LSI 18. Each part of the LSI 18 is configured to perform various controls based on the control from the LSI 18.
- the CPU 181 also controls communication with the outside. For example, when acquiring a stereoscopic video stream from the server 3 or the like, the CPU 181 transmits a control signal to the disk drive 11, the tuner 12, the network communication interface 13, and the memory device interface 14. As a result, the disk drive 11, the tuner 12, the network communication interface 13, and the memory device interface 14 can acquire a stereoscopic video stream from a recording medium, a broadcasting station, or the like.
- the stream controller 182 controls transmission / reception of data among the server 3, the optical disc 4, the antenna 5, the memory card 6, and active shutter glasses (described later).
- the CPU 181 transmits the stereoscopic video stream acquired from the server 3 to the memory controller 186.
- the memory controller 186 writes the data transmitted from each part of the LSI 18 into the buffer memory 16. For example, the memory controller 186 records the stereoscopic video stream acquired from the stream controller 182 in the buffer memory 16. The memory controller 186 reads data recorded in the buffer memory 16 from the buffer memory 16. Then, the buffer memory 16 transmits the read data to each part of the LSI 18.
- the decoder 183 When the decoder 183 acquires data from the memory controller 186, the decoder 183 decodes the acquired data.
- the data input to the decoder 183 is based on the control of the CPU 181.
- the CPU 181 controls the memory controller 186 to read the stereoscopic video stream recorded in the buffer memory 16.
- the CPU 181 controls the memory controller 186 to transmit the read stereoscopic video stream to the decoder 183.
- the stereoscopic video stream is input from the memory controller 186 to the decoder 183.
- the decoder 183 converts the input stereoscopic video stream into encoded data 31 (compression encoded stereoscopic video information, compression encoded audio information, and compression encoded data information).
- the header information 33 is separated. Then, the decoder 183 records the header information 33 in the buffer memory 16.
- the decoder 183 decodes the compressed data 31 based on the decode information included in the header information 33.
- the decoder 183 transmits the decoded information (stereoscopic video information, audio information, and data information) to the memory controller 186.
- the memory controller 186 records the information received from the decoder 183 in the buffer memory 16.
- the AV input / output circuit 184 reads the decoded data 31 and header information 33 information from the buffer memory 16 and generates output data to be displayed on the stereoscopic video display device 2 based on them. Then, the AV input / output circuit 184 transmits the generated output data to the stereoscopic video display device 2 via the data transmission interface 15. At that time, the stream controller 182 and the decoder 183 analyze the header information 33 to obtain base view information.
- the AV input / output circuit 184 includes the base view information in the output data as identification information indicating which one of the left-eye video and the right-eye video has a higher average bit rate. In this embodiment, the base view information is used as the identification information.
- the identification information may be information indicating a video with a higher average bit rate of encoding between the left-eye video and the right-eye video. It is not limited to view information.
- the AV input / output circuit 184 may generate identification information by analyzing a stereoscopic video stream and determining a video with a higher average bit rate of encoding between a left-eye video and a right-eye video. . The identification information is included for each frame in the output data.
- the AV input / output circuit 184 generates output data as shown in FIG.
- the AV input / output circuit 184 performs two steps to generate output data.
- the first step is display image generation processing
- the second step is output data generation processing.
- each processing will be described.
- the display image generation processing is processing for processing stereoscopic video information (left-eye video or right-eye video) in accordance with an instruction from the viewer. Specifically, this processing is performed when a display instruction for subtitles, a display instruction for sub-pictures, or a display instruction for a device image of the stereoscopic video processing device 1 (hereinafter referred to as “processing device image”) is received from the viewer. I do.
- processing device image a display instruction for subtitles, a display instruction for sub-pictures, or a display instruction for a device image of the stereoscopic video processing device 1
- I do Note that the viewer can instruct the stereoscopic video processing apparatus 1 using the remote controller.
- An instruction from the remote control can be received by an infrared sensor provided in the stereoscopic video processing apparatus 1. An example of specific processing will be described below.
- the AV input / output circuit 184 When the stereoscopic video processing apparatus 1 receives an instruction to display the caption video from the viewer, the AV input / output circuit 184 superimposes the caption video on the stereoscopic video data. More specifically, the AV input / output circuit 184 acquires the header information 33 from the buffer memory 16, and superimposes the caption video on the left-eye video or the right-eye video based on the parallax information of the caption video. For example, as illustrated in FIG. 6, when the parallax information (deviation amount) of the caption video is Y pixels, the AV input / output circuit 184 shifts the caption video 51 to the right by Y pixels with respect to the left-eye video 50a. The subtitle video 51 is shifted to the left by Y pixels and superimposed on the right eye video 50b. The same applies to the sub-picture 53 added to the three-dimensional pictures 50a and 50b.
- the AV input / output circuit 184 receives a processing device image corresponding to the instruction from the flash memory 19 (for example, a stereoscopic video processing device). Function menu image 1) data is acquired. Then, the AV input / output circuit 184 acquires parallax information of the caption video from the buffer memory 16. The AV input / output circuit 184 determines the parallax information of the processing device image based on the acquired parallax information of the caption video.
- the AV input / output circuit 184 displays parallax information (for example, Z pixels) so that the processing device image is displayed in front (viewer side) in the depth direction of the screen from the caption video in the stereoscopic display. decide. That is, the parallax information is determined so that the parallax of the device image is larger than the parallax of the caption video. For example, in the stereoscopic display as shown in FIG. 7, in the situation where the object 110 and the caption 51 based on the stereoscopic video are displayed on the viewer 200 side from the screen 30 of the stereoscopic video display device 2, The disparity information of the processing device image 55 is determined so that the processing device image 55 is displayed on the person side.
- parallax information for example, Z pixels
- the three-dimensional object 110 is the object displayed on the viewer 200 most of the objects displayed on the three-dimensional image, and the caption 51 is displayed on the viewer 200 side than the object 110. It is said.
- the viewer can visually recognize the processing device image 55 without a sense of incongruity.
- the AV input / output circuit 184 superimposes the processing device images based on the parallax information determined as described above.
- the processing device image 55 when the disparity information (deviation amount) of the processing device image 55 is Z pixels, the processing device image 55 is superimposed on the left eye image 50a while being shifted to the right by Z pixels. The processing device image 55 is shifted to the left of the Z pixel and superimposed on the eye image 50b.
- the AV input / output circuit 184 generates video data indicating the left eye video 50a and the right eye video 50b in which the processing device images 55 are overlapped in this way.
- the AV input / output circuit 184 generates output data as shown in FIG. As shown in FIG. 8, the output data is J ⁇ K pixel data including an invalid section (blanking area) and an effective section (active area) of the video.
- the active area includes the display image generated by the display image generation process.
- a data transmission interface such as HDMI, audio data, video format information, reserved information, and the like are included in a packet and transmitted in a blanking area.
- the audio data includes audio information corresponding to the video included in the active area.
- the video format information includes information such as resolution and aspect ratio of the screen.
- the reserved information includes identification information indicating a video having a higher average bit rate of encoding between the left eye video and the right eye video. In the present embodiment, base view information is used as the identification information.
- the reserved information further includes the maximum parallax information of the display image generated by the display image generation process. For example, when the processing device image is superimposed by the above-described display image generation process, the parallax information Z is given. A method for calculating the maximum parallax information will be described later.
- the identification information is information indicating a video with a higher average bit rate of encoding between the left eye video and the right eye video.
- the identification information is not limited to this, and may be information indicating which video includes the I frame at the time of encoding. Therefore, in the case of a video encoded with MVC, the decoder may detect whether the frame including the I frame is a left-eye video or a right-eye video, and generate identification information based on the detected information.
- the reserved information includes identification information indicating a video with a higher average bit rate of encoding between the left eye video and the right eye video for each frame.
- the present invention is not limited to this, and it may be included every n frames (n> 1).
- the identification information may be included in the reserved information at the timing when the base view changes from the left eye video to the right eye video (or vice versa).
- the AV input / output circuit 184 outputs the data generated by the above two processes to the stereoscopic video display device 2 via the data transmission interface 15.
- Extraction information is as follows.
- parallax information is adjusted so that the device image of the stereoscopic video processing device 1 is displayed on the viewer side with respect to the caption data.
- the maximum parallax information is Z. Even if the parallax information X is larger than Z, the maximum parallax information is Z because the sub-video is not superimposed on the stereoscopic video information.
- the maximum parallax information is X.
- stereoscopic video information does not have parallax information. Since it is difficult to analyze the stereoscopic video information and obtain the parallax information, the maximum parallax information is obtained using the parallax information of the caption data or the sub-video data.
- the parallax information of the sub-picture data (the minimum parallax among the non-superimposed data) is used. By displaying the device image of the stereoscopic video display device 2 based on the maximum parallax information obtained in this way, it is possible to reduce a sense of discomfort felt by the viewer.
- the parallax information Y of the caption data may be used as the maximum parallax information.
- the stereoscopic video processing apparatus includes a circuit that detects the parallax information of the stereoscopic video information
- the parallax information of the stereoscopic video information that can be detected by the circuit is compared with the parallax information such as caption data and sub-video data.
- the maximum parallax information in the parallax information may be obtained.
- FIG. 9 shows the configuration of the stereoscopic video display device 2.
- the stereoscopic video display device 2 includes a display 24 and displays video data (display image) included in output data from the stereoscopic video processing device 1.
- the display 24 is composed of, for example, a liquid crystal display, a plasma display, or an organic EL display. That is, the stereoscopic video display device 2 can display the video included in the output data transmitted from the stereoscopic video processing device 1.
- the stereoscopic video display device 2 includes a controller 22, a memory 23, a display 24, a data transmission interface 21 and a communication interface 25.
- the memory 23 can be realized by, for example, a flash memory or a DRAM.
- the controller 22 can be realized by a microprocessor, for example.
- the data transmission interface 21 is an interface for transmitting and receiving data between the stereoscopic video display device 2 and the stereoscopic video processing device 1.
- the data transmission interface 21 performs communication based on, for example, HDMI (High-Definition Multimedia Interface).
- the communication interface 25 is an interface for communicating with the active shutter glasses 7.
- the communication interface 25 establishes communication with the active shutter glasses 7 by wireless or wired such as infrared rays or Bluetooth, for example.
- the stereoscopic video display device 2 can switch the display mode between the 3D video display mode and the 2D video display mode in accordance with a signal from the remote controller.
- the display operation in each mode will be described.
- the stereoscopic video display device 2 displays video for enabling viewing of stereoscopic video using the active shutter glasses 7 (see FIG. 10A). Specifically, the stereoscopic video processing device 1 alternately outputs video data indicated by the left eye video and video data indicated by the right eye video to the stereoscopic video display device 2. The stereoscopic video display device 2 alternately displays the left eye video and the right eye video included in the video data acquired from the stereoscopic video processing device 1 on the screen of the display 24 (see FIG. 10B). The viewer can recognize the video displayed on the stereoscopic video display device 2 in this way through the active shutter glasses 7 as a stereoscopic video.
- the active shutter glasses 7 include a shutter that can block the viewer's left or right visual field.
- the active shutter glasses 7 block the viewer's right eye field of view on the stereoscopic image display device 2, while the right-eye image is displayed on the stereoscopic image display device 2.
- the shutter is controlled so as to block the visual field of the left eye with respect to the stereoscopic video display device 2 of the viewer. That is, as shown in FIG. 10A and FIG. 10B, when a screen showing a left-eye image is displayed on the stereoscopic video display device 2, the viewer sees the video with the left eye, and the stereoscopic video display device 2.
- the screen showing the right eye image is displayed on the screen, the image is viewed with the right eye.
- the viewer can visually recognize the screens sequentially displayed on the stereoscopic video display device 2 as a stereoscopic video.
- the controller 22 of the stereoscopic video display device 2 superimposes and displays the device image of the stereoscopic video display device 2 (hereinafter referred to as “display device image”) on the display screen in accordance with a viewer's instruction (remote control instruction).
- display device image is superimposed on the video data and displayed.
- Display device image data is stored in the memory 23.
- the display device image includes, for example, an image indicating channel information and volume information, information for adjusting the brightness, contrast amount, and color temperature of the display, and information for adjusting the image quality of the playback device.
- the controller 22 superimposes and displays the display device image on the video data as follows.
- the controller 22 determines the disparity information (for example, Z + ⁇ pixel) of the display device image based on the disparity information (for example, Z pixel) included in the output data of the stereoscopic video processing device 1.
- the controller 22 superimposes the display device image based on the determined parallax information. Since this superimposing method is the same as the method described in the stereoscopic video processing apparatus 1, it is omitted. In this way, it is possible to superimpose a display device image that is less uncomfortable when displayed on the video processed by the stereoscopic video processing device 1. As a result, the viewer can view the 3D video without feeling uncomfortable.
- the example using the active shutter glasses 7 has been described.
- parallax information included in the output data can be used not only for parallax adjustment of the display device image but also for the following uses.
- the parallax information can be used as follows.
- the stereoscopic video display device first presents the video to the viewer with the pop-up amount of the stereoscopic video determined based on the parallax information included in the output data from the stereoscopic video processing device. Then, the stereoscopic video display device further adjusts the projection amount of the stereoscopic video based on an instruction from the viewer via the remote controller or the like. In this way, as in the case of volume adjustment, the viewer can adjust the parallax with easy means.
- the stereoscopic video display device detects the magnitude of the parallax based on the parallax information included in the output data from the stereoscopic video processing device, and automatically restricts display if the detected parallax is greater than a predetermined value. I do.
- the display restriction the display position of the entire display screen is adjusted so that the parallax between the objects of the right eye image and the left eye image becomes small.
- the two-dimensional video display mode is a mode for displaying a 2D video based on stereoscopic video information.
- the stereoscopic video display device 2 displays only the left eye video or the right eye video on the display 24.
- the function of the active shutter glasses 7 is turned off. That is, the active shutter glasses 7 transmit light to both eyes.
- the viewer can view the 2D video without using the active shutter glasses 7.
- the controller 22 of the stereoscopic video display device 2 uses the identification information included in the output data from the stereoscopic video processing device 1 (either the left eye video or the right eye video has a high average bit rate for encoding). Left eye image or right eye image is selected as the image to be displayed based on the information). That is, the controller 22 causes the display 24 to display the video (for example, the left eye video) indicated by the identification information as an option.
- the stereoscopic video display device 2 can recognize a video that has been compressed with a high average bit rate.
- a stereoscopic video processing device when transmitting video information according to HDMI between a stereoscopic video processing device and a stereoscopic video display device, when switching the video information to be transmitted between 3D video information (stereoscopic video information) and 2D video information, Authentication processing is required between the video processing device and the stereoscopic video display device. During this authentication process, the stereoscopic video display device stops displaying video. For this reason, there is a problem that a re-authentication process occurs every time switching between 3D video (stereoscopic video) information and 2D video information, thereby interrupting the viewer's convenience.
- the stereoscopic video display device 2 receives the 3D video information (stereoscopic video information) from the stereoscopic video processing device 1 and displays the format of the video to be displayed. Can be switched between a three-dimensional display that enables stereoscopic viewing and a two-dimensional display that does not allow stereoscopic viewing. Thereby, since the authentication process as described above is not necessary, it is possible to prevent the convenience of the viewer from being impaired due to the switching between the three-dimensional display and the two-dimensional display. Furthermore, in the two-dimensional video display mode, the video having the higher average bit rate can be recognized by referring to the identification information, so that the video having the higher image quality can be selected and provided to the viewer.
- the 3D video information stereoscopic video information
- the stereoscopic video processing device 1 acquires a stereoscopic video stream from the optical disc 4.
- the stereoscopic video processing device 1 separates the stereoscopic video stream into header information, stereoscopic video encoding information, audio information, and data information. Thereafter, the stereoscopic video processing apparatus 1 decodes each data by the decoder 183 (each decoder), and records the decoded data in the buffer memory 16 (each area).
- the stereoscopic video processing device 1 reads the left eye video data and the right eye video data alternately.
- the stereoscopic video processing device 1 superimposes subtitle data and menu data on stereoscopic video information (left-eye video data or right-eye video data) in accordance with a viewer instruction.
- the stereoscopic image processing device 1 uses the disparity information (caption disparity information and sub-image disparity information) included in the header information of the stereoscopic image stream to position the caption data and the menu data on the right eye image and the left eye image. Is determined and superimposed on the stereoscopic video information.
- the stereoscopic video processing device 1 superimposes the processing device image (OSD) on the stereoscopic video information in accordance with a viewer instruction. At this time, the stereoscopic video processing device 1 determines the parallax information of the processing device image using the caption parallax information or the sub-video parallax information, and superimposes the processing device image using the determined parallax information. In this way, display image information is generated.
- OSD processing device image
- the stereoscopic video processing device 1 calculates the maximum parallax information of the display image. Specifically, the largest parallax information is set as the maximum parallax information among the parallax information of the superimposed video (caption and sub-video).
- the stereoscopic video processing device 1 transmits the parallax information calculated in this way together with the display image information to the stereoscopic video display device 2 as output data.
- the stereoscopic video display device 2 sequentially displays display images on the display based on the received display image information.
- the stereoscopic video display device 2 displays a display device image (OSD) superimposed on the stereoscopic video information in accordance with a viewer instruction. Therefore, the stereoscopic video display device 1 determines the parallax information of the display device image using the parallax information included in the output data from the stereoscopic video processing device 1, and uses the determined parallax information to convert the display device image to the stereoscopic video. Superimpose on.
- OSD display device image
- the stereoscopic video display device 2 can superimpose the display device image at a position on the display image where the viewer feels less discomfort when viewing the display image in a stereoscopic manner.
- the stereoscopic video processing apparatus 1 acquires a stereoscopic video stream from the optical disc 4.
- the stereoscopic video processing device 1 separates the stereoscopic video stream into header information, stereoscopic video encoding information, audio information, and data information. Thereafter, the stereoscopic video processing device 1 decodes each data by the decoder 183 (each decoder).
- the stereoscopic video processing apparatus 1 records the decoded data in the buffer memory 16 (each area).
- the stereoscopic image processing apparatus 1 alternately reads the left eye image data and the right eye image data.
- the stereoscopic video processing device 1 detects the base view information included in the header information 33 of the stereoscopic video stream, combines the detected base view information with the display image as identification information, and outputs the stereoscopic video display device as output data. 2 to send.
- the stereoscopic video display device 2 selects either a left-eye video or a right-eye video from the received display image information, and sequentially displays it on the display. At this time, the stereoscopic video display device 2 selects the left eye video or the right eye video based on the identification information included in the output data. By referring to the identification information in this way, the stereoscopic video display device 2 can recognize a video with better image quality among the left eye video and the right eye video by a simple method.
- the stereoscopic video processing device 1 is a device capable of outputting stereoscopic video information enabling stereoscopic viewing to the stereoscopic video display device 2, and is a disk drive 11 that acquires stereoscopic video information.
- a superimposing unit AV input / output circuit 184 (an example of a superimposing unit) that superimposes additional video information (at least one of caption information, sub-video information, and a processing device image) on stereoscopic video information, and an addition
- a data transmission interface 15 (an example of a transmission unit) that transmits the parallax information of the video information to the video display device 2 in a state of being associated with the stereoscopic video information on which the additional video information is superimposed.
- the video processing device 1 can transmit disparity information related to stereoscopic video information after video processing (decoding) to the video display device 2 by a simpler method.
- the video display device 2 can arrange the display device image (OSD) at a more appropriate position, and can present the display device image (OSD) that can be viewed without a sense of incongruity to the viewer.
- the stereoscopic video processing apparatus 1 of the present embodiment is an apparatus that can output stereoscopic video information that enables stereoscopic viewing including a first eye video and a second eye video on the video display device 2.
- the video processing apparatus 1 acquires a disc drive 11 (acquisition) that acquires stereoscopic video information encoded using an encoding method (for example, MVC) that encodes the first eye video and the second eye video at different bit rates.
- An example of a unit a decoder 183 that decodes stereoscopic video information (an example of a decoding unit), and identification information indicating a video having a higher encoding bit rate of the first eye video and the second eye video.
- a data transmission interface 15 (an example of a transmission unit) that transmits the image display apparatus 2 in a state associated with the stereoscopic image information.
- the video processing device 1 notifies the video display device 2 which one of the first eye video and the second eye video is the higher quality video by a simpler method. Can do.
- the video display device 2 can select the video with the better image quality of the first eye video and the second eye video, and the video display device 2 can view the selected video by two-dimensionally displaying it. 2D video with good image quality can be provided to the user.
- the video source is not limited thereto.
- Broadcasting stations, servers, memory cards, and the like that provide stereoscopic video coding information are also examples of video sources to which the above concept can be applied.
- the embodiment of the present invention is not limited to this.
- base view information may be stored in management information (playlist) included in a stereoscopic video stream, and a video with a high average bit rate may be detected using this management information.
- the management information is information provided at the beginning of the stereoscopic video stream data.
- a video with a high average bit rate may be detected by observing the bit rate of the stereoscopic video coding information.
- the average bit rate may be obtained as an average value in a predetermined section of the stereoscopic video coding information, or may be obtained as an average value of the entire stereoscopic video coding information.
- the identification information and the maximum parallax information are included in the reserved area and output.
- the present invention is not limited to this, and the identification information and the maximum parallax information may be transmitted via a control line as HDMI CEC (Consumer-Electronic-Control) commands.
- the caption information is superimposed on each of the right eye video and the left eye video in consideration of the parallax information.
- the present invention is not limited to this, and in the video content, the left-eye caption information corresponding to the left-eye image and the right-eye caption information corresponding to the right-eye image are superimposed on the left-eye image and the right-eye image, respectively. It may be.
- caption parallax information is easier than obtaining parallax information of stereoscopic video information. The same applies to the sub-picture information.
- the stereoscopic video processing device 1 outputs the parallax information regarding the parallax that is the maximum in the entire display image to the stereoscopic video display device 2, but transmits the parallax information for each partial region of the display image. May be.
- the stereoscopic video processing device 1 uses the disparity information of the processing device image 61 and the caption 62 as the object.
- the information may be output to the stereoscopic video display device 2 together with information related to the area where the image is displayed.
- FIG. 16 shows a format when disparity information is transmitted by such a method. As shown in FIG.
- the parallax information is output to the stereoscopic image display device 2 in association with the start position (xs, ys) of the region and the size of the region (horizontal length Lx ⁇ vertical length Ly) for each region.
- the stereoscopic video display device 2 can determine the display position of the display device image so that the display device image does not overlap the object displayed in each region by referring to the parallax information for each region.
- the parallax information and the information regarding the area are not limited to one or two, and may be plural.
- the present invention can be applied to a device (for example, a video recording device or an optical disk reproducing device) that can output a stereoscopic video to a television receiver or a display that can display a stereoscopic video.
- a device for example, a video recording device or an optical disk reproducing device
- a stereoscopic video to a television receiver or a display that can display a stereoscopic video.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Library & Information Science (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
本実施形態において説明する立体映像処理装置は、立体映像情報を符号化して生成された情報である立体映像符号化情報を取得し、立体映像表示装置で表示可能な形式に変換する。すなわち、立体映像処理装置は、立体映像符号化情報を取得し、復号する。そして、立体映像処理装置は、復号した立体映像情報に、左眼映像又は右眼映像のいずれが符号化の平均ビットレートの高い映像であるかを示す識別情報を関連付けて、立体映像表示装置に送信する。立体映像表示装置は、立体映像処理装置から受信した立体映像情報に基づき2次元映像を表示する場合、その識別情報に基づき2次元映像(左眼映像又は右眼映像)を生成し、表示する。以下、これらの処理を詳細に説明する。なお、以下では、再生対象の映像コンテンツ、映像コンテンツの圧縮技術、映像コンテンツの多重化技術、立体映像表示システムの構成及び動作、他の実施の形態、の順に説明する。
本実施形態で対象とする映像コンテンツは、立体映像情報、音声情報、及びデータ情報で構成される。
立体映像情報は圧縮符合化されている。特に、本実施の形態では、立体映像情報の圧縮技術に関して、立体映像を構成する右眼映像と左眼映像のうちの一方の映像(例えば、右眼映像)が、他方の映像(例えば、左眼映像)よりも高い圧縮率(低い平均ビットレート)で圧縮されるように構成されている。以下、立体映像を構成する映像のうち、圧縮率がより低い方法の映像を「第1眼映像」と称し、圧縮率がより高い方法の映像を「第2眼映像」と称する。以下に具体例を示す。
圧縮符合化された立体映像情報、音声情報、データ情報を関連付けて、転送するための多重化技術を説明する。
図4に、本実施形態の立体映像表示システムの構成を示す。立体映像表示システムは、立体映像処理装置1と立体映像表示装置2を含む。先に立体映像表示システムの概要を説明し、立体映像処理装置1及び立体映像表示装置2の構成は後述する。
図5を用いて立体映像処理装置1の構成を説明する。立体映像処理装置1は、ディスクドライブ11、チューナ12、ネットワーク通信インターフェース13、メモリデバイスインターフェース14、データ伝送インターフェース15、バッファメモリ(フレームメモリ)16、HDドライブ17、フラッシュメモリ19及びLSI18を備える。
表示画像生成処理は、視聴者からの指示に応じて、立体映像情報(左眼映像又は右眼映像)を加工する処理である。具体的には、視聴者から、字幕の表示指示、又は、副映像の表示指示、立体映像処理装置1の装置画像(以下「処理装置画像」と称す)の表示指示を受け付けた場合にこの処理を行う。なお、視聴者は立体映像処理装置1に対してリモコンを用いて指示することができる。リモコンからの指示は、立体映像処理装置1に設けられる赤外線センサで受信することが可能である。以下具体的な処理の例を説明する。
AV入出力回路184は、図8に示すような出力データを生成する。図8に示すように、出力データは映像の無効区間(ブランキング領域)と有効区間(アクティブ領域)とを含むJ×K画素のデータとなる。
上記で説明した表示画像の最大視差情報の算出について2つの例を挙げて説明する。
抽出情報は以下のとおりである。
抽出情報は以下のとおりである。
図9に立体映像表示装置2の構成を示す。立体映像表示装置2はディスプレイ24を備え、立体映像処理装置1からの出力データに含まれる映像データ(表示画像)を表示する。ディスプレイ24は、例えば、液晶ディスプレイ、プラズマディスプレイ又は有機ELディスプレイで構成される。つまり、立体映像表示装置2は、立体映像処理装置1から送信された出力データに含まれる映像を表示可能である。
図10A及び図10Bを参照して3次元映像表示モードでの動作について説明する。立体映像表示装置2は、アクティブシャッターメガネ7を用いて立体映像を視聴可能にするための映像を表示する(図10A参照)。具体的には、立体映像処理装置1は、立体映像表示装置2に対して、左眼映像が示す映像データと右眼映像が示す映像データを交互に出力する。立体映像表示装置2は、立体映像処理装置1から取得した映像データに含まれる左眼映像及び右眼映像を交互にディスプレイ24の画面上に表示する(図10B参照)。視聴者は、このようにして立体映像表示装置2に表示された映像を、アクティブシャッターメガネ7を通して視認することで立体映像として認識できる。
2次元映像表示モードについて説明する。2次元映像表示モードは、立体映像情報に基づき2次元映像を表示するモードである。2次元映像表示モードでは、立体映像表示装置2は左眼映像又は右眼映像のいずれかのみをディスプレイ24に表示する。この際、アクティブシャッターメガネ7の機能はOFFにされる。つまり、アクティブシャッターメガネ7は両方の眼に対して光を透過させる。なお、2次元映像表示モードでは、視聴者はアクティブシャッターメガネ7を使わなくても2次元映像を視聴できる。
6-1.3次元映像表示の動作例
図11及び図12を用いて、3次元映像表示モードにおける、すなわち、3次元映像を表示する際の具体的な動作例を説明する。なお、説明の便宜上、一部の処理については説明を省略している。また、立体映像表示装置2は3次元表示モードに設定されているものとする。
図13及び図14を用いて、2次元映像表示モードにおける、すなわち、2次元映像を表示する際の具体的な動作例を説明する。なお、説明の便宜上、一部の処理については説明を省略している。また、立体映像表示装置2は2次元表示モードに設定されているものとする。
以上のように本実施形態の立体映像処理装置1は、立体映像表示装置2に、立体視を可能とする立体映像情報を出力可能な装置であって、立体映像情報を取得するディスクドライブ11(取得手段の一例)と、立体映像情報に付加映像情報(少なくとも字幕情報、副映像情報及び処理装置画像のいずれか)を重畳する重畳手段AV入出力回路184(重畳手段の一例)と、付加映像情報の視差情報を、付加映像情報が重畳された立体映像情報に関連付けた状態で映像表示装置2に送信するデータ伝送インターフェース15(送信手段の一例)とを備える。
本発明の一実施の形態として上記の例を説明した。しかし、本発明の思想はこれに限られず種々の形態で実現することが可能である。以下、他の実施の形態を説明する。
2 立体映像表示装置
3 サーバ
4 光ディスク
5 アンテナ
6 メモリカード
7 アクティブシャッターメガネ
11 ディスクドライブ
12 チューナ
13 ネットワーク通信インターフェース
14 メモリデバイスインターフェース
15 データ伝送インターフェース
16 バッファメモリ
17 HDドライブ
18 LSI
181 CPU
182 ストリームコントローラ
183 デコーダ
184 AV入出力回路
185 システムバス
186 メモリコントローラ
19 フラッシュメモリ
21 データ伝送インターフェース
22 コントローラ
23 メモリ
24 ディスプレイ
25 通信インターフェース
Claims (5)
- 映像表示装置に、第1眼映像と第2眼映像を含み、立体視を可能とする立体映像情報を出力可能な映像処理装置であって、
前記第1眼映像と第2眼映像をそれぞれ異なるビットレートで符号化する符号化方式を用いて符号化された立体映像情報を取得する取得手段と、
前記立体映像情報を復号する復号手段と、
前記第1眼映像と前記第2眼映像のうちの符号化ビットレートの高い方の映像を示す識別情報を、前記復号された立体映像情報に関連付けた状態で前記映像表示装置に送信する送信手段と、
を備える映像処理装置。 - 前記映像表示装置と前記映像処理装置の間は、伝送する情報が立体視を可能とする立体映像情報と立体視を可能としない2次元映像情報との間で切り替わる際に認証処理が必要となる伝送方式にしたがい接続される、請求項1記載の映像処理装置。
- 前記取得した立体映像情報に含まれる情報に基づいて、前記第1眼映像と前記第2眼映像のいずれの符号化のビットレートが高いかを検出して、当該検出結果に基づき前記識別情報を生成する生成手段をさらに備え、
前記送信手段は、前記生成した識別情報を前記映像表示装置に送信する、
請求項1または2に記載の映像処理装置。 - 前記符号化方式は、前記第1眼映像及び前記第2眼映像のうちのいずれか一方を基礎映像とし、前記基礎映像を当該基礎映像の情報のみを用いて符号化し、他方の映像を、前記第1眼映像と第2眼映像の双方の情報を用いて符号化する方式であり、
前記識別情報は、前記第1眼映像及び前記第2眼映像のうちのいずれが前記基礎映像であるかを示す情報である、
請求項1または2に記載の映像処理装置。 - 映像表示装置に、第1眼映像と第2眼映像を含み、立体視を可能とする立体映像情報を出力可能な映像処理装置であって、
MVC符号化方式によって、前記第1眼映像がI、Pフレームを用いて符号化され、かつ、第2眼映像がPフレームを用いて符号化された立体映像情報を取得する取得手段と、
前記立体映像情報を復号する復号手段と、
前記第1眼映像と前記第2眼映像のうちのIフレームを含んで符号化された映像を示す識別情報を、前記復号された立体映像情報に関連付けた状態で前記映像表示装置に送信する送信手段と、
を備える映像処理装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012506855A JP5390017B2 (ja) | 2010-03-24 | 2011-03-24 | 映像処理装置 |
US13/636,434 US20130002821A1 (en) | 2010-03-24 | 2011-03-24 | Video processing device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010067593 | 2010-03-24 | ||
JP2010-067593 | 2010-03-24 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011118216A1 true WO2011118216A1 (ja) | 2011-09-29 |
Family
ID=44672794
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/001729 WO2011118216A1 (ja) | 2010-03-24 | 2011-03-24 | 映像処理装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20130002821A1 (ja) |
JP (1) | JP5390017B2 (ja) |
WO (1) | WO2011118216A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013123220A (ja) * | 2011-12-09 | 2013-06-20 | Thomson Licensing | 不均衡設定方法及び対応する装置 |
JP2016063481A (ja) * | 2014-09-19 | 2016-04-25 | 株式会社東芝 | エンコード装置、デコード装置、ストリーミングシステム、および、ストリーミング方法 |
KR20200030844A (ko) * | 2018-09-13 | 2020-03-23 | 엘지디스플레이 주식회사 | 표시 장치 및 표시 장치를 포함하는 헤드 마운트 장치 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9264683B2 (en) * | 2013-09-03 | 2016-02-16 | Sony Corporation | Decoding device and decoding method, encoding device, and encoding method |
US20150253974A1 (en) | 2014-03-07 | 2015-09-10 | Sony Corporation | Control of large screen display using wireless portable computer interfacing with display controller |
GB2561152B (en) | 2017-03-21 | 2021-01-13 | Advanced Risc Mach Ltd | Data processing systems |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000134642A (ja) * | 1998-10-21 | 2000-05-12 | Toshiba Corp | 立体モードと平面モードを持つ立体映像再生装置とその方法 |
JP2005094145A (ja) * | 2003-09-12 | 2005-04-07 | Sharp Corp | 画像記録装置及び画像再生装置 |
JP2008042645A (ja) * | 2006-08-08 | 2008-02-21 | Nikon Corp | カメラおよび画像表示装置並びに画像記憶装置 |
JP2008244835A (ja) * | 2007-03-27 | 2008-10-09 | Toshiba Corp | 立体表示装置および立体画像表示方法 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102273210B (zh) * | 2008-12-02 | 2014-08-13 | Lg电子株式会社 | 3d字幕显示方法和实现该方法的3d显示装置 |
EP2382793A4 (en) * | 2009-01-28 | 2014-01-15 | Lg Electronics Inc | BROADCAST RECEIVER AND METHOD FOR PROCESSING VIDEO DATA THEREFOR |
JP4984183B2 (ja) * | 2009-04-07 | 2012-07-25 | ソニー株式会社 | 再生装置、再生方法、および記録方法 |
JP2010245970A (ja) * | 2009-04-08 | 2010-10-28 | Sony Corp | 再生装置、再生方法、およびプログラム |
EP2421264B1 (en) * | 2009-04-17 | 2016-05-25 | LG Electronics Inc. | Method and apparatus for processing a multiview video signal |
US20110310235A1 (en) * | 2009-12-28 | 2011-12-22 | Taiji Sasaki | Display device and method, recording medium, transmission device and method, and playback device and method |
KR20120125246A (ko) * | 2010-01-07 | 2012-11-14 | 톰슨 라이센싱 | 비디오 컨텐츠의 디스플레이를 제공하는 방법 및 장치 |
-
2011
- 2011-03-24 WO PCT/JP2011/001729 patent/WO2011118216A1/ja active Application Filing
- 2011-03-24 JP JP2012506855A patent/JP5390017B2/ja not_active Expired - Fee Related
- 2011-03-24 US US13/636,434 patent/US20130002821A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000134642A (ja) * | 1998-10-21 | 2000-05-12 | Toshiba Corp | 立体モードと平面モードを持つ立体映像再生装置とその方法 |
JP2005094145A (ja) * | 2003-09-12 | 2005-04-07 | Sharp Corp | 画像記録装置及び画像再生装置 |
JP2008042645A (ja) * | 2006-08-08 | 2008-02-21 | Nikon Corp | カメラおよび画像表示装置並びに画像記憶装置 |
JP2008244835A (ja) * | 2007-03-27 | 2008-10-09 | Toshiba Corp | 立体表示装置および立体画像表示方法 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013123220A (ja) * | 2011-12-09 | 2013-06-20 | Thomson Licensing | 不均衡設定方法及び対応する装置 |
JP2016063481A (ja) * | 2014-09-19 | 2016-04-25 | 株式会社東芝 | エンコード装置、デコード装置、ストリーミングシステム、および、ストリーミング方法 |
US11997302B2 (en) | 2014-09-19 | 2024-05-28 | Kabushiki Kaisha Toshiba | Encoding device, decoding device, streaming system, and streaming method |
KR20200030844A (ko) * | 2018-09-13 | 2020-03-23 | 엘지디스플레이 주식회사 | 표시 장치 및 표시 장치를 포함하는 헤드 마운트 장치 |
KR102551131B1 (ko) * | 2018-09-13 | 2023-07-03 | 엘지디스플레이 주식회사 | 표시 장치 및 표시 장치를 포함하는 헤드 마운트 장치 |
Also Published As
Publication number | Publication date |
---|---|
US20130002821A1 (en) | 2013-01-03 |
JP5390017B2 (ja) | 2014-01-15 |
JPWO2011118216A1 (ja) | 2013-07-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2010092823A1 (ja) | 表示制御装置 | |
US9161023B2 (en) | Method and system for response time compensation for 3D video processing | |
EP2537347B1 (en) | Apparatus and method for processing video content | |
EP2375767A1 (en) | Stereoscopic video player, stereoscopic video playback system, stereoscopic video playback method, and semiconductor device for stereoscopic video playback | |
US9361734B2 (en) | Image processing device and image processing method | |
EP2334092A1 (en) | Methods and apparatuses for encoding, decoding, and displaying a stereoscopic 3D image | |
JP5390016B2 (ja) | 映像処理装置 | |
US20100265315A1 (en) | Three-dimensional image combining apparatus | |
JP5502436B2 (ja) | 映像信号処理装置 | |
US9117396B2 (en) | Three-dimensional image playback method and three-dimensional image playback apparatus | |
US20120162367A1 (en) | Apparatus and method for converting image display mode | |
US20110141233A1 (en) | Three-dimensional image data transmission device, three-dimensional image data transmission method, three-dimensional image data reception device, and three-dimensional image data reception method | |
US20110012993A1 (en) | Image reproducing apparatus | |
JP5390017B2 (ja) | 映像処理装置 | |
WO2013031156A1 (ja) | 映像処理システム、送信装置、受信装置、送信方法、受信方法及びコンピュータプログラム | |
TW201108714A (en) | Three-dimensional image data transmission device, three-dimensional image data transmission method, three-dimensional image data reception device, and three-dimensional image data reception method | |
US20130141534A1 (en) | Image processing device and method | |
WO2012029293A1 (ja) | 映像処理装置、映像処理方法、コンピュータプログラム及び配信方法 | |
WO2012067021A1 (ja) | 情報統合装置、情報表示装置、情報記録装置、情報統合方法、情報統合プログラム、および、情報統合プログラムを記録したコンピュータ読み取り可能な記録媒体 | |
US20110285827A1 (en) | Image reproducing apparatus and image display apparatus | |
JP2012089906A (ja) | 表示制御装置 | |
WO2012063675A1 (ja) | 立体画像データ送信装置、立体画像データ送信方法および立体画像データ受信装置 | |
US20130266287A1 (en) | Reproduction device and reproduction method | |
US20120098944A1 (en) | 3-dimensional image display apparatus and image display method thereof | |
WO2013009480A1 (en) | Dual mode user interface system and method for 3d video |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11759025 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13636434 Country of ref document: US Ref document number: 2012506855 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11759025 Country of ref document: EP Kind code of ref document: A1 |