WO2010084437A2 - Transferring of 3d image data - Google Patents
Transferring of 3d image data Download PDFInfo
- Publication number
- WO2010084437A2 WO2010084437A2 PCT/IB2010/050130 IB2010050130W WO2010084437A2 WO 2010084437 A2 WO2010084437 A2 WO 2010084437A2 IB 2010050130 W IB2010050130 W IB 2010050130W WO 2010084437 A2 WO2010084437 A2 WO 2010084437A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- frame
- frame type
- video
- display signal
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/178—Metadata, e.g. disparity information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/167—Synchronising or controlling image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/341—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/003—Aspects relating to the "2D+depth" image format
Definitions
- the invention further relates to the above mentioned 3D source device, the 3D display signal and the 3D display device.
- the invention relates to the field of transferring, via a high-speed digital interface, e.g. HDMI, three-dimensional image data, e.g. 3D video, for display on a 3D display device.
- a high-speed digital interface e.g. HDMI
- three-dimensional image data e.g. 3D video
- the invention is also based on the following recognition. All legacy analog and digital display interface signals inherently are designed for directly generating display control signals, like the horizontal line synchronization pulses and frame sequences described above. Hence the signal itself dictates the timing and generation of the display control signals, whereas the function of each subsequent frame is implicit by its location in the signal.
- the traditional display unit does not process the image data but strictly follows the display interface signal.
- the inventors have seen that for 3D display signals there is a need for constituting the final 3D display control signals in the display device itself, because the various display type signals and viewer conditions and settings cannot be optimally achieved if the components of the 3D image data are combined, by the source device, in a predefined fixed way in the interface signal.
- the new 3D display signal various components are transferred separately in frames of different frame types.
- the process of detecting the different frame types and the process of combining the partial data structures, which takes place in the display device is still to be controlled by the transmitter source device.
- the inventors provided the frame type synchronization indicator that is now included in the 3D display signal.
- Fig. 1 shows a system for transferring three dimensional (3D) image data, such as video, graphics or other visual information.
- a 3D source device 10 is coupled to a 3D display device 13 for transferring a 3D display signal 56.
- the 3D source device has an input unit 51 for receiving image information.
- the input unit device may include an optical disc unit 58 for retrieving various types of image information from an optical record carrier 54 like a DVD or BluRay disc.
- the input unit may include a network interface unit 59 for coupling to a network 55, for example the internet or a broadcast network, such device usually being called a set-top box.
- Image data may be retrieved from a remote media server 57.
- a different 3D format is based on two views using a 2D image and an additional depth image, a so called depth map, which conveys information about the depth of objects in the 2D image.
- the format called image + depth is different in that it is a combination of a 2D image with a so called "depth", or disparity map.
- This is a gray scale image, whereby the gray scale value of a pixel indicates the amount of disparity (or depth in case of a depth map) for the corresponding pixel in the associated 2D image.
- the display device uses the disparity, depth or parallax map to calculate the additional views taking the 2D image as input.
- Adding stereo to video also impacts the format of the video when it is sent from a player device, such as a Blu-ray disc player, to a stereo display.
- a player device such as a Blu-ray disc player
- a stereo display In the 2D case only a 2D video stream is sent (decoded picture data). With stereo video this increases as now a second stream must be sent containing the second view (for stereo) or a depth map. This could double the required bitrate on the electrical interface.
- a different approach is to sacrifice resolution and format the stream such that the second view or the depth map are interlaced or placed side by side with the 2D video.
- Fig. 2 shows an example of 2D data and a depth map. The depth display parameters that are sent to the display to allow the display to correctly interpret the depth information.
Abstract
Description
Claims
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/145,283 US10257493B2 (en) | 2009-01-20 | 2010-01-13 | Transferring of 3D image data |
JP2011545823A JP5809064B2 (en) | 2009-01-20 | 2010-01-13 | Transfer of 3D image data |
RU2011134888/08A RU2536388C2 (en) | 2009-01-20 | 2010-01-13 | 3d image transmission |
BRPI1005146A BRPI1005146A2 (en) | 2009-01-20 | 2010-01-13 | three-dimensional image data transfer method [3d], 3d generating device for transferring three-dimensional image data [3d] to a 3d display device and 3d display signal for transferring three-dimensional image data [3d] to a 3d display device |
CN201080004996.3A CN102292995B (en) | 2009-01-20 | 2010-01-13 | Transferring of 3D image data |
EP10701918A EP2389666A2 (en) | 2009-01-20 | 2010-01-13 | Transferring of 3d image data |
US16/352,916 US20190215508A1 (en) | 2009-01-20 | 2019-03-14 | Transferring of 3d image data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP09150939.8 | 2009-01-20 | ||
EP09150939 | 2009-01-20 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/145,283 A-371-Of-International US10257493B2 (en) | 2009-01-20 | 2010-01-13 | Transferring of 3D image data |
US16/352,916 Continuation US20190215508A1 (en) | 2009-01-20 | 2019-03-14 | Transferring of 3d image data |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2010084437A2 true WO2010084437A2 (en) | 2010-07-29 |
WO2010084437A3 WO2010084437A3 (en) | 2010-09-30 |
Family
ID=42026550
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2010/050130 WO2010084437A2 (en) | 2009-01-20 | 2010-01-13 | Transferring of 3d image data |
Country Status (9)
Country | Link |
---|---|
US (2) | US10257493B2 (en) |
EP (1) | EP2389666A2 (en) |
JP (1) | JP5809064B2 (en) |
KR (1) | KR101630866B1 (en) |
CN (1) | CN102292995B (en) |
BR (1) | BRPI1005146A2 (en) |
RU (1) | RU2536388C2 (en) |
TW (1) | TWI528780B (en) |
WO (1) | WO2010084437A2 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110032329A1 (en) * | 2009-08-06 | 2011-02-10 | Qualcomm Incorporated | Transforming video data in accordance with three dimensional input formats |
EP2418870A1 (en) * | 2010-08-09 | 2012-02-15 | Sony Corporation | Transmission and receiving apparatus and transmission and receiving method |
CN102378030A (en) * | 2010-08-24 | 2012-03-14 | 索尼公司 | Image processing apparatus and image processing method |
US20130106845A1 (en) * | 2011-11-01 | 2013-05-02 | Acer Incorporated | Stereoscopic image display apparatus |
CN103430529A (en) * | 2011-03-18 | 2013-12-04 | 索尼公司 | Image processing device and image processing method |
EP2675174A4 (en) * | 2012-01-19 | 2015-05-06 | Sony Corp | Receiving device, receiving method, and electronic device |
US9900595B2 (en) | 2011-08-31 | 2018-02-20 | Sony Corporation | Encoding device, encoding method, decoding device, and decoding method |
US9979961B2 (en) | 2011-03-18 | 2018-05-22 | Sony Corporation | Image processing device and image processing method |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105744284B (en) * | 2009-02-19 | 2019-04-19 | 交互数字麦迪逊专利控股公司 | Use the device of 3D video format |
KR20120020627A (en) * | 2010-08-30 | 2012-03-08 | 삼성전자주식회사 | Apparatus and method for image processing using 3d image format |
KR20120047055A (en) * | 2010-11-03 | 2012-05-11 | 삼성전자주식회사 | Display apparatus and method for providing graphic image |
US9888232B2 (en) * | 2011-01-17 | 2018-02-06 | Sony Corporation | 3D motion picture processing device |
US20120200670A1 (en) * | 2011-02-04 | 2012-08-09 | Nokia Corporation | Method and apparatus for a disparity limit indicator |
WO2013014177A1 (en) * | 2011-07-25 | 2013-01-31 | Sony Corporation | In-painting method for 3d stereoscopic views generation |
CN102595165A (en) * | 2012-02-29 | 2012-07-18 | 广州博冠光电技术有限公司 | Method and device for freely converting 2D (2 dimensional) /3D (3 dimensional) functions of 3D liquid crystal shutter glasses |
US20130271565A1 (en) * | 2012-04-16 | 2013-10-17 | Qualcomm Incorporated | View synthesis based on asymmetric texture and depth resolutions |
CN103260090B (en) * | 2013-04-26 | 2016-03-30 | 电子科技大学 | A kind of for the video-frequency band scheduling in P2P three-dimensional flow media system and transmission method |
US10764473B2 (en) * | 2016-01-14 | 2020-09-01 | Disney Enterprises, Inc. | Automatically synchronizing multiple real-time video sources |
US11475862B2 (en) | 2017-07-07 | 2022-10-18 | Hewlett-Packard Development Company, L.P. | Selection of an extended display identification data standard |
CN110430423A (en) * | 2019-07-26 | 2019-11-08 | 深圳市创凯智能股份有限公司 | Method of data synchronization, system, device and readable storage medium storing program for executing |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1705929A1 (en) | 2003-12-25 | 2006-09-27 | Brother Kogyo Kabushiki Kaisha | Image display device and signal processing device |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4979033A (en) | 1988-09-27 | 1990-12-18 | Stephens Berton H | Stereoscopic video system and method with field synchronization and intensity control |
EP0888018B1 (en) | 1996-02-28 | 2006-06-07 | Matsushita Electric Industrial Co., Ltd. | Optical disk having plural streams of digital video data recorded thereon in interleaved manner, and apparatuses and methods for recording on, and reproducing from, the optical disk |
RU2157056C2 (en) * | 1998-02-03 | 2000-09-27 | Логутко Альберт Леонидович | Method for three-dimensional tv recording |
JP4707782B2 (en) * | 1999-02-05 | 2011-06-22 | ソニー株式会社 | Image processing apparatus and method |
KR100382108B1 (en) * | 2000-06-24 | 2003-05-01 | 학교법인연세대학교 | 3D graphic accelerator and method for processing graphic acceleration using the same |
RU2237283C2 (en) * | 2001-11-27 | 2004-09-27 | Самсунг Электроникс Ко., Лтд. | Device and method for presenting three-dimensional object on basis of images having depth |
KR100461339B1 (en) | 2002-05-14 | 2004-12-10 | 주식회사 포디컬쳐 | Device and Method for transmitting picture data |
JP2004128769A (en) | 2002-10-01 | 2004-04-22 | Pioneer Electronic Corp | Information recording medium, information recording and/or reproducing apparatus and method, computer program for recording or reproduction control, and data structure including control signal |
JP2006005418A (en) | 2004-06-15 | 2006-01-05 | Sharp Corp | Apparatus, method, and program for receiving/reproducing information, and program recording medium |
US7515759B2 (en) * | 2004-07-14 | 2009-04-07 | Sharp Laboratories Of America, Inc. | 3D video coding using sub-sequences |
KR100658222B1 (en) * | 2004-08-09 | 2006-12-15 | 한국전자통신연구원 | 3 Dimension Digital Multimedia Broadcasting System |
KR100781510B1 (en) | 2005-05-10 | 2007-12-03 | 삼성전자주식회사 | Apparatus, system and method for generating of identification information about A/V device on the A/V network |
KR100813961B1 (en) * | 2005-06-14 | 2008-03-14 | 삼성전자주식회사 | Method and apparatus for transmitting and receiving of video, and transport stream structure thereof |
EP1897056B1 (en) * | 2005-06-23 | 2016-08-10 | Koninklijke Philips N.V. | Combined exchange of image and related data |
US20070247477A1 (en) * | 2006-04-21 | 2007-10-25 | Lowry Gregory N | Method and apparatus for processing, displaying and viewing stereoscopic 3D images |
JP4179387B2 (en) * | 2006-05-16 | 2008-11-12 | ソニー株式会社 | Transmission method, transmission system, transmission method, transmission device, reception method, and reception device |
JP5132690B2 (en) * | 2007-03-16 | 2013-01-30 | トムソン ライセンシング | System and method for synthesizing text with 3D content |
KR100962696B1 (en) * | 2007-06-07 | 2010-06-11 | 주식회사 이시티 | Format for encoded stereoscopic image data file |
JP2009135686A (en) * | 2007-11-29 | 2009-06-18 | Mitsubishi Electric Corp | Stereoscopic video recording method, stereoscopic video recording medium, stereoscopic video reproducing method, stereoscopic video recording apparatus, and stereoscopic video reproducing apparatus |
CN102067591B (en) * | 2008-06-26 | 2014-03-19 | 松下电器产业株式会社 | Reproducing device, recording device, reproducing method and recording method |
JP5338166B2 (en) * | 2008-07-16 | 2013-11-13 | ソニー株式会社 | Transmitting apparatus, stereoscopic image data transmitting method, receiving apparatus, and stereoscopic image data receiving method |
JP2010088092A (en) * | 2008-09-02 | 2010-04-15 | Panasonic Corp | Three-dimensional video transmission system, video display device and video output device |
US8335425B2 (en) * | 2008-11-18 | 2012-12-18 | Panasonic Corporation | Playback apparatus, playback method, and program for performing stereoscopic playback |
-
2010
- 2010-01-13 KR KR1020117019095A patent/KR101630866B1/en active IP Right Grant
- 2010-01-13 US US13/145,283 patent/US10257493B2/en active Active
- 2010-01-13 EP EP10701918A patent/EP2389666A2/en not_active Withdrawn
- 2010-01-13 WO PCT/IB2010/050130 patent/WO2010084437A2/en active Application Filing
- 2010-01-13 BR BRPI1005146A patent/BRPI1005146A2/en not_active Application Discontinuation
- 2010-01-13 RU RU2011134888/08A patent/RU2536388C2/en active
- 2010-01-13 JP JP2011545823A patent/JP5809064B2/en active Active
- 2010-01-13 CN CN201080004996.3A patent/CN102292995B/en active Active
- 2010-01-18 TW TW099101236A patent/TWI528780B/en active
-
2019
- 2019-03-14 US US16/352,916 patent/US20190215508A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1705929A1 (en) | 2003-12-25 | 2006-09-27 | Brother Kogyo Kabushiki Kaisha | Image display device and signal processing device |
Non-Patent Citations (1)
Title |
---|
See also references of EP2389666A2 |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9083958B2 (en) * | 2009-08-06 | 2015-07-14 | Qualcomm Incorporated | Transforming video data in accordance with three dimensional input formats |
US20110032329A1 (en) * | 2009-08-06 | 2011-02-10 | Qualcomm Incorporated | Transforming video data in accordance with three dimensional input formats |
EP2418870A1 (en) * | 2010-08-09 | 2012-02-15 | Sony Corporation | Transmission and receiving apparatus and transmission and receiving method |
CN102377990A (en) * | 2010-08-09 | 2012-03-14 | 索尼公司 | Transmission and receiving apparatus and transmission and receiving method |
CN102378030A (en) * | 2010-08-24 | 2012-03-14 | 索尼公司 | Image processing apparatus and image processing method |
JP6057136B2 (en) * | 2011-03-18 | 2017-01-11 | ソニー株式会社 | Image processing apparatus and image processing method |
CN103430529B (en) * | 2011-03-18 | 2017-07-11 | 索尼公司 | Image processing equipment and image processing method |
EP2688280A1 (en) * | 2011-03-18 | 2014-01-22 | Sony Corporation | Image processing device and image processing method |
EP2688280A4 (en) * | 2011-03-18 | 2014-09-10 | Sony Corp | Image processing device and image processing method |
US10389997B2 (en) | 2011-03-18 | 2019-08-20 | Sony Corporation | Image processing apparatus and image processing method |
CN103430529A (en) * | 2011-03-18 | 2013-12-04 | 索尼公司 | Image processing device and image processing method |
RU2586064C2 (en) * | 2011-03-18 | 2016-06-10 | Сони Корпорейшн | Image processing apparatus and image processing method |
CN107197227B (en) * | 2011-03-18 | 2019-05-10 | 索尼公司 | Image processing equipment, image processing method and computer readable storage medium |
US9615079B2 (en) | 2011-03-18 | 2017-04-04 | Sony Corporation | Image processing apparatus and image processing method |
US20130342647A1 (en) * | 2011-03-18 | 2013-12-26 | Sony Corporation | Image processing apparatus and image processing method |
US9712802B2 (en) | 2011-03-18 | 2017-07-18 | Sony Corporation | Image processing apparatus and image processing method |
CN107197227A (en) * | 2011-03-18 | 2017-09-22 | 索尼公司 | Image processing equipment, image processing method and computer-readable recording medium |
CN107277484A (en) * | 2011-03-18 | 2017-10-20 | 索尼公司 | Image processing equipment, image processing method and computer-readable recording medium |
US10218958B2 (en) | 2011-03-18 | 2019-02-26 | Sony Corporation | Image processing apparatus and image processing method |
EP3267398A3 (en) * | 2011-03-18 | 2018-03-28 | Sony Corporation | Image processing apparatus and image processing method |
AU2016262741B2 (en) * | 2011-03-18 | 2018-05-17 | Sony Corporation | Image Processing Apparatus and Image Processing Method |
US9979961B2 (en) | 2011-03-18 | 2018-05-22 | Sony Corporation | Image processing device and image processing method |
US9900595B2 (en) | 2011-08-31 | 2018-02-20 | Sony Corporation | Encoding device, encoding method, decoding device, and decoding method |
US20130106845A1 (en) * | 2011-11-01 | 2013-05-02 | Acer Incorporated | Stereoscopic image display apparatus |
EP2675174A4 (en) * | 2012-01-19 | 2015-05-06 | Sony Corp | Receiving device, receiving method, and electronic device |
Also Published As
Publication number | Publication date |
---|---|
KR20110114670A (en) | 2011-10-19 |
CN102292995B (en) | 2015-01-28 |
RU2011134888A (en) | 2013-02-27 |
EP2389666A2 (en) | 2011-11-30 |
US10257493B2 (en) | 2019-04-09 |
JP5809064B2 (en) | 2015-11-10 |
RU2536388C2 (en) | 2014-12-20 |
BRPI1005146A2 (en) | 2018-02-20 |
TW201119348A (en) | 2011-06-01 |
CN102292995A (en) | 2011-12-21 |
JP2012516070A (en) | 2012-07-12 |
US20110279645A1 (en) | 2011-11-17 |
KR101630866B1 (en) | 2016-06-16 |
US20190215508A1 (en) | 2019-07-11 |
TWI528780B (en) | 2016-04-01 |
WO2010084437A3 (en) | 2010-09-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190215508A1 (en) | Transferring of 3d image data | |
AU2010207508B2 (en) | Transferring of 3D image data | |
US20110298795A1 (en) | Transferring of 3d viewer metadata | |
US11381800B2 (en) | Transferring of three-dimensional image data | |
US20110316848A1 (en) | Controlling of display parameter settings | |
JP6085626B2 (en) | Transfer of 3D image data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080004996.3 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10701918 Country of ref document: EP Kind code of ref document: A2 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010701918 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2011545823 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13145283 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 5788/CHENP/2011 Country of ref document: IN |
|
ENP | Entry into the national phase |
Ref document number: 20117019095 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011134888 Country of ref document: RU |
|
ENP | Entry into the national phase |
Ref document number: PI1005146 Country of ref document: BR Kind code of ref document: A2 Effective date: 20110715 |