WO2010084437A2 - Transferring of 3d image data - Google Patents

Transferring of 3d image data Download PDF

Info

Publication number
WO2010084437A2
WO2010084437A2 PCT/IB2010/050130 IB2010050130W WO2010084437A2 WO 2010084437 A2 WO2010084437 A2 WO 2010084437A2 IB 2010050130 W IB2010050130 W IB 2010050130W WO 2010084437 A2 WO2010084437 A2 WO 2010084437A2
Authority
WO
WIPO (PCT)
Prior art keywords
display
frame
frame type
video
display signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2010/050130
Other languages
English (en)
French (fr)
Other versions
WO2010084437A3 (en
Inventor
Philip S. Newton
Gerardus W. T. Van Der Heijden
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to EP10701918A priority Critical patent/EP2389666A2/en
Priority to RU2011134888/08A priority patent/RU2536388C2/ru
Priority to US13/145,283 priority patent/US10257493B2/en
Priority to JP2011545823A priority patent/JP5809064B2/ja
Priority to CN201080004996.3A priority patent/CN102292995B/zh
Priority to BRPI1005146A priority patent/BRPI1005146A2/pt
Publication of WO2010084437A2 publication Critical patent/WO2010084437A2/en
Publication of WO2010084437A3 publication Critical patent/WO2010084437A3/en
Anticipated expiration legal-status Critical
Priority to US16/352,916 priority patent/US20190215508A1/en
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178Metadata, e.g. disparity information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/167Synchronising or controlling image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/183On-screen display [OSD] information, e.g. subtitles or menus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00Details of stereoscopic systems
    • H04N2213/003Aspects relating to the "2D+depth" image format

Definitions

  • the invention further relates to the above mentioned 3D source device, the 3D display signal and the 3D display device.
  • the invention relates to the field of transferring, via a high-speed digital interface, e.g. HDMI, three-dimensional image data, e.g. 3D video, for display on a 3D display device.
  • a high-speed digital interface e.g. HDMI
  • three-dimensional image data e.g. 3D video
  • the invention is also based on the following recognition. All legacy analog and digital display interface signals inherently are designed for directly generating display control signals, like the horizontal line synchronization pulses and frame sequences described above. Hence the signal itself dictates the timing and generation of the display control signals, whereas the function of each subsequent frame is implicit by its location in the signal.
  • the traditional display unit does not process the image data but strictly follows the display interface signal.
  • the inventors have seen that for 3D display signals there is a need for constituting the final 3D display control signals in the display device itself, because the various display type signals and viewer conditions and settings cannot be optimally achieved if the components of the 3D image data are combined, by the source device, in a predefined fixed way in the interface signal.
  • the new 3D display signal various components are transferred separately in frames of different frame types.
  • the process of detecting the different frame types and the process of combining the partial data structures, which takes place in the display device is still to be controlled by the transmitter source device.
  • the inventors provided the frame type synchronization indicator that is now included in the 3D display signal.
  • Fig. 1 shows a system for transferring three dimensional (3D) image data, such as video, graphics or other visual information.
  • a 3D source device 10 is coupled to a 3D display device 13 for transferring a 3D display signal 56.
  • the 3D source device has an input unit 51 for receiving image information.
  • the input unit device may include an optical disc unit 58 for retrieving various types of image information from an optical record carrier 54 like a DVD or BluRay disc.
  • the input unit may include a network interface unit 59 for coupling to a network 55, for example the internet or a broadcast network, such device usually being called a set-top box.
  • Image data may be retrieved from a remote media server 57.
  • a different 3D format is based on two views using a 2D image and an additional depth image, a so called depth map, which conveys information about the depth of objects in the 2D image.
  • the format called image + depth is different in that it is a combination of a 2D image with a so called "depth", or disparity map.
  • This is a gray scale image, whereby the gray scale value of a pixel indicates the amount of disparity (or depth in case of a depth map) for the corresponding pixel in the associated 2D image.
  • the display device uses the disparity, depth or parallax map to calculate the additional views taking the 2D image as input.
  • Adding stereo to video also impacts the format of the video when it is sent from a player device, such as a Blu-ray disc player, to a stereo display.
  • a player device such as a Blu-ray disc player
  • a stereo display In the 2D case only a 2D video stream is sent (decoded picture data). With stereo video this increases as now a second stream must be sent containing the second view (for stereo) or a depth map. This could double the required bitrate on the electrical interface.
  • a different approach is to sacrifice resolution and format the stream such that the second view or the depth map are interlaced or placed side by side with the 2D video.
  • Fig. 2 shows an example of 2D data and a depth map. The depth display parameters that are sent to the display to allow the display to correctly interpret the depth information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
PCT/IB2010/050130 2009-01-20 2010-01-13 Transferring of 3d image data Ceased WO2010084437A2 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP10701918A EP2389666A2 (en) 2009-01-20 2010-01-13 Transferring of 3d image data
RU2011134888/08A RU2536388C2 (ru) 2009-01-20 2010-01-13 Передача данных 3d изображения
US13/145,283 US10257493B2 (en) 2009-01-20 2010-01-13 Transferring of 3D image data
JP2011545823A JP5809064B2 (ja) 2009-01-20 2010-01-13 3d画像データの転送
CN201080004996.3A CN102292995B (zh) 2009-01-20 2010-01-13 3d图像数据的传输
BRPI1005146A BRPI1005146A2 (pt) 2009-01-20 2010-01-13 método de transferência de dados de imagem tridimensional [3d], dispositivo de geração de 3d para transferir dados de imagem tridimensional [3d] para um dispositivo de exibição em 3d e sinal de exibição em 3d para transferir dados de imagem tridimensional [3d] para um dispositivo de exibição em 3d
US16/352,916 US20190215508A1 (en) 2009-01-20 2019-03-14 Transferring of 3d image data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP09150939.8 2009-01-20
EP09150939 2009-01-20

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US13/145,283 A-371-Of-International US10257493B2 (en) 2009-01-20 2010-01-13 Transferring of 3D image data
US16/352,916 Continuation US20190215508A1 (en) 2009-01-20 2019-03-14 Transferring of 3d image data

Publications (2)

Publication Number Publication Date
WO2010084437A2 true WO2010084437A2 (en) 2010-07-29
WO2010084437A3 WO2010084437A3 (en) 2010-09-30

Family

ID=42026550

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2010/050130 Ceased WO2010084437A2 (en) 2009-01-20 2010-01-13 Transferring of 3d image data

Country Status (9)

Country Link
US (2) US10257493B2 (enExample)
EP (1) EP2389666A2 (enExample)
JP (1) JP5809064B2 (enExample)
KR (1) KR101630866B1 (enExample)
CN (1) CN102292995B (enExample)
BR (1) BRPI1005146A2 (enExample)
RU (1) RU2536388C2 (enExample)
TW (1) TWI528780B (enExample)
WO (1) WO2010084437A2 (enExample)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110032329A1 (en) * 2009-08-06 2011-02-10 Qualcomm Incorporated Transforming video data in accordance with three dimensional input formats
EP2418870A1 (en) * 2010-08-09 2012-02-15 Sony Corporation Transmission and receiving apparatus and transmission and receiving method
CN102378030A (zh) * 2010-08-24 2012-03-14 索尼公司 图像处理装置和图像处理方法
US20130106845A1 (en) * 2011-11-01 2013-05-02 Acer Incorporated Stereoscopic image display apparatus
CN103430529A (zh) * 2011-03-18 2013-12-04 索尼公司 图像处理设备和图像处理方法
EP2675174A4 (en) * 2012-01-19 2015-05-06 Sony Corp RECEIVING DEVICE, RECEIVING METHOD AND ELECTRONIC DEVICE
US9900595B2 (en) 2011-08-31 2018-02-20 Sony Corporation Encoding device, encoding method, decoding device, and decoding method
US9979961B2 (en) 2011-03-18 2018-05-22 Sony Corporation Image processing device and image processing method

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2399394B1 (en) * 2009-02-19 2020-09-30 InterDigital Madison Patent Holdings 3d video formats
KR20120020627A (ko) * 2010-08-30 2012-03-08 삼성전자주식회사 3d 영상 포맷을 이용한 영상 처리 장치 및 방법
KR20120047055A (ko) * 2010-11-03 2012-05-11 삼성전자주식회사 디스플레이 장치 및 이에 적용되는 그래픽 영상 제공방법
US9888232B2 (en) * 2011-01-17 2018-02-06 Sony Corporation 3D motion picture processing device
US20120200670A1 (en) * 2011-02-04 2012-08-09 Nokia Corporation Method and apparatus for a disparity limit indicator
US9681115B2 (en) * 2011-07-25 2017-06-13 Sony Corporation In-painting method for 3D stereoscopic views generation using left and right images and a depth map
CN102595165A (zh) * 2012-02-29 2012-07-18 广州博冠光电技术有限公司 3d液晶快门眼镜2d/3d功能自由切换方法及装置
US20130271565A1 (en) * 2012-04-16 2013-10-17 Qualcomm Incorporated View synthesis based on asymmetric texture and depth resolutions
CN103260090B (zh) * 2013-04-26 2016-03-30 电子科技大学 一种用于p2p三维流媒体系统中的视频段调度及传输方法
US10764473B2 (en) * 2016-01-14 2020-09-01 Disney Enterprises, Inc. Automatically synchronizing multiple real-time video sources
US10489915B2 (en) * 2017-04-01 2019-11-26 Intel Corporation Decouple multi-layer render fequency
KR20190122768A (ko) * 2017-07-07 2019-10-30 휴렛-팩커드 디벨롭먼트 컴퍼니, 엘.피. 확장 디스플레이 식별 데이터 표준의 선택 기술
CN110430423A (zh) * 2019-07-26 2019-11-08 深圳市创凯智能股份有限公司 数据同步方法、系统、装置及可读存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1705929A1 (en) 2003-12-25 2006-09-27 Brother Kogyo Kabushiki Kaisha Image display device and signal processing device

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4979033A (en) 1988-09-27 1990-12-18 Stephens Berton H Stereoscopic video system and method with field synchronization and intensity control
DE69736062T2 (de) 1996-02-28 2007-01-11 Matsushita Electric Industrial Co., Ltd., Kadoma Optische Platte mit verschachtelt aufgezeichneten Digitalvideo-Datenströmen, sowie Vorrichtungen und Verfahren zur Aufzeichnung auf und Wiedergabe von der optischen Platte
RU2157056C2 (ru) * 1998-02-03 2000-09-27 Логутко Альберт Леонидович Способ объемного телевидения
JP4707782B2 (ja) * 1999-02-05 2011-06-22 ソニー株式会社 画像処理装置およびその方法
KR100382108B1 (ko) 2000-06-24 2003-05-01 학교법인연세대학교 3차원 그래픽 가속기 및 그의 그래픽 가속처리 방법
RU2237283C2 (ru) * 2001-11-27 2004-09-27 Самсунг Электроникс Ко., Лтд. Устройство и способ представления трехмерного объекта на основе изображений с глубиной
KR100461339B1 (ko) 2002-05-14 2004-12-10 주식회사 포디컬쳐 영상데이터 전송장치 및 방법
JP2004128769A (ja) 2002-10-01 2004-04-22 Pioneer Electronic Corp 情報記録媒体、情報記録装置及び方法、情報再生装置及び方法、情報記録再生装置及び方法、記録又は再生制御用のコンピュータプログラム、並びに制御信号を含むデータ構造
JP2006005418A (ja) * 2004-06-15 2006-01-05 Sharp Corp 情報受信・再生装置、情報受信・再生方法、情報受信・再生プログラム及びプログラム記録媒体
US7515759B2 (en) * 2004-07-14 2009-04-07 Sharp Laboratories Of America, Inc. 3D video coding using sub-sequences
KR100658222B1 (ko) 2004-08-09 2006-12-15 한국전자통신연구원 3차원 디지털 멀티미디어 방송 시스템
KR100781510B1 (ko) 2005-05-10 2007-12-03 삼성전자주식회사 A/v 네트워크 상에 존재하는 a/v 장치에 대한 구별정보를 생성하는 장치, 시스템 및 방법
KR100813961B1 (ko) * 2005-06-14 2008-03-14 삼성전자주식회사 영상 수신장치
WO2006137000A1 (en) * 2005-06-23 2006-12-28 Koninklijke Philips Electronics N.V. Combined exchange of image and related data
US20070247477A1 (en) * 2006-04-21 2007-10-25 Lowry Gregory N Method and apparatus for processing, displaying and viewing stereoscopic 3D images
JP4179387B2 (ja) * 2006-05-16 2008-11-12 ソニー株式会社 伝送方法、伝送システム、送信方法、送信装置、受信方法及び受信装置
EP2157803B1 (en) * 2007-03-16 2015-02-25 Thomson Licensing System and method for combining text with three-dimensional content
KR100962696B1 (ko) * 2007-06-07 2010-06-11 주식회사 이시티 부호화된 스테레오스코픽 영상 데이터 파일의 구성방법
JP2009135686A (ja) * 2007-11-29 2009-06-18 Mitsubishi Electric Corp 立体映像記録方法、立体映像記録媒体、立体映像再生方法、立体映像記録装置、立体映像再生装置
RU2518189C2 (ru) * 2008-06-26 2014-06-10 Панасоник Корпорэйшн Носитель записи, устройство воспроизведения, устройство записи, способ воспроизведения, способ записи и программа
JP5338166B2 (ja) * 2008-07-16 2013-11-13 ソニー株式会社 送信装置、立体画像データ送信方法、受信装置および立体画像データ受信方法
JP2010088092A (ja) * 2008-09-02 2010-04-15 Panasonic Corp 立体映像伝送システム、映像表示装置および映像出力装置
US8335425B2 (en) * 2008-11-18 2012-12-18 Panasonic Corporation Playback apparatus, playback method, and program for performing stereoscopic playback

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1705929A1 (en) 2003-12-25 2006-09-27 Brother Kogyo Kabushiki Kaisha Image display device and signal processing device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2389666A2

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9083958B2 (en) * 2009-08-06 2015-07-14 Qualcomm Incorporated Transforming video data in accordance with three dimensional input formats
US20110032329A1 (en) * 2009-08-06 2011-02-10 Qualcomm Incorporated Transforming video data in accordance with three dimensional input formats
EP2418870A1 (en) * 2010-08-09 2012-02-15 Sony Corporation Transmission and receiving apparatus and transmission and receiving method
CN102377990A (zh) * 2010-08-09 2012-03-14 索尼公司 传送和接收设备以及传送和接收方法
CN102378030A (zh) * 2010-08-24 2012-03-14 索尼公司 图像处理装置和图像处理方法
US9615079B2 (en) 2011-03-18 2017-04-04 Sony Corporation Image processing apparatus and image processing method
US9712802B2 (en) 2011-03-18 2017-07-18 Sony Corporation Image processing apparatus and image processing method
EP2688280A4 (en) * 2011-03-18 2014-09-10 Sony Corp IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD
US10389997B2 (en) 2011-03-18 2019-08-20 Sony Corporation Image processing apparatus and image processing method
CN103430529A (zh) * 2011-03-18 2013-12-04 索尼公司 图像处理设备和图像处理方法
RU2586064C2 (ru) * 2011-03-18 2016-06-10 Сони Корпорейшн Устройство обработки изображений и способ обработки изображений
JP6057136B2 (ja) * 2011-03-18 2017-01-11 ソニー株式会社 画像処理装置および画像処理方法
CN107197227B (zh) * 2011-03-18 2019-05-10 索尼公司 图像处理设备、图像处理方法和计算机可读存储介质
CN103430529B (zh) * 2011-03-18 2017-07-11 索尼公司 图像处理设备和图像处理方法
US20130342647A1 (en) * 2011-03-18 2013-12-26 Sony Corporation Image processing apparatus and image processing method
CN107197227A (zh) * 2011-03-18 2017-09-22 索尼公司 图像处理设备、图像处理方法和计算机可读存储介质
CN107277484A (zh) * 2011-03-18 2017-10-20 索尼公司 图像处理设备、图像处理方法和计算机可读存储介质
US10218958B2 (en) 2011-03-18 2019-02-26 Sony Corporation Image processing apparatus and image processing method
EP3267398A3 (en) * 2011-03-18 2018-03-28 Sony Corporation Image processing apparatus and image processing method
AU2016262741B2 (en) * 2011-03-18 2018-05-17 Sony Corporation Image Processing Apparatus and Image Processing Method
US9979961B2 (en) 2011-03-18 2018-05-22 Sony Corporation Image processing device and image processing method
US9900595B2 (en) 2011-08-31 2018-02-20 Sony Corporation Encoding device, encoding method, decoding device, and decoding method
US20130106845A1 (en) * 2011-11-01 2013-05-02 Acer Incorporated Stereoscopic image display apparatus
EP2675174A4 (en) * 2012-01-19 2015-05-06 Sony Corp RECEIVING DEVICE, RECEIVING METHOD AND ELECTRONIC DEVICE

Also Published As

Publication number Publication date
CN102292995A (zh) 2011-12-21
EP2389666A2 (en) 2011-11-30
CN102292995B (zh) 2015-01-28
RU2536388C2 (ru) 2014-12-20
JP5809064B2 (ja) 2015-11-10
BRPI1005146A2 (pt) 2018-02-20
US10257493B2 (en) 2019-04-09
JP2012516070A (ja) 2012-07-12
US20190215508A1 (en) 2019-07-11
WO2010084437A3 (en) 2010-09-30
TWI528780B (zh) 2016-04-01
RU2011134888A (ru) 2013-02-27
US20110279645A1 (en) 2011-11-17
TW201119348A (en) 2011-06-01
KR101630866B1 (ko) 2016-06-16
KR20110114670A (ko) 2011-10-19

Similar Documents

Publication Publication Date Title
US10257493B2 (en) Transferring of 3D image data
AU2010207508B2 (en) Transferring of 3D image data
US20110298795A1 (en) Transferring of 3d viewer metadata
US11381800B2 (en) Transferring of three-dimensional image data
US20110316848A1 (en) Controlling of display parameter settings
JP6085626B2 (ja) 3d画像データの転送

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080004996.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10701918

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2010701918

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2011545823

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 13145283

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 5788/CHENP/2011

Country of ref document: IN

ENP Entry into the national phase

Ref document number: 20117019095

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2011134888

Country of ref document: RU

ENP Entry into the national phase

Ref document number: PI1005146

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20110715