EP1961238A1 - Verfahren zur bereitstellung eines auf dmb basierenden 3d-bilddienstes und decodierungsvorrichtung und verfahren für einen auf dmb basierenden 3d-bilddienst - Google Patents

Verfahren zur bereitstellung eines auf dmb basierenden 3d-bilddienstes und decodierungsvorrichtung und verfahren für einen auf dmb basierenden 3d-bilddienst

Info

Publication number
EP1961238A1
EP1961238A1 EP06769273A EP06769273A EP1961238A1 EP 1961238 A1 EP1961238 A1 EP 1961238A1 EP 06769273 A EP06769273 A EP 06769273A EP 06769273 A EP06769273 A EP 06769273A EP 1961238 A1 EP1961238 A1 EP 1961238A1
Authority
EP
European Patent Office
Prior art keywords
image
service
dmb
additional
reference image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP06769273A
Other languages
English (en)
French (fr)
Other versions
EP1961238A4 (de
Inventor
Kug-Jin Yun
Gwang-Soon Lee
Hoon-Jong Kang
Nam-Ho Hur
Soo-In Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Publication of EP1961238A1 publication Critical patent/EP1961238A1/de
Publication of EP1961238A4 publication Critical patent/EP1961238A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/356Image reproducers having separate monoscopic and stereoscopic modes

Definitions

  • DMB Digital Media Broadcasting
  • a method for providing a DMB-based 3D stereoscopic image service including the steps of: a)defining, through a data service component type, that a broadcast service is a DMB service, and defining the dimension of the DMB service through a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image as different independent streams using different object descriptors.
  • method for providing a DMB-based 3D stereoscopic image service including the steps of: a) defining, through a data service component type, that a broadcast service is a DMB service, and defining the dimension of the DMB service through a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image respectively as an independent stream and a dependent stream for the reference image using one object descriptor.
  • the method including the steps of: a) separately recognizing and decoding a reference image stream and a 3D additional information stream using two different object de- scriptors; b) receiving a play mode from a user; c) when the received play mode is a 2D play mode, deactivating a node corresponding to 3D additional information in a scene descriptor such that only the reference image decoded in the step a) is outputted; and d) when the received play mode is a 3D play mode, converting one of the r eference image and the 3D additional image decoded in the step a) into an image having only odd-numbered line data and converting the other into an image having only even-numbered line data.
  • the present invention provides users with a realistic 3D image service while
  • the present invention provides a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure that can provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system.
  • Fig. 1 is a table with additional data service component types to provide a DMB service based on a DAB;
  • FIG. 2 is a table illustrating a method of discriminating between a 2D DMB service and a 3D DMB service based on a user application type defined in a DAB in accordance with an embodiment of the present invention
  • Fig. 3 is a table illustrating the structure of an MPEG-4 object descriptor used to describe audio/video signals in a conventional DMB service;
  • Fig. 4 is a table illustrating the structure of an object descriptor for providing a
  • the DMB is based on the European digital audio broadcast standards, which
  • the DMB is one of mobile multimedia broadcasts with an excellent reception capability.
  • Fig. 2 is a table illustrating a method of discriminating between a 2D DMB service and a 3D DMB service based on a user application type defined in a DAB in accordance with an embodiment of the present invention.
  • 3D moving pictures are coded independently on the basis of the respective viewpoints, thereby outputting viewpoint- based coded streams.
  • 3D moving pictures are coded on the basis of the correlation between the respective viewpoints with reference to an image at a specific time, thereby outputting viewpoint-based coded streams.
  • the present invention assigns a reference image and 3D
  • 3D additional information used for a digital broadcast based 3D service includes disparity data (Disparity), disparity and residual data (Disparity + Residual Data), depth information (Depth), depth and residual data (Depth + Residual Data), a full right image (Right Image (full)), a right image of half of horizontal (Right Image (Half of Horizontal)), a left image of half of vertical (Left Image (Half of Vertical)), a horizontal/vertical half image (Right Image (Quarter)).
  • the residual data includes residual texture data.
  • the 3D additional information includes "Left image (full)”, “Left image (half of horizontal)”, “Left image (half of vertical)”, “left image (half of vertical)”, and "Left image (quarter)”.
  • the 3D format converter 62 fills even-numbered line data with garbage data and maintains only odd- numbered line data while maintaining the size of an image.
  • the 3D format converter 62 fills odd- numbered line data with garbage data and maintains only even-numbered line data while maintaining the size of an image to be equal to the size of the reference image through an image expansion filtering process using actual data contained therein.
  • the reference image 621 may be converted into the even-numbered data, while the 3D additional image may be converted into the odd-numbered data.
  • the 2D image 610 may be created using only the decoded reference image.
  • the user may adjust a stereoscopic feeling through the horizontal shift, i.e., disparity adjustment of a 3D motion image or an object in an image according to a stereoscopic feeling adjustment mode.
  • the user can enjoy a stereoscopic image by adjusting the disparity of a 3D motion image according to the stereoscopic feeling adjustment mode, which is possible by horizontally shifting left and right images. Also, when the image disparity can be optionally adjusted for each object in an image, the user can enjoy an image by adjusting the image disparity on the basis of a desired object.
  • Fig. 7 illustrates the structure of an object descriptor for representing a bit stream outputted from a codec using one object descriptor when 3D moving pictures are coded independently based on the viewpoints or coded based on the correlation between the respective viewpoints with reference to an image at a specific time.
  • FIG. 4 illustrates the method of assigning a reference image
  • FIG. 7 illustrates a method of assign a reference image and 3D additional information as an independent stream and a dependent stream by using one object descriptor.
  • an elementary stream (ES) descriptor for a reference image and an elementary stream descriptor for 3D additional information are brought forth in a subordinate relationship under one object descriptor.
  • the subordinate relationship can be expressed using "StreamDependanceFlag” and "dependsOn_ES_ID” of an MPEG-4 ES descriptor.
  • FIG. 8 is a block diagram illustrating a decoding apparatus 80 and method for
  • the decoder 81 recognizes and decodes a reference image stream and a 3D additional image stream using one object descriptor.
  • the decoder 81 combines a decoded reference image and a decoded 3D additional image to generate one 3D image.
  • the user can enjoy an image by adjusting the image disparity based on a desired object.
  • the present invention can be similarly applied to a 3D audio service as well as a 3D stereoscopic image service.
  • the methods in accordance with the embodiments of the present invention can be realized as programs and stored in a computer-readable recording medium that can execute the programs.
  • Examples of the computer-readable recording medium include CD-ROM, RAM, ROM, floppy disks, hard disks, magneto-optical disks and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
EP06769273.1A 2005-12-09 2006-07-13 Verfahren zur bereitstellung eines auf dmb basierenden 3d-bilddienstes und decodierungsvorrichtung und verfahren für einen auf dmb basierenden 3d-bilddienst Withdrawn EP1961238A4 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR20050121112 2005-12-09
KR1020060001987A KR100747550B1 (ko) 2005-12-09 2006-01-06 Dmb 기반의 3차원 입체영상 서비스 제공 방법과, dmb기반의 3차원 입체영상 서비스를 위한 복호화 장치 및 그방법
PCT/KR2006/002756 WO2007066868A1 (en) 2005-12-09 2006-07-13 Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service

Publications (2)

Publication Number Publication Date
EP1961238A1 true EP1961238A1 (de) 2008-08-27
EP1961238A4 EP1961238A4 (de) 2014-04-30

Family

ID=38356896

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06769273.1A Withdrawn EP1961238A4 (de) 2005-12-09 2006-07-13 Verfahren zur bereitstellung eines auf dmb basierenden 3d-bilddienstes und decodierungsvorrichtung und verfahren für einen auf dmb basierenden 3d-bilddienst

Country Status (4)

Country Link
EP (1) EP1961238A4 (de)
KR (1) KR100747550B1 (de)
CN (1) CN101366290A (de)
WO (1) WO2007066868A1 (de)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100913397B1 (ko) 2006-12-04 2009-08-21 한국전자통신연구원 Dmb기반의 3차원 입체영상 서비스를 위한 객체 기술방법과, 그에 따른 3차원 입체영상 서비스 수신 및 영상포맷 변환 방법
KR100910996B1 (ko) * 2006-12-08 2009-08-05 한국전자통신연구원 디지털 멀티미디어 방송 시스템에서의 3차원 비디오 서비스제공 방법
KR100938283B1 (ko) * 2007-12-18 2010-01-22 한국전자통신연구원 영상정보의 분리 전송을 이용한 3차원 입체방송 송수신장치 및 그 방법
KR100955578B1 (ko) 2007-12-18 2010-04-30 한국전자통신연구원 스테레오스코픽 콘텐츠 장면 재생 방법 및 그 장치
EP3007440A1 (de) * 2007-12-20 2016-04-13 Koninklijke Philips N.V. Bildcodierungsverfahren zur stereoskopischen darstellung
KR100921686B1 (ko) * 2008-02-18 2009-10-15 전자부품연구원 입체형 비디오 파일 포맷 및 그에 따른 입체형 비디오파일을 기록한 컴퓨터로 판독 가능한 기록매체
EP2288148A4 (de) * 2008-06-18 2012-04-04 Mitsubishi Electric Corp Vorrichtung zur umwandlung und aufzeichnung dreidimensionaler videoinhalte, verfahren zur umwandlung und aufzeichnung dreidimensionaler videoinhalte, aufzeichnungsmedium, vorrichtung zur umwandlung dreidimensionaler videoinhalte sowie vorrichtung zur übertragung dreidimensionaler videoinhalte
KR100963005B1 (ko) 2008-07-09 2010-06-10 한국전자통신연구원 자유시점 av 서비스에 따른 파일 생성 방법
KR20100040640A (ko) 2008-10-10 2010-04-20 엘지전자 주식회사 수신 시스템 및 데이터 처리 방법
EP2319247A4 (de) * 2008-10-27 2012-05-09 Samsung Electronics Co Ltd Verfahren und vorrichtungen zur verarbeitung und anzeige von bildern
KR20100050426A (ko) 2008-11-04 2010-05-13 한국전자통신연구원 3차원 방송 서비스 송수신 방법 및 시스템
KR100972792B1 (ko) 2008-11-04 2010-07-29 한국전자통신연구원 스테레오스코픽 영상을 동기화하는 장치 및 방법과 이를 이용한 스테레오스코픽 영상 제공 장치 및 방법
KR101279120B1 (ko) * 2009-05-15 2013-06-26 엘지디스플레이 주식회사 영상표시장치
TW201119353A (en) 2009-06-24 2011-06-01 Dolby Lab Licensing Corp Perceptual depth placement for 3D objects
WO2010151555A1 (en) 2009-06-24 2010-12-29 Dolby Laboratories Licensing Corporation Method for embedding subtitles and/or graphic overlays in a 3d or multi-view video data
CA2777016C (en) * 2009-10-13 2015-10-20 Lg Electronics Inc. Broadcast receiver and 3d video data processing method thereof
WO2011046338A2 (en) * 2009-10-13 2011-04-21 Lg Electronics Inc. Broadcast receiver and 3d video data processing method thereof
US8988495B2 (en) * 2009-11-03 2015-03-24 Lg Eletronics Inc. Image display apparatus, method for controlling the image display apparatus, and image display system
EP2334088A1 (de) * 2009-12-14 2011-06-15 Koninklijke Philips Electronics N.V. Erzeugung eines 3D-Videosignals
US8325757B2 (en) * 2009-12-17 2012-12-04 Silicon Image, Inc. De-encapsulation of data streams into multiple links
US9426441B2 (en) 2010-03-08 2016-08-23 Dolby Laboratories Licensing Corporation Methods for carrying and transmitting 3D z-norm attributes in digital TV closed captioning
CA2797619C (en) 2010-04-30 2015-11-24 Lg Electronics Inc. An apparatus of processing an image and a method of processing thereof
JP2013535889A (ja) * 2010-07-21 2013-09-12 トムソン ライセンシング 3次元通信システムにおいて補助コンテンツを提供する方法及び装置
KR101910192B1 (ko) * 2010-11-12 2018-10-22 한국전자통신연구원 3dtv 서비스에서의 영상 압축 규격 결정 방법 및 장치
KR101763941B1 (ko) * 2010-12-20 2017-08-01 엘지디스플레이 주식회사 입체영상 표시장치
US9519994B2 (en) 2011-04-15 2016-12-13 Dolby Laboratories Licensing Corporation Systems and methods for rendering 3D image independent of display size and viewing distance
CA2845780C (en) 2011-08-31 2017-04-18 Lg Electronics Inc. Digital broadcast signal processing method and device
JP6192902B2 (ja) * 2011-11-11 2017-09-06 サターン ライセンシング エルエルシーSaturn Licensing LLC 画像データ送信装置、画像データ送信方法、画像データ受信装置および画像データ受信方法
WO2013069608A1 (ja) 2011-11-11 2013-05-16 ソニー株式会社 送信装置、送信方法、受信装置および受信方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100523052B1 (ko) * 2002-08-30 2005-10-24 한국전자통신연구원 다중 디스플레이 방식을 지원하는 다시점 동영상의 객체 기반 부호화 장치 및 그 방법과 그를 이용한 객체 기반 송수신 시스템 및 그 방법
KR100751422B1 (ko) * 2002-12-27 2007-08-23 한국전자통신연구원 스테레오스코픽 비디오 부호화 및 복호화 방법, 부호화 및복호화 장치
KR100491523B1 (ko) * 2003-02-19 2005-05-30 (주)파버나인 입체영상 디스플레이장치
KR20040104777A (ko) * 2003-06-04 2004-12-13 주식회사 팬택앤큐리텔 듀얼 카메라 장착 단말기
KR100585933B1 (ko) * 2003-08-20 2006-06-01 한국전자통신연구원 디지털 멀티미디어 방송 시스템 및 그 방법
KR100999768B1 (ko) * 2003-09-17 2010-12-08 엘지전자 주식회사 디지털 멀티미디어 방송 수신기의 부가정보 저장 및이용방법
KR100576544B1 (ko) * 2003-12-09 2006-05-03 한국전자통신연구원 엠펙-4 객체기술자 정보 및 구조를 이용한 3차원 동영상처리 장치 및 그 방법

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
"Description of Exploration Experiments in 3D AV", 61. MPEG MEETING;22-07-2002 - 26-07-2002; KLAGENFURT; (MOTION PICTUREEXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. N4929, 29 July 2002 (2002-07-29), XP030012352, ISSN: 0000-0363 *
BAUER S ET AL: "THE MPEG-4 MULTIMEDIA CODING STANDARD: ALGORITHMS, ARCHITECTURES AND APPLICATIONS", JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL, IMAGE, AND VIDEO TECHNOLOGY, SPRINGER, NEW YORK, NY, US, vol. 23, no. 1, 1 October 1999 (1999-10-01), pages 7-26, XP000862769, ISSN: 0922-5773, DOI: 10.1023/A:1008136602091 *
FAZEL K ET AL: "MOBILE MULTIMEDIA SERVICES VIA DAB: DMB", IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE. PHOENIX, ARIZONA, NOV. 3 - 8, 1997; [GLOBAL TELECOMMUNICATIONS CONFERENCE (GLOBECOM)], NEW YORK, IEEE, US, 3 November 1997 (1997-11-03), pages 1312-1317, XP000737741, ISBN: 978-0-7803-4199-9 *
GRUBE M ET AL: "Applications of MPEG-4: Digital Multimedia Broadcasting", IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 47, no. 3, 19 June 2001 (2001-06-19), pages 474-484, XP002389300, ISSN: 0098-3063, DOI: 10.1109/30.964136 *
KUGJIN YUN ET AL: "Experimental Evaluation of MAC for stereoscopic video coding", 62. MPEG MEETING; 21-10-2002 - 25-10-2002; SHANGHAI; (MOTION PICTUREEXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. M8911, 16 October 2002 (2002-10-16), XP030037847, ISSN: 0000-0271 *
See also references of WO2007066868A1 *
SEYOON JEONG ET AL: "MPEG-4 extension for augmented stereoscopic video", DIGITAL AND COMPUTATIONAL VIDEO, 2002. DCV 2002. PROCEEDINGS - THIRD I NTERNATIONAL WORKSHOP ON NOV. 14-15, 2002, PISCATAWAY, NJ, USA,IEEE, 14 November 2002 (2002-11-14), pages 176-183, XP010649294, ISBN: 978-0-7803-7984-8 *

Also Published As

Publication number Publication date
EP1961238A4 (de) 2014-04-30
KR100747550B1 (ko) 2007-08-08
WO2007066868A1 (en) 2007-06-14
KR20070060951A (ko) 2007-06-13
CN101366290A (zh) 2009-02-11

Similar Documents

Publication Publication Date Title
WO2007066868A1 (en) Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service
EP2369836B1 (de) Objektbasiertes dreidimensionales Audiodienstsystem mit im Voraus eingestellten Audioszenen
US8705747B2 (en) Object-based 3-dimensional audio service system using preset audio scenes
KR100658222B1 (ko) 3차원 디지털 멀티미디어 방송 시스템
US9380288B2 (en) System and method for transmitting/receiving three dimensional video based on digital broadcasting
JP4362105B2 (ja) 2次元および3次元立体ビデオ信号の適応変換装置およびその方法
KR100905723B1 (ko) 비실시간 기반의 디지털 실감방송 송수신 시스템 및 그방법
KR100802179B1 (ko) 프리셋 오디오 장면을 이용한 객체기반 3차원 오디오서비스 시스템 및 그 방법
JP2010505327A (ja) デジタル放送基盤の三次元静止映像サービス方法及び装置
KR101490005B1 (ko) 3-차원 비디오 콘텐츠로의 삽입을 위해 2-차원 비디오 콘텐츠를 변환하는 방법 및 장치
KR100703715B1 (ko) 다시점 3차원 동영상 송수신 시스템
KR100874226B1 (ko) 다시점 화상 및 3차원 오디오 송수신 장치 및 이를 이용한송수신 방법
KR20160098974A (ko) 3dtv 방송 송수신 장치
KR20170130883A (ko) 하이브리드 망 기반의 가상 현실 방송 서비스 방법 및 장치
KR100826519B1 (ko) Dmb 기반의 3차원 정지영상 서비스를 위한 객체 기술 및다중화 방법과, 그에 따른 복호화 장치 및 그 방법
KR100913397B1 (ko) Dmb기반의 3차원 입체영상 서비스를 위한 객체 기술방법과, 그에 따른 3차원 입체영상 서비스 수신 및 영상포맷 변환 방법
KR20170093637A (ko) 이종 네트워크 환경에서 미디어 전송 스트림 버퍼링 방법 및 이를 이용한 영상 수신 장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20080624

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20140327

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 13/00 20060101ALI20140321BHEP

Ipc: H04N 13/02 20060101AFI20140321BHEP

Ipc: H04N 13/04 20060101ALI20140321BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20140514