WO2011155697A3 - 깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치 - Google Patents

깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치 Download PDF

Info

Publication number
WO2011155697A3
WO2011155697A3 PCT/KR2011/002443 KR2011002443W WO2011155697A3 WO 2011155697 A3 WO2011155697 A3 WO 2011155697A3 KR 2011002443 W KR2011002443 W KR 2011002443W WO 2011155697 A3 WO2011155697 A3 WO 2011155697A3
Authority
WO
WIPO (PCT)
Prior art keywords
depth map
map information
dimensional image
converting
image
Prior art date
Application number
PCT/KR2011/002443
Other languages
English (en)
French (fr)
Other versions
WO2011155697A2 (ko
Inventor
우대식
전병기
김아란
이홍우
하종호
박지훈
정원석
Original Assignee
에스케이텔레콤 주식회사
주식회사 이시티
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 에스케이텔레콤 주식회사, 주식회사 이시티 filed Critical 에스케이텔레콤 주식회사
Priority to EP11792608.9A priority Critical patent/EP2582143A4/en
Priority to CN201180028234.1A priority patent/CN103081476B/zh
Priority to US13/700,939 priority patent/US20130069942A1/en
Priority to JP2013513099A priority patent/JP2013534742A/ja
Publication of WO2011155697A2 publication Critical patent/WO2011155697A2/ko
Publication of WO2011155697A3 publication Critical patent/WO2011155697A3/ko

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)

Abstract

본 발명의 일 실시예는 깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치에 관한 것이다. 본 발명의 일 실시예는 입력된 영상 데이터의 각각의 프레임(Frame) 내에 존재하는 각각의 픽셀(Pixel) 별로 깊이 맵(Depth Map) 정보를 추정하는 깊이 맵 추정부; 상기 각각의 픽셀 별로 상기 깊이 맵 정보만큼 X축 방향으로 이동시키는 깊이 맵 적용부; 상기 이동에 따라 상기 프레임 내에 빈 픽셀이 발생하는 경우, 상기 빈 픽셀의 인접 픽셀들에 가중치를 적용하여 상기 빈 픽셀 내에 보간(Interpolation) 픽셀이 형성되도록 하는 입체 영상 보간부; 및 상기 보간 픽셀을 적용한 좌측 시야용 이미지 및 우측 시야용 이미지가 렌더링(Rendering)되도록 하는 입체 영상 렌더링 처리부를 포함하는 것을 특징으로 하는 깊이 맵 정보를 이용한 입체 영상 변환 장치를 제공한다. 본 발명의 일 실시예에 의하면, 2D 영상 중 자막과 같이 인접 픽셀 간의 깊이 맵 정보에 변화가 큰 영상을 입체 영상으로 변환할 때, 자막의 해당 글자와 같은 오브젝트의 원형을 보존하면서 입체감이 나타나도록 하는 효과가 있다.
PCT/KR2011/002443 2010-06-08 2011-04-07 깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치 WO2011155697A2 (ko)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP11792608.9A EP2582143A4 (en) 2010-06-08 2011-04-07 METHOD AND DEVICE FOR THREE-DIMENSIONAL IMAGE CONVERSION USING DEPTH CARD INFORMATION
CN201180028234.1A CN103081476B (zh) 2010-06-08 2011-04-07 利用深度图信息转换三维图像的方法和设备
US13/700,939 US20130069942A1 (en) 2010-06-08 2011-04-07 Method and device for converting three-dimensional image using depth map information
JP2013513099A JP2013534742A (ja) 2010-06-08 2011-04-07 デプスマップ情報を利用した立体映像変換方法及び装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2010-0053963 2010-06-08
KR1020100053963A KR101385514B1 (ko) 2010-06-08 2010-06-08 깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치

Publications (2)

Publication Number Publication Date
WO2011155697A2 WO2011155697A2 (ko) 2011-12-15
WO2011155697A3 true WO2011155697A3 (ko) 2012-02-02

Family

ID=45098484

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/002443 WO2011155697A2 (ko) 2010-06-08 2011-04-07 깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치

Country Status (6)

Country Link
US (1) US20130069942A1 (ko)
EP (1) EP2582143A4 (ko)
JP (1) JP2013534742A (ko)
KR (1) KR101385514B1 (ko)
CN (1) CN103081476B (ko)
WO (1) WO2011155697A2 (ko)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101276346B1 (ko) * 2011-10-31 2013-06-18 전자부품연구원 선택적 깊이 지도 회전 방법 및 장치
KR101332021B1 (ko) * 2011-10-31 2013-11-25 전자부품연구원 깊이 지도 회전 방법 및 장치
KR101319260B1 (ko) * 2012-02-01 2013-10-18 (주)리얼디스퀘어 영상 복원 장치 및 방법과 이를 이용한 영상 변환 장치 및 방법
WO2013115463A1 (ko) * 2012-02-01 2013-08-08 에스케이플래닛 주식회사 영상 처리 장치 및 방법
CN102611908B (zh) * 2012-03-19 2014-08-06 清华大学 一种反向重采样fpga装置
KR101706216B1 (ko) * 2012-04-03 2017-02-13 한화테크윈 주식회사 고밀도 삼차원 영상 재구성 장치 및 방법
CN102761765B (zh) * 2012-07-16 2014-08-20 清华大学 一种用于三维立体视频的深度快速插帧方法
US9544612B2 (en) * 2012-10-04 2017-01-10 Intel Corporation Prediction parameter inheritance for 3D video coding
US10257506B2 (en) 2012-12-28 2019-04-09 Samsung Electronics Co., Ltd. Method of obtaining depth information and display apparatus
CN105216306B (zh) * 2014-05-30 2018-03-30 深圳创锐思科技有限公司 雕刻模型生成系统及方法、雕刻模型3d打印系统及方法
KR101748637B1 (ko) 2014-08-05 2017-06-20 한국전자통신연구원 깊이 맵 생성 장치 및 방법
KR102341267B1 (ko) 2015-05-04 2021-12-20 삼성전자주식회사 양안 시차 영상에 대한 렌더링 방법 및 장치
MA43028B1 (fr) 2015-10-02 2021-09-30 Hoffmann La Roche Anticorps bispécifiques pour pd1 et tim3
CN108805921B (zh) * 2018-04-09 2021-07-06 奥比中光科技集团股份有限公司 图像获取系统及方法
US11582402B2 (en) * 2018-06-07 2023-02-14 Eys3D Microelectronics, Co. Image processing device
KR102093622B1 (ko) * 2018-07-02 2020-03-27 경희대학교 산학협력단 깊이 카메라를 이용한 실시간 프로젝터 영상 보정 방법 및 장치
US11240481B2 (en) 2018-12-26 2022-02-01 Snap Inc. Creation and user interactions with three-dimensional wallpaper on computing devices
CN113875230B (zh) * 2019-05-23 2023-03-28 奇跃公司 混合模式三维显示方法
CN110460831B (zh) * 2019-08-22 2021-12-03 京东方科技集团股份有限公司 显示方法、装置、设备及计算机可读存储介质
US11039113B2 (en) 2019-09-30 2021-06-15 Snap Inc. Multi-dimensional rendering
EP4070286A4 (en) 2019-12-06 2023-01-18 Magic Leap, Inc. VIRTUAL, AUGMENTED AND MIXED REALITY PROCESSES AND SYSTEMS
CN117095134B (zh) * 2023-10-18 2023-12-22 中科星图深海科技有限公司 一种三维海洋环境数据插值处理方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000215311A (ja) * 1999-01-21 2000-08-04 Nippon Telegr & Teleph Corp <Ntt> 仮想視点画像生成方法およびその装置
JP2000253422A (ja) * 1999-03-03 2000-09-14 Toshiba Corp ２次元映像からの立体映像生成方法
JP2000261828A (ja) * 1999-03-04 2000-09-22 Toshiba Corp 立体映像生成方法
JP2001359119A (ja) * 2000-06-15 2001-12-26 Toshiba Corp 立体映像生成方法

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3096595B2 (ja) * 1994-12-28 2000-10-10 三洋電機株式会社 立体映像発生装置
JP3249335B2 (ja) * 1995-04-17 2002-01-21 三洋電機株式会社 ３次元映像変換方法
JP3771964B2 (ja) * 1996-03-12 2006-05-10 オリンパス株式会社 立体映像ディスプレイ装置
JPH1198533A (ja) * 1997-09-24 1999-04-09 Sanyo Electric Co Ltd ２次元映像を３次元映像に変換する方法
EP1044432A4 (en) * 1997-12-05 2007-02-21 Dynamic Digital Depth Res Pty IMPROVED IMAGE TRANSFORMATION AND CODING TECHNIQUES
JP4056154B2 (ja) * 1997-12-30 2008-03-05 三星電子株式会社 ２次元連続映像の３次元映像変換装置及び方法並びに３次元映像の後処理方法
JP4118146B2 (ja) * 2003-01-09 2008-07-16 三洋電機株式会社 立体画像処理装置
JP4006601B2 (ja) * 2004-03-29 2007-11-14 セイコーエプソン株式会社 画像処理システム、プロジェクタ、プログラム、情報記憶媒体および画像処理方法
JP2006041811A (ja) * 2004-07-26 2006-02-09 Kddi Corp 自由視点画像ストリーミング方式
RU2407224C2 (ru) * 2005-04-19 2010-12-20 Конинклейке Филипс Электроникс Н.В. Восприятие глубины
CN101390131B (zh) * 2006-02-27 2013-03-13 皇家飞利浦电子股份有限公司 呈现输出图像
CN101287142A (zh) * 2008-05-16 2008-10-15 清华大学 基于双向跟踪和特征点修正的平面视频转立体视频的方法
CN101282492B (zh) * 2008-05-23 2010-07-21 清华大学 三维影像显示深度调整方法
CN101610423B (zh) * 2009-07-13 2010-09-08 清华大学 一种渲染图像的方法和装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000215311A (ja) * 1999-01-21 2000-08-04 Nippon Telegr & Teleph Corp <Ntt> 仮想視点画像生成方法およびその装置
JP2000253422A (ja) * 1999-03-03 2000-09-14 Toshiba Corp ２次元映像からの立体映像生成方法
JP2000261828A (ja) * 1999-03-04 2000-09-22 Toshiba Corp 立体映像生成方法
JP2001359119A (ja) * 2000-06-15 2001-12-26 Toshiba Corp 立体映像生成方法

Also Published As

Publication number Publication date
JP2013534742A (ja) 2013-09-05
CN103081476B (zh) 2016-08-10
KR20110134142A (ko) 2011-12-14
KR101385514B1 (ko) 2014-04-16
US20130069942A1 (en) 2013-03-21
EP2582143A4 (en) 2014-01-01
CN103081476A (zh) 2013-05-01
WO2011155697A2 (ko) 2011-12-15
EP2582143A2 (en) 2013-04-17

Similar Documents

Publication Publication Date Title
WO2011155697A3 (ko) 깊이 맵 정보를 이용한 입체 영상 변환 방법 및 장치
GB2501796A8 (en) System and method of image rendering
US9171373B2 (en) System of image stereo matching
WO2011060579A8 (en) Method for generating depth maps from monocular images and systems using the same
WO2016140934A3 (en) Methods and apparatus for 3d image rendering
WO2013052455A3 (en) Resolution enhanced 3d video rendering systems and methods
WO2010074437A3 (en) Image processing method and apparatus therefor
WO2014125502A3 (en) Segmenting objects in multimedia data
WO2011017485A3 (en) 3d autostereoscopic display with true depth perception
WO2012044105A3 (ko) 평활화 보간 필터를 이용하여 영상을 보간하는 방법 및 그 장치
WO2009157668A3 (en) Method and apparatus for outputting and displaying image data
GB2483213A8 (en) 3D image generation
DE602008005312D1 (de) Nichtfotorealistische wiedergabe von erweiterter realität
WO2013068271A3 (en) Method for processing a stereoscopic image comprising an embedded object and corresponding device
WO2009013682A3 (en) Method and apparatus for depth-related information propagation
WO2010151049A3 (en) Method and apparatus for automatic transformation of three-dimensional video
EP2432229A3 (en) Object tracking and highlighting in stereoscopic images
WO2012142505A3 (en) Pixel value compaction for graphics processing
WO2013006115A3 (en) Depth or disparity map upscaling
WO2012099438A3 (en) Method of adaptive frame prediction for multiview video sequence coding
WO2014014603A3 (en) Crosstalk reduction with location-based adjustment in multiview video processing
WO2013002716A3 (en) A method a decoder and encoder for processing a motion vector
WO2009157713A3 (en) Image processing method and apparatus
WO2011135052A8 (en) Apparent display resolution enhancement for moving images
WO2008156010A1 (ja) 画像処理装置、画像処理方法、及びプログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180028234.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11792608

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 13700939

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2013513099

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2011792608

Country of ref document: EP