TW201023618A - View synthesis with boundary-splatting - Google Patents
View synthesis with boundary-splatting Download PDFInfo
- Publication number
- TW201023618A TW201023618A TW098129161A TW98129161A TW201023618A TW 201023618 A TW201023618 A TW 201023618A TW 098129161 A TW098129161 A TW 098129161A TW 98129161 A TW98129161 A TW 98129161A TW 201023618 A TW201023618 A TW 201023618A
- Authority
- TW
- Taiwan
- Prior art keywords
- pixel
- pixels
- view
- depth
- candidate
- Prior art date
Links
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 39
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 39
- 238000000034 method Methods 0.000 claims description 55
- 238000012935 Averaging Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 230000000116 mitigating effect Effects 0.000 abstract 1
- 230000004927 fusion Effects 0.000 description 22
- 238000012545 processing Methods 0.000 description 22
- 230000006870 function Effects 0.000 description 19
- 238000002156 mixing Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 14
- 238000004891 communication Methods 0.000 description 11
- 238000007499 fusion processing Methods 0.000 description 10
- 239000000872 buffer Substances 0.000 description 9
- 241001589086 Bellapiscis medius Species 0.000 description 8
- 239000002131 composite material Substances 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 7
- 239000003550 marker Substances 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000011156 evaluation Methods 0.000 description 6
- 239000000945 filler Substances 0.000 description 5
- 230000003139 buffering effect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000012952 Resampling Methods 0.000 description 2
- 239000000969 carrier Substances 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000002775 capsule Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 229920000314 poly p-methyl styrene Polymers 0.000 description 1
- 239000011148 porous material Substances 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 206010063401 primary progressive multiple sclerosis Diseases 0.000 description 1
- 230000001007 puffing effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/003—Aspects relating to the "2D+depth" image format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/005—Aspects relating to the "3D+depth" image format
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US9296708P | 2008-08-29 | 2008-08-29 | |
| US19261208P | 2008-09-19 | 2008-09-19 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW201023618A true TW201023618A (en) | 2010-06-16 |
Family
ID=41226021
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW098129161A TW201023618A (en) | 2008-08-29 | 2009-08-28 | View synthesis with boundary-splatting |
| TW098129160A TWI463864B (zh) | 2008-08-29 | 2009-08-28 | 具試探式視圖融合之視圖合成 |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW098129160A TWI463864B (zh) | 2008-08-29 | 2009-08-28 | 具試探式視圖融合之視圖合成 |
Country Status (8)
| Country | Link |
|---|---|
| US (2) | US20110148858A1 (enExample) |
| EP (2) | EP2327224A2 (enExample) |
| JP (2) | JP5551166B2 (enExample) |
| KR (2) | KR20110063778A (enExample) |
| CN (2) | CN102138334A (enExample) |
| BR (2) | BRPI0916882A2 (enExample) |
| TW (2) | TW201023618A (enExample) |
| WO (3) | WO2010024938A2 (enExample) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9105130B2 (en) | 2012-02-07 | 2015-08-11 | National Chung Cheng University | View synthesis method capable of depth mismatching checking and depth error compensation |
| CN105488792A (zh) * | 2015-11-26 | 2016-04-13 | 浙江科技学院 | 基于字典学习和机器学习的无参考立体图像质量评价方法 |
Families Citing this family (57)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10187589B2 (en) * | 2008-12-19 | 2019-01-22 | Saab Ab | System and method for mixing a scene with a virtual scenario |
| JP5249114B2 (ja) * | 2009-04-03 | 2013-07-31 | Ｋｄｄｉ株式会社 | 画像生成装置、方法及びプログラム |
| US9124874B2 (en) * | 2009-06-05 | 2015-09-01 | Qualcomm Incorporated | Encoding of three-dimensional conversion information with two-dimensional video sequence |
| JP5209121B2 (ja) * | 2009-09-18 | 2013-06-12 | 株式会社東芝 | 視差画像生成装置 |
| JP2011151773A (ja) * | 2009-12-21 | 2011-08-04 | Canon Inc | 映像処理装置及び制御方法 |
| TWI434227B (zh) * | 2009-12-29 | 2014-04-11 | Ind Tech Res Inst | 動畫產生系統及方法 |
| CN101895752B (zh) * | 2010-07-07 | 2012-12-19 | 清华大学 | 基于图像视觉质量的视频传输方法、系统及装置 |
| CN101895753B (zh) * | 2010-07-07 | 2013-01-16 | 清华大学 | 基于网络拥塞程度的视频传输方法、系统及装置 |
| JP5627498B2 (ja) * | 2010-07-08 | 2014-11-19 | 株式会社東芝 | 立体画像生成装置及び方法 |
| US8760517B2 (en) * | 2010-09-27 | 2014-06-24 | Apple Inc. | Polarized images for security |
| JP5858380B2 (ja) * | 2010-12-03 | 2016-02-10 | 国立大学法人名古屋大学 | 仮想視点画像合成方法及び仮想視点画像合成システム |
| BR112013016890A8 (pt) | 2010-12-30 | 2018-01-02 | Michelin & Cie | Sistema a base de piezoeléctrico e método para determinação de carga de pneu |
| US20120262542A1 (en) * | 2011-04-15 | 2012-10-18 | Qualcomm Incorporated | Devices and methods for warping and hole filling during view synthesis |
| US8988558B2 (en) | 2011-04-26 | 2015-03-24 | Omnivision Technologies, Inc. | Image overlay in a mobile device |
| US9536312B2 (en) * | 2011-05-16 | 2017-01-03 | Microsoft Corporation | Depth reconstruction using plural depth capture units |
| CA2841192C (en) * | 2011-07-15 | 2017-07-11 | Lg Electronics Inc. | Method and apparatus for processing a 3d service |
| WO2013022401A2 (en) * | 2011-08-10 | 2013-02-14 | Telefonaktiebolaget L M Ericsson (Publ) | Method and apparatus for creating a disocclusion map used for coding a three-dimensional video |
| CN102325259A (zh) | 2011-09-09 | 2012-01-18 | 青岛海信数字多媒体技术国家重点实验室有限公司 | 多视点视频中虚拟视点合成方法及装置 |
| CN103828359B (zh) * | 2011-09-29 | 2016-06-22 | 杜比实验室特许公司 | 用于产生场景的视图的方法、编码系统以及解码系统 |
| FR2982448A1 (fr) * | 2011-11-07 | 2013-05-10 | Thomson Licensing | Procede de traitement d'image stereoscopique comprenant un objet incruste et dispositif correspondant |
| WO2013086137A1 (en) | 2011-12-06 | 2013-06-13 | 1-800 Contacts, Inc. | Systems and methods for obtaining a pupillary distance measurement using a mobile computing device |
| JP5911166B2 (ja) * | 2012-01-10 | 2016-04-27 | シャープ株式会社 | 画像処理装置、画像処理方法、画像処理プログラム、撮像装置、及び画像表示装置 |
| WO2013109261A1 (en) | 2012-01-18 | 2013-07-25 | Intel Corporation | Intelligent computational imaging system |
| US10447990B2 (en) * | 2012-02-28 | 2019-10-15 | Qualcomm Incorporated | Network abstraction layer (NAL) unit header design for three-dimensional video coding |
| KR101318552B1 (ko) * | 2012-03-12 | 2013-10-16 | 가톨릭대학교 산학협력단 | 3차원 영상에 대한 인지 왜곡을 측정하는 측정 방법 |
| CN102663741B (zh) * | 2012-03-22 | 2014-09-24 | 侯克杰 | 对彩色数字图像进行视觉立体感知增强的方法及系统 |
| US9483853B2 (en) | 2012-05-23 | 2016-11-01 | Glasses.Com Inc. | Systems and methods to display rendered images |
| US9286715B2 (en) | 2012-05-23 | 2016-03-15 | Glasses.Com Inc. | Systems and methods for adjusting a virtual try-on |
| US9311746B2 (en) | 2012-05-23 | 2016-04-12 | Glasses.Com Inc. | Systems and methods for generating a 3-D model of a virtual try-on product |
| CN103716641B (zh) | 2012-09-29 | 2018-11-09 | 浙江大学 | 预测图像生成方法和装置 |
| CN104081768B (zh) * | 2012-11-30 | 2017-03-01 | 松下知识产权经营株式会社 | 异视点图像生成装置以及异视点图像生成方法 |
| EP2765774A1 (en) | 2013-02-06 | 2014-08-13 | Koninklijke Philips N.V. | System for generating an intermediate view image |
| KR102039741B1 (ko) * | 2013-02-15 | 2019-11-01 | 한국전자통신연구원 | 영상 워핑을 위한 장치 및 방법 |
| WO2014145722A2 (en) * | 2013-03-15 | 2014-09-18 | Digimarc Corporation | Cooperative photography |
| CN104065972B (zh) * | 2013-03-21 | 2018-09-28 | 乐金电子(中国)研究开发中心有限公司 | 一种深度图像编码方法、装置及编码器 |
| CN105308958A (zh) * | 2013-04-05 | 2016-02-03 | 三星电子株式会社 | 用于使用视点合成预测的层间视频编码方法和设备以及用于使用视点合成预测的层间视频解码方法和设备 |
| US20140375663A1 (en) * | 2013-06-24 | 2014-12-25 | Alexander Pfaffe | Interleaved tiled rendering of stereoscopic scenes |
| WO2015167738A1 (en) * | 2014-04-30 | 2015-11-05 | Replay Technologies Inc. | System and method of limiting processing by a 3d reconstruction system of an environment in a 3d reconstruction of an event occurring in an event space |
| TWI517096B (zh) * | 2015-01-12 | 2016-01-11 | 國立交通大學 | 用於立體影像合成之逆向深度映射方法 |
| CN104683788B (zh) * | 2015-03-16 | 2017-01-04 | 四川虹微技术有限公司 | 基于图像重投影的空洞填充方法 |
| WO2016172385A1 (en) * | 2015-04-23 | 2016-10-27 | Ostendo Technologies, Inc. | Methods for full parallax compressed light field synthesis utilizing depth information |
| KR102465969B1 (ko) * | 2015-06-23 | 2022-11-10 | 삼성전자주식회사 | 그래픽스 파이프라인을 수행하는 방법 및 장치 |
| US9773302B2 (en) * | 2015-10-08 | 2017-09-26 | Hewlett-Packard Development Company, L.P. | Three-dimensional object model tagging |
| EP3496388A1 (en) * | 2017-12-05 | 2019-06-12 | Thomson Licensing | A method and apparatus for encoding a point cloud representing three-dimensional objects |
| KR102133090B1 (ko) * | 2018-08-28 | 2020-07-13 | 한국과학기술원 | 실시간 3차원 360 영상 복원 방법 및 그 장치 |
| US11528461B2 (en) | 2018-11-16 | 2022-12-13 | Electronics And Telecommunications Research Institute | Method and apparatus for generating virtual viewpoint image |
| KR102491674B1 (ko) * | 2018-11-16 | 2023-01-26 | 한국전자통신연구원 | 가상시점 영상을 생성하는 방법 및 장치 |
| US11393113B2 (en) | 2019-02-28 | 2022-07-19 | Dolby Laboratories Licensing Corporation | Hole filling for depth image based rendering |
| US11670039B2 (en) | 2019-03-04 | 2023-06-06 | Dolby Laboratories Licensing Corporation | Temporal hole filling for depth image based video rendering |
| KR102192347B1 (ko) * | 2019-03-12 | 2020-12-17 | 한국과학기술원 | 실시간 폴리곤 기반 360 영상 복원 방법 및 그 장치 |
| CN117459718A (zh) | 2019-04-01 | 2024-01-26 | 北京字节跳动网络技术有限公司 | 视频编码中的可选插值滤波器 |
| US10930054B2 (en) * | 2019-06-18 | 2021-02-23 | Intel Corporation | Method and system of robust virtual view generation between camera views |
| EP3997881A4 (en) | 2019-08-20 | 2022-09-14 | Beijing Bytedance Network Technology Co., Ltd. | SELECTIVE USE OF ALTERNATIVE INTERPOLATION FILTERS IN VIDEO PROCESSING |
| EP3937136A1 (en) * | 2020-07-07 | 2022-01-12 | X-Rite Europe GmbH | Visualizing the appearance of at least two materials |
| CN112291549B (zh) * | 2020-09-23 | 2021-07-09 | 广西壮族自治区地图院 | 一种基于dem的光栅地形图立体序列帧图像的获取方法 |
| US11570418B2 (en) | 2021-06-17 | 2023-01-31 | Creal Sa | Techniques for generating light field data by combining multiple synthesized viewpoints |
| KR20230103198A (ko) * | 2021-12-31 | 2023-07-07 | 주식회사 쓰리아이 | 3차원 가상모델 생성을 위한 텍스처링 방법 및 그를 위한 컴퓨팅 장치 |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3826236B2 (ja) * | 1995-05-08 | 2006-09-27 | 松下電器産業株式会社 | 中間像生成方法、中間像生成装置、視差推定方法、及び画像伝送表示装置 |
| JP3769850B2 (ja) * | 1996-12-26 | 2006-04-26 | 松下電器産業株式会社 | 中間視点画像生成方法および視差推定方法および画像伝送方法 |
| WO2001063561A1 (en) * | 2000-02-25 | 2001-08-30 | The Research Foundation Of State University Of New York | Apparatus and method for volume processing and rendering |
| US7079157B2 (en) * | 2000-03-17 | 2006-07-18 | Sun Microsystems, Inc. | Matching the edges of multiple overlapping screen images |
| US7085409B2 (en) * | 2000-10-18 | 2006-08-01 | Sarnoff Corporation | Method and apparatus for synthesizing new video and/or still imagery from a collection of real video and/or still imagery |
| JP2004537082A (ja) * | 2001-01-26 | 2004-12-09 | ザクセル システムズ インコーポレイテッド | 仮想現実環境における実時間バーチャル・ビューポイント |
| US6965379B2 (en) * | 2001-05-08 | 2005-11-15 | Koninklijke Philips Electronics N.V. | N-view synthesis from monocular video of certain broadcast and stored mass media content |
| US7003136B1 (en) * | 2002-04-26 | 2006-02-21 | Hewlett-Packard Development Company, L.P. | Plan-view projections of depth image data for object tracking |
| US7348963B2 (en) * | 2002-05-28 | 2008-03-25 | Reactrix Systems, Inc. | Interactive video display system |
| EP1542167A1 (en) * | 2003-12-09 | 2005-06-15 | Koninklijke Philips Electronics N.V. | Computer graphics processor and method for rendering 3D scenes on a 3D image display screen |
| US7292257B2 (en) * | 2004-06-28 | 2007-11-06 | Microsoft Corporation | Interactive viewpoint video system and process |
| US7364306B2 (en) * | 2005-06-20 | 2008-04-29 | Digital Display Innovations, Llc | Field sequential light source modulation for a digital display system |
| US8384763B2 (en) * | 2005-07-26 | 2013-02-26 | Her Majesty the Queen in right of Canada as represented by the Minster of Industry, Through the Communications Research Centre Canada | Generating a depth map from a two-dimensional source image for stereoscopic and multiview imaging |
| US7471292B2 (en) * | 2005-11-15 | 2008-12-30 | Sharp Laboratories Of America, Inc. | Virtual view specification and synthesis in free viewpoint |
-
2009
- 2009-08-28 KR KR1020117006916A patent/KR20110063778A/ko not_active Ceased
- 2009-08-28 EP EP09806154A patent/EP2327224A2/en not_active Withdrawn
- 2009-08-28 JP JP2011525007A patent/JP5551166B2/ja not_active Expired - Fee Related
- 2009-08-28 TW TW098129161A patent/TW201023618A/zh unknown
- 2009-08-28 BR BRPI0916882A patent/BRPI0916882A2/pt not_active IP Right Cessation
- 2009-08-28 TW TW098129160A patent/TWI463864B/zh not_active IP Right Cessation
- 2009-08-28 KR KR1020117006765A patent/KR20110073474A/ko not_active Withdrawn
- 2009-08-28 CN CN2009801340224A patent/CN102138334A/zh active Pending
- 2009-08-28 WO PCT/US2009/004924 patent/WO2010024938A2/en not_active Ceased
- 2009-08-28 US US12/737,873 patent/US20110148858A1/en not_active Abandoned
- 2009-08-28 CN CN200980134021.XA patent/CN102138333B/zh not_active Expired - Fee Related
- 2009-08-28 US US12/737,890 patent/US20110157229A1/en not_active Abandoned
- 2009-08-28 JP JP2011525011A patent/JP2012501494A/ja active Pending
- 2009-08-28 WO PCT/US2009/004895 patent/WO2010024919A1/en not_active Ceased
- 2009-08-28 WO PCT/US2009/004905 patent/WO2010024925A1/en not_active Ceased
- 2009-08-28 EP EP09789234A patent/EP2321974A1/en not_active Withdrawn
- 2009-08-28 BR BRPI0916902A patent/BRPI0916902A2/pt not_active IP Right Cessation
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9105130B2 (en) | 2012-02-07 | 2015-08-11 | National Chung Cheng University | View synthesis method capable of depth mismatching checking and depth error compensation |
| CN105488792A (zh) * | 2015-11-26 | 2016-04-13 | 浙江科技学院 | 基于字典学习和机器学习的无参考立体图像质量评价方法 |
| CN105488792B (zh) * | 2015-11-26 | 2017-11-28 | 浙江科技学院 | 基于字典学习和机器学习的无参考立体图像质量评价方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2327224A2 (en) | 2011-06-01 |
| BRPI0916902A2 (pt) | 2015-11-24 |
| CN102138333A (zh) | 2011-07-27 |
| WO2010024938A2 (en) | 2010-03-04 |
| US20110157229A1 (en) | 2011-06-30 |
| WO2010024925A1 (en) | 2010-03-04 |
| CN102138333B (zh) | 2014-09-24 |
| KR20110073474A (ko) | 2011-06-29 |
| WO2010024919A1 (en) | 2010-03-04 |
| TW201029442A (en) | 2010-08-01 |
| JP5551166B2 (ja) | 2014-07-16 |
| CN102138334A (zh) | 2011-07-27 |
| WO2010024938A3 (en) | 2010-07-15 |
| JP2012501494A (ja) | 2012-01-19 |
| US20110148858A1 (en) | 2011-06-23 |
| TWI463864B (zh) | 2014-12-01 |
| EP2321974A1 (en) | 2011-05-18 |
| BRPI0916882A2 (pt) | 2016-02-10 |
| JP2012501580A (ja) | 2012-01-19 |
| KR20110063778A (ko) | 2011-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TW201023618A (en) | View synthesis with boundary-splatting | |
| JP5763184B2 (ja) | ３次元画像に対する視差の算出 | |
| JP5607716B2 (ja) | 統合デプス推定 | |
| CN102356637B (zh) | 深度图的编码 | |
| Park et al. | Depth-image-based rendering for 3DTV service over T-DMB | |
| WO2009131703A2 (en) | Coding of depth signal | |
| JP2013540402A (ja) | ユーザ選好に基づいて３ｄビデオレンダリングを調節するための３ｄビデオ制御システム | |
| JP2015521407A (ja) | ３ｄ映像を処理するための品質メトリク | |
| US9497435B2 (en) | Encoder, method in an encoder, decoder and method in a decoder for providing information concerning a spatial validity range | |
| US20220182673A1 (en) | Method and device for multi-view video decoding and method and device for image processing | |
| Huang et al. | Improved depth-assisted error concealment algorithm for 3D video transmission | |
| Rahaman et al. | A novel virtual view quality enhancement technique through a learning of synthesised video | |
| Ostermann et al. | MPEG video compression future | |
| Oh et al. | Evaluation of 3D Data Service Based on Depth Image Based Rendering over T-DMB |