JP2024522463A - マルチビュービデオにおける奥行きセグメント化 - Google Patents

マルチビュービデオにおける奥行きセグメント化 Download PDF

Info

Publication number
JP2024522463A
JP2024522463A JP2023571330A JP2023571330A JP2024522463A JP 2024522463 A JP2024522463 A JP 2024522463A JP 2023571330 A JP2023571330 A JP 2023571330A JP 2023571330 A JP2023571330 A JP 2023571330A JP 2024522463 A JP2024522463 A JP 2024522463A
Authority
JP
Japan
Prior art keywords
patch
source
depth
view
depth map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2023571330A
Other languages
English (en)
Japanese (ja)
Other versions
JP2024522463A5 (https=
Inventor
クリスティアーン ファレカムプ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2024522463A publication Critical patent/JP2024522463A/ja
Publication of JP2024522463A5 publication Critical patent/JP2024522463A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/136—Segmentation; Edge detection involving thresholding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20224—Image subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/275—Image signal generators from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Analysis (AREA)
JP2023571330A 2021-06-03 2022-05-25 マルチビュービデオにおける奥行きセグメント化 Pending JP2024522463A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP21177608.3A EP4099270A1 (en) 2021-06-03 2021-06-03 Depth segmentation in multi-view videos
EP21177608.3 2021-06-03
PCT/EP2022/064243 WO2022253677A1 (en) 2021-06-03 2022-05-25 Depth segmentation in multi-view videos

Publications (2)

Publication Number Publication Date
JP2024522463A true JP2024522463A (ja) 2024-06-21
JP2024522463A5 JP2024522463A5 (https=) 2025-03-18

Family

ID=76269657

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023571330A Pending JP2024522463A (ja) 2021-06-03 2022-05-25 マルチビュービデオにおける奥行きセグメント化

Country Status (9)

Country Link
US (1) US12430836B2 (https=)
EP (2) EP4099270A1 (https=)
JP (1) JP2024522463A (https=)
KR (1) KR20240016401A (https=)
CN (1) CN117413294A (https=)
BR (1) BR112023025252A2 (https=)
CA (1) CA3221973A1 (https=)
TW (1) TW202305746A (https=)
WO (1) WO2022253677A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240257369A1 (en) * 2023-01-31 2024-08-01 Sony Interactive Entertainment LLC Systems and methods for video data depth determination and video modification
US12567167B2 (en) * 2023-02-06 2026-03-03 Walmart Apollo, Llc Systems and methods for analyzing depth in images obtained in product storage facilities to detect outlier items
CN116168071B (zh) * 2023-02-08 2026-03-24 杭州海康机器人股份有限公司 深度数据获取方法、装置、电子设备及机器可读存储介质
US20240391695A1 (en) * 2023-05-24 2024-11-28 United States Postal Service Vehicle mounted sensors and methods of using the same
US20250193443A1 (en) * 2023-12-07 2025-06-12 Electronics And Telecommunications Research Institute Method and apparatus for encoding multi plane image based volumetric video
TWI900021B (zh) * 2024-05-22 2025-10-01 鴻海精密工業股份有限公司 深度估計方法、裝置、電子設備及儲存介質
CN120111200A (zh) * 2025-01-15 2025-06-06 北京天马辉电子技术有限责任公司 3d显示图像生成方法及相关设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009083854A2 (en) * 2007-12-20 2009-07-09 Koninklijke Philips Electronics N.V. Segmentation of image data
WO2018150933A1 (ja) * 2017-02-20 2018-08-23 ソニー株式会社 画像処理装置および画像処理方法
WO2021011040A1 (en) * 2019-07-15 2021-01-21 Google Llc Video background subtraction using depth

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011036761A1 (ja) 2009-09-25 2011-03-31 株式会社東芝 多視点画像生成方法および装置
US20120236114A1 (en) 2011-03-18 2012-09-20 Te-Hao Chang Depth information generator for generating depth information output by only processing part of received images having different views, and related depth information generating method and depth adjusting apparatus thereof
CN104604232A (zh) 2012-04-30 2015-05-06 数码士控股有限公司 用于编码多视点图像的方法及装置,以及用于解码多视点图像的方法及装置
US10089740B2 (en) * 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
CN109147025B (zh) * 2018-07-11 2023-07-18 北京航空航天大学 一种面向rgbd三维重建的纹理生成方法
US10965932B2 (en) 2019-03-19 2021-03-30 Intel Corporation Multi-pass add-on tool for coherent and complete view synthesis
CN110148217A (zh) * 2019-05-24 2019-08-20 北京华捷艾米科技有限公司 一种实时三维重建方法、装置及设备
US12230002B2 (en) * 2019-10-01 2025-02-18 Intel Corporation Object-based volumetric video coding
KR102696467B1 (ko) * 2022-09-16 2024-08-19 한국전자통신연구원 이동시점 동영상 생성 장치 및 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009083854A2 (en) * 2007-12-20 2009-07-09 Koninklijke Philips Electronics N.V. Segmentation of image data
JP2011509451A (ja) * 2007-12-20 2011-03-24 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 画像データのセグメント化
WO2018150933A1 (ja) * 2017-02-20 2018-08-23 ソニー株式会社 画像処理装置および画像処理方法
WO2021011040A1 (en) * 2019-07-15 2021-01-21 Google Llc Video background subtraction using depth

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
EUN-KYUNG LEE: "Three-dimensional video generation using foreground separation and disocclusion detection", 2010 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO, JPN7025005706, 2010, ISSN: 0005766064 *
MAZIAR LOGHMAN: "Segmentation-based view synthesis for multi-view video plus depth", MULTIMEDIA TOOLS AND APPLICATIONS, JPN7025005705, 2013, ISSN: 0005766062 *
奥脇舞希: "多視点画像から得られた３次元点群を用いた高精度なメッシュ復元", 信学技報, JPN6025053947, 2015, ISSN: 0005766063 *

Also Published As

Publication number Publication date
EP4348577A1 (en) 2024-04-10
CN117413294A (zh) 2024-01-16
CA3221973A1 (en) 2022-12-08
US20240378789A1 (en) 2024-11-14
US12430836B2 (en) 2025-09-30
BR112023025252A2 (pt) 2024-02-20
WO2022253677A1 (en) 2022-12-08
EP4099270A1 (en) 2022-12-07
KR20240016401A (ko) 2024-02-06
TW202305746A (zh) 2023-02-01

Similar Documents

Publication Publication Date Title
US12430836B2 (en) Depth segmentation in multi-view videos
JP6914734B2 (ja) シルエット抽出装置、方法およびプログラム
US20240062402A1 (en) Depth orders for multi-view frame storing and rendering
JP2024522463A5 (https=)
EP4361957B1 (en) Image-tiles-based environment reconstruction
Khan et al. A homographic framework for the fusion of multi-view silhouettes
Lee et al. Silhouette segmentation in multiple views
Sankoh et al. Robust billboard-based, free-viewpoint video synthesis algorithm to overcome occlusions under challenging outdoor sport scenes
US20240406363A1 (en) Handling blur in multi-view imaging
Chari et al. Augmented reality using over-segmentation
US12190444B2 (en) Image-based environment reconstruction with view-dependent colour
JP6811679B2 (ja) シルエット抽出装置、方法およびプログラム
Leung et al. Embedded voxel colouring with adaptive threshold selection using globally minimal surfaces
Kim et al. Compensated visual hull for defective segmentation and occlusion
JP5838112B2 (ja) 複数の被写体領域を分離する方法、プログラム及び装置
Yang et al. Multiview video depth estimation with spatial-temporal consistency.
US12488531B2 (en) Multi object surface image (MOSI) format
Kilner Free-Viewpoint Video for Outdoor Sporting Events
Ishii et al. Joint rendering and segmentation of free-viewpoint video
Michoud et al. Towards removing ghost-components from visual-hull estimations
Yamasaki et al. for Human Refinement Performance of Visual Capture
Rajeshkannan et al. Improved Stereo Matching Algorithm Using Contrast Limited Adaptive Histogram Equalization.
Chen Background Estimation with GPU Speed Up

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250306

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20250306

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20251222

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260106

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260326