JP7407703B2 - 3dシーンの点を生成するための方法およびデバイス - Google Patents

3dシーンの点を生成するための方法およびデバイス Download PDF

Info

Publication number
JP7407703B2
JP7407703B2 JP2020518785A JP2020518785A JP7407703B2 JP 7407703 B2 JP7407703 B2 JP 7407703B2 JP 2020518785 A JP2020518785 A JP 2020518785A JP 2020518785 A JP2020518785 A JP 2020518785A JP 7407703 B2 JP7407703 B2 JP 7407703B2
Authority
JP
Japan
Prior art keywords
depth
points
point
scene
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020518785A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020536325A5 (enExample
JP2020536325A (ja
Inventor
ラセール,セバスチャン
リカード,ジュリアン
ジュリアン,レミ
Original Assignee
インターデジタル ヴイシー ホールディングス, インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル ヴイシー ホールディングス, インコーポレイテッド filed Critical インターデジタル ヴイシー ホールディングス, インコーポレイテッド
Publication of JP2020536325A publication Critical patent/JP2020536325A/ja
Publication of JP2020536325A5 publication Critical patent/JP2020536325A5/ja
Application granted granted Critical
Publication of JP7407703B2 publication Critical patent/JP7407703B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/529Depth or shape recovery from texture
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/04Texture mapping
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/56Particle system, point based geometry or rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Image Generation (AREA)
  • Processing Or Creating Images (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
JP2020518785A 2017-10-06 2018-10-03 3dシーンの点を生成するための方法およびデバイス Active JP7407703B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP17306345.4 2017-10-06
EP17306345.4A EP3467782A1 (en) 2017-10-06 2017-10-06 Method and device for generating points of a 3d scene
PCT/US2018/054057 WO2019070778A1 (en) 2017-10-06 2018-10-03 METHOD AND DEVICE FOR GENERATING POINTS OF A 3D SCENE

Publications (3)

Publication Number Publication Date
JP2020536325A JP2020536325A (ja) 2020-12-10
JP2020536325A5 JP2020536325A5 (enExample) 2021-11-11
JP7407703B2 true JP7407703B2 (ja) 2024-01-04

Family

ID=60143653

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020518785A Active JP7407703B2 (ja) 2017-10-06 2018-10-03 3dシーンの点を生成するための方法およびデバイス

Country Status (9)

Country Link
US (1) US11830210B2 (enExample)
EP (2) EP3467782A1 (enExample)
JP (1) JP7407703B2 (enExample)
KR (1) KR102537420B1 (enExample)
CN (1) CN111386556B (enExample)
BR (1) BR112020006530A2 (enExample)
DK (1) DK3692509T3 (enExample)
HU (1) HUE061036T2 (enExample)
WO (1) WO2019070778A1 (enExample)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10907954B2 (en) * 2018-09-28 2021-02-02 Hand Held Products, Inc. Methods and systems for measuring dimensions of a 2-D object
GB2584119B (en) * 2019-05-22 2022-11-02 Sony Interactive Entertainment Inc Content coding system and method
WO2021215849A1 (ko) * 2020-04-22 2021-10-28 엘지전자 주식회사 포인트 클라우드 데이터 처리 장치 및 처리 방법
WO2022050650A1 (ko) * 2020-09-03 2022-03-10 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
US11823327B2 (en) 2020-11-19 2023-11-21 Samsung Electronics Co., Ltd. Method for rendering relighted 3D portrait of person and computing device for the same
WO2022119304A1 (ko) * 2020-12-01 2022-06-09 현대자동차주식회사 적응적 데드존 양자화를 이용하는 포인트 클라우드 코딩 장치 및 방법
MX2023007152A (es) * 2021-01-06 2023-07-21 Lg Electronics Inc Dispositivo de transmision de datos de nube de puntos, metodo de transmision de datos de nube de puntos, dispositivo de recepcion de datos de nube de puntos y metodo de recepcion de datos de nube de puntos.
KR102665543B1 (ko) 2021-02-22 2024-05-16 한국전자통신연구원 다시점 영상으로부터의 깊이지도 생성 장치 및 방법
CN113781653B (zh) * 2021-08-17 2022-09-23 北京百度网讯科技有限公司 对象模型生成方法、装置、电子设备及存储介质
US11756281B1 (en) * 2023-03-14 2023-09-12 Illuscio, Inc. Systems and methods for splat filling a three-dimensional image using semi-measured data
US11935209B1 (en) 2023-07-24 2024-03-19 Illuscio, Inc. Systems and methods for dynamic backfilling of a three-dimensional object
JP2025058733A (ja) * 2023-09-28 2025-04-09 キヤノン株式会社 生成装置、再生装置、情報処理方法、およびプログラム

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090174710A1 (en) 2008-01-08 2009-07-09 Samsung Electronics Co., Ltd. Modeling method and apparatus

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7015926B2 (en) * 2004-06-28 2006-03-21 Microsoft Corporation System and process for generating a two-layer, 3D representation of a scene
US7576737B2 (en) * 2004-09-24 2009-08-18 Konica Minolta Medical & Graphic, Inc. Image processing device and program
EP1875440B1 (en) 2005-04-19 2008-12-03 Koninklijke Philips Electronics N.V. Depth perception
US8249334B2 (en) * 2006-05-11 2012-08-21 Primesense Ltd. Modeling of humanoid forms from depth maps
US9645240B1 (en) * 2010-05-10 2017-05-09 Faro Technologies, Inc. Method for optically scanning and measuring an environment
US20110304618A1 (en) * 2010-06-14 2011-12-15 Qualcomm Incorporated Calculating disparity for three-dimensional images
JP5858380B2 (ja) * 2010-12-03 2016-02-10 国立大学法人名古屋大学 仮想視点画像合成方法及び仮想視点画像合成システム
KR101210625B1 (ko) * 2010-12-28 2012-12-11 주식회사 케이티 빈공간 채움 방법 및 이를 수행하는 3차원 비디오 시스템
CN102055982B (zh) * 2011-01-13 2012-06-27 浙江大学 三维视频编解码方法及装置
US9053571B2 (en) * 2011-06-06 2015-06-09 Microsoft Corporation Generating computer models of 3D objects
US9471988B2 (en) * 2011-11-02 2016-10-18 Google Inc. Depth-map generation for an input image using an example approximate depth-map associated with an example similar image
US9282915B2 (en) * 2011-11-29 2016-03-15 St. Jude Medical, Atrial Fibrillation Division, Inc. Method and system for generating and/or repairing a surface model of a geometric structure
WO2013111994A1 (en) * 2012-01-26 2013-08-01 Samsung Electronics Co., Ltd. Image processing method and apparatus for 3d video
US8712147B2 (en) * 2012-02-03 2014-04-29 Harris Corporation Fractal method for detecting and filling data gaps within LiDAR data
WO2014016895A1 (ja) * 2012-07-23 2014-01-30 富士通株式会社 形状データ生成プログラム、形状データ生成方法及び形状データ生成装置
US9811880B2 (en) * 2012-11-09 2017-11-07 The Boeing Company Backfilling points in a point cloud
WO2014124871A2 (en) 2013-02-12 2014-08-21 Thomson Licensing Method and device for enriching the content of a depth map
US9756359B2 (en) * 2013-12-16 2017-09-05 Qualcomm Incorporated Large blocks and depth modeling modes (DMM'S) in 3D video coding
US9171403B2 (en) * 2014-02-13 2015-10-27 Microsoft Technology Licensing, Llc Contour completion for augmenting surface reconstructions
US9292961B1 (en) * 2014-08-26 2016-03-22 The Boeing Company System and method for detecting a structural opening in a three dimensional point cloud
US9792531B2 (en) * 2015-09-16 2017-10-17 Siemens Healthcare Gmbh Intelligent multi-scale medical image landmark detection
GB2543749A (en) * 2015-10-21 2017-05-03 Nokia Technologies Oy 3D scene rendering
CN105825544B (zh) * 2015-11-25 2019-08-20 维沃移动通信有限公司 一种图像处理方法及移动终端
US20170186223A1 (en) * 2015-12-23 2017-06-29 Intel Corporation Detection of shadow regions in image depth data caused by multiple image sensors
US10192103B2 (en) * 2016-01-15 2019-01-29 Stereovision Imaging, Inc. System and method for detecting and removing occlusions in a three-dimensional image
EP3434012A1 (en) * 2016-03-21 2019-01-30 InterDigital CE Patent Holdings Dibr with depth map preprocessing for reducing visibility of holes by locally blurring hole areas
US20170323471A1 (en) * 2016-05-06 2017-11-09 National Taiwan University 3D rendering method and 3D graphics processing device
US10074160B2 (en) * 2016-09-30 2018-09-11 Disney Enterprises, Inc. Point cloud noise and outlier removal for image-based 3D reconstruction
US9972067B2 (en) * 2016-10-11 2018-05-15 The Boeing Company System and method for upsampling of sparse point cloud for 3D registration
CN110072673B (zh) * 2016-10-20 2022-11-25 睿博天米以色列有限公司 跟踪人类的机器人及其方法
US10176589B2 (en) * 2017-01-31 2019-01-08 Mitsubishi Electric Research Labroatories, Inc. Method and system for completing point clouds using planar segments
CN108694740A (zh) * 2017-03-06 2018-10-23 索尼公司 信息处理设备、信息处理方法以及用户设备
US10803561B2 (en) * 2017-06-02 2020-10-13 Wisconsin Alumni Research Foundation Systems, methods, and media for hierarchical progressive point cloud rendering
US10509413B2 (en) * 2017-09-07 2019-12-17 GM Global Technology Operations LLC Ground reference determination for autonomous vehicle operations

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090174710A1 (en) 2008-01-08 2009-07-09 Samsung Electronics Co., Ltd. Modeling method and apparatus

Also Published As

Publication number Publication date
EP3692509A1 (en) 2020-08-12
EP3467782A1 (en) 2019-04-10
WO2019070778A1 (en) 2019-04-11
US11830210B2 (en) 2023-11-28
BR112020006530A2 (pt) 2020-10-06
DK3692509T3 (da) 2023-01-09
EP3692509B1 (en) 2022-12-07
JP2020536325A (ja) 2020-12-10
KR102537420B1 (ko) 2023-05-26
CN111386556A (zh) 2020-07-07
CN111386556B (zh) 2024-03-12
RU2020115158A (ru) 2021-11-08
HUE061036T2 (hu) 2023-05-28
US20200258247A1 (en) 2020-08-13
KR20200057077A (ko) 2020-05-25

Similar Documents

Publication Publication Date Title
JP7407703B2 (ja) 3dシーンの点を生成するための方法およびデバイス
KR102594003B1 (ko) 볼류메트릭 비디오를 인코딩/디코딩하기 위한 방법, 장치 및 스트림
US20200273258A1 (en) Method and device for modifying attributes of points of a 3d scene
CN111095362B (zh) 用于编码点云的方法和设备
US20190108655A1 (en) Method and apparatus for encoding a point cloud representing three-dimensional objects
CN113597771A (zh) 用于处理点云数据的设备和方法
EP3429206A1 (en) Method and device for encoding a point cloud
CN110915216A (zh) 用于编码/解码表示3d对象的几何形状和颜色的有色点云的方法和装置
US20210166435A1 (en) Method and apparatus for encoding/decoding the geometry of a point cloud representing a 3d object
US20250209674A1 (en) Methods and apparatus of encoding/decoding positions of points of a point cloud encompassed in a cuboid volume
CN118985133A (zh) 编码/解码在长方体体积中包含的点云的点的位置
US20240179347A1 (en) Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
WO2024140684A1 (zh) 端云协同系统、编解码方法及电子设备
RU2788439C2 (ru) Способ и устройство для генерации точек трехмерной (3d) сцены
HK40036511B (en) Method and device for generating points of a 3d scene
HK40036511A (en) Method and device for generating points of a 3d scene
WO2024093215A1 (en) Encoding/decoding point cloud geometry data

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210928

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210928

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221104

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230202

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230529

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230816

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231128

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231219

R150 Certificate of patent or registration of utility model

Ref document number: 7407703

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150