CN111386556B - 用于生成3d场景的点的方法和装置 - Google Patents

用于生成3d场景的点的方法和装置 Download PDF

Info

Publication number
CN111386556B
CN111386556B CN201880076258.6A CN201880076258A CN111386556B CN 111386556 B CN111386556 B CN 111386556B CN 201880076258 A CN201880076258 A CN 201880076258A CN 111386556 B CN111386556 B CN 111386556B
Authority
CN
China
Prior art keywords
depth
point
points
scene
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880076258.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN111386556A (zh
Inventor
S.拉塞尔
J.里卡德
R.朱利安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
InterDigital VC Holdings Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by InterDigital VC Holdings Inc filed Critical InterDigital VC Holdings Inc
Publication of CN111386556A publication Critical patent/CN111386556A/zh
Application granted granted Critical
Publication of CN111386556B publication Critical patent/CN111386556B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/529—Depth or shape recovery from texture
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/56—Particle system, point based geometry or rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Image Generation (AREA)
  • Processing Or Creating Images (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
CN201880076258.6A 2017-10-06 2018-10-03 用于生成3d场景的点的方法和装置 Active CN111386556B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP17306345.4 2017-10-06
EP17306345.4A EP3467782A1 (en) 2017-10-06 2017-10-06 Method and device for generating points of a 3d scene
PCT/US2018/054057 WO2019070778A1 (en) 2017-10-06 2018-10-03 METHOD AND DEVICE FOR GENERATING POINTS OF A 3D SCENE

Publications (2)

Publication Number Publication Date
CN111386556A CN111386556A (zh) 2020-07-07
CN111386556B true CN111386556B (zh) 2024-03-12

Family

ID=60143653

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880076258.6A Active CN111386556B (zh) 2017-10-06 2018-10-03 用于生成3d场景的点的方法和装置

Country Status (9)

Country Link
US (1) US11830210B2 (enExample)
EP (2) EP3467782A1 (enExample)
JP (1) JP7407703B2 (enExample)
KR (1) KR102537420B1 (enExample)
CN (1) CN111386556B (enExample)
BR (1) BR112020006530A2 (enExample)
DK (1) DK3692509T3 (enExample)
HU (1) HUE061036T2 (enExample)
WO (1) WO2019070778A1 (enExample)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10907954B2 (en) * 2018-09-28 2021-02-02 Hand Held Products, Inc. Methods and systems for measuring dimensions of a 2-D object
GB2584119B (en) * 2019-05-22 2022-11-02 Sony Interactive Entertainment Inc Content coding system and method
WO2021215849A1 (ko) * 2020-04-22 2021-10-28 엘지전자 주식회사 포인트 클라우드 데이터 처리 장치 및 처리 방법
WO2022050650A1 (ko) * 2020-09-03 2022-03-10 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
US11823327B2 (en) 2020-11-19 2023-11-21 Samsung Electronics Co., Ltd. Method for rendering relighted 3D portrait of person and computing device for the same
WO2022119304A1 (ko) * 2020-12-01 2022-06-09 현대자동차주식회사 적응적 데드존 양자화를 이용하는 포인트 클라우드 코딩 장치 및 방법
MX2023007152A (es) * 2021-01-06 2023-07-21 Lg Electronics Inc Dispositivo de transmision de datos de nube de puntos, metodo de transmision de datos de nube de puntos, dispositivo de recepcion de datos de nube de puntos y metodo de recepcion de datos de nube de puntos.
KR102665543B1 (ko) 2021-02-22 2024-05-16 한국전자통신연구원 다시점 영상으로부터의 깊이지도 생성 장치 및 방법
CN113781653B (zh) * 2021-08-17 2022-09-23 北京百度网讯科技有限公司 对象模型生成方法、装置、电子设备及存储介质
US11756281B1 (en) * 2023-03-14 2023-09-12 Illuscio, Inc. Systems and methods for splat filling a three-dimensional image using semi-measured data
US11935209B1 (en) 2023-07-24 2024-03-19 Illuscio, Inc. Systems and methods for dynamic backfilling of a three-dimensional object
JP2025058733A (ja) * 2023-09-28 2025-04-09 キヤノン株式会社 生成装置、再生装置、情報処理方法、およびプログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1716311A (zh) * 2004-06-28 2006-01-04 微软公司 用于生成场景的两层、3d表示的系统和过程
CN102055982A (zh) * 2011-01-13 2011-05-11 浙江大学 三维视频编解码方法及装置
CN102939763A (zh) * 2010-06-14 2013-02-20 高通股份有限公司 计算三维图像的视差
CN104981849A (zh) * 2013-02-12 2015-10-14 汤姆逊许可公司 用于丰富深度图的内容的方法和设备
CN105825544A (zh) * 2015-11-25 2016-08-03 维沃移动通信有限公司 一种图像处理方法及移动终端

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7576737B2 (en) * 2004-09-24 2009-08-18 Konica Minolta Medical & Graphic, Inc. Image processing device and program
EP1875440B1 (en) 2005-04-19 2008-12-03 Koninklijke Philips Electronics N.V. Depth perception
US8249334B2 (en) * 2006-05-11 2012-08-21 Primesense Ltd. Modeling of humanoid forms from depth maps
KR20090076412A (ko) * 2008-01-08 2009-07-13 삼성전자주식회사 모델링 방법 및 장치
US9645240B1 (en) * 2010-05-10 2017-05-09 Faro Technologies, Inc. Method for optically scanning and measuring an environment
JP5858380B2 (ja) * 2010-12-03 2016-02-10 国立大学法人名古屋大学 仮想視点画像合成方法及び仮想視点画像合成システム
KR101210625B1 (ko) * 2010-12-28 2012-12-11 주식회사 케이티 빈공간 채움 방법 및 이를 수행하는 3차원 비디오 시스템
US9053571B2 (en) * 2011-06-06 2015-06-09 Microsoft Corporation Generating computer models of 3D objects
US9471988B2 (en) * 2011-11-02 2016-10-18 Google Inc. Depth-map generation for an input image using an example approximate depth-map associated with an example similar image
US9282915B2 (en) * 2011-11-29 2016-03-15 St. Jude Medical, Atrial Fibrillation Division, Inc. Method and system for generating and/or repairing a surface model of a geometric structure
WO2013111994A1 (en) * 2012-01-26 2013-08-01 Samsung Electronics Co., Ltd. Image processing method and apparatus for 3d video
US8712147B2 (en) * 2012-02-03 2014-04-29 Harris Corporation Fractal method for detecting and filling data gaps within LiDAR data
WO2014016895A1 (ja) * 2012-07-23 2014-01-30 富士通株式会社 形状データ生成プログラム、形状データ生成方法及び形状データ生成装置
US9811880B2 (en) * 2012-11-09 2017-11-07 The Boeing Company Backfilling points in a point cloud
US9756359B2 (en) * 2013-12-16 2017-09-05 Qualcomm Incorporated Large blocks and depth modeling modes (DMM'S) in 3D video coding
US9171403B2 (en) * 2014-02-13 2015-10-27 Microsoft Technology Licensing, Llc Contour completion for augmenting surface reconstructions
US9292961B1 (en) * 2014-08-26 2016-03-22 The Boeing Company System and method for detecting a structural opening in a three dimensional point cloud
US9792531B2 (en) * 2015-09-16 2017-10-17 Siemens Healthcare Gmbh Intelligent multi-scale medical image landmark detection
GB2543749A (en) * 2015-10-21 2017-05-03 Nokia Technologies Oy 3D scene rendering
US20170186223A1 (en) * 2015-12-23 2017-06-29 Intel Corporation Detection of shadow regions in image depth data caused by multiple image sensors
US10192103B2 (en) * 2016-01-15 2019-01-29 Stereovision Imaging, Inc. System and method for detecting and removing occlusions in a three-dimensional image
EP3434012A1 (en) * 2016-03-21 2019-01-30 InterDigital CE Patent Holdings Dibr with depth map preprocessing for reducing visibility of holes by locally blurring hole areas
US20170323471A1 (en) * 2016-05-06 2017-11-09 National Taiwan University 3D rendering method and 3D graphics processing device
US10074160B2 (en) * 2016-09-30 2018-09-11 Disney Enterprises, Inc. Point cloud noise and outlier removal for image-based 3D reconstruction
US9972067B2 (en) * 2016-10-11 2018-05-15 The Boeing Company System and method for upsampling of sparse point cloud for 3D registration
CN110072673B (zh) * 2016-10-20 2022-11-25 睿博天米以色列有限公司 跟踪人类的机器人及其方法
US10176589B2 (en) * 2017-01-31 2019-01-08 Mitsubishi Electric Research Labroatories, Inc. Method and system for completing point clouds using planar segments
CN108694740A (zh) * 2017-03-06 2018-10-23 索尼公司 信息处理设备、信息处理方法以及用户设备
US10803561B2 (en) * 2017-06-02 2020-10-13 Wisconsin Alumni Research Foundation Systems, methods, and media for hierarchical progressive point cloud rendering
US10509413B2 (en) * 2017-09-07 2019-12-17 GM Global Technology Operations LLC Ground reference determination for autonomous vehicle operations

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1716311A (zh) * 2004-06-28 2006-01-04 微软公司 用于生成场景的两层、3d表示的系统和过程
CN102939763A (zh) * 2010-06-14 2013-02-20 高通股份有限公司 计算三维图像的视差
CN102055982A (zh) * 2011-01-13 2011-05-11 浙江大学 三维视频编解码方法及装置
CN104981849A (zh) * 2013-02-12 2015-10-14 汤姆逊许可公司 用于丰富深度图的内容的方法和设备
CN105825544A (zh) * 2015-11-25 2016-08-03 维沃移动通信有限公司 一种图像处理方法及移动终端

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Robust technique for 3D shape reconstruction;Hamdi Boukamcha , Abdelkader Ben Amara , Fethi Smach , Mohamed Atri;Journal of Computational Science;第21卷;全文 *
基于多RGBD摄像机的动态场景实时三维重建系统;段勇;裴明涛;;北京理工大学学报(第11期);全文 *

Also Published As

Publication number Publication date
EP3692509A1 (en) 2020-08-12
EP3467782A1 (en) 2019-04-10
JP7407703B2 (ja) 2024-01-04
WO2019070778A1 (en) 2019-04-11
US11830210B2 (en) 2023-11-28
BR112020006530A2 (pt) 2020-10-06
DK3692509T3 (da) 2023-01-09
EP3692509B1 (en) 2022-12-07
JP2020536325A (ja) 2020-12-10
KR102537420B1 (ko) 2023-05-26
CN111386556A (zh) 2020-07-07
RU2020115158A (ru) 2021-11-08
HUE061036T2 (hu) 2023-05-28
US20200258247A1 (en) 2020-08-13
KR20200057077A (ko) 2020-05-25

Similar Documents

Publication Publication Date Title
CN111386556B (zh) 用于生成3d场景的点的方法和装置
CN111615715B (zh) 编码/解码体积视频的方法、装置和流
US20200273258A1 (en) Method and device for modifying attributes of points of a 3d scene
US11019363B2 (en) Method and device for encoding a point cloud
CN112219398B (zh) 用于深度编码和解码的方法和装置
US20190108655A1 (en) Method and apparatus for encoding a point cloud representing three-dimensional objects
US11508041B2 (en) Method and apparatus for reconstructing a point cloud representing a 3D object
KR20190105011A (ko) 몰입형 비디오 포맷을 위한 방법, 장치 및 스트림
EP3429206A1 (en) Method and device for encoding a point cloud
US20200302652A1 (en) A method and apparatus for encoding/decoding a colored point cloud representing the geometry and colors of a 3d object
US20200211232A1 (en) A method and apparatus for encoding/decoding a point cloud representing a 3d object
US20210166435A1 (en) Method and apparatus for encoding/decoding the geometry of a point cloud representing a 3d object
US20200296427A1 (en) A method and apparatus for encoding/decoding the colors of a point cloud representing a 3d object
RU2788439C2 (ru) Способ и устройство для генерации точек трехмерной (3d) сцены
HK40036511A (en) Method and device for generating points of a 3d scene
HK40036511B (en) Method and device for generating points of a 3d scene
CN120092450A (zh) 编码/解码点云几何数据

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant