JP6879891B2 - 平面セグメントを用いて点群を完成させる方法およびシステム - Google Patents

平面セグメントを用いて点群を完成させる方法およびシステム Download PDF

Info

Publication number
JP6879891B2
JP6879891B2 JP2017232350A JP2017232350A JP6879891B2 JP 6879891 B2 JP6879891 B2 JP 6879891B2 JP 2017232350 A JP2017232350 A JP 2017232350A JP 2017232350 A JP2017232350 A JP 2017232350A JP 6879891 B2 JP6879891 B2 JP 6879891B2
Authority
JP
Japan
Prior art keywords
point cloud
dimensional
point
plane
signed distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017232350A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018124985A (ja
JP2018124985A5 (enExample
Inventor
田口　裕一
裕一 田口
ヨン・シャオ
ビニート・アール・カマト
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of JP2018124985A publication Critical patent/JP2018124985A/ja
Publication of JP2018124985A5 publication Critical patent/JP2018124985A5/ja
Application granted granted Critical
Publication of JP6879891B2 publication Critical patent/JP6879891B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/457—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by analysing connectivity, e.g. edge linking, connected component analysis or slices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Processing Or Creating Images (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2017232350A 2017-01-31 2017-12-04 平面セグメントを用いて点群を完成させる方法およびシステム Active JP6879891B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/420,245 2017-01-31
US15/420,245 US10176589B2 (en) 2017-01-31 2017-01-31 Method and system for completing point clouds using planar segments

Publications (3)

Publication Number Publication Date
JP2018124985A JP2018124985A (ja) 2018-08-09
JP2018124985A5 JP2018124985A5 (enExample) 2020-10-22
JP6879891B2 true JP6879891B2 (ja) 2021-06-02

Family

ID=62980041

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017232350A Active JP6879891B2 (ja) 2017-01-31 2017-12-04 平面セグメントを用いて点群を完成させる方法およびシステム

Country Status (2)

Country Link
US (1) US10176589B2 (enExample)
JP (1) JP6879891B2 (enExample)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10066946B2 (en) 2016-08-26 2018-09-04 Here Global B.V. Automatic localization geometry detection
LU100465B1 (en) 2017-10-05 2019-04-09 Applications Mobiles Overview Inc System and method for object recognition
EP3467782A1 (en) * 2017-10-06 2019-04-10 Thomson Licensing Method and device for generating points of a 3d scene
US11093759B2 (en) * 2018-03-06 2021-08-17 Here Global B.V. Automatic identification of roadside objects for localization
KR20250005536A (ko) 2018-09-27 2025-01-09 스냅 인코포레이티드 스테레오 추출을 사용하는 3차원 장면 인페인팅
EP3846134A4 (en) * 2018-10-05 2021-11-03 Samsung Electronics Co., Ltd. METHOD AND DEVICE FOR CODING THREE-DIMENSIONAL IMAGES AND METHOD AND DEVICE FOR DECODING THREE-DIMENSIONAL IMAGES
US11029146B2 (en) * 2018-10-18 2021-06-08 Cyberoptics Corporation Three-dimensional sensor with counterposed channels
CN109859114B (zh) * 2018-12-27 2020-10-16 北京大学 基于局域平滑性和非局域相似性的三维点云修复方法
US11869148B2 (en) * 2019-04-12 2024-01-09 Beijing Chengshi Wanglin Information Technology Co., Ltd. Three-dimensional object modeling method, image processing method, image processing device
CN110084840B (zh) * 2019-04-24 2022-05-13 阿波罗智能技术(北京)有限公司 点云配准方法、装置、服务器和计算机可读介质
WO2020240497A1 (en) 2019-05-31 2020-12-03 Applications Mobiles Overview Inc. System and method of generating a 3d representation of an object
CN110443836B (zh) * 2019-06-24 2022-03-18 中国人民解放军战略支援部队信息工程大学 一种基于平面特征的点云数据自动配准方法及装置
US10818071B1 (en) * 2019-07-26 2020-10-27 Google Llc Image-based geometric fusion of multiple depth images using ray casting
KR102770795B1 (ko) * 2019-09-09 2025-02-21 삼성전자주식회사 3d 렌더링 방법 및 장치
CN110569926B (zh) * 2019-09-19 2021-06-08 北京工商大学 一种基于局部边缘特征增强的点云分类方法
CN111462197B (zh) * 2020-03-06 2023-05-26 深圳大学 外观模型获取方法、装置、计算机设备和存储介质
US11321953B2 (en) 2020-03-25 2022-05-03 Hong Kong Applied Science and Technology Research Institute Company Limited Method and apparatus for posture, dimension and shape measurements of objects in 3D scenes
WO2021195854A1 (en) * 2020-03-30 2021-10-07 Shanghaitech University Multi-view neural human rendering
CN113866791A (zh) * 2020-06-30 2021-12-31 商汤集团有限公司 雷达装置采集的数据的处理方法及处理装置
CN112634366B (zh) * 2020-12-23 2023-10-17 北京百度网讯科技有限公司 位置信息的生成方法、相关装置及计算机程序产品
CN112287907B (zh) * 2020-12-24 2021-03-19 湖南联智科技股份有限公司 一种基于点云密度梯度的孔洞识别方法
WO2022141220A1 (zh) * 2020-12-30 2022-07-07 深圳市大疆创新科技有限公司 点云处理方法和装置、测距装置及可移动平台
CN113052955B (zh) * 2021-03-19 2023-06-30 西安电子科技大学 一种点云补全方法、系统及应用
US11741621B2 (en) * 2021-05-10 2023-08-29 Qingdao Pico Technology Co., Ltd. Method and system for detecting plane information
CN113298952B (zh) * 2021-06-11 2022-07-15 哈尔滨工程大学 一种基于数据扩容与相似性度量的残缺点云分类方法
CN114266780A (zh) * 2022-02-28 2022-04-01 深圳市其域创新科技有限公司 一种建筑物单体化实例分割方法及装置
JP2024133937A (ja) * 2023-03-20 2024-10-03 株式会社リコー 三次元形状生成装置、三次元形状生成方法、プログラム、および三次元形状生成システム

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006084385A1 (en) * 2005-02-11 2006-08-17 Macdonald Dettwiler & Associates Inc. 3d imaging system
JP4715903B2 (ja) * 2008-10-29 2011-07-06 株式会社明電舎 物体の三次元形状モデル作製装置
US8718393B2 (en) * 2010-07-28 2014-05-06 Shenzhen Institutes Of Advanced Technology Chinese Academy Of Sciences Method for reconstruction of urban scenes
US8879828B2 (en) 2011-06-29 2014-11-04 Matterport, Inc. Capturing and aligning multiple 3-dimensional scenes
US8731247B2 (en) 2012-01-20 2014-05-20 Geodigital International Inc. Densifying and colorizing point cloud representation of physical surface using image data
US9183631B2 (en) 2012-06-29 2015-11-10 Mitsubishi Electric Research Laboratories, Inc. Method for registering points and planes of 3D data in multiple coordinate systems
US9811880B2 (en) 2012-11-09 2017-11-07 The Boeing Company Backfilling points in a point cloud
JP5821012B2 (ja) * 2013-05-31 2015-11-24 パナソニックＩｐマネジメント株式会社 モデリング装置、３次元モデル生成装置、モデリング方法、プログラム、レイアウトシミュレータ
US9412040B2 (en) 2013-12-04 2016-08-09 Mitsubishi Electric Research Laboratories, Inc. Method for extracting planes from 3D point cloud sensor data
US9609307B1 (en) * 2015-09-17 2017-03-28 Legend3D, Inc. Method of converting 2D video to 3D video using machine learning
US10026230B2 (en) * 2016-03-30 2018-07-17 Daqri, Llc Augmented point cloud for a visualization system and method
US9972067B2 (en) * 2016-10-11 2018-05-15 The Boeing Company System and method for upsampling of sparse point cloud for 3D registration

Also Published As

Publication number Publication date
JP2018124985A (ja) 2018-08-09
US20180218510A1 (en) 2018-08-02
US10176589B2 (en) 2019-01-08

Similar Documents

Publication Publication Date Title
JP6879891B2 (ja) 平面セグメントを用いて点群を完成させる方法およびシステム
US11704833B2 (en) Monocular vision tracking method, apparatus and non-transitory computer-readable storage medium
US10896497B2 (en) Inconsistency detecting system, mixed-reality system, program, and inconsistency detecting method
CN112771539B (zh) 采用使用神经网络从二维图像预测的三维数据以用于3d建模应用
JP6843237B2 (ja) シーンのポイントクラウドを表現するシステム及び方法
CN108335353B (zh) 动态场景的三维重建方法、装置和系统、服务器、介质
US20200357136A1 (en) Method and apparatus for determining pose of image capturing device, and storage medium
US9886774B2 (en) Photogrammetric methods and devices related thereto
JP2019003621A (ja) 建築物のレイアウトの決定
US10991161B2 (en) Generating virtual representations
US11989827B2 (en) Method, apparatus and system for generating a three-dimensional model of a scene
KR102823654B1 (ko) 증강현실 기반 건설 현장의 스마트 품질 관리 시스템
Kim et al. Interactive acquisition of residential floor plans
CN113643343A (zh) 深度估计模型的训练方法、装置、电子设备及存储介质
CN119295706A (zh) 一种光学透视标定的方法、系统、电子设备及存储介质
US12073512B2 (en) Key frame selection using a voxel grid
US20240290056A1 (en) Methods, storage media, and systems for augmenting data or models
US20250086812A1 (en) Aligning image data and map data
Shade Choosing where to go: mobile robot exploration
AU2023301792A1 (en) Methods, storage media, and systems for combining disparate 3d models of a common building object
Wang et al. Guohui Wang,∗ and Yaowen Liu
CN119206108A (zh) 三维地图构建方法、系统及机器人设备
HK40008743B (en) Inconsistency detection system, mixed reality system, program, and inconsistency detection method
HK40008743A (en) Inconsistency detection system, mixed reality system, program, and inconsistency detection method

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200910

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200910

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20200910

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210127

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20210205

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210216

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210312

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210406

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210430

R150 Certificate of patent or registration of utility model

Ref document number: 6879891

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250