CN106091921B - 用于确定场景中的尺寸的方法 - Google Patents

用于确定场景中的尺寸的方法 Download PDF

Info

Publication number
CN106091921B
CN106091921B CN201610273855.0A CN201610273855A CN106091921B CN 106091921 B CN106091921 B CN 106091921B CN 201610273855 A CN201610273855 A CN 201610273855A CN 106091921 B CN106091921 B CN 106091921B
Authority
CN
China
Prior art keywords
plane
planes
scene
sensor
depth image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610273855.0A
Other languages
English (en)
Chinese (zh)
Other versions
CN106091921A (zh
Inventor
肖勇
冯晨
田口裕一
V·R·卡马特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of CN106091921A publication Critical patent/CN106091921A/zh
Application granted granted Critical
Publication of CN106091921B publication Critical patent/CN106091921B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/231—Hierarchical techniques, i.e. dividing or merging pattern sets so as to obtain a dendrogram
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/7625—Hierarchical techniques, i.e. dividing or merging patterns to obtain a tree-like representation; Dendograms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Geometry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Measurement Of Optical Distance (AREA)
CN201610273855.0A 2015-04-28 2016-04-28 用于确定场景中的尺寸的方法 Active CN106091921B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/698,200 2015-04-28
US14/698,200 US9761015B2 (en) 2015-04-28 2015-04-28 Method for determining dimensions in an indoor scene from a single depth image

Publications (2)

Publication Number Publication Date
CN106091921A CN106091921A (zh) 2016-11-09
CN106091921B true CN106091921B (zh) 2019-06-18

Family

ID=57205763

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610273855.0A Active CN106091921B (zh) 2015-04-28 2016-04-28 用于确定场景中的尺寸的方法

Country Status (3)

Country Link
US (1) US9761015B2 (enExample)
JP (1) JP6489552B2 (enExample)
CN (1) CN106091921B (enExample)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9858681B2 (en) * 2014-10-27 2018-01-02 Digimarc Corporation Signal detection, recognition and tracking with feature vector transforms
US9807365B2 (en) * 2015-12-08 2017-10-31 Mitsubishi Electric Research Laboratories, Inc. System and method for hybrid simultaneous localization and mapping of 2D and 3D data acquired by sensors from a 3D scene
US10721451B2 (en) * 2016-03-23 2020-07-21 Symbol Technologies, Llc Arrangement for, and method of, loading freight into a shipping container
US10445861B2 (en) * 2017-02-14 2019-10-15 Qualcomm Incorporated Refinement of structured light depth maps using RGB color data
JP2018156617A (ja) * 2017-03-15 2018-10-04 株式会社東芝 処理装置および処理システム
US10803663B2 (en) * 2017-08-02 2020-10-13 Google Llc Depth sensor aided estimation of virtual reality environment boundaries
WO2019032736A1 (en) * 2017-08-08 2019-02-14 Smart Picture Technologies, Inc. METHOD OF MEASURING AND MODELING SPACES USING AUGMENTED REALITY WITHOUT MARKER
US10733762B2 (en) * 2018-04-04 2020-08-04 Motorola Mobility Llc Dynamically calibrating a depth sensor
WO2019222255A1 (en) * 2018-05-14 2019-11-21 Sri International Computer aided inspection system and methods
CN109000559B (zh) * 2018-06-11 2020-09-11 广东工业大学 一种物体体积的测量方法、装置、系统和可读存储介质
EP3631494B1 (en) * 2018-06-25 2024-02-07 Beijing Didi Infinity Technology and Development Co., Ltd. Integrated sensor calibration in natural scenes
CN109682304A (zh) * 2019-02-02 2019-04-26 北京理工大学 一种基于ccd相机对位装配系统的综合误差建模方法
US11138757B2 (en) 2019-05-10 2021-10-05 Smart Picture Technologies, Inc. Methods and systems for measuring and modeling spaces using markerless photo-based augmented reality process
CN110853080A (zh) * 2019-09-30 2020-02-28 广西慧云信息技术有限公司 一种田间果实尺寸的测量方法
CN111412842B (zh) * 2020-04-09 2022-02-25 广东博智林机器人有限公司 墙面的截面尺寸的测量方法及装置、系统
CN111914901A (zh) * 2020-07-06 2020-11-10 周爱丽 座椅排列整齐度测量系统及方法
CN113220018B (zh) * 2021-04-23 2023-03-28 上海发电设备成套设计研究院有限责任公司 一种无人机路径规划方法、装置、存储介质及电子设备
US11568614B1 (en) 2021-08-02 2023-01-31 Bank Of America Corporation Adaptive augmented reality system for dynamic processing of spatial component parameters based on detecting accommodation factors in real time
JP7675605B2 (ja) 2021-09-15 2025-05-13 株式会社東芝 壁検出装置、搬送車両、制御方法、プログラム及び演算装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101246599A (zh) * 2007-01-26 2008-08-20 转换器有限公司 根据2d图像序列进行3d场景重构的方法
CN103106688A (zh) * 2013-02-20 2013-05-15 北京工业大学 基于双层配准方法的室内三维场景重建方法
US8908913B2 (en) * 2011-12-19 2014-12-09 Mitsubishi Electric Research Laboratories, Inc. Voting-based pose estimation for 3D sensors

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3855812B2 (ja) * 2002-03-15 2006-12-13 ソニー株式会社 距離計測方法、その装置、そのプログラム、その記録媒体及び距離計測装置搭載型ロボット装置
JP4535096B2 (ja) * 2007-07-27 2010-09-01 ソニー株式会社 平面抽出方法、その装置、そのプログラム、その記録媒体及び撮像装置
WO2013190772A1 (ja) * 2012-06-20 2013-12-27 パナソニック株式会社 空間情報検出装置、人位置検出装置
US9230339B2 (en) * 2013-01-07 2016-01-05 Wexenergy Innovations Llc System and method of measuring distances related to an object
WO2014192316A1 (ja) * 2013-05-31 2014-12-04 パナソニックＩｐマネジメント株式会社 モデリング装置、３次元モデル生成装置、モデリング方法、プログラム、レイアウトシミュレータ
JP5799273B2 (ja) * 2013-10-02 2015-10-21 パナソニックＩｐマネジメント株式会社 寸法計測装置、寸法計測方法、寸法計測システム、プログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101246599A (zh) * 2007-01-26 2008-08-20 转换器有限公司 根据2d图像序列进行3d场景重构的方法
US8908913B2 (en) * 2011-12-19 2014-12-09 Mitsubishi Electric Research Laboratories, Inc. Voting-based pose estimation for 3D sensors
CN103106688A (zh) * 2013-02-20 2013-05-15 北京工业大学 基于双层配准方法的室内三维场景重建方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于Kinect的三维人体建模与测量的研究;宋诗超;《中国优秀硕士学位论文全文数据库 信息科技辑》;20130615;第I138-1192页

Also Published As

Publication number Publication date
JP6489552B2 (ja) 2019-03-27
US20160321827A1 (en) 2016-11-03
US9761015B2 (en) 2017-09-12
CN106091921A (zh) 2016-11-09
JP2016212086A (ja) 2016-12-15

Similar Documents

Publication Publication Date Title
CN106091921B (zh) 用于确定场景中的尺寸的方法
Borrmann et al. A mobile robot based system for fully automated thermal 3D mapping
Braun et al. A concept for automated construction progress monitoring using bim-based geometric constraints and photogrammetric point clouds.
US20190197311A1 (en) Evaluation Method of Solar Energy Utilization Potential in Urban High-density Areas Based on Low-altitude Photogrammetry
Borrmann et al. Robotic mapping of cultural heritage sites
Borrmann et al. The project thermalmapper–thermal 3d mapping of indoor environments for saving energy
CN115222905B (zh) 基于视觉特征的空地多机器人地图融合方法
Özdemir et al. A multi-purpose benchmark for photogrammetric urban 3D reconstruction in a controlled environment
Sgrenzaroli et al. Indoor Mobile Mapping Systems and (BIM) digital models for construction progress monitoring
Schaub et al. Point cloud to BIM registration for robot localization and Augmented Reality
Blaszczak-Bak et al. Integrating Data from Terrestrial Laser Scanning and Unmanned Aerial Vehicle with LiDAR for BIM Developing
Senthilvel et al. Comparison of handheld devices for 3D reconstruction in construction
Jarzabek-Rychard et al. Quality analysis on 3d buidling models reconstructed from uav imagery
Zhu et al. Potentials of RGB-D cameras in as-built indoor environment modeling
Gordon et al. Calibration of a multi-beam laser system by using a TLS-generated reference
Shen et al. Automatic Scan Planning and Construction Progress Monitoring in Unknown Building Scene
Skuratovskyi et al. Outdoor mapping framework: from images to 3d model
Peng et al. Automated 3D Scenes Reconstruction Using Multiple Stereo Pairs from Portable Four‐Camera Photographic Measurement System
Cheng et al. Automatical acquisition of point clouds of construction sites and its application in autonomous interior finishing robot
Lee et al. Applications of panoramic images: From 720 panorama to interior 3d models of augmented reality
CN116612091A (zh) 一种基于多视角视图匹配的施工进度自动估计的方法
Sokolova et al. Floorplan-aware camera poses refinement
CN117115434A (zh) 数据分割装置和方法
Li et al. Design and application of parallel stereo matching algorithm based on CUDA
Pargieła et al. Application of mobile laser scanner to augment stationary collected point clouds

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant