JP7312685B2 - 複数の３ｄポイントクラウドを使用して物理的オブジェクトの関節運動可能な部分を識別するための装置及び方法 - Google Patents

複数の３ｄポイントクラウドを使用して物理的オブジェクトの関節運動可能な部分を識別するための装置及び方法 Download PDF

Info

Publication number
JP7312685B2
JP7312685B2 JP2019221896A JP2019221896A JP7312685B2 JP 7312685 B2 JP7312685 B2 JP 7312685B2 JP 2019221896 A JP2019221896 A JP 2019221896A JP 2019221896 A JP2019221896 A JP 2019221896A JP 7312685 B2 JP7312685 B2 JP 7312685B2
Authority
JP
Japan
Prior art keywords
point
point cloud
points
cluster
articulatable portion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019221896A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020109626A5 (https=
JP2020109626A (ja
Inventor
マシュー・シュリーブ
スリニバス・ヴェンコバラオ
Original Assignee
パロ アルト リサーチ センター インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パロ アルト リサーチ センター インコーポレイテッド filed Critical パロ アルト リサーチ センター インコーポレイテッド
Publication of JP2020109626A publication Critical patent/JP2020109626A/ja
Publication of JP2020109626A5 publication Critical patent/JP2020109626A5/ja
Application granted granted Critical
Publication of JP7312685B2 publication Critical patent/JP7312685B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24147—Distances to closest patterns, e.g. nearest neighbour classification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/005—Tree description, e.g. octree, quadtree
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757—Matching configurations of points or features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/653—Three-dimensional [3D] objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Architecture (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)
JP2019221896A 2018-12-28 2019-12-09 複数の３ｄポイントクラウドを使用して物理的オブジェクトの関節運動可能な部分を識別するための装置及び方法 Active JP7312685B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/235,434 US10896317B2 (en) 2018-12-28 2018-12-28 Apparatus and method for identifying an articulatable part of a physical object using multiple 3D point clouds
US16/235,434 2018-12-28

Publications (3)

Publication Number Publication Date
JP2020109626A JP2020109626A (ja) 2020-07-16
JP2020109626A5 JP2020109626A5 (https=) 2022-12-19
JP7312685B2 true JP7312685B2 (ja) 2023-07-21

Family

ID=69055788

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019221896A Active JP7312685B2 (ja) 2018-12-28 2019-12-09 複数の３ｄポイントクラウドを使用して物理的オブジェクトの関節運動可能な部分を識別するための装置及び方法

Country Status (3)

Country Link
US (2) US10896317B2 (https=)
EP (1) EP3675040B1 (https=)
JP (1) JP7312685B2 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11003959B1 (en) * 2019-06-13 2021-05-11 Amazon Technologies, Inc. Vector norm algorithmic subsystems for improving clustering solutions
CN112907729B (zh) * 2021-02-09 2022-02-11 南京航空航天大学 一种基于三维局部点云配准的复合材料预制体整体外形重建方法
US11403817B1 (en) 2021-04-14 2022-08-02 Lineage Logistics, LLC Point cloud filtering
US11725504B2 (en) * 2021-05-24 2023-08-15 Saudi Arabian Oil Company Contactless real-time 3D mapping of surface equipment
CN115648197B (zh) * 2021-07-09 2025-06-13 深圳富泰宏精密工业有限公司 零部件识别方法及系统
US12437357B2 (en) * 2021-12-23 2025-10-07 United States Of America As Represented By The Secretary Of The Navy Systems and methods to perform 3D localization of target objects in point cloud data using a corresponding 2D image
AU2023207962A1 (en) 2022-01-11 2024-07-18 Lineage Logistics, LLC Planning and controlling automated layer pickers
CN114694134A (zh) * 2022-03-23 2022-07-01 成都睿芯行科技有限公司 一种基于深度相机点云数据的托盘识别和定位方法
CN119072716A (zh) 2022-03-26 2024-12-03 美国亚德诺半导体公司 用于执行对象尺寸标注的方法和系统
WO2023192137A1 (en) * 2022-03-26 2023-10-05 Analog Devices, Inc. Methods and systems for performing object dimensioning
JP2024063579A (ja) * 2022-10-26 2024-05-13 株式会社日立製作所 製造設備の設計支援装置並びに設計支援方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006172099A (ja) 2004-12-15 2006-06-29 Mitsubishi Electric Corp 変化領域認識装置および変化認識システム
JP2007101197A (ja) 2005-09-30 2007-04-19 Nachi Fujikoshi Corp 物体探索装置，物体探索装置を備えるロボットシステム及び物体探索方法
JP2012203894A (ja) 2011-03-28 2012-10-22 Kumamoto Univ ３ｄパターンマッチング方法
JP2015156136A (ja) 2014-02-20 2015-08-27 株式会社東芝 算出装置、方法及びプログラム

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7164789B2 (en) 2003-08-11 2007-01-16 Palo Alto Research Center Incorporated Three-dimensional active vision with glyph address carpet
US8452086B2 (en) 2009-07-10 2013-05-28 Palo Alto Research Center Incorporated System and user interface for machine-assisted human labeling of pixels in an image
US9600711B2 (en) 2012-08-29 2017-03-21 Conduent Business Services, Llc Method and system for automatically recognizing facial expressions via algorithmic periocular localization
US9154773B2 (en) 2013-03-15 2015-10-06 Seiko Epson Corporation 2D/3D localization and pose estimation of harness cables using a configurable structure representation for robot operations
US9858640B1 (en) 2015-07-15 2018-01-02 Hrl Laboratories, Llc Device and method for merging 3D point clouds from sparsely distributed viewpoints
WO2017096299A1 (en) * 2015-12-04 2017-06-08 Autodesk, Inc. Keypoint-based point-pair-feature for scalable automatic global registration of large rgb-d scans
US10242282B2 (en) 2017-03-20 2019-03-26 Conduent Business Services, Llc Video redaction method and system
US11308673B2 (en) * 2018-05-03 2022-04-19 Magic Leap, Inc. Using three-dimensional scans of a physical subject to determine positions and/or orientations of skeletal joints in the rigging for a virtual character

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006172099A (ja) 2004-12-15 2006-06-29 Mitsubishi Electric Corp 変化領域認識装置および変化認識システム
JP2007101197A (ja) 2005-09-30 2007-04-19 Nachi Fujikoshi Corp 物体探索装置，物体探索装置を備えるロボットシステム及び物体探索方法
JP2012203894A (ja) 2011-03-28 2012-10-22 Kumamoto Univ ３ｄパターンマッチング方法
JP2015156136A (ja) 2014-02-20 2015-08-27 株式会社東芝 算出装置、方法及びプログラム

Also Published As

Publication number Publication date
EP3675040B1 (en) 2021-08-11
US20200210680A1 (en) 2020-07-02
US20210142039A1 (en) 2021-05-13
EP3675040A1 (en) 2020-07-01
US11610415B2 (en) 2023-03-21
JP2020109626A (ja) 2020-07-16
US10896317B2 (en) 2021-01-19

Similar Documents

Publication Publication Date Title
JP7312685B2 (ja) 複数の３ｄポイントクラウドを使用して物理的オブジェクトの関節運動可能な部分を識別するための装置及び方法
US20240062345A1 (en) Method, apparatus, and computer-readable medium for foreground object deletion and inpainting
JP7403528B2 (ja) シーンの色及び深度の情報を再構成するための方法及びシステム
CN109697688B (zh) 一种用于图像处理的方法和装置
US9715761B2 (en) Real-time 3D computer vision processing engine for object recognition, reconstruction, and analysis
US9412040B2 (en) Method for extracting planes from 3D point cloud sensor data
US10885708B2 (en) Automated costume augmentation using shape estimation
EP3326156B1 (en) Consistent tessellation via topology-aware surface tracking
Manni et al. Snap2cad: 3D indoor environment reconstruction for AR/VR applications using a smartphone device
WO2016123913A1 (zh) 数据处理的方法和装置
Hernandez et al. Accurate 3D face reconstruction via prior constrained structure from motion
Governi et al. 3D geometry reconstruction from orthographic views: A method based on 3D image processing and data fitting
Coleca et al. Self-organizing maps for hand and full body tracking
US20230237753A1 (en) Dynamic facial hair capture of a subject
Ozbay et al. A hybrid method for skeleton extraction on Kinect sensor data: Combination of L1-Median and Laplacian shrinking algorithms
US20140168204A1 (en) Model based video projection
CN116258830A (zh) 用于3d建模的装置和方法
CN110310325B (zh) 一种虚拟测量方法、电子设备及计算机可读存储介质
Teng et al. Reconstructing three-dimensional models of objects using a Kinect sensor
JP2017188071A (ja) 柄替えシミュレーション装置、柄替えシミュレーション方法、及びプログラム
CN116758205B (zh) 数据处理方法、装置、设备及介质
JP6806160B2 (ja) ３次元運動評価装置、３次元運動評価方法、及びプログラム
CN115810081A (zh) 三维模型生成方法及装置
JP2015011496A (ja) 画像処理装置、画像処理方法、およびプログラム
CN116228850A (zh) 物体姿态估计方法、装置、电子设备及可读存储介质

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20191217

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20191219

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221209

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221209

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20221209

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230206

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230427

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230608

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230710

R150 Certificate of patent or registration of utility model

Ref document number: 7312685

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150