JP6844803B1 - 画像分類に基づく物体認識または物体登録のための方法および計算システム - Google Patents

画像分類に基づく物体認識または物体登録のための方法および計算システム Download PDF

Info

Publication number
JP6844803B1
JP6844803B1 JP2020181951A JP2020181951A JP6844803B1 JP 6844803 B1 JP6844803 B1 JP 6844803B1 JP 2020181951 A JP2020181951 A JP 2020181951A JP 2020181951 A JP2020181951 A JP 2020181951A JP 6844803 B1 JP6844803 B1 JP 6844803B1
Authority
JP
Japan
Prior art keywords
storage space
template
target image
image portion
template storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020181951A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021111354A (ja
Inventor
ユ，ジンゼ
ロドリゲス，ホセ ジェロニモ モレイラ
ロドリゲス，ホセ ジェロニモ モレイラ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mujin Inc
Original Assignee
Mujin Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/991,466 external-priority patent/US11772271B2/en
Application filed by Mujin Inc filed Critical Mujin Inc
Priority to JP2021018886A priority Critical patent/JP2021111423A/ja
Application granted granted Critical
Publication of JP6844803B1 publication Critical patent/JP6844803B1/ja
Publication of JP2021111354A publication Critical patent/JP2021111354A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1628—Programme controls characterised by the control loop
    • B25J9/163—Programme controls characterised by the control loop learning, adaptive, model based, rule based expert control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1661—Programme controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/28—Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G61/00—Use of pick-up or transfer devices or of manipulators for stacking or de-stacking articles not otherwise provided for
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35074—Display object, recognition of geometric forms
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40564—Recognize shape, contour of object, extract position and orientation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06—Recognition of objects for industrial automation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
  • Manipulator (AREA)
JP2020181951A 2020-01-10 2020-10-30 画像分類に基づく物体認識または物体登録のための方法および計算システム Active JP6844803B1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021018886A JP2021111423A (ja) 2020-01-10 2021-02-09 画像分類に基づく物体認識または物体登録のための方法および計算システム

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202062959182P 2020-01-10 2020-01-10
US62/959,182 2020-01-10
US16/991,466 US11772271B2 (en) 2020-01-10 2020-08-12 Method and computing system for object recognition or object registration based on image classification
US16/991,466 2020-08-12

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2021018886A Division JP2021111423A (ja) 2020-01-10 2021-02-09 画像分類に基づく物体認識または物体登録のための方法および計算システム

Publications (2)

Publication Number Publication Date
JP6844803B1 true JP6844803B1 (ja) 2021-03-17
JP2021111354A JP2021111354A (ja) 2021-08-02

Family

ID=74860898

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2020181951A Active JP6844803B1 (ja) 2020-01-10 2020-10-30 画像分類に基づく物体認識または物体登録のための方法および計算システム
JP2021018886A Pending JP2021111423A (ja) 2020-01-10 2021-02-09 画像分類に基づく物体認識または物体登録のための方法および計算システム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2021018886A Pending JP2021111423A (ja) 2020-01-10 2021-02-09 画像分類に基づく物体認識または物体登録のための方法および計算システム

Country Status (4)

Country Link
US (1) US20230381971A1 (enExample)
JP (2) JP6844803B1 (enExample)
CN (1) CN113111899A (enExample)
DE (1) DE102020213566A1 (enExample)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7418762B2 (ja) * 2021-08-09 2024-01-22 株式会社Mujin 計算システム、方法及び非一時的コンピュータ可読媒体
WO2023017413A1 (en) * 2021-08-09 2023-02-16 Mujin, Inc. Systems and methods for object detection

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US770011A (en) 1904-01-21 1904-09-13 Bucyrus Co Lower tumbler and ladder end for elevator-dredges.
JP3426002B2 (ja) * 1993-09-20 2003-07-14 三菱電機株式会社 物体認識装置
US5835634A (en) * 1996-05-31 1998-11-10 Adobe Systems Incorporated Bitmap comparison apparatus and method using an outline mask and differently weighted bits
JPH11333770A (ja) * 1998-03-20 1999-12-07 Kobe Steel Ltd 積荷位置姿勢認識装置
JP4740003B2 (ja) * 2006-03-20 2011-08-03 クラリオン株式会社 移動体監視装置
JP5866728B2 (ja) * 2011-10-14 2016-02-17 サイバーアイ・エンタテインメント株式会社 画像認識システムを備えた知識情報処理サーバシステム
JP5939775B2 (ja) * 2011-11-30 2016-06-22 キヤノン株式会社 画像処理装置、画像処理プログラム、ロボット装置及び画像処理方法
JP2014029664A (ja) * 2012-06-28 2014-02-13 Seiko Epson Corp 比較画像範囲生成方法、位置姿勢検出方法、比較画像範囲生成装置、位置姿勢検出装置、ロボット、ロボットシステム、比較画像範囲生成プログラム及び位置姿勢検出プログラム
JP2014127186A (ja) * 2012-12-27 2014-07-07 Ricoh Co Ltd 画像処理装置、画像処理方法およびプログラム
US9120622B1 (en) * 2015-04-16 2015-09-01 inVia Robotics, LLC Autonomous order fulfillment and inventory control robots
KR20180018211A (ko) * 2016-08-12 2018-02-21 엘지전자 주식회사 자가 학습 로봇
CN106488164B (zh) * 2016-09-30 2019-09-13 合肥杰发科技有限公司 视频信号处理方法及装置
CN106552772B (zh) * 2016-10-25 2019-01-22 北京京东尚科信息技术有限公司 视觉识别系统和使用所述视觉识别系统的分类分拣系统
JP2019063984A (ja) * 2017-10-02 2019-04-25 キヤノン株式会社 情報処理装置、方法及びロボットシステム
US12039746B2 (en) * 2019-03-28 2024-07-16 Sony Group Corporation Information processing device and information processing method for extracting information from an image

Also Published As

Publication number Publication date
JP2021111423A (ja) 2021-08-02
US20230381971A1 (en) 2023-11-30
JP2021111354A (ja) 2021-08-02
CN113111899A (zh) 2021-07-13
DE102020213566A1 (de) 2021-07-15

Similar Documents

Publication Publication Date Title
US11772271B2 (en) Method and computing system for object recognition or object registration based on image classification
JP7433609B2 (ja) 物体識別のための方法および計算システム
US11087172B2 (en) Systems and methods for creating training data
US12236609B2 (en) Method and computing system for processing candidate edges
US20240221350A1 (en) Method and computing system for generating a safety volume list for object detection
US20230381971A1 (en) Method and computing system for object registration based on image classification
US20250303558A1 (en) Heuristic-based robotic grasps
JP2024028219A (ja) ポイント・クラウド・ベース把持計画フレームワークのための方法及びシステム
JP7191352B2 (ja) 物体検出を実施するための方法および計算システム
US20240066723A1 (en) Automatic bin detection for robotic applications
CN112734783B (zh) 用于处理候选边缘的方法和计算系统
JP6843458B1 (ja) 物体認識のために画像分類を行う方法およびシステム
CN112288038B (zh) 基于图像分类的物体识别或物体注册的方法及计算系统
US20240198515A1 (en) Transformation for covariate shift of grasp neural networks
Bhuyan et al. Structure‐aware multiple salient region detection and localization for autonomous robotic manipulation
Wang et al. Robust grasp detection with incomplete point cloud and complex background
CN112288040B (zh) 执行用于物体识别的图像分类的方法和系统
CN113361651A (zh) 生成用于物体检测的安全空间列表的方法和计算系统

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201112

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20201112

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20201130

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201203

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201228

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210112

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210209

R150 Certificate of patent or registration of utility model

Ref document number: 6844803

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350