DE102016013274B4 - Bildverarbeitungsvorrichtung zur Erkennung eines Bilds eines zu erkennenden Objekts aus Eingabedaten - Google Patents

Bildverarbeitungsvorrichtung zur Erkennung eines Bilds eines zu erkennenden Objekts aus Eingabedaten

Info

Publication number
DE102016013274B4
DE102016013274B4 DE102016013274.4A DE102016013274A DE102016013274B4 DE 102016013274 B4 DE102016013274 B4 DE 102016013274B4 DE 102016013274 A DE102016013274 A DE 102016013274A DE 102016013274 B4 DE102016013274 B4 DE 102016013274B4
Authority
DE
Germany
Prior art keywords
image
feature point
points
feature
model pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
DE102016013274.4A
Other languages
German (de)
English (en)
Other versions
DE102016013274A1 (de
Inventor
Yuta Namiki
Fumikazu Warashina
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fanuc Corp
Original Assignee
Fanuc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fanuc Corp filed Critical Fanuc Corp
Publication of DE102016013274A1 publication Critical patent/DE102016013274A1/de
Application granted granted Critical
Publication of DE102016013274B4 publication Critical patent/DE102016013274B4/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757—Matching configurations of points or features
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02—Sensing devices
    • B25J19/04—Viewing devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/28—Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/40—Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
    • G06F18/41—Interactive pattern learning with a human teacher
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/77—Determining position or orientation of objects or cameras using statistical methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/778—Active pattern-learning, e.g. online learning of image or video features
    • G06V10/7784—Active pattern-learning, e.g. online learning of image or video features based on feedback from supervisors
    • G06V10/7788—Active pattern-learning, e.g. online learning of image or video features based on feedback from supervisors the supervisor being a human, e.g. interactive learning with a human teacher
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/647—Three-dimensional [3D] objects by matching two-dimensional images to three-dimensional objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Probability & Statistics with Applications (AREA)
  • Human Computer Interaction (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
DE102016013274.4A 2015-11-06 2016-10-28 Bildverarbeitungsvorrichtung zur Erkennung eines Bilds eines zu erkennenden Objekts aus Eingabedaten Active DE102016013274B4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015218357A JP6348093B2 (ja) 2015-11-06 2015-11-06 入力データから検出対象物の像を検出する画像処理装置および方法
JP2015-218357 2015-11-06

Publications (2)

Publication Number Publication Date
DE102016013274A1 DE102016013274A1 (de) 2017-05-11
DE102016013274B4 true DE102016013274B4 (de) 2026-06-25

Family

ID=58584873

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102016013274.4A Active DE102016013274B4 (de) 2015-11-06 2016-10-28 Bildverarbeitungsvorrichtung zur Erkennung eines Bilds eines zu erkennenden Objekts aus Eingabedaten

Country Status (4)

Country Link
US (1) US11227144B2 (enExample)
JP (1) JP6348093B2 (enExample)
CN (1) CN106682673B (enExample)
DE (1) DE102016013274B4 (enExample)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6126437B2 (ja) * 2013-03-29 2017-05-10 キヤノン株式会社 画像処理装置および画像処理方法
JP6049882B2 (ja) * 2013-07-18 2016-12-21 三菱電機株式会社 目標類識別装置
US20160012594A1 (en) * 2014-07-10 2016-01-14 Ditto Labs, Inc. Systems, Methods, And Devices For Image Matching And Object Recognition In Images Using Textures
JP6333871B2 (ja) * 2016-02-25 2018-05-30 ファナック株式会社 入力画像から検出した対象物を表示する画像処理装置
JP6487493B2 (ja) * 2017-05-18 2019-03-20 ファナック株式会社 画像処理システム
EP3404583A1 (en) * 2017-05-19 2018-11-21 MVTec Software GmbH System and method for model adaptation
CN110245667A (zh) * 2018-03-08 2019-09-17 中华映管股份有限公司 物件辨识方法及其装置
JP6574920B1 (ja) * 2018-07-06 2019-09-11 楽天株式会社 画像処理システム、画像処理方法、及びプログラム
JP6836561B2 (ja) * 2018-09-20 2021-03-03 ファナック株式会社 画像処理装置及び画像処理方法
DE102019124809A1 (de) * 2018-09-21 2020-03-26 Fanuc Corporation Bildgebungsvorrichtung und Bildgebungssystem
US10883823B2 (en) 2018-10-18 2021-01-05 Cyberoptics Corporation Three-dimensional sensor with counterposed channels
JP6863946B2 (ja) * 2018-10-31 2021-04-21 ファナック株式会社 画像処理装置
JP7378934B2 (ja) * 2019-01-29 2023-11-14 キヤノン株式会社 情報処理装置、情報処理方法及びシステム
CN113711275B (zh) * 2019-04-18 2025-03-18 博洛尼亚大学 在机器学习中为图像中的对象标注创建训练数据可变性
JP7372076B2 (ja) 2019-08-07 2023-10-31 ファナック株式会社 画像処理システム
JP7488033B2 (ja) * 2019-08-22 2024-05-21 ファナック株式会社 物体検出装置及び物体検出用コンピュータプログラム
KR102770795B1 (ko) * 2019-09-09 2025-02-21 삼성전자주식회사 3d 렌더링 방법 및 장치
CN110880003B (zh) * 2019-10-12 2023-01-17 中国第一汽车股份有限公司 一种图像匹配方法、装置、存储介质及汽车
JP7362453B2 (ja) * 2019-11-28 2023-10-17 株式会社日立製作所 モデル作成装置及びモデル作成方法
WO2021117363A1 (ja) * 2019-12-09 2021-06-17 コニカミノルタ株式会社 オブジェクト検出方法及びオブジェクト検出装置
US12361582B2 (en) 2020-01-06 2025-07-15 Fanuc Corporation Object detection device and model pattern evaluation device
US12236663B2 (en) 2020-01-17 2025-02-25 Fanuc Corporation Image processing system
CN115004246B (zh) * 2020-02-04 2025-06-03 发那科株式会社 图像处理装置
CN115668283A (zh) 2020-05-18 2023-01-31 发那科株式会社 机器学习装置和机器学习系统
US12466074B2 (en) * 2020-10-30 2025-11-11 Dmg Mori Co., Ltd. Image processing method, image processing apparatus, robot-mounted transfer device, and system
CN112476489B (zh) * 2020-11-13 2021-10-22 哈尔滨工业大学（深圳） 基于自然特征的柔性机械臂同步测量方法及系统
JP7498135B2 (ja) * 2021-03-29 2024-06-11 トヨタテクニカルディベロップメント株式会社 情報処理装置、情報処理方法及び情報処理プログラム
US20240221352A1 (en) * 2021-05-13 2024-07-04 Fanuc Corporation Image processing device
JP7847337B2 (ja) * 2022-02-28 2026-04-17 パナソニックＩｐマネジメント株式会社 特徴点登録装置、特徴点登録方法および画像処理システム
EP4488929A4 (en) * 2022-02-28 2025-06-18 Panasonic Intellectual Property Management Co., Ltd. Feature registration device and feature registration method
CN114913060B (zh) * 2022-05-31 2025-08-29 东风电驱动系统有限公司 图像变形方法、装置、设备及可读存储介质
CN115205354B (zh) * 2022-06-23 2023-04-07 中国人民解放军国防科技大学 基于ransac和icp点云配准的相控阵激光雷达成像方法
CN116403010A (zh) * 2023-01-13 2023-07-07 浪潮云信息技术股份公司 一种基于fast算法的医学图像匹配方法
JP2024139326A (ja) * 2023-03-27 2024-10-09 株式会社トプコン データ管理装置、データ管理システム、データ管理方法、及びデータ管理プログラム
CN116817789A (zh) * 2023-06-25 2023-09-29 北京航空航天大学 基于单目视觉的超景深粗糙表面三维形貌测量方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0737085A (ja) 1993-06-29 1995-02-07 Kawasaki Steel Corp 基準パターン作成装置
US20040131247A1 (en) 2003-01-07 2004-07-08 Kazuhiro Hiwada Image processing device executing image processing on input image and processing method for the same
JP4843415B2 (ja) 2006-08-30 2011-12-21 株式会社東芝 パターン評価方法およびプログラム
JP5080416B2 (ja) 2008-10-15 2012-11-21 ファナック株式会社 入力画像から検出対象物の像を検出する画像処理装置
US20150009214A1 (en) 2013-07-08 2015-01-08 Vangogh Imaging, Inc. Real-time 3d computer vision processing engine for object recognition, reconstruction, and analysis
JP2015007972A (ja) 2013-05-31 2015-01-15 オムロン株式会社 画像照合方法、画像照合装置、モデルテンプレート生成方法、モデルテンプレート生成装置、およびプログラム
WO2015107859A1 (ja) 2014-01-15 2015-07-23 オムロン株式会社 画像照合装置、画像センサ、処理システム、画像照合方法
US20150235380A1 (en) 2012-11-19 2015-08-20 Ihi Corporation Three-dimensional object recognition device and three-dimensional object recognition method

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2149149C3 (de) 1971-10-01 1978-08-31 Kloeckner-Humboldt-Deutz Ag, 5000 Koeln Verfahren zur Regelung einer Brennanlage für feinkörniges Gut mit mehreren parallelgeschalteten Vorerhitzungseinrichtungen für das Aufgabegut
DE2357653A1 (de) 1973-11-19 1975-05-28 Siemens Ag Magnetschwebefahrzeug mit einem synchronen linearmotor
KR100414432B1 (ko) * 1995-03-24 2004-03-18 마츠시타 덴끼 산교 가부시키가이샤 윤곽추출장치
US6980690B1 (en) * 2000-01-20 2005-12-27 Canon Kabushiki Kaisha Image processing apparatus
US7657083B2 (en) * 2000-03-08 2010-02-02 Cyberextruder.Com, Inc. System, method, and apparatus for generating a three-dimensional representation from one or more two-dimensional images
US7065242B2 (en) * 2000-03-28 2006-06-20 Viewpoint Corporation System and method of three-dimensional image capture and modeling
US7171048B2 (en) * 2002-04-10 2007-01-30 National Instruments Corporation Pattern matching system utilizing discrete curve matching with a mapping operator
US7340089B2 (en) * 2004-08-17 2008-03-04 National Instruments Corporation Geometric pattern matching using dynamic feature combinations
US7706612B2 (en) * 2004-11-23 2010-04-27 Carestream Health, Inc. Method for automatic shape classification
JP4613617B2 (ja) * 2005-01-07 2011-01-19 ソニー株式会社 画像処理システム、学習装置および方法、並びにプログラム
KR100647322B1 (ko) * 2005-03-02 2006-11-23 삼성전자주식회사 객체의 모양모델 생성장치 및 방법과 이를 이용한 객체의특징점 자동탐색장치 및 방법
US7742634B2 (en) * 2005-03-15 2010-06-22 Omron Corporation Image processing method, three-dimensional position measuring method and image processing apparatus
JP4093273B2 (ja) * 2006-03-13 2008-06-04 オムロン株式会社 特徴点検出装置、特徴点検出方法および特徴点検出プログラム
JP4950787B2 (ja) * 2007-07-12 2012-06-13 株式会社東芝 画像処理装置及びその方法
JP4926116B2 (ja) * 2008-04-16 2012-05-09 株式会社日立ハイテクノロジーズ 画像検査装置
US8160366B2 (en) * 2008-06-20 2012-04-17 Sony Corporation Object recognition device, object recognition method, program for object recognition method, and recording medium having recorded thereon program for object recognition method
US8204301B2 (en) * 2009-02-25 2012-06-19 Seiko Epson Corporation Iterative data reweighting for balanced model learning
JP5287550B2 (ja) * 2009-07-01 2013-09-11 富士通株式会社 生体認証システム，生体認証方法，生体認証装置，生体情報処理装置，生体認証プログラムおよび生体情報処理プログラム
JPWO2011086889A1 (ja) * 2010-01-12 2013-05-16 日本電気株式会社 特徴点選択システム、特徴点選択方法および特徴点選択プログラム
US20140050392A1 (en) * 2012-08-15 2014-02-20 Samsung Electronics Co., Ltd. Method and apparatus for detecting and tracking lips
JP5263437B2 (ja) * 2012-09-07 2013-08-14 カシオ計算機株式会社 三次元モデリング装置、三次元モデリング方法、ならびに、プログラム
EP2907082B1 (en) * 2012-10-11 2018-07-18 OpenText Corporation Using a probabilistic model for detecting an object in visual data
JP6126437B2 (ja) * 2013-03-29 2017-05-10 キヤノン株式会社 画像処理装置および画像処理方法
JP6049882B2 (ja) * 2013-07-18 2016-12-21 三菱電機株式会社 目標類識別装置
GB2518589B (en) * 2013-07-30 2019-12-11 Holition Ltd Image processing
US9646201B1 (en) * 2014-06-05 2017-05-09 Leap Motion, Inc. Three dimensional (3D) modeling of a complex control object
JP6372198B2 (ja) * 2014-07-01 2018-08-15 セイコーエプソン株式会社 ロボットシステム及び処理装置
JP6426968B2 (ja) * 2014-10-08 2018-11-21 キヤノン株式会社 情報処理装置およびその方法

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0737085A (ja) 1993-06-29 1995-02-07 Kawasaki Steel Corp 基準パターン作成装置
US20040131247A1 (en) 2003-01-07 2004-07-08 Kazuhiro Hiwada Image processing device executing image processing on input image and processing method for the same
JP4843415B2 (ja) 2006-08-30 2011-12-21 株式会社東芝 パターン評価方法およびプログラム
JP5080416B2 (ja) 2008-10-15 2012-11-21 ファナック株式会社 入力画像から検出対象物の像を検出する画像処理装置
US20150235380A1 (en) 2012-11-19 2015-08-20 Ihi Corporation Three-dimensional object recognition device and three-dimensional object recognition method
JP2015007972A (ja) 2013-05-31 2015-01-15 オムロン株式会社 画像照合方法、画像照合装置、モデルテンプレート生成方法、モデルテンプレート生成装置、およびプログラム
US20150009214A1 (en) 2013-07-08 2015-01-08 Vangogh Imaging, Inc. Real-time 3d computer vision processing engine for object recognition, reconstruction, and analysis
WO2015107859A1 (ja) 2014-01-15 2015-07-23 オムロン株式会社 画像照合装置、画像センサ、処理システム、画像照合方法
US20160328834A1 (en) * 2014-01-15 2016-11-10 Omron Corporation Image comparison device, image sensor, processing system, and image comparison method

Non-Patent Citations (9)

* Cited by examiner, † Cited by third party
Title
An On-line Visual Human Tracking Algorithm Using SURF-based Dynamic Object Model", A. Meenakshi Gupta et al., Transactions on the IEEE 2013 International Conference on Image Processing, Seiten 3875 bis 3879
D.H. Ballard, „Generalizing the Hough Transform to Detect Arbitrary Shapes", Pattern Recognition Bd. 13, Nr. 2, S. 111-122, 1981
David G. Lowe, „Object Recognition from Local Scale-Invariant Features", Proc. of the International Conference on Computer Vision, Korfu (Sept. 1999
Federico Tombari et al., „Object recognition in 3D scenes with occlusions and clutter by Hough voting", IEEE 2010 Fourth Pacific-Rim Symposium on Image and Video Technology
Federico Tombari et al., „Unique Signatures of Histograms for Local Surface Description", Computer Vision, ECCV 2010, Teil III., LNCS 6313, S. 356-369, 2010
GUPTA, A. Meenakshi, et al. An on-line visual human tracking algorithm using SURF-based dynamic object model. In: 2013 IEEE International Conference on Image Processing. IEEE, 2013. S. 3875-3879 *
Martin A. Fischler et al., „Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography", Communications of the Association for Computing Machinery Bd. 24, Nr. 6, Seiten 381-395, März 1980
Niloy J. Mitra et al., „Estimating Surface Normals in Noisy Point Cloud Data", SCG'03 Proceedings of nineteenth annual symposium on Computational geometry, Seiten 322-328, 2003
Paul J. Best et al., „A method for Registration for 3-D Shapes", IEEE Transactions on Pattern Analysis and Machine Intelligence, Bd. 14, Nr. 2, Februar 1992

Also Published As

Publication number Publication date
US20170132451A1 (en) 2017-05-11
CN106682673B (zh) 2019-08-20
JP2017091079A (ja) 2017-05-25
DE102016013274A1 (de) 2017-05-11
CN106682673A (zh) 2017-05-17
JP6348093B2 (ja) 2018-06-27
US11227144B2 (en) 2022-01-18

Legal Events

Date Code Title Description
R012 Request for examination validly filed
R016 Response to examination communication
R079 Amendment of ipc main class

Free format text: PREVIOUS MAIN CLASS: G06K0009480000

Ipc: G06V0030182000

R079 Amendment of ipc main class

Free format text: PREVIOUS MAIN CLASS: G06V0030182000

Ipc: G06V0010440000

R018 Grant decision by examination section/examining division