JP6483168B2 - ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法 - Google Patents

ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法 Download PDF

Info

Publication number
JP6483168B2
JP6483168B2 JP2017023685A JP2017023685A JP6483168B2 JP 6483168 B2 JP6483168 B2 JP 6483168B2 JP 2017023685 A JP2017023685 A JP 2017023685A JP 2017023685 A JP2017023685 A JP 2017023685A JP 6483168 B2 JP6483168 B2 JP 6483168B2
Authority
JP
Japan
Prior art keywords
probe
gradient
image
score
probes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017023685A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017182785A (ja
Inventor
アール. ボーガン,ナタニエル
アール. ボーガン,ナタニエル
Original Assignee
コグネックス・コーポレイション
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コグネックス・コーポレイション filed Critical コグネックス・コーポレイション
Publication of JP2017182785A publication Critical patent/JP2017182785A/ja
Priority to JP2019024021A priority Critical patent/JP6899189B2/ja
Application granted granted Critical
Publication of JP6483168B2 publication Critical patent/JP6483168B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75Determining position or orientation of objects or cameras using feature-based methods involving models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/255Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/28Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/344Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/752Contour matching
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/754Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries involving a deformation of the sample pattern or of the reference pattern; Elastic matching
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/757Matching configurations of points or features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/772Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30204Marker
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06Recognition of objects for industrial automation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
JP2017023685A 2016-02-12 2017-02-11 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法 Active JP6483168B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019024021A JP6899189B2 (ja) 2016-02-12 2019-02-13 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662294430P 2016-02-12 2016-02-12
US62/294,430 2016-02-12
US15/429,336 US10769776B2 (en) 2016-02-12 2017-02-10 System and method for efficiently scoring probes in an image with a vision system
US15/429,336 2017-02-10

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2019024021A Division JP6899189B2 (ja) 2016-02-12 2019-02-13 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法

Publications (2)

Publication Number Publication Date
JP2017182785A JP2017182785A (ja) 2017-10-05
JP6483168B2 true JP6483168B2 (ja) 2019-03-13

Family

ID=58668707

Family Applications (4)

Application Number Title Priority Date Filing Date
JP2017023685A Active JP6483168B2 (ja) 2016-02-12 2017-02-11 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
JP2019024021A Active JP6899189B2 (ja) 2016-02-12 2019-02-13 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
JP2021098371A Active JP7133283B2 (ja) 2016-02-12 2021-06-12 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
JP2022135459A Active JP7651523B2 (ja) 2016-02-12 2022-08-28 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法

Family Applications After (3)

Application Number Title Priority Date Filing Date
JP2019024021A Active JP6899189B2 (ja) 2016-02-12 2019-02-13 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
JP2021098371A Active JP7133283B2 (ja) 2016-02-12 2021-06-12 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
JP2022135459A Active JP7651523B2 (ja) 2016-02-12 2022-08-28 ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法

Country Status (4)

Country Link
US (3) US10769776B2 (enExample)
EP (1) EP3206164B1 (enExample)
JP (4) JP6483168B2 (enExample)
CN (2) CN107085728B (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022169723A (ja) * 2016-02-12 2022-11-09 コグネックス・コーポレイション ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10825199B2 (en) 2018-09-12 2020-11-03 Cognex Corporation Methods and apparatus for processing image data for machine vision
US10846563B2 (en) 2018-09-12 2020-11-24 Cognex Corporation Methods and apparatus for generating a dense field of three dimensional data for machine vision
JP7182528B2 (ja) * 2018-09-12 2022-12-02 コグネックス・コーポレイション マシンビジョン用の画像データを処理するための方法及び装置
US10878299B2 (en) 2018-09-12 2020-12-29 Cognex Corporation Methods and apparatus for testing multiple fields for machine vision
GB2575333B (en) * 2018-12-21 2020-09-09 Imagination Tech Ltd Double-angle gradients
US11941863B2 (en) * 2021-08-04 2024-03-26 Datalogic Ip Tech S.R.L. Imaging system and method using a multi-layer model approach to provide robust object detection
CN114252666A (zh) * 2022-01-17 2022-03-29 上海华岭集成电路技术股份有限公司 获取探针卡上测试针位置分布方法、装置、介质和电子设备
CN121079021A (zh) * 2023-05-05 2025-12-05 医达科技公司 用于估计腹腔镜超声手术中超声探头位姿的方法和系统
CN117173389B (zh) * 2023-08-23 2024-04-05 无锡芯智光精密科技有限公司 一种基于轮廓匹配的固晶机视觉定位方法

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4581762A (en) 1984-01-19 1986-04-08 Itran Corporation Vision inspection system
US4876457A (en) 1988-10-31 1989-10-24 American Telephone And Telegraph Company Method and apparatus for differentiating a planar textured surface from a surrounding background
JPH07210687A (ja) * 1994-01-18 1995-08-11 Matsushita Electric Ind Co Ltd 形状検出装置
US5640200A (en) 1994-08-31 1997-06-17 Cognex Corporation Golden template comparison using efficient image registration
US5850466A (en) 1995-02-22 1998-12-15 Cognex Corporation Golden template comparison for rotated and/or scaled images
US5761070A (en) 1995-11-02 1998-06-02 Virginia Tech Intellectual Properties, Inc. Automatic color and grain sorting of materials
JP3560749B2 (ja) * 1996-11-18 2004-09-02 株式会社東芝 画像出力装置及び画像出力のための信号処理方法
US5912984A (en) * 1996-12-19 1999-06-15 Cognex Corporation Method and apparatus for in-line solder paste inspection
US6094508A (en) 1997-12-08 2000-07-25 Intel Corporation Perceptual thresholding for gradient-based local edge detection
US6175652B1 (en) 1997-12-31 2001-01-16 Cognex Corporation Machine vision system for analyzing features based on multiple object images
US6175644B1 (en) 1998-05-01 2001-01-16 Cognex Corporation Machine vision system for object feature analysis and validation based on multiple object images
US7016539B1 (en) * 1998-07-13 2006-03-21 Cognex Corporation Method for fast, robust, multi-dimensional pattern recognition
US7062093B2 (en) * 2000-09-27 2006-06-13 Mvtech Software Gmbh System and method for object recognition
EP1193642B1 (en) * 2000-09-27 2005-03-30 MVTec Software GmbH System and method for object recognition
GB0112773D0 (en) 2001-05-25 2001-07-18 Univ Manchester Object identification
US7058233B2 (en) 2001-05-30 2006-06-06 Mitutoyo Corporation Systems and methods for constructing an image having an extended depth of field
WO2003009579A2 (en) 2001-07-17 2003-01-30 Amnis Corporation Computational methods for the segmentation of images of objects from background in a flow imaging instrument
US7003161B2 (en) 2001-11-16 2006-02-21 Mitutoyo Corporation Systems and methods for boundary detection in images
US7162073B1 (en) 2001-11-30 2007-01-09 Cognex Technology And Investment Corporation Methods and apparatuses for detecting classifying and measuring spot defects in an image of an object
US6636298B1 (en) 2001-12-18 2003-10-21 Cognex Technology And Investment Corporation Method and apparatus for focusing an optical inspection system
US7110602B2 (en) 2002-08-21 2006-09-19 Raytheon Company System and method for detection of image edges using a polar algorithm process
US7567713B2 (en) 2006-02-08 2009-07-28 Mitutoyo Corporation Method utilizing intensity interpolation for measuring edge locations in a high precision machine vision inspection system
WO2009018445A1 (en) 2007-08-01 2009-02-05 Yeda Research & Development Co. Ltd. Multiscale edge detection and fiber enhancement using differences of oriented means
DE602007003849D1 (de) 2007-10-11 2010-01-28 Mvtec Software Gmbh System und Verfahren zur 3D-Objekterkennung
US8238639B2 (en) 2008-04-09 2012-08-07 Cognex Corporation Method and system for dynamic feature detection
JP5301239B2 (ja) 2008-08-09 2013-09-25 株式会社キーエンス 画像処理におけるパターンモデルの位置決め方法、画像処理装置、画像処理プログラム及びコンピュータで読み取り可能な記録媒体
JP5253066B2 (ja) * 2008-09-24 2013-07-31 キヤノン株式会社 位置姿勢計測装置及び方法
US8515171B2 (en) 2009-01-09 2013-08-20 Rochester Institute Of Technology Methods for adaptive and progressive gradient-based multi-resolution color image segmentation and systems thereof
CN103377382A (zh) 2012-04-27 2013-10-30 通用电气公司 用于图像对准的最佳梯度寻踪
AU2013305770A1 (en) 2012-08-21 2015-02-26 Pelican Imaging Corporation Systems and methods for parallax detection and correction in images captured using array cameras
US20140270362A1 (en) * 2013-03-15 2014-09-18 Qualcomm Incorporated Fast edge-based object relocalization and detection using contextual filtering
EP2985565A4 (en) * 2013-03-27 2016-11-16 Nikon Corp MOLDING DEVICE, STRUCTURE MANUFACTURING SYSTEM, SHAPING METHOD, STRUCTURE MANUFACTURING METHOD AND SHAPING MEASUREMENT PROGRAM
US9135519B2 (en) * 2013-07-10 2015-09-15 Canon Kabushiki Kaisha Pattern matching method and pattern matching apparatus
US9569850B2 (en) * 2013-10-16 2017-02-14 Cognex Corporation System and method for automatically determining pose of a shape
US9995573B2 (en) 2015-01-23 2018-06-12 Cognex Corporation Probe placement for image processing
US10769776B2 (en) * 2016-02-12 2020-09-08 Cognex Corporation System and method for efficiently scoring probes in an image with a vision system
US10878299B2 (en) * 2018-09-12 2020-12-29 Cognex Corporation Methods and apparatus for testing multiple fields for machine vision
US10825199B2 (en) * 2018-09-12 2020-11-03 Cognex Corporation Methods and apparatus for processing image data for machine vision
US10846563B2 (en) * 2018-09-12 2020-11-24 Cognex Corporation Methods and apparatus for generating a dense field of three dimensional data for machine vision

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022169723A (ja) * 2016-02-12 2022-11-09 コグネックス・コーポレイション ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
JP7651523B2 (ja) 2016-02-12 2025-03-26 コグネックス・コーポレイション ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法

Also Published As

Publication number Publication date
JP2019091493A (ja) 2019-06-13
US11676301B2 (en) 2023-06-13
JP7133283B2 (ja) 2022-09-08
US20240233177A9 (en) 2024-07-11
EP3206164B1 (en) 2022-05-25
JP2017182785A (ja) 2017-10-05
US20170236263A1 (en) 2017-08-17
JP6899189B2 (ja) 2021-07-07
JP2022169723A (ja) 2022-11-09
US10769776B2 (en) 2020-09-08
CN113159094A (zh) 2021-07-23
CN107085728B (zh) 2021-02-12
EP3206164A1 (en) 2017-08-16
US20240135583A1 (en) 2024-04-25
JP7651523B2 (ja) 2025-03-26
CN107085728A (zh) 2017-08-22
JP2021168143A (ja) 2021-10-21
US20210090230A1 (en) 2021-03-25

Similar Documents

Publication Publication Date Title
JP7133283B2 (ja) ビジョンシステムで画像内のプローブを効率的に採点するためのシステム及び方法
US10043279B1 (en) Robust detection and classification of body parts in a depth map
JP6305171B2 (ja) シーン内の物体を検出する方法
CN107230203B (zh) 基于人眼视觉注意机制的铸件缺陷识别方法
JP2023159360A (ja) ビジョンシステムにより画像特徴におけるエッジと法線を同時に考慮するためのシステム及び方法
US20180268237A1 (en) Method and system for determining at least one property related to at least part of a real environment
JP2019079553A (ja) ビジョンシステムでラインを検出するためのシステム及び方法
JP6317725B2 (ja) 取得された画像内のクラッタを決定するためのシステム及び方法
KR102153962B1 (ko) 비전 시스템으로 이미지에서 라인을 찾기 위한 시스템 및 방법
CN110222661B (zh) 一种用于运动目标识别及跟踪的特征提取方法
US6993177B1 (en) Gauging based on global alignment and sub-models
JP2016031766A (ja) Cadデータとsem画像との位置合わせ
CN119445005B (zh) 一种基于视觉的点云图像融合方法
US20150104068A1 (en) System and method for locating fiducials with known shape
JP5904168B2 (ja) 撮像画像の特徴点抽出方法および特徴点抽出装置
Zhu et al. Efficient stitching method of tiled scanned microelectronic images
Peng et al. Real time and robust 6D pose estimation of RGBD data for robotic bin picking
Choe et al. Vision-based estimation of bolt-hole location using circular hough transform
Takimoto et al. Rough surface wear analysis using image processing techniques
Dadson et al. Marine Event Vision: Harnessing Event Cameras for Robust Object Detection in Marine Scenarios
Chen et al. A survey of 2d and 3d image matching in industrial object alignment
Leimeister ElectricEye: metallic object pose estimation
Felix et al. Image Processing Techniques to Improve Deep 6DoF Detection in RGB Images
Grajeda et al. Efficient 6D Object Pose Estimation for Robotic Grasping Using Lightweight
Kenyon et al. A framework for printing, detection, tracking, and registration of deformable grids

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180518

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180605

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180904

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20181217

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20190116

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190213

R150 Certificate of patent or registration of utility model

Ref document number: 6483168

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250