WO2000038494A8 - Automatic inspection system with stereovision - Google Patents

Automatic inspection system with stereovision

Info

Publication number
WO2000038494A8
WO2000038494A8 PCT/US1999/030206 US9930206W WO0038494A8 WO 2000038494 A8 WO2000038494 A8 WO 2000038494A8 US 9930206 W US9930206 W US 9930206W WO 0038494 A8 WO0038494 A8 WO 0038494A8
Authority
WO
WIPO (PCT)
Prior art keywords
stereo images
components
location
computed
reference points
Prior art date
Application number
PCT/US1999/030206
Other languages
French (fr)
Other versions
WO2000038494A3 (en
WO2000038494A2 (en
Inventor
Christopher B Jackson
Original Assignee
Cyberoptics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cyberoptics Corp filed Critical Cyberoptics Corp
Priority to IL13777899A priority Critical patent/IL137778A0/en
Priority to KR1020007009019A priority patent/KR20010040998A/en
Priority to CA002321096A priority patent/CA2321096A1/en
Priority to JP2000590448A priority patent/JP2003522347A/en
Priority to AU33425/00A priority patent/AU3342500A/en
Priority to EP99969986A priority patent/EP1057390A2/en
Publication of WO2000038494A2 publication Critical patent/WO2000038494A2/en
Publication of WO2000038494A3 publication Critical patent/WO2000038494A3/en
Publication of WO2000038494A8 publication Critical patent/WO2000038494A8/en

Links

Classifications

    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K13/00—Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
    • H05K13/08—Monitoring manufacture of assemblages
    • H05K13/081—Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines
    • H05K13/0815—Controlling of component placement on the substrate during or after manufacturing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/001—Industrial image inspection using an image reference approach
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30141—Printed circuit board [PCB]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Abstract

In one embodiment of the present invention, two banks (22, 24) of fixed array cameras provide tiled stereo images (I1, I2, I3) and electronics assemble the tiled stereo images into a mosaic image. The mosaic image includes height information derived from the two sets stereo images, and is also compensated as a function of reference points in the image to more closely conform to the actual board (10). Preferably, a SAM model is used to locate the reference points. Reconstructed SAM models corresponding to components on the board are applied within a search area where a certain type of component is expected to be found. The best-fit location of the component within the search area, as well as the skew angle and the probability are computed. The best-fit location is the location where the Manhabolis distance and the residual error are optimized. Once the best-fit location is computed, it is compared to tolerances to identify improperly placed components, the absence of components or the like.
PCT/US1999/030206 1998-12-19 1999-12-17 Automatic inspection system with stereovision WO2000038494A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
IL13777899A IL137778A0 (en) 1998-12-19 1999-12-17 Automatic inspection system with stereovision
KR1020007009019A KR20010040998A (en) 1998-12-19 1999-12-17 Automatic inspection system with stereovision
CA002321096A CA2321096A1 (en) 1998-12-19 1999-12-17 Automatic inspection system with stereovision
JP2000590448A JP2003522347A (en) 1998-12-19 1999-12-17 Automatic inspection system using stereo images
AU33425/00A AU3342500A (en) 1998-12-19 1999-12-17 Automatic inspection system with stereovision
EP99969986A EP1057390A2 (en) 1998-12-19 1999-12-17 Automatic inspection system with stereovision

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB9828109.0A GB9828109D0 (en) 1998-12-19 1998-12-19 Inspection equipment and methods of inspection
GB9828109.0 1998-12-19

Publications (3)

Publication Number Publication Date
WO2000038494A2 WO2000038494A2 (en) 2000-06-29
WO2000038494A3 WO2000038494A3 (en) 2000-09-14
WO2000038494A8 true WO2000038494A8 (en) 2000-10-26

Family

ID=10844634

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/030206 WO2000038494A2 (en) 1998-12-19 1999-12-17 Automatic inspection system with stereovision

Country Status (8)

Country Link
EP (1) EP1057390A2 (en)
JP (1) JP2003522347A (en)
KR (1) KR20010040998A (en)
AU (1) AU3342500A (en)
CA (1) CA2321096A1 (en)
GB (1) GB9828109D0 (en)
IL (1) IL137778A0 (en)
WO (1) WO2000038494A2 (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1220596A1 (en) * 2000-12-29 2002-07-03 Icos Vision Systems N.V. A method and an apparatus for measuring positions of contact elements of an electronic component
US7477774B2 (en) * 2001-07-04 2009-01-13 Koninklijke Philips Electronics N.V. Choice of reference markings for enabling fast estimating of the position of an imaging device
JP4596422B2 (en) * 2005-05-20 2010-12-08 キヤノンマシナリー株式会社 Imaging device for die bonder
WO2006135040A1 (en) 2005-06-17 2006-12-21 Omron Corporation Image processing device and image processing method performing 3d measurement
WO2007053557A1 (en) * 2005-10-31 2007-05-10 Cyberoptics Corporation Electronics assembly machine with embedded solder paste inspection
WO2009094489A1 (en) * 2008-01-23 2009-07-30 Cyberoptics Corporation High speed optical inspection system with multiple illumination imagery
CN101614679B (en) * 2008-06-27 2011-06-22 上海纺印印刷包装有限公司 Quality detection device for concave-convex printed product
US8872912B2 (en) * 2009-09-22 2014-10-28 Cyberoptics Corporation High speed distributed optical sensor inspection system
JP2013505465A (en) * 2009-09-22 2013-02-14 サイバーオプティクス コーポレーション High-speed, high-resolution 3D solar cell inspection system
US8670031B2 (en) 2009-09-22 2014-03-11 Cyberoptics Corporation High speed optical inspection system with camera array and compact, integrated illuminator
US8388204B2 (en) 2009-09-22 2013-03-05 Cyberoptics Corporation High speed, high resolution, three dimensional solar cell inspection system
US8681211B2 (en) 2009-09-22 2014-03-25 Cyberoptics Corporation High speed optical inspection system with adaptive focusing
US8894259B2 (en) 2009-09-22 2014-11-25 Cyberoptics Corporation Dark field illuminator with large working area
JP5465062B2 (en) * 2010-03-31 2014-04-09 名古屋電機工業株式会社 Substrate appearance inspection apparatus and substrate appearance inspection method
KR101160663B1 (en) * 2010-10-21 2012-06-28 한국원자력연구원 Three Dimensional Visualization of Stereo X-ray Images based on Volume Reconstruction
KR20140078621A (en) * 2011-11-14 2014-06-25 에베 그룹 에. 탈너 게엠베하 Measuring form changes of a substrate
US20140198185A1 (en) * 2013-01-17 2014-07-17 Cyberoptics Corporation Multi-camera sensor for three-dimensional imaging of a circuit board
US11176635B2 (en) * 2013-01-25 2021-11-16 Cyberoptics Corporation Automatic programming of solder paste inspection system
US10126252B2 (en) * 2013-04-29 2018-11-13 Cyberoptics Corporation Enhanced illumination control for three-dimensional imaging
US9743527B2 (en) 2013-08-09 2017-08-22 CyberOptics Corporaiton Stencil programming and inspection using solder paste inspection system
US9707584B2 (en) 2014-07-09 2017-07-18 Nordson Corporation Dual applicator fluid dispensing methods and systems
CN106290423B (en) * 2016-10-18 2024-04-05 同方威视技术股份有限公司 Method, device and system for scanning imaging
CN111434202B (en) * 2017-12-07 2021-06-22 雅马哈发动机株式会社 Work device for mounted object
CN113692215A (en) * 2021-07-30 2021-11-23 广州佳帆计算机有限公司 System, method and device for adjusting position of patch element

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4978224A (en) * 1987-07-14 1990-12-18 Sharp Kabushiki Kaisha Method of and apparatus for inspecting mounting of chip components
EP0301255A1 (en) * 1987-07-30 1989-02-01 Siemens Aktiengesellschaft Three-dimensional position recognition of component pins for automatic insertion
JP2714277B2 (en) * 1991-07-25 1998-02-16 株式会社東芝 Lead shape measuring device

Also Published As

Publication number Publication date
AU3342500A (en) 2000-07-12
CA2321096A1 (en) 2000-06-29
GB9828109D0 (en) 1999-02-17
EP1057390A2 (en) 2000-12-06
IL137778A0 (en) 2001-10-31
WO2000038494A3 (en) 2000-09-14
KR20010040998A (en) 2001-05-15
JP2003522347A (en) 2003-07-22
WO2000038494A2 (en) 2000-06-29

Similar Documents

Publication Publication Date Title
WO2000038494A3 (en) Automatic inspection system with stereovision
WO2003053226A3 (en) Apparatus, method and system for intravascular photographic imaging
WO2004084136A3 (en) Automatic processing of aerial images
WO2004061504A3 (en) Systems and methods for inspecting an optical interface
EP1209623A3 (en) Stereo image processing apparatus and method of processing stereo image
AU2002347641A1 (en) Face recognition using kernel fisherfaces
WO2000023863A3 (en) Determining differences between two or more metadata models
ATE491191T1 (en) MULTIPLE CAMERA OBJECT TRACKING SYSTEM
GB0224105D0 (en) Systems and methods for generating digital images having image meta-data combined with the image data
WO2001004837A3 (en) Method and apparatus for detecting independent motion in three-dimensional scenes
CA2252552A1 (en) Method and system for inspecting a low gloss surface of an object at a vision station
WO2006078310A3 (en) Method and apparatus for determining a location associated with an image
TR199800397T2 (en) Method and apparatus for detecting the position of a television camera for use in an apparent studio.
GB2276512A (en) Solid state sensor arrangement for video camera
WO2003073359A3 (en) Method and apparatus for recognizing objects
CA2374490A1 (en) Test processing workflow tracking system
WO2007014092A3 (en) Method of placing constraints on a deformation map and system for implementing same
EP1737230A3 (en) Image processing apparatus
WO1998010593A3 (en) Picture encoding and decoding
CA2434704A1 (en) System and method for reading license plates
WO2008009966A3 (en) Determining the location of a vehicle on a map
DE602004015759D1 (en)
CA2063158A1 (en) System for detecting an edge of an image
AU2002212657A1 (en) Method and system for remote image reconstitution and processing and imaging data collectors communicating with the system
CA2213944A1 (en) Multidirectional image pickup apparatus using a plurality of image pickup cameras

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 137778

Country of ref document: IL

ENP Entry into the national phase

Ref document number: 2321096

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 1020007009019

Country of ref document: KR

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2000 590448

Kind code of ref document: A

Format of ref document f/p: F

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1999969986

Country of ref document: EP

AK Designated states

Kind code of ref document: A3

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

AK Designated states

Kind code of ref document: C1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

CFP Corrected version of a pamphlet front page
CR1 Correction of entry in section i
WWP Wipo information: published in national office

Ref document number: 1999969986

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 1020007009019

Country of ref document: KR

WWW Wipo information: withdrawn in national office

Ref document number: 1999969986

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1020007009019

Country of ref document: KR