EP1438883A1 - Automatische filterauswechslung zum gebrauch mit einer inspektionskameravorrichtung einer oberflächenmontierungseinrichtung - Google Patents

Automatische filterauswechslung zum gebrauch mit einer inspektionskameravorrichtung einer oberflächenmontierungseinrichtung

Info

Publication number
EP1438883A1
EP1438883A1 EP02772667A EP02772667A EP1438883A1 EP 1438883 A1 EP1438883 A1 EP 1438883A1 EP 02772667 A EP02772667 A EP 02772667A EP 02772667 A EP02772667 A EP 02772667A EP 1438883 A1 EP1438883 A1 EP 1438883A1
Authority
EP
European Patent Office
Prior art keywords
item
circuit board
filter
image
physical features
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP02772667A
Other languages
English (en)
French (fr)
Inventor
Michael T. Swab
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Assembleon BV
Original Assignee
Assembleon BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/970,960 external-priority patent/US6765185B2/en
Application filed by Assembleon BV filed Critical Assembleon BV
Publication of EP1438883A1 publication Critical patent/EP1438883A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05KPRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K13/00Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
    • H05K13/08Monitoring manufacture of assemblages
    • H05K13/081Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines
    • H05K13/0812Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines the monitoring devices being integrated in the mounting machine, e.g. for monitoring components, leads, component placement

Definitions

  • the invention relates to visualization of printed circuit boards and parts presenting characteristic visualization problems.
  • the invention is particularly, but not exclusively, useful for recognizing by computer vision physical features of any of several types of printed circuit boards or electronic parts, where each type of board or part presents a different characteristic visualization problem.
  • Automated printed circuit board assembly equipment such as the Automated Component Mounter from Assembleon, utilize computer vision systems to inspect and accurately place printed circuit boards and parts to be mounted on those boards.
  • the inspection of these items typically requires visualizing an item, recognizing the physical features of the item and analyzing the physical characteristics of the physical features.
  • An empty printed circuit board or card is typically picked out of a storage location and computer vision equipment, including a camera and frontal lighting, is employed by the assembly machine to inspect the physical features on the board. Certain of these physical features are called f ⁇ ducials, which are provided to precisely register the parts that will be installed on the board. Other such physical features on the circuit board are solder paste contact pads. If the inspected board is not rejected, the assembly machine then places it into position to receive parts for mounting.
  • Each part to be mounted is then picked out of a storage location and computer vision equipment, again including a camera and frontal lighting, is employed by the assembly machine to inspect the part. If the part is not rejected, the assembly machine then steers the placement of the part with proper registration to its mounting position on the board or card.
  • CCD charge coupled device
  • aspects of the invention may be found in a method and apparatus in which a filter is automatically deployed when inspecting circuit boards and parts of a certain type.
  • the filter corrects characteristic problems encountered when visualizing the physical features of items of that type.
  • the contrast in a image between silver fiducials and a light colored printed circuit board, or between silver contacts and a light colored part may be improved by linearly polarizing the illumination of the circuit board and imaging the board or part through a linear polarizing filter oriented in a different direction than the illumination filter.
  • the contrast between contacts of one color and a background of another color in an image of a part may be improved by imaging the part through a color filter.
  • the glare in an image of a circuit board or part may be reduced by imaging the board or part through a circular-polarizing filter.
  • the effect of reflected infrared radiation on a CCD camera may be reduced in an image of a circuit board or part by imaging the board or part through a filter rejecting infrared.
  • an aspect of the invention may be found in the following method for visualizing an item having physical features on a background.
  • the item is illuminated with electromagnetic radiation, using an illumination source.
  • An image is formed of the electromagnetic radiation reflected from the item, which image has characteristic defects depending on the type of item being visualized.
  • the reflected electromagnetic radiation is automatically filtered to remove the characteristic defects from the image, thereby improving the contrast between the physical features and the background in the filtered image.
  • circuit board or part may be recognized in the filtered image for the purpose of inspection.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • the filter is moved linearly into position.
  • Figure 1 is a schematic elevational cross-section view of visualization, recognition and placement apparatus in accordance with the invention
  • Figure 2 is a top view of illumination and reption parts of Figure 1, as viewed from the lines 2-2;
  • Figure 3 is a cross-section view of visualization, recognition, placement and linear filter deployment apparatus in accordance with the invention, with the filter retracted;
  • Figure 4 is a cross-section view with the filter deployed;
  • Figure 5 is a cross-section view of another embodiment of the invention, showing a rotational filter deployment apparatus;
  • Figure 6 is a top view of the rotational filter deployment apparatus of Figure 5.
  • FIG. 1 of the drawing an embodiment of the present invention for visualization of parts having metallic objects against a dielectric or non-metallic poorly contrasting background, is explained in conjunction with a conventional computer vision system 10 recognizing a usually two dimensional Ball Grid Array (BGA) 12 of small high melt solder balls 14 carried by a ceramic dielectric substrate 16.
  • BGA Ball Grid Array
  • GA 12 is held by a gripper or manipulator 18 of a pick and place machine (not shown) over an upwardly looking camera 20 of computer vision system 10.
  • the camera 20 forms and provides an electronic image to computer vision system 10, which system utilizes the electronic image to recognize and inspect the solder balls 14 of the BGA 12, as to existence, size and spacing. If the BGA 12 passes inspection, the vision system 10 steers the translation and placement of BGA 12 by manipulator 18 on a circuit board or card 22, with the recognized solder balls 14 of the BGA in registration with contact pads 24 of the board or card 22.
  • the contact pads 24 are coated with a eutectic solder paste, and after the placement of the BGA 12 and other surface mount components on circuit board or card 22, heat is applied to card with placed BGA and other components to fuse the solder paste into fillets (not shown) firmly surface mounting the BGA to the circuit board or card.
  • the light box 26 is used to provide generally upwardly and inwardly directed polarized illumination I of BGA 12, in conjunction with a polarization filter 28 in front of the lens 30 of camera 20, in order to allow for proper visualization by camera 20, and proper recognition by vision system 10 of solder balls 14.
  • a preferred embodiment of light box 26 has a central aperture 32 through which camera 20 looks upward via polarization filter 28, and four upwardly and outwardly inclined trapezoidal faces 34, 36, 38, 40 of a frusto-pyramid, each face forming a separate source of polarized light.
  • the faces 34, 36, 38, and 40 comprise polarization filters 40, 42, 44, and 46 over respective milk glass diffuser panels 50, over LED arrays 52.
  • polarization filters 40 and 44 are oriented to pass linear polarization directed at 90° and polarization filters 42 and 46 are oriented to pass linear polarization directed at 180°.
  • the result is that the downwardly directed component of light from the four sources reflected from the solder balls 14 has a polarization at 90°, which is, or is nearly, orthogonal with the polarization direction that would be passed by polarization filter 28. Therefore no light reflected by solder balls 14 reach the lens 30 of camera 20.
  • the downwardly directed component of light reflected from the white or light colored substrate 16 is substantially uniformly distributed in polarization and a substantial amount of light reflected downward from the substrate 16 passes through polarization filter 28 and reaches the lens 30 of camera 20.
  • the solder balls 14 appear substantially black and the substrate 16 appears substantially white, providing good contrast for reliable recognition of solder balls 14.
  • This contrast producing effect is thought to be due to a preservation of polarization in reflection of electromagnetic radiation from shiny metal objects versus a the smearing of polarization in reflection of electromagnetic radiation from dielectric objects.
  • a printed circuit board assembly machine will inspect parts of different types during the assembly of a single circuit board.
  • Such a substrate provides good contrast with the silver or gold colored fiducials used to register the parts installed on the circuit board.
  • other circuit boards or cards handled by the same assembly machine may have a white, or other light colored, ceramic substrate, which provides poor contrast with the metallic fiducials.
  • the technique described above for deploying a filter when appropriate to achieve reliable recognition of solder balls on parts having either light colored or dark colored substrates can also be used to reliably recognize metallic fiducials on either light colored or dark colored printed circuit boards and cards.
  • the control system of a circuit board assembly machine typically utilizes a specification file for each type of item (printed circuit board, card or part) it handles. This file contains information on the characteristics of each type of item.
  • Information from that file such as the number and location of physical features (fiducials and contact pads on boards and cards, or contacts on parts), is provided to the computer vision system for the inspection process.
  • the specification file would also contain information indicating whether a filter should be used when inspecting an item of that type and, for the embodiment shown in Figure 5, specifying which type of filter is to be used.
  • FIG. 3 of the drawing an embodiment of the invention employing a linear filter deployment apparatus 60 is shown with the filter retracted.
  • a filter 61 is attached by linkage 64 to linear actuator 65.
  • the linear actuator 65 When energized by the circuit board assembly machine control system, the linear actuator 65 will adopt the configuration shown, with the filter retracted from the optical axis of the camera 20.
  • the linear actuator 65 When de-energized by the control system, the linear actuator 65 will adopt the configuration shown in Figure 4 of the drawing, with the linkage extended and the filter 61 deployed in front of the lens 30 of camera 20.
  • the action of the actuator 65 will be the opposite of that described above: when the actuator 65 is energized, the filter 61 will be deployed and when the actuator 65 is de-energized, the filter 61 will be retracted. While the above description discusses the use of a linear actuator to deploy filter 61, it should be understood that a solenoid could also be employed in an embodiment of the invention.
  • Filter 61 in Figures 3 and 4 could be the linear polarization filter 28 shown in Figure 1, employed in combination with linearly polarized illumination, as described above, to correct the visualization problem associated with metallic physical features on a light colored background.
  • filter 61 could be one of several other types of filter chosen to correct other characteristic problems, as will now be described. These other types of filters can be used to equal effectiveness with polarized or non-polarized illumination.
  • filter 61 could be chosen to be a red color filter. Such a filter would pass the red light reflecting from the red physical features while blocking the green light reflecting from the background, causing the physical features to appear substantially white and the background to appear substantially black in the image from a monochrome camera.
  • camera 20 employs a charge coupled device (CCD) to form the electronic image
  • CCD charge coupled device
  • items that are especially reflective in the infrared spectrum may present a different characteristic visualization problem.
  • a CCD is very sensitive to radiation in the infrared spectrum
  • the electronic image of such an item may be washed out, with both the physical features and the background of the item appearing as light gray objects in the image, preventing the computer vision system from being able to recognize the physical features on the item.
  • filter 61 could be chosen to be an infrared filter, which blocks infrared radiation and passes visible light.
  • filter 61 could be chosen to be a circular polarizing filter. Such a filter restricts the rotation component of the illumination reflected from the item, thereby reducing glare from the item and allowing correct recognition of the physical features on the item. While the preceding discussion has described recognizing contacts on electronic parts or fiducials and contact pads on printed circuit boards and cards, it should be understood that the physical features being recognized on other items may not be contacts or fiducials.
  • thermoset adhesive glue dots serve to mount parts that are not soldered to the board.
  • FIG. 5 An embodiment of the invention allowing one of several filters to be deployed is illustrated in Figure 5 of the drawing.
  • a rotational filter deployment apparatus 70 is shown, which is a filter wheel 75 mounted on the shaft of stepper motor 76. Also visible in Figure 5 are filters 61 and 63 mounted on the filter wheel 75 in registration with apertures 72 and 74.
  • stepper motor 76 In response to signals from the assembly machine control system, stepper motor 76 will rotate to a specified position, thereby deploying the appropriate filter for the part being visualized.
  • Filter wheel 75 can be seen to have, in this embodiment of the invention, four apertures 71, 72, 73, and 74. Apertures 72, 73, and 74 are covered by filters 61, 62, and 63, respectively, while aperture 71 is not covered with a filter.
  • the hub of filter wheel 75 is mounted to the shaft of stepper motor 76.
  • Lens 30 is seen through aperture 74. While motor 76 is described above as a stepper motor, it should be understood that servo motors could also be used in an embodiment of the invention to position filter wheel 75 in response to signals from the assembly machine control system.
  • Figures 3, 4 and 5 show embodiments of the invention being used for visualization of a BGA package, it should be appreciated that the techniques of the invention can be used to improve visualization of other types of packages and of printed circuit boards and cards.

Landscapes

  • Engineering & Computer Science (AREA)
  • Operations Research (AREA)
  • Manufacturing & Machinery (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Image Input (AREA)
  • Image Processing (AREA)
EP02772667A 2001-10-04 2002-09-30 Automatische filterauswechslung zum gebrauch mit einer inspektionskameravorrichtung einer oberflächenmontierungseinrichtung Withdrawn EP1438883A1 (de)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US970960 2001-10-04
US09/970,960 US6765185B2 (en) 2001-10-04 2001-10-04 Computer vision recognition of metallic objects against a poorly contrasting background
US24788 2001-12-19
US10/024,788 US20030068078A1 (en) 2001-10-04 2001-12-19 Automatic filter changer for use on surface mounter inspection camera
PCT/IB2002/004046 WO2003032705A1 (en) 2001-10-04 2002-09-30 Automatic filter changer for use on surface mounter inspection camera

Publications (1)

Publication Number Publication Date
EP1438883A1 true EP1438883A1 (de) 2004-07-21

Family

ID=26698868

Family Applications (1)

Application Number Title Priority Date Filing Date
EP02772667A Withdrawn EP1438883A1 (de) 2001-10-04 2002-09-30 Automatische filterauswechslung zum gebrauch mit einer inspektionskameravorrichtung einer oberflächenmontierungseinrichtung

Country Status (4)

Country Link
EP (1) EP1438883A1 (de)
JP (1) JP2005505942A (de)
CN (1) CN1561659A (de)
WO (1) WO2003032705A1 (de)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI549256B (zh) * 2012-12-24 2016-09-11 鴻海精密工業股份有限公司 發光二極體模組之製造方法
JP2015106603A (ja) * 2013-11-29 2015-06-08 スタンレー電気株式会社 部品装着用光照射撮像装置
EP3506728B1 (de) * 2016-08-24 2024-05-15 Fuji Corporation Montagevorrichtung
CN106454040A (zh) * 2016-10-21 2017-02-22 东风商用车有限公司 一种夜间防眩光车载摄像头及其控制方法
EP3567425B1 (de) * 2017-01-06 2024-05-01 Fuji Corporation Beleuchtungsvorrichtung zur bilderfassung

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5044072A (en) * 1990-04-13 1991-09-03 Air-Vac Engineering Company, Inc. Vision system apparatus and method for component/pad alignment
JPH09264722A (ja) * 1996-03-28 1997-10-07 Sony Corp 外観検査方法およびその装置
JP2000121338A (ja) * 1998-10-13 2000-04-28 Yamagata Casio Co Ltd 電子部品検査装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO03032705A1 *

Also Published As

Publication number Publication date
CN1561659A (zh) 2005-01-05
JP2005505942A (ja) 2005-02-24
WO2003032705A1 (en) 2003-04-17

Similar Documents

Publication Publication Date Title
JP2010217169A (ja) 印刷回路基板の外観検査システム及びその方法
US20030068078A1 (en) Automatic filter changer for use on surface mounter inspection camera
JP2958014B2 (ja) 表面装着された部品をもつプリント回路板の点検装置及び点検方法
WO2003032705A1 (en) Automatic filter changer for use on surface mounter inspection camera
US7551768B2 (en) Image recognition apparatus and method for surface discrimination using reflected light
JP2698213B2 (ja) 回路基板および回路基板の位置認識方式
JP4818572B2 (ja) 画像認識装置および画像認識方法
JPH05288527A (ja) 実装基板外観検査方法およびその装置
US5923772A (en) Method and apparatus for visual recognition of a component supplied to an industrial automated system
JP4818571B2 (ja) 画像認識装置および画像認識方法
JP2006165106A (ja) 電子部品実装方法
JPH0775035B2 (ja) 画像処理によるsmdの極性識別検査装置
JP3665495B2 (ja) クリーム半田印刷機用検査装置及び方法及び該検査装置を有する印刷機
WO2005118212A1 (en) Solder mask enhancement and method of inspecting printed circuit board assemblies
JPH04162700A (ja) 配線基板の位置検出方法
JP2002261499A (ja) データ作成装置及びデータ作成方法
JPS61243304A (ja) 実装基板の外観検査方式
KR19990018439A (ko) 부품 검사장치
JPH05152728A (ja) プリント配線基板
JPH09113242A (ja) フープ状テープに貼着した電子部品の外観検査方法
JPH07105355A (ja) 画像認識方法及び装置
GB2308185A (en) Inspecting component solder joints and leads inserted in printed circuit boards
Abraham Automated inspection in printed circuit board assembly (PCBA) manufacturing
JPH04130441U (ja) 半田付け検査用治具
JPS61108200A (ja) プリント基板のチツプ部品装着モレ検査装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20040504

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20060401