WO2012139088A2 - Système et procédé pour générer de multiples images entrelacées à l'aide d'une caméra de balayage unique ayant de multiples sources de lumière alternées - Google Patents

Système et procédé pour générer de multiples images entrelacées à l'aide d'une caméra de balayage unique ayant de multiples sources de lumière alternées Download PDF

Info

Publication number
WO2012139088A2
WO2012139088A2 PCT/US2012/032682 US2012032682W WO2012139088A2 WO 2012139088 A2 WO2012139088 A2 WO 2012139088A2 US 2012032682 W US2012032682 W US 2012032682W WO 2012139088 A2 WO2012139088 A2 WO 2012139088A2
Authority
WO
WIPO (PCT)
Prior art keywords
interlaced
light
light sources
product
camera
Prior art date
Application number
PCT/US2012/032682
Other languages
English (en)
Other versions
WO2012139088A3 (fr
Inventor
Wei-Song TAN
David KOSEN
Thomas R. NEWTON
Steven R. WACHTEL
Agustin DAZA
Original Assignee
Accusentry, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Accusentry, Inc. filed Critical Accusentry, Inc.
Publication of WO2012139088A2 publication Critical patent/WO2012139088A2/fr
Publication of WO2012139088A3 publication Critical patent/WO2012139088A3/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/89—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
    • G01N21/8901—Optical details; Scanning details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/89—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
    • G01N21/8901—Optical details; Scanning details
    • G01N2021/8908—Strip illuminator, e.g. light tube

Definitions

  • the invention relates generally to the field of manufacturing and particularly to machine vision, i.e. the systems and methods or imaging products for the purposes of product inspection.
  • US Patent 6,493,079 discloses a machine vision system, which instead of viewing a single face of a cube, for example, the patent suggests orientation of the camera such that three faces are visible by positioning a corner of the cube nearest the lens. The image is subsequently divided up to allow each face to be processed separately.
  • US Patent 7,030,400 discloses an approach which is nearly the opposite of the instant invention. Instead of using two lights with a single camera, the authors of this patent propose to use a single light with two cameras. One camera observes the transmitted light through the web, while the other observes the reflected light off of the web. This method is simpler than the invention presented herein, but is limited to acquiring only front and backlit images from the same spectrum of light.
  • the preferred embodiment of the present invention can comprise a system and method for generating multiple, interlaced images using one line scan camera with multiple, alternating light sources.
  • the system can include a CCD line scan camera, two or more strobed light sources, an image processing computer, and electronic circuitry facilitating the synchronization of the CCD line scan camera and the light sources.
  • This apparatus is used for machine vision product inspections where different physical qualities of a product are revealed under different spectrums, orientations, angles, focuses of light, or any combination thereof.
  • the apparatus allows the product to be inspected under multiple light sources using only a single camera. This reduces cost, complexity and required space on a manufacturing production line.
  • the product to be inspected can be either continuous or discrete.
  • This system can be extended to a system wherein the image processing computer processes images gathered from multiple cameras.
  • This method can be employed where the light spectrums are visible, ultra-violet, or infrared.
  • This method can be extended to application in which one or more lights sources are not strobed, but constantly powered.
  • the invention is not limited to use with line scan cameras.
  • an area scan camera in which multiple lines or rows are imaged at the same time can be employed.
  • This type of camera can be employed to sequentially image a two dimensional sections or blocks of a product under inspection, and these sequential images can be combined into a single interlaced images in which the representative data or dimensions of the multiple sections retain the same relationship by virtue of use of the same camera, in the same manner as discussed with reference to the exemplary embodiment employing a line scan camera.
  • An area scan camera can also be employed in one additional manner. Instead of sequentially imaging sections of a product, under different lighting conditions, an area scan camera can be employed with multiple light sources illuminating different sections at the same time. Thus when the area scan camera is activated, the camera itself or other control components of the system can activate multiple light sources. The resultant, multi-section image can then be processed by essentially the same image processing computer or software as was employed in processing the sequentially illuminated and interlaced images described with reference to the exemplary embodiment depicted herein.
  • a line scan camera of the type employing multiple lines sensors can be employed in the same manner as would an area scan camera.
  • Figure 1 is a block diagram of interlaced lines can camera and light arrangement.
  • Figure 2 is a description of components of a representative product to be imaged.
  • Figure 3 is an illustration of the imaging of a product using the instant system and method.
  • Figures 4A and 4B are illustrations of the resulting de-interlaced images using white light Figure 4A and UV light Figure 4B.
  • Figure 5 shows an interlaced image acquired using two lights (one front light and one back light) and the instant system and method for capturing interlaced line scan camera images.
  • Figure 6 shows an enlarged portion of interlaced image acquired using two lights (one front light and one back light) and the instant system and method for capturing interlaced line scan camera images.
  • Figures 7A and 7B are de-interlaced images from Figure 6 exhibiting front lighting to the left and back lighting to the right.
  • Figure 8 is a layout of the machine vision system architecture, referred to herein as SVC, in which at least one line scan camera employs the method and apparatus of the present invention.
  • Figure 9 is a view of an alternate embodiment of this invention in which an area scan camera is used instead of a line scan camera as shown in Figure 3.
  • the preferred embodiment of the system 1 consists of an image processing computer 2, line scan camera 3, two or more lights 4 and 5, light power supply and controller 6, camera power supply 7 and encoder 8.
  • the production line PLC 9 will send a trigger signal to the image processing computer 2.
  • the image processing computer 2 will in-turn instruct the line scan camera 3 to begin acquiring an image.
  • the line scan camera 3 will wait for each line trigger signal to be sent from the encoder 8 by way of the camera power supply and the light power supply and controller 6.
  • the light power supply controller 6 will alternately strobe either the Light 4 or the Light 5.
  • Light 4 will be strobed as the line scan camera 3 exposes the first line of the image.
  • the inter-laced image is generated by alternately strobing the white light and UV as the product moves across the camera's field of view.
  • This raw image is sent to the image processing computer, where it is de-interlaced into two separate images. As displayed in Figure 4A, one image appears as if it had been captured in the conventional method using white light alone. The second image appears as if it had been captured in the conventional method using UV light alone, as shown in Figure 4B.
  • This product 10 is a feminine hygiene pad. It is composed of four main components: the non- woven 1 1 , elastic 12, core 1 3 and release tape 14.
  • the elastic 12 is secured in position by hot-melt adhesive, which cannot be visually inspected except under ultraviolet light which causes an additive in the adhesive to fluoresce visible light.
  • the de-interlaced image shows all components except the adhesive 15 as represented in Figure 4A.
  • the de-interlaced image shows the adhesive 1 5, which fluoresces under UV light, as well as fainter lines showing other components, but it is not possible to visualize the elastic 12 in Figure 4B.
  • Figures 4A and 4B thus represent two different sets of product inspection data or two different product inspection images.
  • Using traditional methods of imaging it would be possible to capture and process images of each product under each type of light by using two separate cameras, but it would not be possible to measure the relative positions of the adhesive and the elastic within an individual product.
  • Note further that in the UV image little other identifiable features would be evident and it could not be known if the adhesive was out of position or if the camera trigger signal was out of phase with the product.
  • the relative position of the product relative to the lights and single camera, as well as the timing of the inspection is known and will remain relatively constant, it is now possible to measure the position of the elastic 14 relative to the adhesive 15, especially using image processing software.
  • FIG. 5 An image acquired using a prototype of system and method according to this invention is shown in Figure 5. A small portion of the image has been enlarged in Figure 6 where it is evident that the interlaced image was generated by using two lights. One light provided front illumination, and one light was behind the product to provide back illumination. Figures 7A and 7B show the two resulting de- interlaced images clearly demonstrating the positions of each light.
  • a line scan camera 3 which will integrate with the machine vision architecture, referred to herein as SVC architecture which includes an image processing computer, and will require no additional controller cards or hardware except for an encoder to correlate the action of the machine vision system with a production line on which it will be employed.
  • SVC architecture which includes an image processing computer
  • the timing and synchronization of light strobes 4, 5 and the camera line exposures must be tightly controlled. This is accomplished by using the line scan camera 3 itself to control the timing.
  • the layout for the SVC architecture incorporating this system for generating interlaced images using one line scan camera and multiple, alternating light sources is shown in Figure 8.
  • the camera 3 will control the timing of the light switching and line exposures thought the SVC Linescan LED Dual Light Controller 6.
  • the camera head will generate a control signal which will allow the Controller 6 and the SVC Power Supply to ultimately switch the lights.
  • the invention is not limited to use with line scan cameras.
  • an area scan camera 3A in which multiple lines or rows are imaged at the same time can be employed.
  • This type of camera can be employed to sequentially image a two dimensional sections or blocks of a product under inspection, and these sequential images can be combined into a single interlaced images in which the representative data or dimensions of the multiple sections retain the same relationship by virtue of use of the same camera, in the same manner as discussed with reference to the exemplary embodiment employing a line scan camera.
  • lights 4A and 5A would be activated to illuminate the area to be scanned by area scan camera 3A.
  • An area scan camera can also be employed in one additional manner. Instead of sequentially imaging sections of a product, under different lighting conditions, an area scan camera can be employed with multiple light sources illuminating different sections at the same time. Thus when the area scan camera is activated, the camera itself or other control components of the system can activate multiple light sources. The resultant, multi-section image can then be processed by essentially the same image processing computer or software as was employed in processing the sequentially illuminated and interlaced images described with reference to the exemplary embodiment depicted herein.
  • a line scan cameras of the type employing multiple lines sensors can be employed in the same manner as would an area scan camera.
  • a single multi-spectrum light could be used alone by strobing only certain spectra of LEDs, or in conjunction with single spectrum lights.
  • One or more lights could be constantly powered on, as opposed to strobed.
  • the de-interlaced images could be captured at different times (frame triggers), camera gains, image dimensions, exposure times or resolutions in the direction of motion from one another.
  • the de-interlaced images can also be of different binings. Binnings means that the charge on two or more pixels on the CCD sensor are added together, so that the image resolution is reduced but the image will be brighter, depending upon how many pixels are added together.
  • the image processing computer could communicate with one or more line scan cameras using the instant interlacing method, line scan cameras using traditional lighting, or area scan cameras or any combination thereof.
  • the strobing pattern for the light could be selectively adjusted.
  • the images could be inspected with or with-out de-interlacing.
  • the product to be inspected could be continuous or discrete.
  • the system could be used to strobe one or more lights for the purpose of extending the usable lifetime of said lights.
  • the lights employed in this invention can also be activated before the camera to allow the lights and the illumination to stabilize before the scan or image is generated or to insure that the pulse width activating the lights is of sufficient length, so that a higher quality image may be generated.
  • the image processing computer could be included inside the line scan camera, as in a "smart camera” configuration.
  • the system can be employed to inspect a continuous product in paper form, such as paper, film, adhesive or no-woven roll goods, and the term product is not limited to discrete product, such as shown in the representative examples.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Textile Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

L'invention porte sur un système et un procédé pour générer de multiples images entrelacées à l'aide d'une caméra de balayage ayant de multiples sources de lumière stroboscopiques en alternance. Le système comprend une caméra de balayage de ligne CCD, deux sources de lumière stroboscopiques ou plus, un ordinateur de traitement d'image et des circuits électroniques facilitant la synchronisation de la caméra de balayage de ligne CCD et des sources de lumière. A mesure que l'objet d'intérêt est imagé par la caméra de balayage de ligne, les sources de lumière sont individuellement et séquentiellement stroboscopiques à mesure que chaque ligne est exposée. L'image électronique résultante contiendra des lignes entrelacées, chaque ligne étant éclairée par uniquement l'une des sources de lumière. L'image résultante sera ensuite désentrelacée par l'ordinateur de traitement d'image pour produire de multiples images séparées concordant avec le nombre de sources de lumière, chaque image étant éclairée par une seule source de lumière.
PCT/US2012/032682 2011-04-08 2012-04-09 Système et procédé pour générer de multiples images entrelacées à l'aide d'une caméra de balayage unique ayant de multiples sources de lumière alternées WO2012139088A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161516821P 2011-04-08 2011-04-08
US61/516,821 2011-04-08

Publications (2)

Publication Number Publication Date
WO2012139088A2 true WO2012139088A2 (fr) 2012-10-11
WO2012139088A3 WO2012139088A3 (fr) 2012-11-22

Family

ID=46969861

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/032682 WO2012139088A2 (fr) 2011-04-08 2012-04-09 Système et procédé pour générer de multiples images entrelacées à l'aide d'une caméra de balayage unique ayant de multiples sources de lumière alternées

Country Status (1)

Country Link
WO (1) WO2012139088A2 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103884650A (zh) * 2014-03-28 2014-06-25 北京大恒图像视觉有限公司 一种多光源线阵成像系统及方法
WO2016141163A1 (fr) * 2015-03-03 2016-09-09 Diebold, Incorporated Lecture de données textuelles prédéfinies sur une feuille
CN107478661A (zh) * 2017-09-11 2017-12-15 深圳市中天元光学玻璃有限公司 一种玻璃屏幕在线检测装置
CN109583358A (zh) * 2018-11-26 2019-04-05 广东智源信息技术有限公司 一种医疗卫生监督快速精准执法方法
WO2019243199A1 (fr) * 2018-06-20 2019-12-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Dispositif et procédé permettant d'identifier et/ou d'évaluer des articles ou des produits
CN110708444A (zh) * 2019-09-27 2020-01-17 广州荣峰光电科技有限公司 用于拍摄焊接过程的摄像系统及其控制方法
WO2021062938A1 (fr) * 2019-09-30 2021-04-08 苏州精濑光电有限公司 Mécanisme de détection optique pour membrane

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6327374B1 (en) * 1999-02-18 2001-12-04 Thermo Radiometrie Oy Arrangement and method for inspection of surface quality
US20040061850A1 (en) * 2002-09-26 2004-04-01 Orbotech Ltd Illumination and image acquisition system
US20060001880A1 (en) * 2002-07-26 2006-01-05 Stober Bernd R Device and method for inspecting material
US20090185182A1 (en) * 2007-04-25 2009-07-23 Kim Moon S Simultaneous Acquisition of Fluorescence and Reflectance Imaging Techniques with a Single Imaging Device for Multitask Inspection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6327374B1 (en) * 1999-02-18 2001-12-04 Thermo Radiometrie Oy Arrangement and method for inspection of surface quality
US20060001880A1 (en) * 2002-07-26 2006-01-05 Stober Bernd R Device and method for inspecting material
US20040061850A1 (en) * 2002-09-26 2004-04-01 Orbotech Ltd Illumination and image acquisition system
US20090185182A1 (en) * 2007-04-25 2009-07-23 Kim Moon S Simultaneous Acquisition of Fluorescence and Reflectance Imaging Techniques with a Single Imaging Device for Multitask Inspection

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103884650A (zh) * 2014-03-28 2014-06-25 北京大恒图像视觉有限公司 一种多光源线阵成像系统及方法
WO2016141163A1 (fr) * 2015-03-03 2016-09-09 Diebold, Incorporated Lecture de données textuelles prédéfinies sur une feuille
CN107478661A (zh) * 2017-09-11 2017-12-15 深圳市中天元光学玻璃有限公司 一种玻璃屏幕在线检测装置
WO2019243199A1 (fr) * 2018-06-20 2019-12-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Dispositif et procédé permettant d'identifier et/ou d'évaluer des articles ou des produits
CN109583358A (zh) * 2018-11-26 2019-04-05 广东智源信息技术有限公司 一种医疗卫生监督快速精准执法方法
CN110708444A (zh) * 2019-09-27 2020-01-17 广州荣峰光电科技有限公司 用于拍摄焊接过程的摄像系统及其控制方法
CN110708444B (zh) * 2019-09-27 2021-09-07 广州荣峰光电科技有限公司 用于拍摄焊接过程的摄像系统及其控制方法
WO2021062938A1 (fr) * 2019-09-30 2021-04-08 苏州精濑光电有限公司 Mécanisme de détection optique pour membrane

Also Published As

Publication number Publication date
WO2012139088A3 (fr) 2012-11-22

Similar Documents

Publication Publication Date Title
WO2012139088A2 (fr) Système et procédé pour générer de multiples images entrelacées à l'aide d'une caméra de balayage unique ayant de multiples sources de lumière alternées
KR101691242B1 (ko) 다중 모드 이미징
US10644410B2 (en) Control module for a camera in a production system and method for acquiring images by means of such a camera
US9719939B2 (en) Apparatus and method for inspecting printed images
CN108351308B (zh) 用于监控连续的织物幅面的装置和方法
US20070286471A1 (en) Auto Distinction System And Auto Distinction Method
JP2005244953A (ja) 移動中の印刷物の所定部分の画像を撮影する装置
JP7262260B2 (ja) 欠陥検査装置、及び欠陥検査方法
CN110376207A (zh) 一种超宽厚板表面缺陷在线检测系统图像采集方法
US7304726B2 (en) Auto distinction system
JP5824278B2 (ja) 画像処理装置
JP2008286646A (ja) 表面疵検査装置
JP4903031B2 (ja) 透光性を有するシート材の外観検査装置および方法
JP4980033B2 (ja) 欠陥ログの検出方法及び検出装置
US20210360140A1 (en) Multimodality multiplexed illumination for optical inspection systems
WO2014104375A1 (fr) Dispositif d'inspection
JP6006374B2 (ja) 物体検出用撮像システム
CN107976451B (zh) 用于补偿在材料幅检查时的材料幅偏移的方法和设备
EP3667302A1 (fr) Lampe latérale aérienne
JP2010085388A (ja) 印刷物の検査方法及び検査装置
JP2007328583A (ja) 画像センシングシステム
JP2970663B1 (ja) 印刷物汚染検査装置ならびに検査方法
JP2007327953A (ja) センサ装置
JP6048939B2 (ja) 光輝性印刷物の検査方法
JPH09284753A (ja) 監視カメラの撮像制御方法とその装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12767734

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12767734

Country of ref document: EP

Kind code of ref document: A2