CA2226473A1 - Inspection system for exterior article surfaces - Google Patents
Inspection system for exterior article surfaces Download PDFInfo
- Publication number
- CA2226473A1 CA2226473A1 CA002226473A CA2226473A CA2226473A1 CA 2226473 A1 CA2226473 A1 CA 2226473A1 CA 002226473 A CA002226473 A CA 002226473A CA 2226473 A CA2226473 A CA 2226473A CA 2226473 A1 CA2226473 A1 CA 2226473A1
- Authority
- CA
- Canada
- Prior art keywords
- data
- color
- image
- specimen
- inspection area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 90
- 238000004458 analytical method Methods 0.000 claims description 20
- 230000007547 defect Effects 0.000 claims description 14
- 238000005286 illumination Methods 0.000 claims description 8
- 238000000034 method Methods 0.000 claims description 8
- 230000007704 transition Effects 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims 3
- 230000000977 initiatory effect Effects 0.000 claims 2
- 238000005070 sampling Methods 0.000 claims 2
- 238000001228 spectrum Methods 0.000 claims 1
- 238000011144 upstream manufacturing Methods 0.000 claims 1
- 235000013361 beverage Nutrition 0.000 abstract description 6
- 238000002372 labelling Methods 0.000 abstract description 3
- 238000012937 correction Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000003086 colorant Substances 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000015654 memory Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000013519 translation Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000003708 edge detection Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000010223 real-time analysis Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 150000001768 cations Chemical class 0.000 description 1
- 230000004456 color vision Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/90—Investigating the presence of flaws or contamination in a container or its contents
- G01N21/9036—Investigating the presence of flaws or contamination in a container or its contents using arrays of emitters or receivers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/90—Investigating the presence of flaws or contamination in a container or its contents
- G01N21/909—Investigating the presence of flaws or contamination in a container or its contents in opaque containers or opaque container parts, e.g. cans, tins, caps, labels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/0078—Testing material properties on manufactured objects
- G01N33/0081—Containers; Packages; Bottles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Food Science & Technology (AREA)
- Medicinal Chemistry (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Spectrometry And Color Measurement (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Image Processing (AREA)
Abstract
A system for automated inspection of article exteriors includes a plurality of video cameras (32). One or more of these video cameras (32) is black and white while at least one is color capable. A strobe light for illuminating a specimen (22) disposed in a specimen area (24) onto which all of the cameras (32) are focused. The strobe allows for each camera (32) to capture a still image of the specimen (22), The black and white cameras (32) capture images which allow determining whether the exterior layout is acceptable. The color camera or cameras (30) captures an image which allows determining whether the coloration of the specimen (22) is acceptable. Specimens (22) are selectively rejected on the basis of these acquired images. The system is particularly useful in inspection of beverage container (22) and their associated labelling.
Description
WO 96/41299 PCT/U'~ 7610 ~'-~lON ~ FOR E ~ ~ IOR 1iRTICLF SlnUFACF~
Bao~4~ of the Invention This application pertains to the art of video inspection and more particularly to automated high speed inspection of a stream of similar articles.
The invention is particularly applicable to automated, real-time inspection of beverage containers and will be described with particular reference thereto.
Hcw~, it will also be appreciated that the invention has broader application, such as in the inspection of any article wherein both exterior layout and coloration are definable within set ranges or st~ ~ds.
Automated, real-time inspection is evolving to be an essential element of mass-manufactured goods. Such inspection is particularly essential in the food packaging industry. Flaws in or on containers can result in loss of product, poor consumer impression, as well as possible cont~ ;n~tion or spoilage.
A first application of automated video inspection to the container industry was for analysis of cont~ r subassemblies. For example, can ends for beverage cont~; n~s could be inspected for imperfections in the material or formation. Another generation of inspection devices functioned to analyze interiors of these cont~;n~s.
While current systems perform quite well for analyzing sub-assemblies, stock and interiors, no system adequately addresses the particular detailed inspection requirements for con~;n~r exteriors. Of particular importance is the integrity of the exterior indicia, such as labeling, on a conventional beverage can. Current systems are inadequate for the detailed inspection of both integrity of a container exterior, as well as the coloration thereof.
The present invention contemplates a new and improved exterior inspection system which ove~co -~ the above-referred problems, and others, and provides an exterior video inspection system which allows for detailed real-time analysis of article exteriors, inclusive of label integrity and coloration.
~ y of the Invention An inspection system for article exteriors includes a plurality of cameras. At least one of the cameras is sensitive to colors. The r~in;ng camera or cameras are suitably black and white. A series of specimens is communicated to an inspection area to which lenses of all of the cameras are focused. Once a specimen is disposed in the specimen area, a strobe light is pulsed to illuminate it. From this illumination, each camera captures a still image of a portion of the specimen. An W O 96/41299 PCT~US96/07610 analysis is completed against the black and white image or images to determine integrity of the exterior surface, such as structural and label integrity. An analysis of a color image is completed to determine whether the resultant colors are acceptable to preselected characteristics. The results of this analysis allows for generating a signal representative of acceptability of the specimen. Specimens that are deemed unacceptable are removed from the stream of acceptable specimens.
In accordance with a more limited aspect of the subject invention, a system is provided for acquiring a training set representative of the characteristics or range of characteristics for specimens deemed acceptable. This tr~i n i~g set is, in turn, used to determine the acceptability of fuL~e, inspected specimens.
In accordance with yet a further aspect of the present invention, the images acquired from a plurality of black and white cameras are conjoined prior to analysis of the data disposed therein.
An advantage of the present invention is the provision of a real-time inspection system which allows for inspection of both an exterior surface, surface labeling, and surface coloration of a stream of similar articles.
Yet another advantage of the present invention is the provision of an inspection system which may be readily adapted to various or varying specimens.
Yet another advantage of the present invention is the provision of an inspection system which allows for archiving of data on unacceptable specimens to allow for correction in the manufacturing process to address the concern.
Yet a further advantage of the present invention is the provision of a real-time cont~;n~ exterior inspection system which may be used in a closed-system feedback matter so as to allow for continuous updating and ref;n~ -nt of data representing an acceptable specimen.
Further advantages will h~ ? apparent to one of ordinary skill in the art upon a re~;ng and underst~n~;~q of the subject specification.
Brief De~cription of the Drawin~s 15The invention may take physical form in certain parts, and arrangements of parts, a preferred embodiment of which will be described in detail in this specification and illustrated in the accompanying drawings which form a part hereof and wherein:
20FIGURE 1 illustrates an overall setup of the inspection system of the present invention;
FIGURE 2 provides a block diagram of the subject inspection system;
W O 96/41299 PCT/U',-/~7610 FIGURE 3 illustrates suitable placement for multiple cameras around a specimen disposed in an inspection area;
6 FIGURE 4 illustrates a suitable field of view accomplished via a single camera on a specimen;
FIGURE 5 illustrates a transition from an RGB
signal acquired from a color camera in the subject invention into an HSI model to facilitate detailed analysis of the resultant image data;
10FIGURE 6 illustrates a suitable histogram output for an analysis of color data acquired from a color camera;
FIGURE 7 is a flow chart of an image combining and analysis undertaken in connection with the subject inspection system;
15FIGURE 8 provides a flow chart of overall system timing for real-time analysis and specimen rejection in a series of specimens;
FIGURE 9 is a flow chart for a training sequence for creating template data representative of acceptable specimens;
FIGURE 10 provides a flow chart for automated video camera gain control settings for use in the subject system; and FIGURE 11 is a flow chart for a suitable automated light calibration routine for use in connection with the subject invention.
W O 96141299 PC~rrUS96/07610 Detailed Description of the Preferred Embodiment Turning now to the drawings wherein the showings are for the purpose of illustrating the preferred emho~;ment in the invention only, and not for the ~u~ose of limiting the same, FIGURE 1 shows a diagram of the inspection system A working on a series or stream of articles or specimens B. The inspection system A will be detailed in particular below. As illustrated, the system completes an inspection of the specimen stream B.
The inspection system A includes a main processor section 10 works in con~t with a storage medium 12, suitably comprised of a hard disk, tape unit, floppy disk, magneto optical disk, or the like. A suitable CPU is a SPARC 3PU-3CC. O~L~u~s of the main processor section 10 are also communicated to a monitor unit 14. The actual inspection is accomplished in an inspection area disposed within an inspection unit or tunnel 16. The tunnel 16 functions to isolate specimens from ambient light during illumination and imaging thereof in a manner detailed below.
Turning now to FIGURE 2, illustrated is a block diagram of the overall inspection system of the subject invention. A conveyor 20 communicates a series of similar specimens such as can 22 as illustrated. A specimen arriving at inspection area 24 is detected by a first part detector suitably comprised of photosensor 26. At this CA 02226473 l998-0l-07 W O 96/41299 PCT/U~ 7610 point a strobe light (not shown) is initialized. During strobe illumination of the specimen 22 disposed in the - inspection area 24, each of a series of radially disposed cameras acquires a still image of a unique image thereof.
In the embodiment of FIGURE 2, a lens of color camera 30 is focused on the specimen 22 in the inspection area 24. Six monochrome or black and white cameras 32~
32lf) are also similarly trained on each specimen disposed in the inspection area 24. The cameras 32 are underplaced to be sensitive to gray levels of the images captured thereby. Thus, when the specimen is illuminated by operation of the strobe, still images are acquired by six black and white cameras and a single color camera in the disclosed embodiment. In this embo~; -nt, the monochrome or black and white image capture is accomplished using the six cameras 32 spaced evenly at 60~ intervals around the specimen, such as can 22. In order to minimize distortion, each can is advantageously placed approximately centrally in the inspection area 24 at about a focal distance of 18 inches away from the can.
The cameras 32 used in the preferred embodiment implement a single frame ouL~uL of 640 horizontal pixels per line and 480 vertical pixels per line. To best utilize resolution of the cameras, they are oriented such that the 640 horizontal pixels are aligned with a top-to-bottom axis (also referred to as a vertical wall) of a specimen. To W O 96/41299 PC~r~US96/07610 reconstruct a can's image, a useful area from each camera is advantageously selected as 64 0 horizontal pixels by 144 vertical pixels. This will allow for reassembly of the images to form an effective image at 8 64 pixels by 640 pixels. By way of example, this results of an image resolution of approximately 9.5 to 9. 8 mils per pixel for a typical beverage cont~ r, A color camera 30 is used to induct a color image. Camera-to-can orientation is chosen advantageously as the same as that for the black and white cameras 32.
Thus, resulting resolution of the color camera is 640 horizontal pixels for a top-to-bottom (height) of a can and 24 0 pixels for a section of a circumference of a can. As will be detailed below, the primary color RGB (red, green, blue) GuL~u~s of the color image are digitized and converted to HSI (hue, saturation, intensity) while an image is being inducted.
It will be appreciated that actual pixel-to-size resolution of cans varies in accordance with physical 2 0 dimensions of a can or other specimen to be analyzed.
Actual images acquired from the cameras are co u~licated to a series of image processor modules 40(a)-40ld). These modules, in turn, include a digital acquisition subassembly, an analog scanner, an analog sc~nner acquisition module, an analog generator display module, an arithmetic unit and advanced processor module for CA 02226473 l998-0l-07 W O 96/41299 PCT~US96/07610 convolution, statistical analysis, look-up-table ("LUT") processing, and morphology.
~ The color camera 30 ouL~Ls its digitized image first to a color module 42 before communicating it to its own image processor module ~O(a). Data from each of the image proceC-cor modules 40 is communicated to a real-time host disposed in the main prorDcco~ section 10. In the preferred embsA; -nt, the pro~-~ccor module 10 includes a RISC based processor, such as a host 50 computer comprised of the SPARC workstation noted above. It includes as well a real-time controller 52 in data communication therewith.
The proceCcor module 10 allows for comparison of retrieved video image with data representative of acceptable specimens. Details of this will be provided further below.
The processor module 10 thus monitors data that operates in connertion with a second photosensitive part detector 54 and a blow-off ?chAn;~ 56. The real-time host ~6 tracks progress of specimens along the conveyor 20. Those specimens which are detel ;ne~ to be unacceptable to preselected st~n~ds are therefore removed from the conveyor when the part detector 54 senses the presences of the specimen by operation of the blow-off merh~n;-cm 56.
Also disclosed in FIGURE 2 is a provision for an acceptable power supply 60, the particulars of which will be appreciated by one of ordinary skill in the art. The system also advantageously includes a host 64 which is W O 96/41299 PCT~US96/07610 placed in data r -;cation with the real-time host ~6.
The host 64 is advantageously provided with a graphical user interface ("GUI") as illustrated at 68.
Turning now to FIGURE 3, a diagram evidencing the stream of specimens B, inspection area 24, as well as the cameras 32~a)-32(f) is illustrated. It will be seen that, in the preferred embodiment, all of the black and white cameras are spaced equidistantly around a perimeter of the inspection area 24. The subject system anticipates a minimum inter-specimen spacing a. This distance is highly application specific and will be appreciated to be a function of the image complexity and -~ L of available . Ling power provided by the processor module 10 and its ~csociated, support hardware. For example, a typical beverage cont~;ne~ might require a spacing of 4.7 ;nçhec to 5.6 inches with the disclosed hardware platform.
Turning to FIGURE 4, illustrated in detail is a particular image ce5 -nt ca~L~,ed by a single camera. It will be appreciated that each camera 32 will acquire a si ;1~ image from a different portion of the specimen.
Detailed video inspection of specimen exteriors requires an ability to detect defect categories such as spots, smears/smudges, off-registration, and color defects.
A spot is suitably defined as a smaller, singular defect with some measurable area. A spot might be caused by any problem which results in a different pattern W O 96/41299 PCT/U',~'07610 appearing in a different area. For example, spots can be caused by defects such as scratches, extra or missing ink, - certain dents or any type of dirt.
Smears or smudges typically do not have a S contrast such as that which would be associated with spots.
Accordingly, detecting such defects requires a larger surface area.
Off-registration occurs when two or more colors are not aligned correctly. For example, where ever a color occurs, a discrepancy similar to a spot or smear may result.
Color defects are those which are related to fade or darkening. Color defects include hue-related defects.
The subject system accomplishes both monochrome inspection, as well as color inspection. The monochrome inspection consists of a line-by-line, pixel-by-pixel c _-~ison between a known image, referred to as a template, and a final conjoined or warped image contained from the plurality of black and white cameras. The actual analysis of the color aspects of the present invention will be detailed next.
Turning to FIGURE 5, an RGB color 90 cube evidences color perception as provided by human cognizance.
While such primary color combinations are acceptable for humans, it does not adapt well to machine analysis.
Accurate technical measuL~- ~nt is provided with analysis of HSI (hue, saturation, intensity) information. Thus, the subject system accomplishes a conversion from an RGB (red, green, and blue primaries) format, such as is ouL~uL from a typical color camera, to an HSI format. The system accomplishes this translation via the disclosed hardware.
In the illustration of FIGURE 5, the RGB output of the color camera or cameras is illustrated at 9~. The actual hardware translation is provided by inputting the RGB signals to a translator 92 which works in concert with a first look-up table ("LUT") 96 and a second LUT 98. The details of the translation hardware are well within the underst~n~;ng of one of ordinary skill in the art and will not be repeated herein. Once translated, the data from the acquired, color image is provided in an HSI model illustrated generally at 100. In the HSI model, hue is represented circumferentially, saturation is represented radially, and intensity is represented along an x axis (top-to-bottom).
Hue is described as a gradation in color or color shifts. Saturation is defined as an amount of color present. Intensity describes a level or amount of color.
In the subject system, a series of acceptable specimens are provided to the system and resultant color data is obtained. This data forms a histogram which sets forth a range of acceptable color parameters. Such a histogram suitable for analysis is illustrated in FIGURE 6.
W O 96/41299 PCT/U','1~7610 Turning to FIGURE 7, a flow chart showing the actual inspection or operation "run mode" of the subject inspection system is described. At block 104, digitized image data from each of the seven cameras of the preferred embodiment is acquired. The system directs image acquisition from the image processor modules 40 tFIGURE 2).
Each such acquisition unit interfaces between two black and white cameras 32 and analog-to-digital image processor modules. Three such image proc~ccors are used for acquiring images in the preferred embodiment. Three more image processors are suitably used to hold three memory stores in a gain/offset correction portion from which color analysis is performed. An acquisition pipe is used to acquire data from the digitizer. From an A/D module, data is piped into two pairs of memory stores.
Next, at block 106, an actual edge detection is accomplished. This is done by selectively passing codes through a look-up table to acquire a binary representation;
(2) selectively writing codes to columns within a can image; writing code for a host to find edges, top, middle, bottom, and center lines using acquired information IP; and writing code for a host to generate coefficients for unwarping.
In step 108, the system accomplishes an unwarping of the images. A warping pipe uses processing rectangles selected on a second pair of stores. These memories are CA 02226473 l998-0l-07 used to unwarp the image. Coefficients for the warp generation are provided by the host c- _~Ler 10 (FIGURE 1).
In block 110, an auto filter is provided to adjust acquired images for gain and offset correction. An unwarped image advantageously has high and low light intensity spots corrected on its image. Such intensity spots may be due to such things as a filament from a light source. Such light correction information is obt~;n~ from a template constructed while the system is provided in its learn mode. A correction type is created and an image is sent through an arithmetic unit module of the proc~scor wherein correction are made.
Next, at block 112, the system finds a fiducial portion of images. A fiducial is some repeatable pattern or characteristic in an acquired image which, when located is used to define a single, unique location on the specimen's exterior or decoration.
Once an image has completed an unwarping at block 108, a fiducial or reference point on a can is located.
Once fiducials have been found or isolated in block 112, an actual analysis of the image is completed.
The image analysis includes pattern matching and tolerance template checking at block 114 and color analysis at block 116. A summation of inputs is accomplished at block 116.
A summation of inputs is accomplished at block 118. It W O 96/41299 PCTrUS96/07610 will be appreciated that inter-processor communications are also utilized. This is provided for at block 120.
Turning next to FIGURE 8, the actual tracking of specimens along the conveyor 20 is detailed in flow chart form. A tracking operation is c~ c~ at block 140.
From this point, actual progress of the conveyor 20 is monitored from an associated gear clock at block 1~2. ~he illumination of the specimen disposed in the inspection area 24 is accomplished via the snap control 1~ which is synchronized to the conveyor and the particular specimen.
It will be appreciated that actual acquisition of the image and analysis thereof is completed between snap control block 144 and the second part detector 54 (FIGURE
2) as indicated at block 146. Parts that have been so determined defective to preselected st~ rds are eliminated or removed from the stream by blow-off -ch~n;!
56 (FIGURE 2) as evidenced by block 1~8. At block 150, an actual graphical user interface image is provided to the user.
Turning now to FIGURE 9, a learn mode for acquiring the template or test data from which a determination as specimen acceptability is made is described. At block 200, the systems snaps seven pictures, six monochrome or black and white pictures, six monochrome or black and white pictures and one color image in the preferred --ho~;ment. From the resultant images, an W O 96/41299 PCT~US96/07610 analysis is completed by edge detection at block 202, unwarping at block 204, filtering at block 206, fiducial analysis at block 208, and an image conjoining or "stitching" at block 210. It will be appreciated that the data analysis and acquisition is similar to that provided in the actual run mode. The difference with the learn mode from the run mode being that results from several test iterations (100 in the disclosed embodiment) are averaged at subsequent block 212. This averaged information provides the template data which will be used to actually determine specimen acceptability during run mode.
In the preferred - ho-l; ment, another template is provided for light h~ ncing. It will be appreciated that light intensity may vary in certain areas of an image due to such things as light filaments or reflections. Such a template is advantageously created by using a solid white specimen. Such a specimen is chosen to be the uniformly color on the surface thereof. A picture taken of this specimen, in an ideal instance, would have the same gray level for every pixel. Any variation from a chosen reference point is seized upon and provided into an intensity template as a set off from the ideal.
Turning now to FIGURE 10, a flow chart detailing the camera gain routine which functions to properly set up a gain and offset of each camera analog-to-digital ("A/D") converter is described. Video gain is related directly to WO 96/41299 PCT~US96/07610 a lens aperture setting, camera gain, and A/D circuit gain.
Since a light source directly effects apparent video gain, the subject system provides for isolation of a light source from a camera's related gain components. This is accomplished by calibration. A suitable source for calibration is a fixture approximately the size of a specimen with one or more horizontal light bars, each consisting of an evenly diffused light source.
In FIGURE 10, the camera gain routine is initialized at block 300. At this point, a calibration fixture is positioned in the inspection area on the conveyor. once a routine is entered from block 300, it is "free running." From block 300, progress is made to a time delay, suitably one second, at block 302. A first of series of images, seven in an embodiment employing seven cameras, is then procured at block 30~. A loop is next undertaken for each of the seven cameras at block 306. In the preferred embodiment, starting at line 240, a measurement of a delta between every eighth pixel is then accomplished at block 308. The largest value of a delta achieved in block 308 is calculated at block 310. Next, at block 312, pixels are highlighted which have been measured on a selected image. A location of the largest delta found is noted.
The system then progresses to block 314. At this point, a display of the delta is found. A darkes~ and W O 96/41299 PCTrUS96/07610 brightest picture is also measured. Next, at block 316, a determination is made as to whether all seven cameras have been measured. A "no" detel ;n~tion causes ~O~L ess to block 318. At this point, the camera number is in~L, ~nted and yloyLess is returned to block 308. A "ye~"
determination at block 316 causes ~LG~Less to block 320.
At block 320, a determination is made as to whether new gain and offset parameters had been entered from a user at the graphical user interface. A "yes" determination allows an operator to save the parameters selectively at block 322. Such a save causes progress to block 324, at which point an updating of new gain and offset parameters is made to the image processor modules. Progress is then returned to block 302.
A negative determination made at block 322 causes either an exit of the ~I GYL am or return to block 304, depending on an operator selection.
Turning next to FIGURE 11, a light calibration routine advantageously employed in the above-described system setup is described. The light calibration routine serves to provide maintenance personnel of the system with a method to quickly and accurately adjust a light assembly for most even top-to-bottom lighting of specimens. The operator is also provided with an ability to set the D/A
converter values associated with each strobe supply. In the preferred embodiment, the light ~l;h~ate routine of W O 96/41299 PCT/U~r-'~7610 FIGURE 11 uses a specimen which is evenly colored as possible, as noted above. The routine is commenced at - block 400. Thereafter, ~OYLeSS is made to block 204, at which point an A/D circuit values are updated. A one second delay is then initialed at block ~0~.
Next, a snap induction of images is undertaken at block 406, one image at a time. One camera image is selected to be first. Thereafter, a measurement loop is entered at block 408. Again, in the preferred embodiment, starting at line 240, pixel locations 20-24 are isolated at block 410. At block 412, measurement of four pixels of each image is undertaken. An averaging of these pixels is completed at block 414. These values are then stored in a buffer at block 416.
Next, at block 418, a determination is made as to whether eight meaxul~ -nts have been taken. If the answer is no, ~Gyless is made to block 420. At this point, the horizontal line counter is incremented by 75 and the system is returned to block 412. A positive indication from block 418 causes ~oy~ess to block 422. Here, an ouL~uL of a gray level meaX~ -nt is made to a graphical user interface screen. Next, a determination at block 424 is made as to whether all cameras have been a~ ted. If the answer is no, progress is returned to block 412. If the answer is yes, progress is made to block 426.
CA 02226473 l998-0l-07 WO 96/41299 PCTrUS96/07610 At block 426, a determination is made as to whether an operator had asked for an update of the earlier values to be made. If the answer is yes, these values are written into the A/D circuits by progressing to block ~02.
If the answer is no, a one second delay is then reinitiated as ~oyLess is p~s~ again to block ~0~.
With this structure, both a real-world calibration of inspection system's characteristics is facilitated, as well as acquisition of empirical data representative of acceptable specimens. This allows for accurate inspections to be completed at a rapid rate. It also allows for easy modifications to acc~ odate various specimens and specimen characteristics.
This invention has been described with reference to the preferred embodiment. Obviously, modifications and alterations will occur to others upon the reading and underst~n~ing of the specification. It is inte~e~ that all such modifications and alterations be included insofar as they come within the scope of the appended claims or the equivalents thereof.
Bao~4~ of the Invention This application pertains to the art of video inspection and more particularly to automated high speed inspection of a stream of similar articles.
The invention is particularly applicable to automated, real-time inspection of beverage containers and will be described with particular reference thereto.
Hcw~, it will also be appreciated that the invention has broader application, such as in the inspection of any article wherein both exterior layout and coloration are definable within set ranges or st~ ~ds.
Automated, real-time inspection is evolving to be an essential element of mass-manufactured goods. Such inspection is particularly essential in the food packaging industry. Flaws in or on containers can result in loss of product, poor consumer impression, as well as possible cont~ ;n~tion or spoilage.
A first application of automated video inspection to the container industry was for analysis of cont~ r subassemblies. For example, can ends for beverage cont~; n~s could be inspected for imperfections in the material or formation. Another generation of inspection devices functioned to analyze interiors of these cont~;n~s.
While current systems perform quite well for analyzing sub-assemblies, stock and interiors, no system adequately addresses the particular detailed inspection requirements for con~;n~r exteriors. Of particular importance is the integrity of the exterior indicia, such as labeling, on a conventional beverage can. Current systems are inadequate for the detailed inspection of both integrity of a container exterior, as well as the coloration thereof.
The present invention contemplates a new and improved exterior inspection system which ove~co -~ the above-referred problems, and others, and provides an exterior video inspection system which allows for detailed real-time analysis of article exteriors, inclusive of label integrity and coloration.
~ y of the Invention An inspection system for article exteriors includes a plurality of cameras. At least one of the cameras is sensitive to colors. The r~in;ng camera or cameras are suitably black and white. A series of specimens is communicated to an inspection area to which lenses of all of the cameras are focused. Once a specimen is disposed in the specimen area, a strobe light is pulsed to illuminate it. From this illumination, each camera captures a still image of a portion of the specimen. An W O 96/41299 PCT~US96/07610 analysis is completed against the black and white image or images to determine integrity of the exterior surface, such as structural and label integrity. An analysis of a color image is completed to determine whether the resultant colors are acceptable to preselected characteristics. The results of this analysis allows for generating a signal representative of acceptability of the specimen. Specimens that are deemed unacceptable are removed from the stream of acceptable specimens.
In accordance with a more limited aspect of the subject invention, a system is provided for acquiring a training set representative of the characteristics or range of characteristics for specimens deemed acceptable. This tr~i n i~g set is, in turn, used to determine the acceptability of fuL~e, inspected specimens.
In accordance with yet a further aspect of the present invention, the images acquired from a plurality of black and white cameras are conjoined prior to analysis of the data disposed therein.
An advantage of the present invention is the provision of a real-time inspection system which allows for inspection of both an exterior surface, surface labeling, and surface coloration of a stream of similar articles.
Yet another advantage of the present invention is the provision of an inspection system which may be readily adapted to various or varying specimens.
Yet another advantage of the present invention is the provision of an inspection system which allows for archiving of data on unacceptable specimens to allow for correction in the manufacturing process to address the concern.
Yet a further advantage of the present invention is the provision of a real-time cont~;n~ exterior inspection system which may be used in a closed-system feedback matter so as to allow for continuous updating and ref;n~ -nt of data representing an acceptable specimen.
Further advantages will h~ ? apparent to one of ordinary skill in the art upon a re~;ng and underst~n~;~q of the subject specification.
Brief De~cription of the Drawin~s 15The invention may take physical form in certain parts, and arrangements of parts, a preferred embodiment of which will be described in detail in this specification and illustrated in the accompanying drawings which form a part hereof and wherein:
20FIGURE 1 illustrates an overall setup of the inspection system of the present invention;
FIGURE 2 provides a block diagram of the subject inspection system;
W O 96/41299 PCT/U',-/~7610 FIGURE 3 illustrates suitable placement for multiple cameras around a specimen disposed in an inspection area;
6 FIGURE 4 illustrates a suitable field of view accomplished via a single camera on a specimen;
FIGURE 5 illustrates a transition from an RGB
signal acquired from a color camera in the subject invention into an HSI model to facilitate detailed analysis of the resultant image data;
10FIGURE 6 illustrates a suitable histogram output for an analysis of color data acquired from a color camera;
FIGURE 7 is a flow chart of an image combining and analysis undertaken in connection with the subject inspection system;
15FIGURE 8 provides a flow chart of overall system timing for real-time analysis and specimen rejection in a series of specimens;
FIGURE 9 is a flow chart for a training sequence for creating template data representative of acceptable specimens;
FIGURE 10 provides a flow chart for automated video camera gain control settings for use in the subject system; and FIGURE 11 is a flow chart for a suitable automated light calibration routine for use in connection with the subject invention.
W O 96141299 PC~rrUS96/07610 Detailed Description of the Preferred Embodiment Turning now to the drawings wherein the showings are for the purpose of illustrating the preferred emho~;ment in the invention only, and not for the ~u~ose of limiting the same, FIGURE 1 shows a diagram of the inspection system A working on a series or stream of articles or specimens B. The inspection system A will be detailed in particular below. As illustrated, the system completes an inspection of the specimen stream B.
The inspection system A includes a main processor section 10 works in con~t with a storage medium 12, suitably comprised of a hard disk, tape unit, floppy disk, magneto optical disk, or the like. A suitable CPU is a SPARC 3PU-3CC. O~L~u~s of the main processor section 10 are also communicated to a monitor unit 14. The actual inspection is accomplished in an inspection area disposed within an inspection unit or tunnel 16. The tunnel 16 functions to isolate specimens from ambient light during illumination and imaging thereof in a manner detailed below.
Turning now to FIGURE 2, illustrated is a block diagram of the overall inspection system of the subject invention. A conveyor 20 communicates a series of similar specimens such as can 22 as illustrated. A specimen arriving at inspection area 24 is detected by a first part detector suitably comprised of photosensor 26. At this CA 02226473 l998-0l-07 W O 96/41299 PCT/U~ 7610 point a strobe light (not shown) is initialized. During strobe illumination of the specimen 22 disposed in the - inspection area 24, each of a series of radially disposed cameras acquires a still image of a unique image thereof.
In the embodiment of FIGURE 2, a lens of color camera 30 is focused on the specimen 22 in the inspection area 24. Six monochrome or black and white cameras 32~
32lf) are also similarly trained on each specimen disposed in the inspection area 24. The cameras 32 are underplaced to be sensitive to gray levels of the images captured thereby. Thus, when the specimen is illuminated by operation of the strobe, still images are acquired by six black and white cameras and a single color camera in the disclosed embodiment. In this embo~; -nt, the monochrome or black and white image capture is accomplished using the six cameras 32 spaced evenly at 60~ intervals around the specimen, such as can 22. In order to minimize distortion, each can is advantageously placed approximately centrally in the inspection area 24 at about a focal distance of 18 inches away from the can.
The cameras 32 used in the preferred embodiment implement a single frame ouL~uL of 640 horizontal pixels per line and 480 vertical pixels per line. To best utilize resolution of the cameras, they are oriented such that the 640 horizontal pixels are aligned with a top-to-bottom axis (also referred to as a vertical wall) of a specimen. To W O 96/41299 PC~r~US96/07610 reconstruct a can's image, a useful area from each camera is advantageously selected as 64 0 horizontal pixels by 144 vertical pixels. This will allow for reassembly of the images to form an effective image at 8 64 pixels by 640 pixels. By way of example, this results of an image resolution of approximately 9.5 to 9. 8 mils per pixel for a typical beverage cont~ r, A color camera 30 is used to induct a color image. Camera-to-can orientation is chosen advantageously as the same as that for the black and white cameras 32.
Thus, resulting resolution of the color camera is 640 horizontal pixels for a top-to-bottom (height) of a can and 24 0 pixels for a section of a circumference of a can. As will be detailed below, the primary color RGB (red, green, blue) GuL~u~s of the color image are digitized and converted to HSI (hue, saturation, intensity) while an image is being inducted.
It will be appreciated that actual pixel-to-size resolution of cans varies in accordance with physical 2 0 dimensions of a can or other specimen to be analyzed.
Actual images acquired from the cameras are co u~licated to a series of image processor modules 40(a)-40ld). These modules, in turn, include a digital acquisition subassembly, an analog scanner, an analog sc~nner acquisition module, an analog generator display module, an arithmetic unit and advanced processor module for CA 02226473 l998-0l-07 W O 96/41299 PCT~US96/07610 convolution, statistical analysis, look-up-table ("LUT") processing, and morphology.
~ The color camera 30 ouL~Ls its digitized image first to a color module 42 before communicating it to its own image processor module ~O(a). Data from each of the image proceC-cor modules 40 is communicated to a real-time host disposed in the main prorDcco~ section 10. In the preferred embsA; -nt, the pro~-~ccor module 10 includes a RISC based processor, such as a host 50 computer comprised of the SPARC workstation noted above. It includes as well a real-time controller 52 in data communication therewith.
The proceCcor module 10 allows for comparison of retrieved video image with data representative of acceptable specimens. Details of this will be provided further below.
The processor module 10 thus monitors data that operates in connertion with a second photosensitive part detector 54 and a blow-off ?chAn;~ 56. The real-time host ~6 tracks progress of specimens along the conveyor 20. Those specimens which are detel ;ne~ to be unacceptable to preselected st~n~ds are therefore removed from the conveyor when the part detector 54 senses the presences of the specimen by operation of the blow-off merh~n;-cm 56.
Also disclosed in FIGURE 2 is a provision for an acceptable power supply 60, the particulars of which will be appreciated by one of ordinary skill in the art. The system also advantageously includes a host 64 which is W O 96/41299 PCT~US96/07610 placed in data r -;cation with the real-time host ~6.
The host 64 is advantageously provided with a graphical user interface ("GUI") as illustrated at 68.
Turning now to FIGURE 3, a diagram evidencing the stream of specimens B, inspection area 24, as well as the cameras 32~a)-32(f) is illustrated. It will be seen that, in the preferred embodiment, all of the black and white cameras are spaced equidistantly around a perimeter of the inspection area 24. The subject system anticipates a minimum inter-specimen spacing a. This distance is highly application specific and will be appreciated to be a function of the image complexity and -~ L of available . Ling power provided by the processor module 10 and its ~csociated, support hardware. For example, a typical beverage cont~;ne~ might require a spacing of 4.7 ;nçhec to 5.6 inches with the disclosed hardware platform.
Turning to FIGURE 4, illustrated in detail is a particular image ce5 -nt ca~L~,ed by a single camera. It will be appreciated that each camera 32 will acquire a si ;1~ image from a different portion of the specimen.
Detailed video inspection of specimen exteriors requires an ability to detect defect categories such as spots, smears/smudges, off-registration, and color defects.
A spot is suitably defined as a smaller, singular defect with some measurable area. A spot might be caused by any problem which results in a different pattern W O 96/41299 PCT/U',~'07610 appearing in a different area. For example, spots can be caused by defects such as scratches, extra or missing ink, - certain dents or any type of dirt.
Smears or smudges typically do not have a S contrast such as that which would be associated with spots.
Accordingly, detecting such defects requires a larger surface area.
Off-registration occurs when two or more colors are not aligned correctly. For example, where ever a color occurs, a discrepancy similar to a spot or smear may result.
Color defects are those which are related to fade or darkening. Color defects include hue-related defects.
The subject system accomplishes both monochrome inspection, as well as color inspection. The monochrome inspection consists of a line-by-line, pixel-by-pixel c _-~ison between a known image, referred to as a template, and a final conjoined or warped image contained from the plurality of black and white cameras. The actual analysis of the color aspects of the present invention will be detailed next.
Turning to FIGURE 5, an RGB color 90 cube evidences color perception as provided by human cognizance.
While such primary color combinations are acceptable for humans, it does not adapt well to machine analysis.
Accurate technical measuL~- ~nt is provided with analysis of HSI (hue, saturation, intensity) information. Thus, the subject system accomplishes a conversion from an RGB (red, green, and blue primaries) format, such as is ouL~uL from a typical color camera, to an HSI format. The system accomplishes this translation via the disclosed hardware.
In the illustration of FIGURE 5, the RGB output of the color camera or cameras is illustrated at 9~. The actual hardware translation is provided by inputting the RGB signals to a translator 92 which works in concert with a first look-up table ("LUT") 96 and a second LUT 98. The details of the translation hardware are well within the underst~n~;ng of one of ordinary skill in the art and will not be repeated herein. Once translated, the data from the acquired, color image is provided in an HSI model illustrated generally at 100. In the HSI model, hue is represented circumferentially, saturation is represented radially, and intensity is represented along an x axis (top-to-bottom).
Hue is described as a gradation in color or color shifts. Saturation is defined as an amount of color present. Intensity describes a level or amount of color.
In the subject system, a series of acceptable specimens are provided to the system and resultant color data is obtained. This data forms a histogram which sets forth a range of acceptable color parameters. Such a histogram suitable for analysis is illustrated in FIGURE 6.
W O 96/41299 PCT/U','1~7610 Turning to FIGURE 7, a flow chart showing the actual inspection or operation "run mode" of the subject inspection system is described. At block 104, digitized image data from each of the seven cameras of the preferred embodiment is acquired. The system directs image acquisition from the image processor modules 40 tFIGURE 2).
Each such acquisition unit interfaces between two black and white cameras 32 and analog-to-digital image processor modules. Three such image proc~ccors are used for acquiring images in the preferred embodiment. Three more image processors are suitably used to hold three memory stores in a gain/offset correction portion from which color analysis is performed. An acquisition pipe is used to acquire data from the digitizer. From an A/D module, data is piped into two pairs of memory stores.
Next, at block 106, an actual edge detection is accomplished. This is done by selectively passing codes through a look-up table to acquire a binary representation;
(2) selectively writing codes to columns within a can image; writing code for a host to find edges, top, middle, bottom, and center lines using acquired information IP; and writing code for a host to generate coefficients for unwarping.
In step 108, the system accomplishes an unwarping of the images. A warping pipe uses processing rectangles selected on a second pair of stores. These memories are CA 02226473 l998-0l-07 used to unwarp the image. Coefficients for the warp generation are provided by the host c- _~Ler 10 (FIGURE 1).
In block 110, an auto filter is provided to adjust acquired images for gain and offset correction. An unwarped image advantageously has high and low light intensity spots corrected on its image. Such intensity spots may be due to such things as a filament from a light source. Such light correction information is obt~;n~ from a template constructed while the system is provided in its learn mode. A correction type is created and an image is sent through an arithmetic unit module of the proc~scor wherein correction are made.
Next, at block 112, the system finds a fiducial portion of images. A fiducial is some repeatable pattern or characteristic in an acquired image which, when located is used to define a single, unique location on the specimen's exterior or decoration.
Once an image has completed an unwarping at block 108, a fiducial or reference point on a can is located.
Once fiducials have been found or isolated in block 112, an actual analysis of the image is completed.
The image analysis includes pattern matching and tolerance template checking at block 114 and color analysis at block 116. A summation of inputs is accomplished at block 116.
A summation of inputs is accomplished at block 118. It W O 96/41299 PCTrUS96/07610 will be appreciated that inter-processor communications are also utilized. This is provided for at block 120.
Turning next to FIGURE 8, the actual tracking of specimens along the conveyor 20 is detailed in flow chart form. A tracking operation is c~ c~ at block 140.
From this point, actual progress of the conveyor 20 is monitored from an associated gear clock at block 1~2. ~he illumination of the specimen disposed in the inspection area 24 is accomplished via the snap control 1~ which is synchronized to the conveyor and the particular specimen.
It will be appreciated that actual acquisition of the image and analysis thereof is completed between snap control block 144 and the second part detector 54 (FIGURE
2) as indicated at block 146. Parts that have been so determined defective to preselected st~ rds are eliminated or removed from the stream by blow-off -ch~n;!
56 (FIGURE 2) as evidenced by block 1~8. At block 150, an actual graphical user interface image is provided to the user.
Turning now to FIGURE 9, a learn mode for acquiring the template or test data from which a determination as specimen acceptability is made is described. At block 200, the systems snaps seven pictures, six monochrome or black and white pictures, six monochrome or black and white pictures and one color image in the preferred --ho~;ment. From the resultant images, an W O 96/41299 PCT~US96/07610 analysis is completed by edge detection at block 202, unwarping at block 204, filtering at block 206, fiducial analysis at block 208, and an image conjoining or "stitching" at block 210. It will be appreciated that the data analysis and acquisition is similar to that provided in the actual run mode. The difference with the learn mode from the run mode being that results from several test iterations (100 in the disclosed embodiment) are averaged at subsequent block 212. This averaged information provides the template data which will be used to actually determine specimen acceptability during run mode.
In the preferred - ho-l; ment, another template is provided for light h~ ncing. It will be appreciated that light intensity may vary in certain areas of an image due to such things as light filaments or reflections. Such a template is advantageously created by using a solid white specimen. Such a specimen is chosen to be the uniformly color on the surface thereof. A picture taken of this specimen, in an ideal instance, would have the same gray level for every pixel. Any variation from a chosen reference point is seized upon and provided into an intensity template as a set off from the ideal.
Turning now to FIGURE 10, a flow chart detailing the camera gain routine which functions to properly set up a gain and offset of each camera analog-to-digital ("A/D") converter is described. Video gain is related directly to WO 96/41299 PCT~US96/07610 a lens aperture setting, camera gain, and A/D circuit gain.
Since a light source directly effects apparent video gain, the subject system provides for isolation of a light source from a camera's related gain components. This is accomplished by calibration. A suitable source for calibration is a fixture approximately the size of a specimen with one or more horizontal light bars, each consisting of an evenly diffused light source.
In FIGURE 10, the camera gain routine is initialized at block 300. At this point, a calibration fixture is positioned in the inspection area on the conveyor. once a routine is entered from block 300, it is "free running." From block 300, progress is made to a time delay, suitably one second, at block 302. A first of series of images, seven in an embodiment employing seven cameras, is then procured at block 30~. A loop is next undertaken for each of the seven cameras at block 306. In the preferred embodiment, starting at line 240, a measurement of a delta between every eighth pixel is then accomplished at block 308. The largest value of a delta achieved in block 308 is calculated at block 310. Next, at block 312, pixels are highlighted which have been measured on a selected image. A location of the largest delta found is noted.
The system then progresses to block 314. At this point, a display of the delta is found. A darkes~ and W O 96/41299 PCTrUS96/07610 brightest picture is also measured. Next, at block 316, a determination is made as to whether all seven cameras have been measured. A "no" detel ;n~tion causes ~O~L ess to block 318. At this point, the camera number is in~L, ~nted and yloyLess is returned to block 308. A "ye~"
determination at block 316 causes ~LG~Less to block 320.
At block 320, a determination is made as to whether new gain and offset parameters had been entered from a user at the graphical user interface. A "yes" determination allows an operator to save the parameters selectively at block 322. Such a save causes progress to block 324, at which point an updating of new gain and offset parameters is made to the image processor modules. Progress is then returned to block 302.
A negative determination made at block 322 causes either an exit of the ~I GYL am or return to block 304, depending on an operator selection.
Turning next to FIGURE 11, a light calibration routine advantageously employed in the above-described system setup is described. The light calibration routine serves to provide maintenance personnel of the system with a method to quickly and accurately adjust a light assembly for most even top-to-bottom lighting of specimens. The operator is also provided with an ability to set the D/A
converter values associated with each strobe supply. In the preferred embodiment, the light ~l;h~ate routine of W O 96/41299 PCT/U~r-'~7610 FIGURE 11 uses a specimen which is evenly colored as possible, as noted above. The routine is commenced at - block 400. Thereafter, ~OYLeSS is made to block 204, at which point an A/D circuit values are updated. A one second delay is then initialed at block ~0~.
Next, a snap induction of images is undertaken at block 406, one image at a time. One camera image is selected to be first. Thereafter, a measurement loop is entered at block 408. Again, in the preferred embodiment, starting at line 240, pixel locations 20-24 are isolated at block 410. At block 412, measurement of four pixels of each image is undertaken. An averaging of these pixels is completed at block 414. These values are then stored in a buffer at block 416.
Next, at block 418, a determination is made as to whether eight meaxul~ -nts have been taken. If the answer is no, ~Gyless is made to block 420. At this point, the horizontal line counter is incremented by 75 and the system is returned to block 412. A positive indication from block 418 causes ~oy~ess to block 422. Here, an ouL~uL of a gray level meaX~ -nt is made to a graphical user interface screen. Next, a determination at block 424 is made as to whether all cameras have been a~ ted. If the answer is no, progress is returned to block 412. If the answer is yes, progress is made to block 426.
CA 02226473 l998-0l-07 WO 96/41299 PCTrUS96/07610 At block 426, a determination is made as to whether an operator had asked for an update of the earlier values to be made. If the answer is yes, these values are written into the A/D circuits by progressing to block ~02.
If the answer is no, a one second delay is then reinitiated as ~oyLess is p~s~ again to block ~0~.
With this structure, both a real-world calibration of inspection system's characteristics is facilitated, as well as acquisition of empirical data representative of acceptable specimens. This allows for accurate inspections to be completed at a rapid rate. It also allows for easy modifications to acc~ odate various specimens and specimen characteristics.
This invention has been described with reference to the preferred embodiment. Obviously, modifications and alterations will occur to others upon the reading and underst~n~ing of the specification. It is inte~e~ that all such modifications and alterations be included insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (16)
1. An article exterior inspection system comprising:
a plurality of cameras, at least one of the cameras being sensitive to a plurality of color spectra, secured about a perimeter of an inspection area such that a lens of each camera is directed generally to a center of the inspection area;
a strobe light adapted to direct a light pulse to the inspection area;
a strobe controller adapted to selectively enable the strobe light;
means for communicating, to a data processor, image data, the image data including data indicative of hue, saturation and intensity of a plurality of images of an associated specimen disposed in the inspection area, each of the images being acquired by each of the cameras;
the data processor including, means for detecting transition information in the image data, the transition information being representative of an edge of the associated specimen represented therein, means for completing an Nth order polynomial transformation on the image data, wherein N is defined as a positive integer, means for isolating fiducials within transformed image data, comparison means for comparing isolated fiducials against data representative of acceptable specimen characteristics, and means for generating an acceptability signal representative of acceptability of the associated specimen in accordance with an output of the comparison means.
a plurality of cameras, at least one of the cameras being sensitive to a plurality of color spectra, secured about a perimeter of an inspection area such that a lens of each camera is directed generally to a center of the inspection area;
a strobe light adapted to direct a light pulse to the inspection area;
a strobe controller adapted to selectively enable the strobe light;
means for communicating, to a data processor, image data, the image data including data indicative of hue, saturation and intensity of a plurality of images of an associated specimen disposed in the inspection area, each of the images being acquired by each of the cameras;
the data processor including, means for detecting transition information in the image data, the transition information being representative of an edge of the associated specimen represented therein, means for completing an Nth order polynomial transformation on the image data, wherein N is defined as a positive integer, means for isolating fiducials within transformed image data, comparison means for comparing isolated fiducials against data representative of acceptable specimen characteristics, and means for generating an acceptability signal representative of acceptability of the associated specimen in accordance with an output of the comparison means.
2. The container exterior inspection system of claim 1 further comprising:
sampling means for sampling selected pixels of the image data;
means for comparing values of neighboring, selected pixels against one another so as to obtain delta information; and means for adjusting an image capture parameter of at least one of the cameras in accordance with the delta information.
sampling means for sampling selected pixels of the image data;
means for comparing values of neighboring, selected pixels against one another so as to obtain delta information; and means for adjusting an image capture parameter of at least one of the cameras in accordance with the delta information.
3. The container exterior inspection system of claim 2 further comprising:
a conveyor for communicating a series of specimens to the inspection area;
tracking means for tracking progress of each specimen of the series of specimens after progress through the inspection area; and means for selectively removing specimens from the conveyor in accordance with an acceptability signal.
a conveyor for communicating a series of specimens to the inspection area;
tracking means for tracking progress of each specimen of the series of specimens after progress through the inspection area; and means for selectively removing specimens from the conveyor in accordance with an acceptability signal.
4. The container exterior inspection system of claim 3 wherein the specimens are comprised of cans.
5. An article exterior inspection system comprising:
at least one black-and-white camera disposed about a perimeter of an inspection area such that a lens of each camera is directed to the inspection area;
at least one color camera disposed such that its lens is directed to the inspection area;
a light adapted to illuminate the inspection area;
a controller adapted to selectively capture image data from the one of the cameras;
image data communication means for communicating captured image data representative of at least one black-and-white image of each specimen of a series thereof disposed in the inspection area to a data processor, which image data is obtained from the at least one camera as a result of illumination resultant from the strobe; and color data communication means for communicating color data representative of a color image of each specimen of the series thereof disposed in the inspection area to the data processor, which color data is obtained from the at least one color camera as a result of illumination resultant from the strobe,; and wherein the data processor includes, an image analyzer for analyzing the image data to determine a presence of image defects, a color analyzer for analyzing the color data to determine a presence of color defects, and means for generating an acceptability signal representative of an output of at least one of the image analyzer and the color analyzer.
at least one black-and-white camera disposed about a perimeter of an inspection area such that a lens of each camera is directed to the inspection area;
at least one color camera disposed such that its lens is directed to the inspection area;
a light adapted to illuminate the inspection area;
a controller adapted to selectively capture image data from the one of the cameras;
image data communication means for communicating captured image data representative of at least one black-and-white image of each specimen of a series thereof disposed in the inspection area to a data processor, which image data is obtained from the at least one camera as a result of illumination resultant from the strobe; and color data communication means for communicating color data representative of a color image of each specimen of the series thereof disposed in the inspection area to the data processor, which color data is obtained from the at least one color camera as a result of illumination resultant from the strobe,; and wherein the data processor includes, an image analyzer for analyzing the image data to determine a presence of image defects, a color analyzer for analyzing the color data to determine a presence of color defects, and means for generating an acceptability signal representative of an output of at least one of the image analyzer and the color analyzer.
6. The article exterior inspection system of claim 5 wherein:
the at least one camera includes a plurality thereof;
the image data communication means includes means for communicating the image data, comprised of a black-and-white image from each of the plurality of black-and-white cameras, to the data processor; and the data processor further comprises means for conjoining each black-and-white image to form the image data as data representative of a generally contiguous image of each specimen of the series thereof disposed in the inspection area.
the at least one camera includes a plurality thereof;
the image data communication means includes means for communicating the image data, comprised of a black-and-white image from each of the plurality of black-and-white cameras, to the data processor; and the data processor further comprises means for conjoining each black-and-white image to form the image data as data representative of a generally contiguous image of each specimen of the series thereof disposed in the inspection area.
7. The article exterior inspection system of claim 6 further comprising:
a conveyor for communicating a stream of generally similar specimens to the inspection area;
a sensor disposed to the conveyor and upstream from the inspection area, the sensor including means for initiating a signal to the strobe controller so as to cause the strobe controller to enable the strobe light as each specimen progresses thereto; and means for removing selected specimens from the conveyor in accordance with the acceptability signal.
a conveyor for communicating a stream of generally similar specimens to the inspection area;
a sensor disposed to the conveyor and upstream from the inspection area, the sensor including means for initiating a signal to the strobe controller so as to cause the strobe controller to enable the strobe light as each specimen progresses thereto; and means for removing selected specimens from the conveyor in accordance with the acceptability signal.
8. The article exterior inspection system of claim 6 wherein:
the color data emanating from the color camera is comprised of primary color data;
the system further comprises a conversion means for converting the primary color data such that the color data is comprised of data representative of hue, saturation and intensity before it is analyzed by the color analyzer.
the color data emanating from the color camera is comprised of primary color data;
the system further comprises a conversion means for converting the primary color data such that the color data is comprised of data representative of hue, saturation and intensity before it is analyzed by the color analyzer.
9. The article exterior inspection system of claim 8 wherein:
the color analyzer includes means for comparing the color data to template data representative of specimen acceptability to determine the presence of color defects; and wherein the template data is comprised of data obtained from analysis of a set of acceptable specimens.
the color analyzer includes means for comparing the color data to template data representative of specimen acceptability to determine the presence of color defects; and wherein the template data is comprised of data obtained from analysis of a set of acceptable specimens.
10. The article exterior inspection system of claim 9 wherein the image analyzer includes:
means for detecting transition information in the image data, the transition information being representative of an edge of the associated specimen represented therein, means for completing an Nth order polynomial transformation on the image data, wherein N is defined as a positive integer, means for isolating fiducials within transformed image data, comparison means for comparing isolated fiducials against template data representative of acceptable specimen characteristics, and means for generating the acceptability signal representative of acceptability of the associated specimen in accordance with an output of the comparison means.
means for detecting transition information in the image data, the transition information being representative of an edge of the associated specimen represented therein, means for completing an Nth order polynomial transformation on the image data, wherein N is defined as a positive integer, means for isolating fiducials within transformed image data, comparison means for comparing isolated fiducials against template data representative of acceptable specimen characteristics, and means for generating the acceptability signal representative of acceptability of the associated specimen in accordance with an output of the comparison means.
11. An article exterior inspection method comprising the steps of:
sensing each of a series of specimens communicated along a conveyor;
enabling a light so as to illuminate each specimen of the series thereof as it is disposed in an inspection area proximate to the conveyor;
generating, from at least one black-and-white camera disposed about a perimeter of the inspection area such that a lens of each camera is directed to the inspection area, image data obtained from the at least one black-and-white camera as a result of illumination resultant of each specimen of the series thereof disposed in the inspection area;
communicating the image data representative of at least one black-and-white image to a data processor;
and generating, from at least one color camera disposed such that its lens is directed to the inspection area, color data obtained from the at least one color camera as a result of illumination of each specimen of the series thereof disposed in the inspection area;
communicating the color data to the data processor;
analyzing the image data to determine a presence of image defects;
analyzing the color data to determine a presence of color defects; and generating an acceptability signal representative of an output of at least one of the image analyzer and the color analyzer.
sensing each of a series of specimens communicated along a conveyor;
enabling a light so as to illuminate each specimen of the series thereof as it is disposed in an inspection area proximate to the conveyor;
generating, from at least one black-and-white camera disposed about a perimeter of the inspection area such that a lens of each camera is directed to the inspection area, image data obtained from the at least one black-and-white camera as a result of illumination resultant of each specimen of the series thereof disposed in the inspection area;
communicating the image data representative of at least one black-and-white image to a data processor;
and generating, from at least one color camera disposed such that its lens is directed to the inspection area, color data obtained from the at least one color camera as a result of illumination of each specimen of the series thereof disposed in the inspection area;
communicating the color data to the data processor;
analyzing the image data to determine a presence of image defects;
analyzing the color data to determine a presence of color defects; and generating an acceptability signal representative of an output of at least one of the image analyzer and the color analyzer.
12. The article exterior inspection method of claim 11 wherein the at least one black-and-white camera includes a plurality thereof, and wherein the method further includes the steps of:
communicating the image data, comprised of a black-and-white image from each of the plurality of black-and-white cameras, to the data processor; and conjoining each black-and-white image to form a the image data as data representative of a generally contiguous image of each specimen of the series thereof disposed in the inspection area.
communicating the image data, comprised of a black-and-white image from each of the plurality of black-and-white cameras, to the data processor; and conjoining each black-and-white image to form a the image data as data representative of a generally contiguous image of each specimen of the series thereof disposed in the inspection area.
13. The article exterior inspection method of claim 12 further comprising the steps of:
communicating a stream of generally similar specimens to the inspection area;
initiating a signal to the controller so as to illuminate each specimen; and removing selected specimens from the conveyor in accordance with the acceptability signal.
communicating a stream of generally similar specimens to the inspection area;
initiating a signal to the controller so as to illuminate each specimen; and removing selected specimens from the conveyor in accordance with the acceptability signal.
14. The article exterior inspection method of claim 12 wherein color data emanating from the color camera is comprised of primary color data, and wherein the system further comprises the step of converting the primary color data such that the color data is comprised of data representative of hue, saturation and intensity before it is analyzed by the color analyzer.
15. The article exterior inspection method of claim 12 further comprising the step of:
comparing the color data to template date representative of specimen acceptability to determine the presence of color defects; and wherein the template data is comprised of data obtained from analysis of a set of acceptable specimens.
comparing the color data to template date representative of specimen acceptability to determine the presence of color defects; and wherein the template data is comprised of data obtained from analysis of a set of acceptable specimens.
16. The article exterior inspection method of claim 13 further comprising the steps of:
detecting transition information in the image data, the transition information being representative of an edge of the associated specimen represented therein;
completing an Nth order polynomial transformation on the image data, wherein N is defined as a positive integer;
isolating fiducials within transformed image data;
comparing isolated fiducials against template data representative of acceptable specimen characteristics; and generating the acceptability signal representative of acceptability of the associated specimen in accordance with an output of the comparison means.
detecting transition information in the image data, the transition information being representative of an edge of the associated specimen represented therein;
completing an Nth order polynomial transformation on the image data, wherein N is defined as a positive integer;
isolating fiducials within transformed image data;
comparing isolated fiducials against template data representative of acceptable specimen characteristics; and generating the acceptability signal representative of acceptability of the associated specimen in accordance with an output of the comparison means.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US47449295A | 1995-06-07 | 1995-06-07 | |
US08/474,492 | 1995-06-07 |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2226473A1 true CA2226473A1 (en) | 1996-12-19 |
Family
ID=23883761
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002226473A Abandoned CA2226473A1 (en) | 1995-06-07 | 1996-05-24 | Inspection system for exterior article surfaces |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP0870274A4 (en) |
AU (1) | AU5875296A (en) |
CA (1) | CA2226473A1 (en) |
WO (1) | WO1996041299A1 (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6519356B1 (en) | 1999-08-03 | 2003-02-11 | Intelligent Machine Concepts, L.L.C. | System and method for inspecting cans |
US6525333B1 (en) * | 2000-07-18 | 2003-02-25 | Intelligent Machine Concepts, L.L.C. | System and method for inspecting containers with openings with pipeline image processing |
EP2629969B8 (en) * | 2010-10-19 | 2024-07-17 | Pressco Technology Inc. | Systems and methods for printing component identification and selected adjustment thereof |
US9555616B2 (en) | 2013-06-11 | 2017-01-31 | Ball Corporation | Variable printing process using soft secondary plates and specialty inks |
CN105764692B (en) * | 2013-09-24 | 2018-04-24 | 艾美株式会社 | Tank printing equipment and tank check device |
DE102014002582B4 (en) | 2014-02-26 | 2018-10-11 | Heye International Gmbh | Method for detecting cracks in the walls of hollow glass articles |
DE102014112483A1 (en) * | 2014-08-29 | 2016-03-03 | Krones Aktiengesellschaft | Apparatus and method for printing on containers with error detection |
ES2734983T3 (en) | 2014-12-04 | 2019-12-13 | Ball Beverage Packaging Europe Ltd | Printing apparatus |
CN107923837A (en) * | 2015-06-03 | 2018-04-17 | 工业动力有限公司 | System and method for checking container using multiple radiation sources |
US10549921B2 (en) | 2016-05-19 | 2020-02-04 | Rexam Beverage Can Company | Beverage container body decorator inspection apparatus |
US10976263B2 (en) | 2016-07-20 | 2021-04-13 | Ball Corporation | System and method for aligning an inker of a decorator |
US11034145B2 (en) | 2016-07-20 | 2021-06-15 | Ball Corporation | System and method for monitoring and adjusting a decorator for containers |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4482971A (en) * | 1982-01-18 | 1984-11-13 | The Perkin-Elmer Corporation | World wide currency inspection |
US4764681A (en) * | 1987-06-04 | 1988-08-16 | Owens-Illinois Televison Products Inc. | Method of and apparatus for electrooptical inspection of articles |
US5172005A (en) * | 1991-02-20 | 1992-12-15 | Pressco Technology, Inc. | Engineered lighting system for tdi inspection comprising means for controlling lighting elements in accordance with specimen displacement |
-
1996
- 1996-05-24 EP EP96920459A patent/EP0870274A4/en not_active Withdrawn
- 1996-05-24 AU AU58752/96A patent/AU5875296A/en not_active Abandoned
- 1996-05-24 WO PCT/US1996/007610 patent/WO1996041299A1/en not_active Application Discontinuation
- 1996-05-24 CA CA002226473A patent/CA2226473A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
AU5875296A (en) | 1996-12-30 |
WO1996041299A1 (en) | 1996-12-19 |
EP0870274A1 (en) | 1998-10-14 |
EP0870274A4 (en) | 1998-11-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108445007B (en) | Detection method and detection device based on image fusion | |
KR101338576B1 (en) | Defect inspection device for inspecting defect by image analysis | |
JP5424659B2 (en) | Inspection device for inspection object | |
US20060147092A1 (en) | Intelligent digital graphics inspection system and method | |
US5481619A (en) | Inspection method using templates images, unique histogram analysis, and multiple gray levels correlated to addresses of template images | |
JPH0132458B2 (en) | ||
CA2226473A1 (en) | Inspection system for exterior article surfaces | |
JPH11108759A (en) | Defect inspecting method and device therefor | |
JP2016206760A (en) | Color discrimination method and color discrimination device, as well as printer color tone control method | |
JP5424660B2 (en) | Inspection device for inspection object | |
JP2009156872A6 (en) | Inspection device for inspection object | |
JP2005182143A (en) | Inspection method for cap top surface | |
JP2011179987A (en) | Method and device for measurement of residue | |
JPH09264856A (en) | Article appearance inspection device | |
CA2153647A1 (en) | Method and apparatus for recognizing geometrical features of parallelepiped-shaped parts of polygonal section | |
JPH07121721A (en) | Printed character inspecting method | |
JPH04216445A (en) | Device for inspecting bottle | |
Lee et al. | High-speed automated color-sorting vision system | |
JPH06118026A (en) | Method for inspecting vessel inner surface | |
JPH0943097A (en) | Color filter defect inspection device | |
Connolly et al. | The use of video cameras for remote colour measurement | |
JP7340213B1 (en) | Visual inspection device, visual inspection system, and visual inspection method for transparent containers | |
JPH0731131B2 (en) | Method for spotting periodic pattern | |
JPH08101068A (en) | Color measuring apparatus | |
Connolly et al. | Industrial colour inspection by video camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FZDE | Discontinued |