AU648354B2

AU648354B2 - Optical inspection of moving objects

Info

Publication number: AU648354B2
Application number: AU86918/91A
Authority: AU
Inventors: Philippe Flotterer
Original assignee: Saint Gobain Cinematique et Controle SA
Current assignee: SGCC SAS
Priority date: 1990-11-20
Filing date: 1991-10-31
Publication date: 1994-04-21
Anticipated expiration: 2011-10-31
Also published as: EP0487402A1; MX173902B; ZA918739B; FR2669429B1; FR2669429A1; JPH04291140A; CA2055640A1; NO914522L; IE913793A1; NO914522D0; NZ240443A; AU8691891A; BR9105019A

Description

64jL 4

AUSTRALIA

Patents Act 1990

ORIGINAL

COMPLETE SPECIFICATION STANDARD PATENT Invention Title: OPTICAL INSPECTION OF MOVING OBJECTS.

The following statement is a full description of this invention, including the best method of performing it known to me:t IL. I L lA OPTICAL INSPECTION OF MOVING OBJECTS *r I

I.

The optical inspection of objects made in large numbers both with a view to deciding whether they are acceptable or not and to monitor the general quality level of a production line involves certain dimensional examinations and inspections, but particularly with respect to the appearance. The latter reveals the surface state and more particularly its abnormalities and, in the case of transparent or translucent objects, possible internal faults.

This is why such an inspection is very widely used in the glass and in particular hollow glass industry, either for the fine inspection of de-limited zones able to have specific defects, particularly checks and then varyingly wide or narrow oriented light beams are used, or on a larger part of the wall for the detection of more varied defects and faults, such as inclusions, paste defects, thickness, adhesion, etc. In this case it is necessary to study an image of the moving object with or without rotation, usually formed by transparency in diffuse lighting.

It is then necessary to analyze in real time i.e. at a very high speed, the signal supplied by an optoelectronic device located along a conveyor and associating with an adequate emitter a receiver operating in rectangular Cartesian coordinates, i.e. constructed around a matrix camera (CCD: Charged Coupled Device) equipped with an array of cells capturing a virtually instantaneous overall image. A priori this image is not uniform, even on a perfect object and, no matter what analysis method is chosen, must, if it is wished to obtain adequate information, be compared by image analysis members and then decision members with a L. -Y ~I

F

2 model constituted by an empirically determined table of criteria. The complete means is controlled by a microcomputer.

One of the difficulties is that the higher the inspection speed, the more difficult it becomes to manipulate the objects. A widely adopted solution consists of conveying them upright on generally rectilinear, horizontal belt conveyors using lateral belts for placing them and, if need be, for rotating them in the case of circular bottles.

However, it remains difficult to observe the image in a uniform position, even by synchronising its acquisition with the passage of the object.

A machine for inspecting an object moving on a conveyor, said object having an angular marker, said machine comprising an opto-electronic device including an emitter and a receiver for foruLing and transposing an instantaneous image of the object into rectangular Cartesian co-ordinates S: and supplying the co-ordinates to an image analyser having 0.:a Cartesian co-ordinate grid, said emitter and receiver 20 being positioned in face to face relationship with each 6 oother on opposed sides of the conveyor so that the object 0 passes between the emitter and receiver, and an electronic o a" converter which is able to display the image of the object in a predetermined position superposed on the Cartesian o 25 analysis grid of the image analyser, wherein the image of 0 0 the object is displayed in the predetermined position in o. 0 accordance with identification of the centre of the image ooo of the object and the position of the angular marker provided on the object.

aOQ According to the present invention there is provided an electronic conversion device for a machine according to any one of claims 1 to 7 for insertion between the receiver and a target memory for supplying the analyser, to transpose in real time the signal supplied by the receiver and C I Ik~rr digitising the signal, by grouping, in conjunction with a central processing unit controlling the machine, a location unit for determining the centre of the observed image, a graphic unit for authorising the analyser to seek on the light profile of said image along a given marking line of the matrix on the basis of values of the signal stored in an initial auxiliary memory a characteristic sequence of the marker CPU then calculates the transformation algorithm which will bring the grid on to the image and a transposition unit for carrying out pointwise the transformation and calculating by interpolation, on the basis of the initial value, the converted signal value to be conversely allocated to the successive boxes of the grid.

The first objective of the invention is to provide optical inspection machines equipped with a device able to restore in a fixed position in front of a Cartesian analysis grid, each instantaneous image of an object provided with an adequate angular marker and placed on the conveyor obtained in a variable position on their receiver. Thus, it proposes for said machines a generally applicable electronic converter means able, by insertion between the camera and the analyser, to transpose in real time at speeds of 36,000 articles per hour and higher the digitised electronic signal from said camera. This device must at the minimum be able to reset each image in a fraction of the video reading time, not only in translation in the direction of the conveyor, but at least also in perpendicular translation and in rotation starting from the detection of it silhouette and the position of the marker.

Receiving its data from the camera to transmit them to the image analyser, the converter according to the invention groups, in conjunction with the central processing unit 3 controlling the machine and the circuits of the analyzer, several specialized units namely a location unit, a graphic unit and a transposing unit, which will be described in greater detail hereinafter in connection with the inspection or examination of the bottom of a glass container.

This embodiment chosen for reasons of clarity will be accompanied by information on certain transpositions which can be easily made to other cases. In the drawings shown: Fig. 1 A possible structure of an inspection station.

Fig. 2 The image received on the camera.

Fig. 3 The shape of the row signals.

Fig. 4 A flow chart.

Fig. 5 The image stored by the initial memory.

Fig. 6 The standard image of a perfect bottle.

As shown in Fig. 1, usually, but not necessarily, between two successive sections la, lb of a horizontal belt conveyor 1, beneath a light emitter 2, is placed a gap covered by two opposing lateral belts 3. The image of the bottom, obtained by observing in accordance with the vertical axis of each of the containers B in the form of bottles driven in translation at minimum intervals by these two belts, is formed on the sensitive surface of a camera 4 e.g. constituted by an array 5 of 384 x 288 square meshes, whose useful field E is arranged lengthwise in the direction of the conveyor.

No matter whether it is circular or not, direct or indirect and even supplied by the "flat" bottom (in reality slightly concave) of a perfect bottle, said image shown in Fig.

2 does not have a uniform brightness. There can not only i \i be thickness or lighting differences, but also systematic disturbances, namely ribbed areas S 1 for cooling the shoulder, S 2 S3, coded or uncoded writing: factory, mould number, etc., orientation marker M, e.g. for sticking labels, etc. and said different zones involve different severity criteria and treatments.

As shown by Fig. 3, the video signal S supplied linewise by the camera is firstly digitized by a converter (ADC analogic-digital converter) in a series of digits Z to 28 256 grey levels, representing the average illumination of each mesh, usually addressed in a target memory for supplying an adequate analyzer comparing the image obtained with the table of criteria defined by the inspection protocol, whereby the latter can be likened to a standard image.

In principle, the image is of a constant size, because it is taken at fixed distances on the optical device, but will be captured by the array 5 in a slightly variable position within the available field E. Moreover, even if it is not circular, a priori the bottle has a not known orientation.

It is necessary to overcome this double difficulty for comparing its image with the analysis grid formed by the model, if it is e.g. wished to avoid any local marking neutralizing a complete ring on the bottom.

So as not to overburden reading, Fig. 4 provides with respect to the operation provided by the invention a diagram reduced to the circulation of information obtained on the basis of the signal Z from the converter 6 in conjunction with the central processing unit or CPU 7 of the inspection machine.

Here, the signal Z is not directly stored in the target memory 8 for supplying the analyzer 9, whose principle is known per se and which is therefore not specifically described, but is firstly converted into a signal W by an electronic convGesion device 10 also controlled by the CPU 7. Thus, it is firstly stored as a quadruple image [Z] on a matric [XY] corresponding to the design of the sensitive surface, in the four parallel memory planes ila, l1b, llc, lid of an initial memory 11 (1 M-byte random access memory or RAM).

Summated on the complete image, a histogram of grey levels will bring about the systematic appearance of two populations, that of the very light colours corresponding to the bright bottom and that of the darker colours which may carry certain significant peaks of systematic or accidental abnormalities, but which certainly indicate the presence of the object. This makes it possible to find a threshold s from the signal Z to a black and white (1) binary signal z, which will supply the silhouette of the object, namely that of the bottle bottom or more precisely its shadow. The presence of belts causes no problems.

Working in a data flow and able to firstly carry out the aforementioned processing on the signal received at it is the location unit 12 which will then summate row j by row j and column i by column i the matrix in accordance with the diagram of Fig. 5, on the basis of the signal Z 2 reextracted from its video memory 12a the respective quantities j.n and i.ni, in which n i and n, are respective black numbers of the signal z in the corresponding row or column. To within the factors of the numbers of rows of the matrix, the thus obtained sums I and 6 J are the coordinates of the centre of gravity G of the shadow, which is independent of the chosen system of coordinates, i.e. in the present case the orientation of tie bottle on its conveyor. When entered in a matrix they will conversely supply the translation L 1 to be imposed on the image in order to bring said centre to the chosen origin O of the target matrix with reference to which will then be made the image analysis calculations for characterizing the bottle with respect to the standard image During this operating phase, it should be noted that it is possible to use the still free memory 8 as the memory 12a.

It should also be noted that for fixing a centre it is possible, on a double symmetry object, to replace the investigation of the centre of gravity G by that of the median point. The corresponding calculation is simpler, but this gain poorly compensates the loss of flexibility resulting from such a choice.

The aforementioned information is also transmitted by the C: central processing unit 7 to the graphic unit 13, which uses it for authorizing in the memory 11, along the circle C, centred on G and whose radius r is known beforehand, namely parallel in the four planes lla to lld on four Squadrants Ca to Cd (monotonic functions), the reading Z 3 by a d Z3mag the analyzer 9 of the light profile of the stored image The analyzer will detect a specific intensity sequence or variation in it, characterizing an angular marker M, either previously existing or which is specifically provided for this purpose on the bottom and in particular a bead forming a lump in front of the emitter.

i 7 As soon as the coordinates P and Q of this marker are identified in tbe! matrix the CPU 7 will supply the directional coefficients, cosine and sine, p and q of the direction of said marker point When inscribed in a matrix they will conversely determine the necessary rotation R" 1 for bringing its image on to one of the axes of the target plane, e.g. the U axis.

The translation L" 1 and then the rotation R" 1 of the complete image will bring the latter in front of the standard image of a perfect bottom in order to permit the analysis thereof by any appropriate method. In practice, the desired algorithm, in the present case the moving matrix which is the opposite of the matrix product will make it possible, according to Fig. 6, to pass from the matrix [UV] to the matrix [XY] and consequently to the image obtained on the camera, in order to determine with which elements of the latter corresponds the signal intensity W which will characterize a pixel of the target matrix, or better conversely to which pixels (X,Y,Z) of the initial matrix to refer for calculating W and in iwhat way. Use will be made of homogeneous coordinates with 3x3 matrixes.

The CPU 7 carries out the calculation of the matrix and 1i transmits it to the transposition unit 14 for that of W.

If it is accepted that W is the direct representation of the illumination of the image, a possible method for determining the value to be attributed to it is the transfer of the value Z of the closest pixel, or even that corresponding to the integral values of X' and Indeed the coordinates X' and Y' of the initial point corresponding to said target pixel will only exceptio,,ally be integers. The circuits used are suitable for using more

I

8 accurate methods, but these methods will be more complex.

In view of the time constraints, the preferred, relatively S 5 simple method is that of bilinear interpolation between four adjacent pixels, pro rata to the inverse of their coordinate differences.

If it is assumed that to a certain pixel A(U,V) of the target matrix corresponds an initial point A' X+x, Y' in which X and Y represent the integral parts of the coordinates and x and y their fractional parts, said point is located within the square formed by the centres of the four boxes If the respective brightnesses thereof are Zoo, Z 01

Z

10

Z

11 to A' and therefore to A will be attributed a brightness Z' Zoo (1-x)y Z 0 1 x(l-y) Z 10 xy Z, 1 W. As an arbitrary example with decimal notation and assuming that to the pixel A of the target matrix corresponds, within the square formed by the centres of the four boxes: (X 8, Yo of brightness 137, i (X 8, Y 1 of brightness 145, S 25 (X 1 9, Yo of brightness 123,

(X

1 9, YI of brightness 111, San initial point A' of the coordinates X' 8.37 and Y' -3.48, to it will be attributed respective multiplying coefficients: kx 0.63 and 0.37, ky 0.52 and 0.48, i.e.

a brightness W equal to: Z' 0.63x0.52x137 0.63x0.48x145 0.37x0.52x123 0.37x0.48x111 132.

The calculation to be carried out will therefore consist of investigating boxwise with respect to the useful area of the target matrix the coordinates of the initial point, on c 1 ~ciiili--l.rL1. .i the basis of their integral parts, the brightnesses of the four initial pixels surrounding the same and of their fractional parts the four multiplying coefficients k, in order to carry out the above summation.

The transposition unit 14 essentially has two data transposing circuits 14x and 14y (IRS Image Resampling sequencer) carrying out the calculation in question by a series of linear iterations, and a multiplier-accumulator

(MAC)

Object after object, the CPU 7 calculates the matrix whose coefficients are stored in buffer stores of each of the two transposers 14x and 14y. On the basis of these coefficients and for each pair U,V of the useful field, said transposers process the values X' and They select their integral parts X and Y in order to sample in parallel the four corresponding values Z in the four planes of the initial memory 11 and their fractional parts x and y for storing the corresponding interpolation coefficients k in a buffer store 16. The multiplier-accumulator 15 performs Sthe calculation of Z' W, which it transfers into the target memory 8, whose data will then be used only for supplying the analyzer 9. It should be noted that the latter could directly extract certain of its data from the values Z 11 but once again this would lead to a i' values Zo.. Z111 oneagi possible loss of use flexibility.

The main members used for constructing the device are as follows: central processing unit 7 Philips RTC microprocessor 68070 location unit 12 asics HISTO of Imapply International, graphic unit 13 transposers 14x and 14y multiplier-accumulator 15 memories 8 and 11 QPDM AM95C60 of Advanced Micro-Devices, TMC 2301 of TRW, TMC 2210 of TRW, 2 9 x2 9 box RAM (1 M-byte).

Within an inspection or examination period of e.g.

approximately 100 ms, such a device is now able to record an image in less than 15 ms, i.e. less than 20% of the cycle time, with an adequate rendition, on the raster of a 512x512 box matrix memory and even increase or decrease the size of the image. It should also be noted that under certain speed conditions said members, which can be completed by auxiliary circuits, make it possible to make the treatment of the image more or less complicated, as is explained by their use instructions. Thus, in the case of an inspection of sidewalls, it is possible to give the wall a developed image by modifying the scale of the single coordinate U. For example, for the inspection of a pitted bottom, it would be possible through adding a conversion matrix, to expand in a variable manner around the point G the two coordinates U and V.

Finally, optionally certain of the above-described units could during the remainder of the cycle fulfil different functions in conjunction with the CPU and the image analysis members. Thus, it is possible to use as the graphic unit 13 that intended for controlling the processing operations to be carried out on the final image in the different zones of the standard image dead zones T 1

T

2 N, reading an alphanumeric code T3, investigating local defects F with various sensitivities T 4 thickness measurements, etc.

I I.

I I,

Claims

1. A machine for inspecting an object moving on a conveyor, said object having an angular marker, said machine comprising an opto-electronic device including an emitter and a receiver for forming and transposing an instantaneous image of the object into rectangular Cartesian co-ordinates and supplying the co-ordinates to an image analyser having a Cartesian co-ordinate grid, said emitter and receiver being positioned in face to face relationship with each other on opposed sides of the conveyor so that the object passes between the emitter and receiver, and an electronic converter which is able to display the image of the object in a predetermined position superposed on the Cartesian analysis grid of the image analyser, wherein the image of the object is displayed in the predetermined position in accordance with identification of the ceatre of the image of the object and the position of the angular marker provided on the object.

2. A machine according to claim i, which is capable of transforming the image of the object by both deforming the image and by similarity transformation.

3. A machine according to claim 2 in which the transformation comprises a bidimensional displacement.

4. A machine according to any one of claims 1 to 3 in which the object is a glass container. A machine according to claim 4 for inspecting the base of the container, comprising a light emitter associated with a matrix camera arranged on the same substantially vertical axis.

6. A machine according to any one of claims 1 to located between two successive sections of a horizontal I c 11111111111~1 CIIPr 12 belt conveyor wherein the optoelectronic device is located in a gap defined between two opposed lateral belts for transporting the object.

7. A machine according to any preceding claim for inspecting a plurality of objects moving quickly along the conveyor.

8. An electronic conversion device used in a machine according to any one of claims 1 to 7 to transpose in real time the signal which is supplied by the receiver and then digitized, by grouping, in conjunction with a central procesing unit (CPU) controlling the machine, said device comprising: a location unit for determining the centre of the image of the object, a graphic unit for permitting the image analyser to seek a characteristic sequence of the angular marker of the object on a light profile of said image along a given marking line of a matrix on the basis of values of the signal stored in an initial auxiliary memory, the CPU then calculating the transformation algorithm which will superpose the grid on to the image, i and a transposition unit for carryng out j pointwise the transformation and calculating by interpolation, on the basis of the initial value, the converted signal value to be conversely allocated to the successive boxes of the grid.

9. A conversion device according to claim 8, in which the location unit is able to supply a histogram of the intensities of the light signal to produce a binary signal supplying the shadow of the object from a threshold found on said histogram, and to calculate from the position of the centre thereof on an initial matrix the translation to be imposed on the image in order to bring the centre of Sthe image to the origin target memory. i c 13 A device according to claim 9, in which the location unit determines the position of the centre of the image by calculating the co-ordinates of the centre of gravity of the shadow or, optionally, the median point of a double symmetry object.

11. A device according to any one of claims 8 to in which the graphic unit seeks along a marking line constituted by four quadrants of a circle having as its centre that of the shadow for determining the rotation to be imposed on the image.

12. A device according to any. one of claims 8 to 11 in which the transposition unit comprises two data transposers supplying a multiplier-accumulator.

13. A device according to claim 12, in which the transposition unit processes the value of the converted signal by a multiplier-accumulator, boxwise of the useful o 0 0 area of the target matrix, by bilinear interpolation 0 90 "0"0 between the intensities of the signal appropriate for four 00.. adjacent pixels of the corresponding initial point, on the S00. 20 basis of the integral parts and the fractional parts of the .a00. co-ordinates.

14. A device according to claim 13, in which the initial memory has several memory planes scanned in °parallel by various members. 00a 25 15. A device according to any one of claims 11 to 14, S in which the transposition unit operates in homogeneous co- 1 ordinates for recording the image on the analysis grid by iteration by means of a 3 x 3 matrix, inverse calculated by the central unit of the product of the two matrixes of 7r E f/# c 0 16-- 14 rotation and translation.

16. A device according to any one of claims 8 to having an operating time which does not exceed 20% of the duration of the examination cycle and that during the latter certain units are used in turn with different functions.

17. A machine for inspecting a moving object substantially as hereinbefore described with reference to any one of the accompanying drawings. 0. 18. An electronic conversion device for a machine substantially as hereinbefore described with reference to any one of the accompanying drawings. fDated this 19th day of October 1993 ''SAINT-GOBAIN CINEMATIQUE ET CONTROLE By its Patent Attorneys: o 20 GRIFFITH HACK CO aoQe 0 Fellows Institute of Patent Attorneys of Australia *000 a o 6 I o i S06 a 00oOO o u 0 C 0 0 00 DESCRIPTIVE ABSTRACT 0 Ua o 0 0 3 a receiver operating in rectangular Cartesian coordinates followed by DO an image analyzer, controlled by a microcomputer and equipped with an electronic converter (10) able to restore in a fixed position in front of the Cartesian analysis grid of the analyzer any instantaneous DESCRIPTIVE ABSTRACT oc.Oa image obtained on the receiver The invention relatewhich is more particularly usable in ton examination oflow glassware moving objectsdustry, in artprovided with an angular markerct, associatingn rea time an along a conveyorgh speeds the bottoms of contadevice incorporating an productn emitter and a o no a receiver operating in rectangular Cartesian coordinates followed by a an image analyzer, controlled by a microcomputer and equipped with an electronic converter (10) able to restore in a fixed position in front of the Cartesian analysis grid of the analyzer any instantaneous image obtained on the receiver This machine, which is more particularly usable in the hollow glassware industry, in particular makes it possible to inspect, in real time and at very high speeds, the bottoms of containers on production lines. AL -1 M MWW