GB2384852A

GB2384852A - Workpiece inspection apparatus

Info

Publication number: GB2384852A
Application number: GB0220458A
Authority: GB
Inventors: William Clocksin; Charalampos Bakolias
Original assignee: MILLENNIUM VENTURE HOLDINGS LT
Current assignee: MILLENNIUM VENTURE HOLDINGS LT
Priority date: 2001-09-03
Filing date: 2002-09-03
Publication date: 2003-08-06
Also published as: GB0220458D0; WO2003021242A1

Abstract

Apparatus for determining the physical characteristics of the surface of a workpiece, such as a ceramic tile in which a light source 5 directs a structured light beam onto the tile surface which is arranged to pass through the light beam. A time delay integration camera 4 is located to capture structured light ("structogram") reflected by the surface of the tile. Preferably an electrical storage device stores a reference "structogram" and the captured "structogram" is compared to it to sort a succession of tiles relative to preset tolerance levels.

Description

METHOD AND APPARATUS FOR INSPECTING

THE SURFACE OF WORKPIECES

Field of the Invention

5 The present invention relates to machine vision systems, and more particularly to a method and apparatus for determining the physical characteristics of the surface of workpieces, particularly ceramic tiles.

Background of the Invention

10 It is well known during the manufacture of ceramic tiles, for example, a number of factors may contribute to a defective surface of the tile. Typical defects are warps in the body of the tile and roughness of the tile surface caused by defective polishing, grinding or moulding. In addition, some designs of tiles may include a degree of surface roughness for cosmetic 15 reasons, but it is important in the manufacturing process to ensure that the roughness is kept within tolerated variation.

More particularly, it is well known to use structured light in the field of

optical ranging, encompassing techniques such as triangulation ranging and Moire fringe analysis.

20 In triangulation ranging, a pattern of light is projected from a light source onto the object. An image of the reflected pattern is obtained from a camera placed at a different angle of view to that of the light source.

Deviation in the pattern corresponds to displacements in depth relative to the

angles of view of the light source and the camera. In a typical application, a worl iece is moved through the projected pattern so that range samples can be obtained along the workpiece. Structured light projectors as light sources are widely available. A typical such projector consists of a low-power laser 5 emitting light through a slit, and a cylindrical lens is used to form a sheet of light, which reflects off the surface of the object to form a curved stripe pattern. The curvature of the pattern, when viewed from a different angle of view, provides information regarding variations in the range (distance) from the viewpoint to a point on the pattern 10 One characteristic of this approach is Mat at each instant in tune, a two d ensional area must be imaged, and the unage processed to find the pattern as the workpiece moves under the projected pattern. There are consequent trade-offs between object speed, image size and resolution, angles of projections and view, exposure fume, illumination power, and the accuracy of 15 the estimated range. A typical example is to use high-speed analogue or digital signal processing for a small (hundreds of pixels square) image so that image frames can be processed at a rate of hundreds or thousands per second.

For example, if the workpiece is moving at a rate of one metro per second, and if it is desired to sample the range variation at a resolution of 0. 5 20 rnillirnetre, it is necessary to process two thousand twodimensional images per second.

In some applications, this solution is not suitable because a large image (thousands of pixels square) is required to subtend the workpiece at We

required resolution, and it is not feasible to process such large images at the rate required. Therefore, in applications of this type in which structured light is not used, it is common to use line-scan cameras, either synchronizing line acquisition with conveyor belt movement, or using a free-running camera 5 above a belt moving at a precise constant speed. The fact that only a line is sampled instead of an area of pixels has hitherto ruled out the use of line-scan cameras in structured light applications.

Another type of line-scan sensor is known as a Time-Delay Integration (TDI) sensor. A TDI sensor consists of a number of rows R (typically from 10 32 to 96) of photosensitive sites ("photosites"). Each row may contain a 2a, number C (say from 1024 to 4096) of such sites. The sensor is placed in such a way as to subtend the width of the object as it moves under the sensor, thus scanning the object in its entirety. a TDI sensor, all rows are exposed at the same time, but at each line interval, the charge ire each row of photosites is 15 shifted to the next row a given direction and added so that the charge accumulates in successive photosites along each column. If the rate of this row transfer (the "transfer rate") is synchronized precisely with the movement of the workpiece, and if the movement of the workplace is precisely orthogonal to the rows of photosites, a given point on the work piece will be 20 exposed repeatedly as many times as there are rows in the TDI sensor. The effect on this repeated exposure and accumulation is to greatly increase the sensitivity without degrading image quality and resolution, while retaining the high speed and large linewidth of line-scan acquisition. Furthennore, random

noise in the image is reduced by approximately the square root of R (the number of rows). There is a time delay between the moment a line of pixels is exposed to the moment it is outputted from the camera, during which the exposure has been integrated R times, hence the name time-delay integration.

5 TDI cameras using the TDI sensors are widely available, and a method as just disclosed is found in, for example, U.S. Patent Nos. 4,922,397 and 5, 040,057 as well as in U.S. Patent Nos. 4,314,275, 4,382,267 and 4,952,809.

Summary of the Invention

10 It is an object of the present invention to create a method that is capable of measuring the surface planarity and roughness of a ceramic tile product (the "workpiece") quickly, and more efficiently than hitherto known.

According to one aspect of the present invention there is provided a method of determining physical characteristics of the surface of a workpiece, 15 comprising passing the workpiece below a structured light beam, and utilising a time delay integration camera to capture the structured light reflected from the surface of the workpiece.

According to another aspect of the present invention there is provided an inspection apparatus to determine the physical characteristics of the surface 20 of a workpiece, comprising light source means for emitting a structured light beam onto a workpiece arranged to pass under the light source, and a time delay integration camera located to capture structured light reflected by the surface of the workpiece.

When using a TDI sensor or camera according to prior techniques as described above, it is necessary to carefully arrange the camera, illumination, and workplace so that successive exposures will preserve the consistency of viewing conditions. Normally this is accomplished by synchronising the 5 movement of the object with the transfer rate of the TDI sensor.

By contrast, the present invention deliberately, but systematically, disrupts the viewing conditions dunag scarfing. Structured illumination in the form of a sheet of light is projected onto the workpiece and reflects onto the photosites of the TDI sensor. As the workpiece moves through the stripe 10 synchronized with the row transfer within the sensor the charge transferred from one row to the next is systematically related to the distortion of He stripe due to changes in surface image. Therefore, the output of the camera will not be the result of successive exposure of similar viewing conditions, but will instead be the accumulation of the effect of distortion in the illuminated stripe.

15 Because the distortion of the stripe is caused by variation in range to points on the object, the variation in pixel intensity will correspond to variation in range from the camera to a corresponding point on the object. Therefore, the image produced by the system, in which variations of brightness correspond to variations in surface profile and roughness of the workpiece, is for 20 convenience referred to as a "structogram" which is not a recognised optical term, but one evolved by the applicant for the purpose of clarity of this description.

The present invention requires that the recommended usage of the IDI camera, namely that viewing conditions are to remain constant during exposure, be violated in a systematic manner in order to encode information about the distance from the sensor to points on the workpiece. Therefore, the S TDI camera is employed in a way hitherto undisclosed, namely that accumulated exposure of a column of photosites is directly affected by the distortion of the reflected pattern of structured illumination that occurs when the surface of the object is not flat. US Patent 5,668,887 also discloses an arrangement based on a combination of TDI camera and structured light in 10 which the TDI camera is deliberately not synchronized to the speed of the web. Because the effect of the lack of synchronization is to smear the image, that arrangement is designed to emphasize longitudinal streak imperfections in a paper or fabric web, and is not designed to provide information about range (distance) variations and does not therefore provide information 15 regarding range information such as a planarity and roughness of the observed surface. After a workpiece is scanned using the present combination of structure light and a TDI camera in accordance win the present invention, the result is an image (structogram) of the tile in which variations in brightness correspond 20 to the surface relief of the tile. The variations in brightness do not correspond linearly to the range to the surface from the camera, but correspond in a non linear manner to the partial derivative of surface range with respect to an axis parallel to the direction of tile movement. Using assumptions that apply in

practice, it is possible to process the structogram to solve for an estimate of the range to each point on the surface of the tile. Alternatively, the variations in structograrn brightness may be used directly to measure surface planarity and roughness relative to a known sample.

5 a first embodiment of the present invention a method of the tile inspection requires: 1. A workplace which is known to be free of defects to be placed on the conveyor belt so it may be inspected by the light source/camera combination in a training mode. The training mode provides the system with a reference.: 'k 10 structogram against which structograms of production workplaces are compared in turn. Alternatively, it is possible to store reference structograms, thereby forming a data base of samples taken from different batches of workpieces. 2. Production workplaces fed onto the conveyor belt are inspected by the 15 system, and resulting structograms are compared with the reference structogram. If a production structogram is in excess of the reference structogram by more than given tolerances, the workpiece is reported as a reject. Otherwise the workpiece is reported as normal.

In a second preferred form in accordance with the present invention a 20 plurality of reference structograms previously obtained from workplaces of different types, and stored in the memory of the control processor, are retrievable individually from the memory data base, thereby providing the

system with preset references against which production workpieces of a selected type may be compared at will.

The present invention advantageously utilises a TDI line-scan camera in such a manner as to obtain the image necessary for estimating the range to the 5 surface from the camera; an area-scan camera is not required. This is advantageous because it is not necessary to process a large twodimensional image to recover stripe shape information at each incremental step of workplace movement.

Furthermore, range information can be obtained in real time (limited by 10 the conveyor speed) because immediately each image row is outputted from the camera in the form of an electrical signal, the structogram image has encoded information that can be used to estimate range directly.

Brief Description of the Drawings

15 An embodiment of the present invention will now be described by way of example with reference to the accompanying drawings in which: Figure 1 illustrates an apparatus mounted over a conveyor belt; and Figure 2 illustrates an optical path of a structured light and TDI sensor.

20 Detailed Description of the Preferred Embodiments

One embodiment in accordance with the present invention will now be described with reference to Figures 1 and 2.

i In Figure 1 there is shown an apparatus 1 comprising an elongate conveyor belt 2 arranged to extend through a rigid support frame 3 which supports a Time Delay Integrated (TDI) camera 4 and a light source or projector 5, both spaced from the conveyor belt by an amount which at the 5 very least allows a workpiece 6, such as a ceramic tile, to pass on the conveyor belt 2 beneath the camera 4 and light source 5.

A control processor 7 is conveniently mounted on a base 8 of the support frame 3. The control processor 7 is connected, although not illustrated for clarification purposes, by electrical connections of any form to 10 the camera 4, light source 5 and the conveyor belt 2 via a shaft encoder 9 located at one end 1O of the conveyor belt to control the speed of movement of the conveyor belt.

When a workpiece 6 is located on the conveyor belt 2 the workpiece is moved by the conveyor belt past the light source 5.

15 As clearly shown in Figure 2 the light source 5 emits a diverging sheet of light 15 from a narrow slit 16 extending diametrically across the output surface of light source 5. The emitted light beam is therefore a structured light beam and falls onto the worl iece as a strip of light 17. An image pattern (known as a stripe) is reflected from the workpiece to be received by 20 camera 4 which is located to optimise the light reflected from the workplace 6. The light source 5 is adjusted on the support 3 to project the sheet of light 15 at an angle a relative to an imaginary line extending perpendicularly

through the workpiece at the point of intersection of the light beam 15 with the workpiece. The camera 4 is located on an opposite side of the support 3 and focussed on the point of intersection of the light beam 15 with a workpiece to receive a reflected light beam 18 also at an angle a relative to 5 the above mentioned perpendicularly extending imaginary line.

More particularly, camera 4 comprises a lens 20 which is arranged so as to focus the stripe 17 onto an array of photosensitive sites 21 (photosites) to produce an image 22 of the stripe pattern upon the photosites. Such image 22 is usually referred to as a structogram.

10 By using an apparatus such as Mat just described it is possible to monitor or sense the physical characteristics of the surface of the workpiece 6 such as the planarity and roughness of the workpiece as the workpiece is moved through the field of view of the camera 4.

Because of the consistency of the stripe 17, a constant value is 15 accumulated by the TDI camera 4, and the resulting structogram image data - contains constant pixel values. practice there will be a small variation in pixel values do to random scattering illumination and variations on the perfonnance of the optical and electronic apparatus in the camera, but within given tolerances the image can be assumed to be constant.

20 When an imperfect workpiece is placed on the conveyor belt 2 and the workpiece passes through the field of view ofthe camera 4, the stripe 17 will

be distorted in a systematic manner that depends on the surface topology. As the workpiece passes under the stripe 17, the shape of the stripe will change at

a speed depending on the surface topology and the speed that the workpiece is being transported by the conveyor belt. The key principle is that the TDI camera will be integrating an image at the time during which the stripe is undergoing distortion, the change in shape causing non- constant integration of 5 the image in a non-linear proportion to the amount and speed of distortion. A theoretical model that expresses the image intensity I(x) at point x resulting from surface shape is as follows: I(x) oc E(x) dt cc (1 + ten A tan Theta) ax/m where E is exposure at point x, A is the angle of incidence of the structured 10 light sheet (a constant measured from the surface normal), Theta is the surface slope (measured from the horizontal), and m is the magnification (a constant determined by the focal length of the camera).

Therefore, product inspection apparatus and the method of inspection of the product in accordance with the present invention advantageously utilise a 15 reference structogram image of a defect-free master workpiece, which is then compared directly with the structogram image of a production workplace to obtain a measure of error, if any, between Me two structograms.

If an error occurs between these structograms the difference signal is utilised in a known manner to instruct a sorting apparatus, not shown, to 20 divert that particular workpiece to an imperfect workplace bin.

Furthermore, the error signal can be correlated with human judgements of deviation from the defect free workplace and it is therefore not necessary to obtain an absolute depth map from the structogram.

Conveniently, the light source 5 may comprise a laser, light emitting diode(s), a fluorescent lamp, or an incandescent lamp. Moreover, the slit 16 which is more suitable for use with a laser may be replaced by any other shaped opening suitable for the purpose of producing structured light.

S Conveniently the fluorescent can be a fluorescent strip lamp to provide the structured light source. Altematively, the structured broad-spread sheet of light can be provided with the use of optical lenses, such as a cylindrical lens.

an alternative embodiment of the present invention an algorithm may be specified from recovering a metric profile from the reference structogram lo image data. This algorithm converts each basic image pixel into a relative profile measurement (for example, relative height of each sampled point on the surface) by low-pass filtering the image to reduce noise, and integrating the structograrn pixel values along the direction of workpiece movement profile recovery algorithms required for converting the measured image into 15 height information are not unrelated to phase unwrapping, a technique lmown to practitioners of interferometry. This is not a precise comparison because the images obtained are not interferograms and therefore do not exhibit the discontinuities that occur in interferograms when phase changes by a multiple of 2 pi. However, like phase unwrapping, the profile recovery algorithTn is 20 sensitive to noise, and error propagates through the data. Also like phase unwrapping, there is no general solution to the problem and therefore the performance of the profile recovery algorithm depends on image quality. In turn, image quality depends on embodiment details such as We relative

locations of the projector and sensor, the speed of movement of the workpiece, the intensity and shape of the projected illumination, and the row transfer frequency of the TDI camera. The present invention does not exclude embodiments that contain the method step of calculating the metric profile 5 from the raw structogram data

Claims

CLAIMS:

1. A method of determining physical characteristics of the surface of a workpiece, comprising passing the worl iece below a structured light beam, 5 and utilising a time delay integration camera to capture the structured light reflected from the surface of the workpiece.

2. A method as claimed in Claim 1, comprising storing a digital

output representative of a stAructogram for that workpiece, and comparing the 10 structogramA with z reference structogram and rejecting any workpiece having a structogram outside predetermined tolerances.

3. A method as claimed in claim 1 or 2, comprising passing the workplaces through a beam of structured light comprising a sheet of light 15 projecting from a slit of a light source.

4. A method as claimed in any preceding claim, comprising storing the reference structogram in a control processor.

20

5. A method as claimed in claim 3, comprising instructing sorting means to direct the production workplace to a store of similar such workpieces.

I:

6. A method as claimed in any preceding claim, comprising moving the workplace through the field of view of the camera on a conveyor belt.

7. A method as claimed in claim 6, comprising controlling the speed 5 of movement of the conveyer belt by a shaft encoder electrically coupled with the control processor.

8. A method as claimed in claim 7, comprising controlling the operation of the light source and camera by the control processor. -^:

9. A method as claimed in claim 8, wherein controlling the operation of the light sources and camera is synchronised with the speed of movement of the conveyor belt in the control processor.

IS

10. An inspection apparatus to determine the physical characteristics of the surface of a workpiece, comprising light source means for emitting a structured light beam onto a workpiece arranged to pass under the light source, and a time delay integration camera located to capture structured light reflected by the surface of the workpiece.

11. An apparatus as claimed in claim 10, comprising storage means for storing a reference structogram and comparator means for comparing the reference structogram and a structogram of a production workplace arranged

to pass through the apparatus and rejecting a workplace having a structogram outside predetermined tolerances.

12. An apparatus as claimed in claim 10 or 11, comprising movable 5 means for moving the workplace through the structured light beam.

13. An apparatus as claimed in claim 12, wherein the movable means comprises a conveyor belt.

10

14. An apparatus as claimed in clann 13, comprising a control processor for controlling the speed at which the workplace is movable passed the structured light beam.

15. An apparatus as claimed in clann 14, comprising a shaft controller 15 electrically connected with the control processor so as to control the speed of movement of the conveyor belt.

16. An apparatus as claimed in any of clanns 10 to 15, comprising a light projector for transmitting said structured light beam.

17. An apparatus as claimed in clann 16, wherein the projector includes an elongate slit for restructuring the light transmitted therefrom into a sheet of light.

18. An apparatus as claimed in any of claims 10 to 17, comprising support means on which the light source and the time delay integration camera are mounted so as to transmit light onto a workpiece surface and 5 receive reflected light from the workpiece surface, respectively.

19. An apparatus as clanned in claim 18, when dependent on any of clanns 13 to 15, wherein the support means comprises a Maine through which the conveyor belt is arranged to move the workpiece beneath the light source 10 and time delay integration camera.;

20. A method of in-process inspection substantially as hereinbefore described with reference to, and as illustrated in, the accompanying drawings.

15

21. An in-process inspection apparatus substantially as hereinbefore described with reference to, and as illustrated in, the accompanying drawings.