EP2325625A1 - Inspection system - Google Patents
Inspection system Download PDFInfo
- Publication number
- EP2325625A1 EP2325625A1 EP08792309A EP08792309A EP2325625A1 EP 2325625 A1 EP2325625 A1 EP 2325625A1 EP 08792309 A EP08792309 A EP 08792309A EP 08792309 A EP08792309 A EP 08792309A EP 2325625 A1 EP2325625 A1 EP 2325625A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- imaging
- section
- image data
- grid pattern
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/89—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
- G01N21/892—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles characterised by the flaw, defect or object feature examined
- G01N21/896—Optical defects in or on transparent materials, e.g. distortion, surface flaws in conveyed flat sheet or rod
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/958—Inspecting transparent materials or objects, e.g. windscreens
Definitions
- This invention relates to an inspection system to extract and inspect a distortion existing inside of a transparent platy body such as a glass plate or a flaw or a foreign material (hereinafter also collectively called as a defect) existing on a surface of a mirror-finished platy body based on an imaged image.
- a transparent platy body such as a glass plate or a flaw or a foreign material (hereinafter also collectively called as a defect) existing on a surface of a mirror-finished platy body based on an imaged image.
- a CCD is often utilized as a line sensor for this kind of the inspection system.
- the line sensor has an arrangement wherein multiple photodiodes are arranged in line and CCDs are arranged in parallel to correspond to each of the photo diodes. Then, electric charge generated due to exposure of the photodiode is charged to the CCD and the charged electric charge is read out respectively so that a line of the image data is produced.
- the TDI method is to synchronize a moving speed of an object projected to the CCD in a direction of a column with a timing of transferring the electric charge in a vertical direction and to conduct an integral exposure by a number of vertical steps (for example, "M" steps) by utilizing a property that the electric charge is vertically transferred by a unit of a column at a time of reading out the electric charge, where the CCD is arranged in two-dimensions, so that a sensitivity by "M" times of an ordinary linear image sensor can be realized.
- the identical position of the object is imaged at "M" times and all of the imaged images are overlapped so as to improve the sensitivity.
- Moire fringes are formed on the image data by making use of a grid pattern and a defect is detected based on a disorder of a sine wave appearing on the Moire fringes.
- the disorder of the sine wave is detected by producing the data for inspection by providing a predetermined calculation of an output value of each of the imaging elements such as the CCD.
- the present claimed invention intends to solve all of the problems and to provide an inspection system that can calculate the data for inspection having a high S/N ratio and high accuracy with high freedom.
- an inspection system in accordance with this invention comprises an imaging device having multiple imaging elements arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, an imaging control section that receives a light intensity signal from all or a part of the imaging elements at a predetermined imaging timing and stores each detected light intensity value indicated by the light intensity signal as two-dimensional image data in an image storage area set in a memory, and an image processing section that produces data for inspection by processing the two dimensional image data, and the imaging device images an object while the object is moved relative to the imaging device in the X-axis direction.
- the imaging control section adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object to move by "m" pixels ("m” is an integer number greater than or equal to 1) in the X-axis direction on the imaging elements, with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements and to store it as a single unit of two-dimensional image data in accordance with the object in the image storage area
- the image processing section comprises a specifying section that specifies partial image data imaged at the identical inspection position on the object respectively from the two-dimensional image data based on the object appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data imaged at each of the imaging timings, and a data producing section that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data.
- a grid pattern forming device that forms a grid pattern wherein grid units comprising
- the optical distortion calculating section may comprise a sine wave producing section that extracts and produces multiple kinds of sine waves whose phases are displaced by 90° respectively from the image data of the Moire fringes, a phase angle calculating section that calculates a phase angle of the Moire fringes at each of the imaging elements from each of the sine waves, and a distortion amount calculating section that calculates the optical distortion amount from a difference of the phase angles between each of the imaging elements.
- This invention can be applied to not only the inspection system but also an imaging device having less noise.
- the imaging device may comprise multiple imaging elements arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, an imaging control section that receives a light intensity signal from all or a part of the imaging elements at a predetermined imaging timing and stores each light intensity value indicated by the light intensity signal in an image storage area set in a memory as two-dimensional image data, and an image processing section that produces noise-reduced data by processing the two-dimensional image data, wherein an object is imaged while the object is moved relative to the imaging device in the X-axis direction, and characterized in that the imaging control section adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object to move by "m" pixels ("m" is an integer number greater than or equal to 1) in the X-axis direction on the imaging elements, with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements and to store it as a single unit of two-
- the present claimed invention is also applied to an inspection method.
- the inspection method may be an inspection method that images and inspects the object by the use of an imaging device while the object is moved in an X-axis direction relative to the imaging device, the imaging device having multiple imaging elements arranged in two-dimensions along the X-axis and a Y-axis, which are two virtual orthogonal axes, and an imaging control section that receives a light intensity signal from all or a part of the imaging elements at a predetermined imaging timing and stores each light intensity value indicated by the light intensity signal in an image storage area set in a memory as two-dimensional image data, and characterized by comprising a synchronizing step that adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object to move by "m" pixels ("m" is an integer number greater than or equal to 1) in the X-axis direction on the imaging elements, with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements and to store it as a single unit of two-
- the detected light intensity value from each of the imaging elements is stored once in the image storage area every time the image is taken and a calculation is conducted on the data stored in the image storage area, merits can be enjoyed such that there is a lot of flexibility in an arithmetic processing so that various processing can be conducted easily compared with a case that data for every imaging is automatically integrated like the TDI.
- an inexpensive area image sensor such as a CMOS sensor can be used as the imaging element, a cost can be reduced.
- each optical distortion amount calculated at the identical position of the object is measured at portions where the grid pattern is different, it is possible to reduce a cause of the noise such as the fluctuation of the width of the bright section and the dark section of the grid pattern, the fluctuation of the width (the pitch width) of the grid units, or dust on the grid pattern, and only the optical distortion of the glass board can be emphasized by integrating the amount of the optical distortion. Then an S/N ratio is improved so that a measurement can be conducted accurately.
- An inspection system 100 in accordance with this invention comprises, as shown in Fig. 1 , a grid pattern forming device 1 and an imaging device 2 and is so arranged to move a transparent glass board W, which is an object to be inspected, in one direction between the grid pattern forming device 1 and the imaging device 2 by means of a transporting device, not shown in drawings, for scanning and imaging.
- the grid pattern forming device 1 forms a grid pattern 11 comprising continuous multiple grid units 1a each of which comprises a bright section and a dark section having a constant width.
- the grid pattern 11 is depicted on a long rectangular plate.
- the long rectangular plate may be backlit from behind or a grid pattern may be formed by arranging a light source such as an LED or a fluorescent light and a shielding member alternately.
- the grid pattern forming device 1 is arranged on a back surface of the glass board W with a direction of repeating the bright section and the dark section orthogonal to a direction of moving the glass board W.
- the transporting device utilizes a roller that moves the glass board W at a constant speed, for example, by pinching side edge sections of the glass board W from a direction of its thickness.
- the transporting device may be, for example, an X-Y stage.
- the imaging device 2 comprises, as shown in Fig. 1 and Fig. 5 , an optical member 21, multiple imaging elements 22 arranged at a back side of the optical member 21 and an information processing device 23 that receives and processes a light intensity signal from each of the imaging elements 22, each of which is housed in a body.
- An imaging surface of the imaging device 2 is arranged to face a surface (a surface to be inspected) of the glass board W .
- the optical member 21 comprises a combination of lenses and its focal point is adjusted to the grid pattern 11.
- the imaging element 22 uses, for example, a CMOS sensor.
- CMOS sensor is relatively inexpensive and an amplifier is integrally incorporated into each photodiode (not shown in drawings) as being a light sensitive element so that it is easy to read out the light intensity signal.
- a CCD or other imaging element may be used as the imaging element 22.
- An imaging element group in a rectangular plate shape is formed, as shown in Fig. 1 and Fig. 3 , by arranging the imaging elements 22 two-dimensionally along an X-axis and a Y-axis, which are two virtual orthogonal axes.
- a posture of the imaging device 2 is so set that a direction of the X-axis coincides with a moving direction of the glass board W and the X-Y plane is parallel to the surface of the glass board W .
- ⁇ Moire fringes determined by a value of ⁇ , which is a deviance, appear on the two-dimensional image data.
- a relationship between the imaging elements 22 and the grid pattern 11 is shown in Fig. 4 .
- the imaging device 2 comprises a two-dimensional area sensor (a group of imaging elements 22 arranged two-dimensionally), however, the imaging elements 22 arranged in a line along the Y-axis direction of the two-dimensional area sensor are used for this inspection system 100 as a function of the line sensor (detail will be described later).
- the information processing device 23 physically comprises, as shown in Fig. 5 , a CPU 231, a memory 232 and an I/O port 233 for communication, and is incorporated into the body of the imaging device 2. As shown in Fig. 6 , the information processing device 23 produces the functions of an imaging control section 3 and an image processing section 4 by cooperatively working the CPU 231 or its peripheral devices based on a program set in a predetermined area of the memory 232. All of the functions of the information processing device 23 are not necessarily incorporated into the body. For example, a part of the functions (especially the image processing section 4) may be produced by other computers by making the information processing device 23 communicable with other computers. Next, each of the above-mentioned function sections will be explained.
- the imaging control section 3 receives the light intensity signal from each of the imaging elements 22 at a predetermined imaging timing and stores each value of the light intensity shown by the light intensity signal as the two-dimensional image data in an image storage area D1 set in the memory 232.
- the imaging timing is adjusted so that a unit moving time of the projected image of the glass board W, which is a time for the projected image to move by one pixel in the X-axis direction on the imaging element 22, is synchronized with an imaging time interval, which is a time interval when the light intensity signal is received from the imaging element 22 and stored in the image storage area D1 as a single unit of two-dimensional image data in accordance with the object.
- the image processing section 4 produces data for inspection by processing the two-dimensional image data in the image storage area D1. More concretely, as shown in Fig. 6 , the image processing section 4 comprises a specifying section 41 that specifies each section of the partial image data imaged at the identical inspection position on the glass board W from each unit of the two-dimensional image data, respectively, based on an image of the glass board W appearing deviated by one pixel in the X-axis direction in each unit of the two-dimensional data imaged at each of the imaging timings, namely, stored in the image storage area D1, and a data producing section 42 that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data.
- a specifying section 41 specifies each section of the partial image data imaged at the identical inspection position on the glass board W from each unit of the two-dimensional image data, respectively, based on an image of the glass board W appearing deviated by one pixel in the X-axis direction in each unit of the two-dimensional data
- the data producing section 42 comprises an optical distortion calculating section 421 that calculates an amount of the optical distortion generated at each section of the partial image data at the inspection position based on the Moire fringes (shown in Fig. 8 ) appearing on the partial image data due to the grid pattern 11 and a noise reducing section 422 that integrates and averages the amount of the optical distortion in accordance with each section of the partial image data and produces the data for inspection.
- an optical distortion calculating section 421 that calculates an amount of the optical distortion generated at each section of the partial image data at the inspection position based on the Moire fringes (shown in Fig. 8 ) appearing on the partial image data due to the grid pattern 11
- a noise reducing section 422 that integrates and averages the amount of the optical distortion in accordance with each section of the partial image data and produces the data for inspection.
- the optical distortion calculating section 421 comprises a sine wave producing section 421a that extracts and produces several different kinds of the sine waves whose phases deviate by 90° respectively from the image data of the Moire fringes, a phase angle calculating section 421b that calculates a phase angle of the Moire fringes in each of the imaging elements 22 from each of the sine waves, and a distortion amount calculating section 421c that calculates the amount of the optical distortion from a difference of the phase angles between the imaging elements 22.
- the imaging device 2 When the glass board W is transported, the imaging device 2 obtains two-dimensional image data imaged in a certain area of the grid pattern 11 and the glass board W passes over the grid pattern 11 one after another at the imaging timing synchronized with the moving speed of the glass board W and transfers the two-dimensional image data to the image storage area D1 and stores it.
- a number of the stored two-dimensional image data is a number of pieces of the imaging elements 22 of the grid pattern image appearing on the imaging elements 22 in a width along the X-axis. In this embodiment, the number of the imaging elements 22 is set as "M" pieces.
- an image processing is conducted on the partial image data obtained from one predetermined line along the Y-axis of the imaging elements 22, namely a detected light intensity value of each of the imaging elements 22.
- one predetermined line of the imaging elements 22 is, as shown by a black border in Fig. 7(a) , one line located at the most end part of the grid pattern image of the imaging elements 22.
- this line of the imaging elements is hereinafter denoted as 22(1).
- a graph (namely, the partial image data) made for this line of the imaging elements 22(1) with a number of the imaging elements plotted on the X-axis and the detected value of the light intensity from each of the imaging elements plotted on the Y-axis shows a zonal line due to the grid pattern 11, and the width of the zonal line fluctuates in a constant cycle and then the Moire fringes appear as shown in Fig. 8 .
- the Moire fringes will form a most perfect sine wave and the phase angle of the detected light intensity value of each of the imaging elements 22 will increase constantly according to the most perfect sine wave. Practically the phase angle will increase from 0°to 359°and return to 0°. Then the graph of the ideal phase angle of each of the imaging elements 22 shows a triangle wave as shown in Fig. 10 . If a calculation is conducted by considering a change of the phase angle from 359°to 0°and a difference between the adjacent imaging elements 22 is plotted on the Y-axis and an order of each of the imaging elements 22 is plotted on the X-axis, the graph shows a horizontal straight line.
- the amount of the optical distortion can be calculated from an amount of the peak.
- a line of the imaging element 22(2) that is next to the first one line of the imaging element 22(1) used for calculating the optical distortion is specified as the partial image data imaged at the identical position of the glass board W, and the amount of the optical distortion is calculated from the partial image data obtained from the imaging element 22(2), namely, the detected light intensity value of each of the imaging elements 22 by means of the same procedure as that of the above-mentioned.
- the amount of the optical distortion is calculated based on the detected light intensity value from the imaging element 22(3) in the third two-dimensional image data.
- the amount of the optical distortion is calculated by conducting the same procedure on the two-dimensional image data imaged continuously at "M" times.
- the data in accordance with the final amount of the optical distortion wherein a noise is reduced namely the data for inspection is produced by integrating and averaging "M" pieces of the calculated amounts of the optical distortion.
- each amount of the optical distortion calculated from the identical position of the glass board W is measured at a position where the grid pattern 11 differs respectively, it is possible to reduce a cause of the noise such as the fluctuation of the width of the bright section and the dark section of the grid pattern 11, the fluctuation of the width (the pitch width) of the grid unit 1a or the dust on the grid pattern 11, and only the optical distortion of the glass board W can be emphasized by integrating each of the amounts of the optical distortion. Then an S/N ratio is improved so that a measurement can be conducted accurately.
- the detected light intensity value from each of the imaging elements 22 is stored once in the image storage area D1 every time the image is taken and a calculation is conducted on the data stored in the image storage area D1, there is a lot of flexibility in the arithmetic processing so that various processing can be conducted easily compared with a case that data for every imaging is automatically integrated like the above-mentioned TDI.
- the present claimed invention is not limited to the above-mentioned embodiment.
- the amount of the optical distortion is calculated by focusing on only one line of the imaging element 22 in the above-mentioned embodiment, however, it is also possible to calculate the amount of the optical distortion across a broader range by conducting parallel processing on multiple lines (for example, two lines) of the imaging elements 22 as shown in Fig. 12 .
- the multiple lines may be separated or continuous.
- the grid pattern 11 may be arranged so as to have the direction of repeating the bright section and the dark section in the grid pattern 11 coincide with a relative moving direction of the glass board W as shown in Fig. 13 .
- the amount of the optical distortion is calculated by using a part or all of one line of the imaging elements 22 along the X-direction by means of the same procedure as that of the above-mentioned.
- a length of the grid pattern 11 in the X-direction on the imaging element 22 has to be longer than a number of one line of the imaging elements 22 used in the above-mentioned calculation of the optical distortion.
- the light intensity signal from all of the imaging elements is transferred to and stored in the image storage area as the two-dimensional image data at every imaging timing, however, only partial image data may be transferred to and stored in the image storage area.
- only partial image data imaged at the identical position of an object may be transferred to the storage area and then the amount of the optical distortion is calculated by conducting an image processing on the partial image data.
- the object to be inspected is the transparent board in the above-mentioned embodiment, however, this invention may be applied also to an opaque object with a mirror finish.
- the imaging device 2 and the grid forming device may be arranged at the same side as the object to be inspected so that the light from the grid pattern 11 reflects on a surface to be inspected of the object and is taken into the imaging device 2.
- image data with reduced noise may be output without calculating the amount of the optical distortion from each of the partial image data.
- the detected light intensity value from each of the imaging elements is stored once in the image storage area every time the image is taken and a calculation is conducted on the data stored in the image storage area, there is a lot of flexibility in the arithmetic processing so that various processing can be conducted easily compared with a case that data for every imaging is automatically integrated like the TDI.
Landscapes
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Immunology (AREA)
- Physics & Mathematics (AREA)
- Biochemistry (AREA)
- Engineering & Computer Science (AREA)
- Textile Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Processing (AREA)
Abstract
An object of this invention is to provide an inspection system (100) that can calculate highly accurate data for inspection having a high S/N ratio with high freedom. In order to attain this object, an imaging timing is adjusted so as to synchronize a time for a projected image of an object (W) to move by "m" pixels ("m" is an integer number greater than or equal to 1) in the X-axis direction on imaging elements (22), with an imaging time interval, and partial image data imaged at the identical inspection position on the object (W) is specified from each unit of two-dimensional image data based on the object (W) appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data imaged at each of the imaging timings, and data for inspection in which a noise reducing processing is conducted at the inspection position is produced based on each section of the partial image data.
Description
- This invention relates to an inspection system to extract and inspect a distortion existing inside of a transparent platy body such as a glass plate or a flaw or a foreign material (hereinafter also collectively called as a defect) existing on a surface of a mirror-finished platy body based on an imaged image.
- A CCD is often utilized as a line sensor for this kind of the inspection system. The line sensor has an arrangement wherein multiple photodiodes are arranged in line and CCDs are arranged in parallel to correspond to each of the photo diodes. Then, electric charge generated due to exposure of the photodiode is charged to the CCD and the charged electric charge is read out respectively so that a line of the image data is produced.
- Since it is not possible for this kind of line sensor to conduct a next exposure until an electric charge charged to the CCD is read out and reset, it is relatively difficult to significantly shorten an interval of exposure, namely, an imaging interval, if a reset time is also included. However, by conversely utilizing the property that an electric charge is stored in succession until the CCD is reset, recently a line sensor has been developed that employs a TDI (Time Delay Integration) method which can conduct sensing at high speed and high accuracy.
- The TDI method is to synchronize a moving speed of an object projected to the CCD in a direction of a column with a timing of transferring the electric charge in a vertical direction and to conduct an integral exposure by a number of vertical steps (for example, "M" steps) by utilizing a property that the electric charge is vertically transferred by a unit of a column at a time of reading out the electric charge, where the CCD is arranged in two-dimensions, so that a sensitivity by "M" times of an ordinary linear image sensor can be realized. In short, the identical position of the object is imaged at "M" times and all of the imaged images are overlapped so as to improve the sensitivity.
- Patent document 1: Japan Patent Laid-open number
2004-251878 - With this TDI method, however, the electric charge of the CCD at each imaging timing is simply integrated. Accordingly, the above-mentioned TDI linear image sensor cannot be used for the purpose of constructing useful image data with an improved S/N ratio by providing some sort of calculation on an electric charge amount at each of the imaging timings followed by integrating the calculation results. In addition, there is also a problem that the CCD used for TDI is expensive.
- For example, with a defect detecting device shown in the
patent document 1 that has been applied and patented by the present claimed inventor, Moire fringes are formed on the image data by making use of a grid pattern and a defect is detected based on a disorder of a sine wave appearing on the Moire fringes. In this case, the disorder of the sine wave is detected by producing the data for inspection by providing a predetermined calculation of an output value of each of the imaging elements such as the CCD. In order to improve the S/N ratio for this defect detecting device, it is useful to integrate by multiple times the output value of each of the imaging elements on which the predetermined calculation is provided, however, it is difficult to use the TDI linear image sensor for this purpose. - The present claimed invention intends to solve all of the problems and to provide an inspection system that can calculate the data for inspection having a high S/N ratio and high accuracy with high freedom.
- More specifically, an inspection system in accordance with this invention comprises an imaging device having multiple imaging elements arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, an imaging control section that receives a light intensity signal from all or a part of the imaging elements at a predetermined imaging timing and stores each detected light intensity value indicated by the light intensity signal as two-dimensional image data in an image storage area set in a memory, and an image processing section that produces data for inspection by processing the two dimensional image data, and the imaging device images an object while the object is moved relative to the imaging device in the X-axis direction.
- Then the imaging control section adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object to move by "m" pixels ("m" is an integer number greater than or equal to 1) in the X-axis direction on the imaging elements, with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements and to store it as a single unit of two-dimensional image data in accordance with the object in the image storage area, and the image processing section comprises a specifying section that specifies partial image data imaged at the identical inspection position on the object respectively from the two-dimensional image data based on the object appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data imaged at each of the imaging timings, and a data producing section that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data.
- As an inspection system wherein an effect of this invention is especially remarkable, the inspection system may further comprise a grid pattern forming device that forms a grid pattern wherein grid units comprising a bright section and a dark section having a constant width are continuously arranged, and the grid pattern is arranged at a focal position of the imaging device and the object is arranged on an optical path between the grid pattern and the imaging device respectively, "n" ("n" is an integer number greater than or equal to 1) pieces of the grid unit are so arranged to correspond to Xn±α (X=4p (p is an integer number greater than or equal to 1), α<<n) pieces of the imaging elements in the projected image of the grid pattern on the imaging elements, and the data producing section comprises an optical distortion calculating section that calculates an optical distortion amount generated at each section of the partial image data at the inspection position from Moire fringes appearing on the partial image data due to the grid pattern, and a noise reducing section that integrates the optical distortion amount in accordance with each section of the partial image data and produces the data for inspection.
- As a concrete arrangement of the optical distortion calculating section, the optical distortion calculating section may comprise a sine wave producing section that extracts and produces multiple kinds of sine waves whose phases are displaced by 90° respectively from the image data of the Moire fringes, a phase angle calculating section that calculates a phase angle of the Moire fringes at each of the imaging elements from each of the sine waves, and a distortion amount calculating section that calculates the optical distortion amount from a difference of the phase angles between each of the imaging elements.
- This invention can be applied to not only the inspection system but also an imaging device having less noise.
- The imaging device may comprise multiple imaging elements arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, an imaging control section that receives a light intensity signal from all or a part of the imaging elements at a predetermined imaging timing and stores each light intensity value indicated by the light intensity signal in an image storage area set in a memory as two-dimensional image data, and an image processing section that produces noise-reduced data by processing the two-dimensional image data, wherein an object is imaged while the object is moved relative to the imaging device in the X-axis direction, and characterized in that the imaging control section adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object to move by "m" pixels ("m" is an integer number greater than or equal to 1) in the X-axis direction on the imaging elements, with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements and to store it as a single unit of two-dimensional image data in accordance with the object in the image storage area, and the image processing section comprises a specifying section that specifies partial image data imaged at the identical position on the object respectively from each unit of the two-dimensional image data based on the object appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data imaged at each of the imaging timings, and a data producing section that produces noise-reduced data in which a noise reducing process is provided at the position based on each section of the partial image data.
- In addition, the present claimed invention is also applied to an inspection method.
- More specifically, the inspection method may be an inspection method that images and inspects the object by the use of an imaging device while the object is moved in an X-axis direction relative to the imaging device, the imaging device having multiple imaging elements arranged in two-dimensions along the X-axis and a Y-axis, which are two virtual orthogonal axes, and an imaging control section that receives a light intensity signal from all or a part of the imaging elements at a predetermined imaging timing and stores each light intensity value indicated by the light intensity signal in an image storage area set in a memory as two-dimensional image data, and characterized by comprising a synchronizing step that adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object to move by "m" pixels ("m" is an integer number greater than or equal to 1) in the X-axis direction on the imaging elements, with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements and to store it as a single unit of two-dimensional image data in accordance with the object in the image storage area, a specifying step that specifies partial image data imaged at the identical inspection position on the object in the multiple units of two-dimensional image data imaged at each of the imaging timings based on the object appearing deviated by "m" pixels in the X-axis direction in each of the units of two-dimensional image data due to a difference of the imaging time, and a data producing step that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data.
- In this case, it is more preferable if a grid pattern, wherein grid units comprising a bright section and a dark section having a constant width are continuously arranged, is arranged at a focal position of the imaging device and the object is arranged on an optical path between the grid pattern and the imaging device respectively, and "n" ("n" is an integer number greater than or equal to 1) pieces of the grid unit are so arranged to correspond to Xn±α (X=4p (p is an integer number greater than or equal to 1), α<<n) pieces of the imaging elements in the projected image of the grid pattern on the imaging elements, and an optical distortion calculating step is performed that calculates an optical distortion amount generated at each section of the partial image data from Moire fringes appearing on the partial image data due to the grid pattern, and a noise reducing step is performed that integrates the optical distortion amount in accordance with each section of the partial image data and produces the data for inspection, in the data producing step.
- In accordance with this invention, since the detected light intensity value from each of the imaging elements is stored once in the image storage area every time the image is taken and a calculation is conducted on the data stored in the image storage area, merits can be enjoyed such that there is a lot of flexibility in an arithmetic processing so that various processing can be conducted easily compared with a case that data for every imaging is automatically integrated like the TDI. In addition, since an inexpensive area image sensor such as a CMOS sensor can be used as the imaging element, a cost can be reduced.
- Furthermore, since each optical distortion amount calculated at the identical position of the object is measured at portions where the grid pattern is different, it is possible to reduce a cause of the noise such as the fluctuation of the width of the bright section and the dark section of the grid pattern, the fluctuation of the width (the pitch width) of the grid units, or dust on the grid pattern, and only the optical distortion of the glass board can be emphasized by integrating the amount of the optical distortion. Then an S/N ratio is improved so that a measurement can be conducted accurately.
-
-
Fig. 1 is an overall pattern diagram of an inspection system in accordance with one embodiment of the present claimed invention. -
Fig. 2 is a front view of a grid forming device in accordance with this embodiment. -
Fig. 3 is a front view of an imaging element group in accordance with this embodiment. -
Fig. 4 is a relation explanatory view showing a relationship between a grid unit width and a number of an imaging element in accordance with this embodiment. -
Fig. 5 is a physical structure view of an information processing unit in accordance with this embodiment. -
Fig. 6 is a functionally internal structure view of an imaging device in accordance with this embodiment. -
Fig. 7 is an explanatory view of an inspection position specifying method in order to explain a method for specifying an inspection position in this embodiment. -
Fig. 8 is a graph showing image data and Moire fringes in this embodiment. -
Fig. 9 is a graph showing a sine wave extracted from the Moire fringes in this embodiment. -
Fig. 10 is a graph showing a phase angle of each imaging element calculated from the sine wave in this embodiment. -
Fig. 11 is a graph showing an amount of the optical distortion calculated after the phase angle is calculated in this embodiment. -
Fig. 12 is an explanatory view of an inspection position specifying method in order to explain a method for specifying an inspection position in another embodiment of this invention. -
Fig. 13 is an explanatory view of a method for specifying an inspection position in order to explain a method for specifying an inspection position in a further different embodiment of this invention. -
Fig. 14 is an overall pattern diagram of an inspection system in accordance with a further different embodiment of the present claimed invention. -
- 100
- inspection system
- 1
- grid pattern forming device
- 11
- grid pattern
- 1a
- grid unit
- 2
- imaging device
- 22
- imaging element (CMOS sensor)
- 232
- memory
- 3
- imaging control section
- 4
- image processing section
- 41
- specifying section
- 42
- data producing section
- 421
- optical distortion calculating section
- 422
- noise reducing section
- 421a
- sine wave producing section
- 421b
- phase angle calculating section
- 421c
- distortion amount calculating section
- D1
- image storage area
- One embodiment of the present claimed invention will be explained with reference to drawings.
- An
inspection system 100 in accordance with this invention comprises, as shown inFig. 1 , a gridpattern forming device 1 and animaging device 2 and is so arranged to move a transparent glass board W, which is an object to be inspected, in one direction between the gridpattern forming device 1 and theimaging device 2 by means of a transporting device, not shown in drawings, for scanning and imaging. - As shown in
Fig. 1 andFig. 2 , the gridpattern forming device 1 forms agrid pattern 11 comprising continuousmultiple grid units 1a each of which comprises a bright section and a dark section having a constant width. In this embodiment, thegrid pattern 11 is depicted on a long rectangular plate. In addition, for example, the long rectangular plate may be backlit from behind or a grid pattern may be formed by arranging a light source such as an LED or a fluorescent light and a shielding member alternately. The gridpattern forming device 1 is arranged on a back surface of the glass board W with a direction of repeating the bright section and the dark section orthogonal to a direction of moving the glass board W. - The transporting device, not shown in drawings, utilizes a roller that moves the glass board W at a constant speed, for example, by pinching side edge sections of the glass board W from a direction of its thickness. In addition to this, the transporting device may be, for example, an X-Y stage.
- The
imaging device 2 comprises, as shown inFig. 1 andFig. 5 , anoptical member 21,multiple imaging elements 22 arranged at a back side of theoptical member 21 and aninformation processing device 23 that receives and processes a light intensity signal from each of theimaging elements 22, each of which is housed in a body. An imaging surface of theimaging device 2 is arranged to face a surface (a surface to be inspected) of the glass board W. - If the
imaging device 2 is described in detail, theoptical member 21 comprises a combination of lenses and its focal point is adjusted to thegrid pattern 11. - In this embodiment, the
imaging element 22 uses, for example, a CMOS sensor. The reason is that the CMOS sensor is relatively inexpensive and an amplifier is integrally incorporated into each photodiode (not shown in drawings) as being a light sensitive element so that it is easy to read out the light intensity signal. A CCD or other imaging element may be used as theimaging element 22. - An imaging element group in a rectangular plate shape is formed, as shown in
Fig. 1 andFig. 3 , by arranging theimaging elements 22 two-dimensionally along an X-axis and a Y-axis, which are two virtual orthogonal axes. In this embodiment, a posture of theimaging device 2 is so set that a direction of the X-axis coincides with a moving direction of the glass board W and the X-Y plane is parallel to the surface of the glass board W. In addition, a distance between theimaging device 2 and thegrid pattern 11 or an imaging magnification is so set that "n" ("n" is an integer number greater than or equal to 1) pieces of thegrid unit 1a correspond to Xn±α (X=4p (p is an integer number greater than or equal to 1), α<<n) pieces of theimaging elements 22 in the projected image of thegrid pattern 11 on theimaging element 22. With this arrangement, Moire fringes determined by a value of α, which is a deviance, appear on the two-dimensional image data. To help understanding, a relationship between theimaging elements 22 and thegrid pattern 11 is shown inFig. 4 . As mentioned, theimaging device 2 comprises a two-dimensional area sensor (a group ofimaging elements 22 arranged two-dimensionally), however, theimaging elements 22 arranged in a line along the Y-axis direction of the two-dimensional area sensor are used for thisinspection system 100 as a function of the line sensor (detail will be described later). - The
information processing device 23 physically comprises, as shown inFig. 5 , aCPU 231, amemory 232 and an I/O port 233 for communication, and is incorporated into the body of theimaging device 2. As shown inFig. 6 , theinformation processing device 23 produces the functions of animaging control section 3 and animage processing section 4 by cooperatively working theCPU 231 or its peripheral devices based on a program set in a predetermined area of thememory 232. All of the functions of theinformation processing device 23 are not necessarily incorporated into the body. For example, a part of the functions (especially the image processing section 4) may be produced by other computers by making theinformation processing device 23 communicable with other computers. Next, each of the above-mentioned function sections will be explained. - The
imaging control section 3 receives the light intensity signal from each of theimaging elements 22 at a predetermined imaging timing and stores each value of the light intensity shown by the light intensity signal as the two-dimensional image data in an image storage area D1 set in thememory 232. In this embodiment, the imaging timing is adjusted so that a unit moving time of the projected image of the glass board W, which is a time for the projected image to move by one pixel in the X-axis direction on theimaging element 22, is synchronized with an imaging time interval, which is a time interval when the light intensity signal is received from theimaging element 22 and stored in the image storage area D1 as a single unit of two-dimensional image data in accordance with the object.
Theimage processing section 4 produces data for inspection by processing the two-dimensional image data in the image storage area D1. More concretely, as shown inFig. 6 , theimage processing section 4 comprises a specifyingsection 41 that specifies each section of the partial image data imaged at the identical inspection position on the glass board W from each unit of the two-dimensional image data, respectively, based on an image of the glass board W appearing deviated by one pixel in the X-axis direction in each unit of the two-dimensional data imaged at each of the imaging timings, namely, stored in the image storage area D1, and adata producing section 42 that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data. - In addition, the
data producing section 42 comprises an opticaldistortion calculating section 421 that calculates an amount of the optical distortion generated at each section of the partial image data at the inspection position based on the Moire fringes (shown inFig. 8 ) appearing on the partial image data due to thegrid pattern 11 and anoise reducing section 422 that integrates and averages the amount of the optical distortion in accordance with each section of the partial image data and produces the data for inspection. - Furthermore, if the optical
distortion calculating section 421 is described in more detail, the opticaldistortion calculating section 421 comprises a sinewave producing section 421a that extracts and produces several different kinds of the sine waves whose phases deviate by 90° respectively from the image data of the Moire fringes, a phaseangle calculating section 421b that calculates a phase angle of the Moire fringes in each of theimaging elements 22 from each of the sine waves, and a distortionamount calculating section 421c that calculates the amount of the optical distortion from a difference of the phase angles between theimaging elements 22. - Next, the
inspection system 100 having the above arrangement will be explained by focusing on an operation of theimaging device 2 with reference toFig. 7 . - When the glass board W is transported, the
imaging device 2 obtains two-dimensional image data imaged in a certain area of thegrid pattern 11 and the glass board W passes over thegrid pattern 11 one after another at the imaging timing synchronized with the moving speed of the glass board W and transfers the two-dimensional image data to the image storage area D1 and stores it. A number of the stored two-dimensional image data is a number of pieces of theimaging elements 22 of the grid pattern image appearing on theimaging elements 22 in a width along the X-axis. In this embodiment, the number of theimaging elements 22 is set as "M" pieces. - Next, in the first two-dimensional image data, an image processing is conducted on the partial image data obtained from one predetermined line along the Y-axis of the
imaging elements 22, namely a detected light intensity value of each of theimaging elements 22. - If explained more concretely, one predetermined line of the
imaging elements 22 is, as shown by a black border inFig. 7(a) , one line located at the most end part of the grid pattern image of theimaging elements 22. In order to classify theimaging elements 22, this line of the imaging elements is hereinafter denoted as 22(1). A graph (namely, the partial image data) made for this line of the imaging elements 22(1) with a number of the imaging elements plotted on the X-axis and the detected value of the light intensity from each of the imaging elements plotted on the Y-axis shows a zonal line due to thegrid pattern 11, and the width of the zonal line fluctuates in a constant cycle and then the Moire fringes appear as shown inFig. 8 . - Next, several different kinds of the sine waves having phases deviated by 90° respectively are extracted from the Moire fringes (refer to
Fig. 9 ). Then a phase angle of the Moire fringes appearing on the detected light intensity value of each of theimaging elements 22 is calculated from each of the sine waves (refer toFig. 10 ). The amount of the optical distortion is calculated from a difference of the phase angles between theimaging elements 22. - The principle that the amount of the optical distortion can be calculated from the difference of the phase angles between the
imaging elements 22 will now be conceptually explained (refer to thepatent document 1 for more detail). - On the condition that there is no defect on the glass board W so that no optical distortion is generated, the Moire fringes will form a most perfect sine wave and the phase angle of the detected light intensity value of each of the
imaging elements 22 will increase constantly according to the most perfect sine wave. Practically the phase angle will increase from 0°to 359°and return to 0°. Then the graph of the ideal phase angle of each of theimaging elements 22 shows a triangle wave as shown inFig. 10 . If a calculation is conducted by considering a change of the phase angle from 359°to 0°and a difference between theadjacent imaging elements 22 is plotted on the Y-axis and an order of each of theimaging elements 22 is plotted on the X-axis, the graph shows a horizontal straight line. - Meanwhile, if an optical distortion is generated due to a defect of the glass board W, the Moire fringes are disturbed and the disturbance makes a peak as shown in
Fig. 11 on the graph of the horizontal straight line. The amount of the optical distortion can be calculated from an amount of the peak. - However, practically noise is generated due to white noise of the
imaging elements 22, fluctuation of a width of the bright section and the dark section of thegrid pattern 11, fluctuation of a width (a pitch width) of thegrid units 1a, or dust on thegrid pattern 11. As shown in a graph ofFig. 11 , the noise appears as fine waves. Then since a subtle surge or an irregularity on the surface of the glass board W can appear as a peak having a smaller height than that of the fine waves, there might be a case of failing to detect the subtle surge or the irregularity on the surface of the glass board W because it is buried in the noise. - In this embodiment, since the image of the glass board W in the two-dimensional image data obtained in the next imaging timing appears deviated by one pixel in the X-axis direction from the image of the first two-dimensional image data (refer to
Fig. 7(b) ), a line of the imaging element 22(2) that is next to the first one line of the imaging element 22(1) used for calculating the optical distortion is specified as the partial image data imaged at the identical position of the glass board W, and the amount of the optical distortion is calculated from the partial image data obtained from the imaging element 22(2), namely, the detected light intensity value of each of theimaging elements 22 by means of the same procedure as that of the above-mentioned. Next, the amount of the optical distortion is calculated based on the detected light intensity value from the imaging element 22(3) in the third two-dimensional image data. - Since the
grid pattern 11 has a width of multiple pixels (for example, "M" pixels) in the X-axis direction, the amount of the optical distortion is calculated by conducting the same procedure on the two-dimensional image data imaged continuously at "M" times. - Next, the data in accordance with the final amount of the optical distortion wherein a noise is reduced, namely the data for inspection is produced by integrating and averaging "M" pieces of the calculated amounts of the optical distortion.
- Since each amount of the optical distortion calculated from the identical position of the glass board W is measured at a position where the
grid pattern 11 differs respectively, it is possible to reduce a cause of the noise such as the fluctuation of the width of the bright section and the dark section of thegrid pattern 11, the fluctuation of the width (the pitch width) of thegrid unit 1a or the dust on thegrid pattern 11, and only the optical distortion of the glass board W can be emphasized by integrating each of the amounts of the optical distortion. Then an S/N ratio is improved so that a measurement can be conducted accurately. - In addition, in accordance with this embodiment, since the detected light intensity value from each of the
imaging elements 22 is stored once in the image storage area D1 every time the image is taken and a calculation is conducted on the data stored in the image storage area D1, there is a lot of flexibility in the arithmetic processing so that various processing can be conducted easily compared with a case that data for every imaging is automatically integrated like the above-mentioned TDI. - The present claimed invention is not limited to the above-mentioned embodiment.
For example, the amount of the optical distortion is calculated by focusing on only one line of theimaging element 22 in the above-mentioned embodiment, however, it is also possible to calculate the amount of the optical distortion across a broader range by conducting parallel processing on multiple lines (for example, two lines) of theimaging elements 22 as shown inFig. 12 . The multiple lines may be separated or continuous. - In addition, the
grid pattern 11 may be arranged so as to have the direction of repeating the bright section and the dark section in thegrid pattern 11 coincide with a relative moving direction of the glass board W as shown inFig. 13 . In this case, as shown in a black border inFig. 13 , the amount of the optical distortion is calculated by using a part or all of one line of theimaging elements 22 along the X-direction by means of the same procedure as that of the above-mentioned. A length of thegrid pattern 11 in the X-direction on theimaging element 22 has to be longer than a number of one line of theimaging elements 22 used in the above-mentioned calculation of the optical distortion. - Furthermore, in the above-mentioned embodiment, the light intensity signal from all of the imaging elements is transferred to and stored in the image storage area as the two-dimensional image data at every imaging timing, however, only partial image data may be transferred to and stored in the image storage area. In this case, only partial image data imaged at the identical position of an object (taking the first embodiment as an example, only data from one line of the
imaging elements 22 is deviated by one line) may be transferred to the storage area and then the amount of the optical distortion is calculated by conducting an image processing on the partial image data. With this arrangement, since an amount of the data to be transferred to the image storage area can be reduced, it is possible to shorten an interval of the imaging timing so as to speed up the time required for imaging. - In addition, the object to be inspected is the transparent board in the above-mentioned embodiment, however, this invention may be applied also to an opaque object with a mirror finish. In this case, as shown in
Fig. 14 , theimaging device 2 and the grid forming device may be arranged at the same side as the object to be inspected so that the light from thegrid pattern 11 reflects on a surface to be inspected of the object and is taken into theimaging device 2. - Furthermore, the imaging device in accordance with this invention is not limited to the use for inspection. More specifically, image data with reduced noise (noise-reduced data) may be output without calculating the amount of the optical distortion from each of the partial image data.
- The present claimed invention is not limited to the above-mentioned embodiment and it is a matter of course that this invention may be variously modified without departing from the spirit of the invention.
- In accordance with this invention, since the detected light intensity value from each of the imaging elements is stored once in the image storage area every time the image is taken and a calculation is conducted on the data stored in the image storage area, there is a lot of flexibility in the arithmetic processing so that various processing can be conducted easily compared with a case that data for every imaging is automatically integrated like the TDI.
Claims (7)
- An inspection system (100) comprising an imaging device (2) having multiple imaging elements (22) arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, an imaging control section (3) that receives a light intensity signal from all or a part of the imaging elements (22) at a predetermined imaging timing and stores each detected light intensity value indicated by the light intensity signal as two-dimensional image data in an image storage area (D1) set in a memory, and an image processing section (4) that produces data for inspection by processing the two dimensional image data, wherein an object (W) is imaged by the imaging device (2) while the object (W) is moved relative to the imaging device (2) in an X-axis direction, and characterized in that
the imaging control section (3) adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object (W) to move by "m" pixels, wherein "m" is an integer number greater than or equal to 1, in the X-axis direction on the imaging elements (22), with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements (22) and to store it as a single unit of two-dimensional image data in accordance with the object (W) in the image storage area (D1), and
the image processing section (4) comprises
a specifying section (41) that specifies partial image data imaged at an identical inspection position on the object (W) respectively from each unit of the two-dimensional image data based on the object (W) appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data imaged at each of the imaging timing, and
a data producing section (42) that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data. - The inspection system (100) described in claim 1, further comprising
a grid pattern forming device (1) that forms a grid pattern (11) wherein grid units (1a) comprising a bright section and a dark section having a constant width are continuously arranged, and the grid pattern (11) is arranged at a focal position of the imaging device (2) and the object (W) is arranged on an optical path between the grid pattern (11) and the imaging device (2) respectively, and "n", wherein "n" is an integer number greater than or equal to 1, pieces of the grid units (1a) are so arranged to correspond to Xn±α, wherein X=4p, p is an integer number greater than or equal to 1, and α<<n, pieces of the imaging elements (22) in the projected image of the grid pattern (11) on the imaging elements (22), wherein
the data producing section (42) comprises
an optical distortion calculating section (421) that calculates an optical distortion amount generated at each section of the partial image data at the inspection position from Moire fringes appearing on the partial image data due to the grid pattern (11), and
a noise reducing section (422) that integrates the optical distortion amount in accordance with each section of the partial image data and produces data for inspection. - The inspection system (100) described in claim 2, wherein
the optical distortion calculating section (421) comprises
a sine wave producing section (421a) that extracts and produces multiple kinds of sine waves whose phases are displaced by 90° respectively from image data of the Moire fringes,
a phase angle calculating section (421b) that calculates a phase angle of the Moire fringes at each of the imaging elements (22) from each of the sine waves, and
a distortion amount calculating section (421c) that calculates the optical distortion amount from a difference of the phase angles between each of the imaging elements (22). - An imaging device (2) comprising multiple imaging elements (22) arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, an imaging control section (3) that receives a light intensity signal from all or a part of the imaging elements (22) at a predetermined imaging timing and stores each light intensity value indicated by the light intensity signal in an image storage area (D1) set in a memory as two-dimensional image data, and an image processing section (4) that produces noise-reduced data by processing the two-dimensional image data, wherein an object (W) is imaged while the object (W) is moved relative to the imaging device (2) in an X-axis direction, and characterized in that
the imaging control section (3) adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object (W) to move by "m" pixels, wherein "m" is an integer number greater than or equal to 1, in the X-axis direction on the imaging elements (22), with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements (22) and to store it as a single unit of two-dimensional image data in accordance with the object (W) in the image storage area (D1), and
the image processing section (4) comprises
a specifying section (41) that specifies partial image data imaged at an identical inspection position on the object (W) respectively from each unit of the two-dimensional image data based on the object (W) appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data imaged at each of the imaging timings, and
a data producing section (42) that produces noise-reduced data in which a noise reducing process is provided at the inspection position based on each section of the partial image data. - The imaging device (2) described in claim 4, and used together with a grid pattern forming device (1) that forms a grid pattern (11) wherein grid units (1a) comprising a bright section and a dark section having a constant width are continuously arranged, and the grid pattern (11) is arranged at a focal position of the imaging device (2) and the object (W) is arranged on an optical path between the grid pattern (11) and the imaging device (2) respectively, and "n", wherein "n" is an integer number greater than or equal to 1, pieces of the grid unit (1a) are so arranged to correspond to Xn±α, wherein X=4p, p is an integer number greater than or equal to 1, and α<<n, pieces of the imaging elements (22) in the projected image of the grid pattern (11) on the imaging elements (22), wherein
the data producing section (42) comprises
an optical distortion calculating section (421) that calculates an optical distortion amount generated at each section of the partial image data at the inspection position from Moire fringes appearing on the partial image data due to the grid pattern (11), and
a noise reducing section (422) that integrates the optical distortion amount in accordance with each section of the partial image data and produces the noise-reduced data. - An inspection method that images and inspects an object (W) using an imaging device (2) while the object (W) is moved in an X-axis direction relative to the imaging device (2), which has multiple imaging elements (22) arranged in two-dimensions along an X-axis and a Y-axis which are two virtual orthogonal axes, and an imaging control section (3) that receives a light intensity signal from all or a part of the imaging elements (22) at a predetermined imaging timing and stores each light intensity value indicated by the light intensity signal in an image storage area (D1) set in a memory as two-dimensional image data, and characterized by comprising
a synchronizing step that adjusts the imaging timing so as to synchronize a projected image unit moving time, which is a time for the projected image of the object (W) to move by "m" pixels, wherein "m" is an integer number greater than or equal to 1, in the X-axis direction on the imaging elements (22), with an imaging time interval, which is a time interval to receive the light intensity signal from the imaging elements (22) and to store it as a single unit of two-dimensional image data in accordance with the object (W) in the image storage area (D1),
a specifying step that specifies partial image data imaged at an identical inspection position on the object (W) from each of the multiple units of two-dimensional image data imaged at each of the imaging timings based on the object (W) appearing deviated by "m" pixels in the X-axis direction in each unit of the two-dimensional image data due to a difference of the imaging time, and
a data producing step that produces data for inspection in which a noise reducing process is provided at the inspection position based on each section of the partial image data. - The inspection method described in claim 6,
wherein a grid pattern (11), wherein grid units (1a) comprising a bright section and a dark section having a constant width are continuously arranged, is arranged at a focal position of the imaging device (2) and the object (W) is arranged on an optical path between the grid pattern (11) and the imaging device (2) respectively, and "n", wherein "n" is an integer number greater than or equal to 1, pieces of the grid unit (1a) are so arranged to correspond to Xn±α, wherein X=4p, p is an integer number greater than or equal to 1,and α<<n, pieces of the imaging elements (22) in the projected image of the grid pattern (11) on the imaging elements (22), and
wherein, conducted in the data producing step are:an optical distortion calculating step that calculates an optical distortion amount generated at each section of the partial image data from Moire fringes appearing on the partial image data due to the grid pattern (11), anda noise reducing step that integrates the optical distortion amount in accordance with each section of the partial image data and produces data for inspection.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2008/064252 WO2010016137A1 (en) | 2008-08-07 | 2008-08-07 | Inspection system |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2325625A1 true EP2325625A1 (en) | 2011-05-25 |
Family
ID=40612174
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP08792309A Withdrawn EP2325625A1 (en) | 2008-08-07 | 2008-08-07 | Inspection system |
Country Status (4)
Country | Link |
---|---|
US (1) | US8736677B2 (en) |
EP (1) | EP2325625A1 (en) |
CN (1) | CN102119328B (en) |
WO (1) | WO2010016137A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9651525B2 (en) | 2013-06-27 | 2017-05-16 | TecScan Systems Inc. | Method and apparatus for scanning an object |
US11717967B2 (en) | 2021-03-04 | 2023-08-08 | TecScan Systems Inc. | System and method for scanning an object using an array of ultrasonic transducers |
EP4231001A1 (en) * | 2022-02-16 | 2023-08-23 | Carl Zeiss Vision International GmbH | Testing device and testing method |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2958404B1 (en) * | 2010-04-01 | 2012-04-27 | Saint Gobain | METHOD AND DEVICE FOR ANALYZING THE OPTICAL QUALITY OF A TRANSPARENT SUBSTRATE |
DE102011109793B4 (en) * | 2011-08-08 | 2014-12-04 | Grenzbach Maschinenbau Gmbh | Method and device for the reliable detection of material defects in transparent materials |
US9924105B2 (en) * | 2011-12-12 | 2018-03-20 | Visys Nv | System and method for individually inspecting objects in a stream of products and a sorting apparatus comprising such system |
ES2733504T5 (en) | 2012-12-28 | 2023-03-16 | Nestle Sa | Preparation procedure of a foaming auxiliary agent, the foaming auxiliary agent and its uses |
CN103472072A (en) * | 2013-09-09 | 2013-12-25 | 深圳市维图视技术有限公司 | Novel visual inspection method and device for glass tube defects |
JP2015184059A (en) * | 2014-03-20 | 2015-10-22 | 旭硝子株式会社 | Transparent plate body inspection method and transparent plate body inspection device |
DE102014008596B4 (en) * | 2014-06-10 | 2016-01-28 | Grenzebach Maschinenbau Gmbh | Apparatus and method for fast and reliable measurement of distortion errors in a produced float glass belt |
CN104111040B (en) * | 2014-06-11 | 2016-08-17 | 华中科技大学 | A kind of float glass brush line online test method |
US20160178535A1 (en) * | 2014-12-17 | 2016-06-23 | Xerox Corporation | Inspection Device And Method |
JP6393663B2 (en) * | 2015-07-06 | 2018-09-19 | 株式会社豊田中央研究所 | Surface inspection device |
US9587933B2 (en) * | 2015-08-07 | 2017-03-07 | General Electric Company | System and method for inspecting an object |
US20180164224A1 (en) * | 2016-12-13 | 2018-06-14 | ASA Corporation | Apparatus for Photographing Glass in Multiple Layers |
JP6908106B2 (en) * | 2017-04-07 | 2021-07-21 | コニカミノルタ株式会社 | Quality inspection method |
CN110998298B (en) * | 2017-08-24 | 2023-01-06 | 日本电气硝子株式会社 | Method for manufacturing plate-shaped glass |
CN110609439B (en) * | 2018-06-15 | 2023-01-17 | 夏普株式会社 | Inspection apparatus |
WO2020075756A1 (en) * | 2018-10-12 | 2020-04-16 | パナソニックIpマネジメント株式会社 | Prediction device and prediction method |
CN110418124B (en) * | 2019-08-05 | 2021-11-30 | 歌尔光学科技有限公司 | Projection image detection method, projection image detection device, projection image detection equipment and computer-readable storage medium |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08247954A (en) * | 1995-03-15 | 1996-09-27 | Asahi Glass Co Ltd | Measuring method of optical distortion |
JPH0989603A (en) * | 1995-09-26 | 1997-04-04 | Asahi Glass Co Ltd | Method for correcting measuring device and measuring device |
US5917934A (en) * | 1996-03-15 | 1999-06-29 | Sony Corporation | Automated visual inspection apparatus for detecting defects and for measuring defect size |
US6064759A (en) * | 1996-11-08 | 2000-05-16 | Buckley; B. Shawn | Computer aided inspection machine |
FR2761475B1 (en) * | 1997-03-28 | 1999-06-11 | Lorraine Laminage | METHOD FOR INSPECTING THE SURFACE OF A SCROLLING STRIP BY IMAGE SEGMENTATION IN SUSPECTED AREAS |
US6061086A (en) * | 1997-09-11 | 2000-05-09 | Canopular East Inc. | Apparatus and method for automated visual inspection of objects |
JP3680636B2 (en) * | 1999-06-10 | 2005-08-10 | 日産自動車株式会社 | Uneven coating inspection equipment |
US7796801B2 (en) * | 1999-08-26 | 2010-09-14 | Nanogeometry Research Inc. | Pattern inspection apparatus and method |
US6748110B1 (en) * | 2000-11-09 | 2004-06-08 | Cognex Technology And Investment | Object and object feature detector system and method |
US6987875B1 (en) * | 2001-05-22 | 2006-01-17 | Cognex Technology And Investment Corporation | Probe mark inspection method and apparatus |
US7009163B2 (en) * | 2001-06-22 | 2006-03-07 | Orbotech Ltd. | High-sensitivity optical scanning using memory integration |
US7162073B1 (en) * | 2001-11-30 | 2007-01-09 | Cognex Technology And Investment Corporation | Methods and apparatuses for detecting classifying and measuring spot defects in an image of an object |
JP4072466B2 (en) | 2002-12-27 | 2008-04-09 | 日本板硝子株式会社 | Apparatus and method for evaluating optical distortion of plate-like body |
CN100546396C (en) * | 2003-02-21 | 2009-09-30 | 大塚电子株式会社 | Assess the measuring system of mobile image displaying quality |
DE10333794A1 (en) * | 2003-07-24 | 2005-03-03 | Technovision Gmbh | Method and device for online contact lens evaluation |
US7324682B2 (en) * | 2004-03-25 | 2008-01-29 | Mitutoyo Corporation | System and method for excluding extraneous features from inspection operations performed by a machine vision inspection system |
EP1605241A1 (en) * | 2004-06-09 | 2005-12-14 | Automation & Robotics | Device for the optical test of transparent or reflective samples |
US7583852B2 (en) * | 2004-10-26 | 2009-09-01 | Mitutoyo Corporation | Method of filtering an image for high precision machine vision metrology |
JP4130435B2 (en) * | 2004-11-30 | 2008-08-06 | 本田技研工業株式会社 | Abnormality detection device for imaging device |
JP2006284183A (en) * | 2005-03-31 | 2006-10-19 | Toshiba Corp | Inspection device and imaging apparatus |
DE102005029901B4 (en) * | 2005-06-25 | 2022-10-06 | Modi Modular Digits Gmbh | Device and method for visually detecting two-dimensional or three-dimensional objects |
JP2007192660A (en) * | 2006-01-19 | 2007-08-02 | Fujifilm Corp | Surface flaw detecting method and detector of film |
US8089582B2 (en) * | 2007-05-31 | 2012-01-03 | Hitachi Displays, Ltd. | Liquid crystal display device comprising at least one groove having an end portion that stops short of the non-adjacent opposite side surfaces and extends in a direction perpendicular to the non-adjacent side surfaces |
-
2008
- 2008-08-07 CN CN2008801307433A patent/CN102119328B/en not_active Expired - Fee Related
- 2008-08-07 WO PCT/JP2008/064252 patent/WO2010016137A1/en active Application Filing
- 2008-08-07 US US13/057,992 patent/US8736677B2/en not_active Expired - Fee Related
- 2008-08-07 EP EP08792309A patent/EP2325625A1/en not_active Withdrawn
Non-Patent Citations (1)
Title |
---|
See references of WO2010016137A1 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9651525B2 (en) | 2013-06-27 | 2017-05-16 | TecScan Systems Inc. | Method and apparatus for scanning an object |
US11717967B2 (en) | 2021-03-04 | 2023-08-08 | TecScan Systems Inc. | System and method for scanning an object using an array of ultrasonic transducers |
EP4231001A1 (en) * | 2022-02-16 | 2023-08-23 | Carl Zeiss Vision International GmbH | Testing device and testing method |
WO2023156329A1 (en) * | 2022-02-16 | 2023-08-24 | Carl Zeiss Vision International Gmbh | Testing device and testing method |
US11885751B2 (en) | 2022-02-16 | 2024-01-30 | Carl Zeiss Vision International Gmbh | Testing device and testing method |
Also Published As
Publication number | Publication date |
---|---|
US20110141270A1 (en) | 2011-06-16 |
CN102119328B (en) | 2013-01-23 |
US8736677B2 (en) | 2014-05-27 |
CN102119328A (en) | 2011-07-06 |
JP4250199B2 (en) | 2009-04-08 |
JPWO2010016137A1 (en) | 2012-01-12 |
WO2010016137A1 (en) | 2010-02-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8736677B2 (en) | Inspection system | |
KR100710610B1 (en) | Device and method for evaluating optical distortion of transparent plate body | |
US20170221228A1 (en) | Image processing apparatus, imaging apparatus, and image processing method | |
US20140010438A1 (en) | Three dimensional shape measurement apparatus and method | |
TWI629665B (en) | Defect inspection method and defect inspection system | |
KR20100087103A (en) | Imaging measurements system with periodic pattern illumination and tdi | |
JP4680640B2 (en) | Image input apparatus and image input method | |
CN101673043A (en) | Wide-angle distortion testing system and method | |
JP2012127675A (en) | Method and apparatus for evaluating front-surface shape | |
JP5100247B2 (en) | Optical defect detection apparatus and detection method | |
TWI485358B (en) | Closure plate body inspection apparatus and method | |
TWI380694B (en) | ||
EP3121588A1 (en) | Optical characteristic measuring apparatus | |
JP2009300137A (en) | Line sensor elevation angle measuring apparatus by image processing | |
JP2012008078A (en) | Defect inspecting device | |
JP6322087B2 (en) | Inspection apparatus and inspection method | |
KR100966814B1 (en) | A Surface Defect Detection and Surface Shape Recognition Equipment | |
JP4250199B1 (en) | Inspection system | |
CN109631765A (en) | Blurring sensor and its measurement method | |
KR100651791B1 (en) | Apparatus and method for inspecting parts | |
JP4815796B2 (en) | Defect inspection equipment | |
CN116457629A (en) | Three-dimensional measurement device and three-dimensional measurement program | |
KR20030053386A (en) | Method for measuring a precision of size using a CCD camera | |
CN111272762A (en) | Surface defect inspection device for translucent member | |
JPS6095308A (en) | Position detecting device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20110304 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA MK RS |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20140701 |