WO2001022070A1 - Method and system of lcd inspection by pattern comparison - Google Patents

Method and system of lcd inspection by pattern comparison Download PDF

Info

Publication number
WO2001022070A1
WO2001022070A1 PCT/JP1999/005118 JP9905118W WO0122070A1 WO 2001022070 A1 WO2001022070 A1 WO 2001022070A1 JP 9905118 W JP9905118 W JP 9905118W WO 0122070 A1 WO0122070 A1 WO 0122070A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
lcd
plane
pattern
error
Prior art date
Application number
PCT/JP1999/005118
Other languages
French (fr)
Inventor
Tatsuya Yabe
Makoto Kaida
Kean Hong Lau
Kok Hua Tong
Original Assignee
Matsushita Electric Industrial Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co., Ltd. filed Critical Matsushita Electric Industrial Co., Ltd.
Priority to JP2001525192A priority Critical patent/JP2003510568A/en
Priority to PCT/JP1999/005118 priority patent/WO2001022070A1/en
Publication of WO2001022070A1 publication Critical patent/WO2001022070A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/001—Industrial image inspection using an image reference approach
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956—Inspecting patterns on the surface of objects
    • G01N21/95607—Inspecting patterns on the surface of objects using a comparative method
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N2021/9513—Liquid crystal panels
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956—Inspecting patterns on the surface of objects
    • G01N21/95607—Inspecting patterns on the surface of objects using a comparative method
    • G01N2021/95615—Inspecting patterns on the surface of objects using a comparative method with stored comparision signal

Definitions

  • This invention relates to machine vision methods for liquid crystal display (LCD) inspection by checking a pattern produced by an LCD under inspection against a template pattern.
  • LCD liquid crystal display
  • LCD panels are commonly used in electronic devices to display graphics and texts for conveying messages to the user.
  • an LCD cell may be physically damaged thus displaying an undesirable intensity output.
  • An LCD cell may also display an undesirable intensity due to faulty wiring or damaged memory chip.
  • LCD panels are checked to ensure proper operations.
  • inspection of LCD panel is commonly based on human operator.
  • the main advantage of human inspection is its versatile capability towards various types of LCD defects.
  • the consistency of inspection may change from time to time. There will be rare occasions when small defects are missed by a tiring eye. Therefore, there is a need to develop an inspection system to automatically detect for defects on an LCD panel.
  • One technique of LCD inspection is pattern comparison. Two images, one captured of an ideal LCD and the other of an LCD under inspection, are subtracted to obtain the difference. Any discrepancy between the two patterns indicates a defect in the LCD set, be it an LCD cell defect or an integration fault.
  • One critical issue involved in this step is the miss-placement of the LCD set on the inspection platform. The miss-placement of LCD set will cause pattern miss-alignment between the two images under subtraction, thus leading to false alarms.
  • the patterns of two images involved in subtraction need to be aligned on a common reference frame before subtraction is carried out.
  • the alignment process requires the consideration of the effects of object pose and image perspective.
  • the residue of subtraction needs to be analyzed to differentiate between regions of pattern difference from regions of no pattern difference, and between actual residues (due to pattern discrepancy) from false residues (due to image miss-alignment and noise) .
  • the LCD pattern in an image is mapped to an ideal rectangle.
  • a camera model which relates a world point to its image point is used to derive the above mapping.
  • the ideal rectangle which is specified in the world coordinate, provides the common reference frame for image comparison. All images are transformed from the image coordinate to the common reference frame before subtraction. An error score is evaluated at every point on the resultant image of image subtraction. To account for subtraction residue due to slight miss-alignment of images, the contrast information of the original image pattern is used to suppress the error scores around high contrast regions .
  • the present invention is a method for detecting defects in the pattern displayed by a liquid crystal display (LCD), comprising the steps of: generating a pattern on said LCD; generating a camera image containing the whole panel of said LCD
  • LCD determining the locations of at least four non-collinear feature points in said camera image; determining the transformation parameters between the coordinate system of said camera image and a 2-D coordinate system on a plane in the 3-D space; transforming said camera image to said plane; subtracting the transformed image with a template pattern to produce an error image; and evaluating the residue in said error image for any pattern defect.
  • the present invention is also directed to a vision system for detecting defects in the pattern displayed by a liquid crystal display (LCD), said system comprising: an LCD panel driver for generating patterns on said LCD; a CCD camera for generating camera images containing the whole panel of said LCD; means for determining the locations of at least four non- collinear feature points in said camera image; means for determining the transformation parameters between the coordinate system of said camera image and a 2-D coordinate system on a plane in the 3-D space; means for transforming said camera image to said plane; means for subtracting the transformed image with a template pattern to produce an error image; and means for evaluating the residue in said error image for any pattern defect.
  • a vision system for detecting defects in the pattern displayed by a liquid crystal display (LCD)
  • LCD liquid crystal display
  • said plane is a plane parallel to the XY-plane of the 3-D space.
  • said XY-plane is a plane that coincides with said LCD panel.
  • said template pattern is generated by said transformation or said means for transformation from a camera image of an ideal LCD pattern to said plane.
  • said step of subtraction or said means for subtraction takes the absolute value of difference as the result of processing.
  • said evaluation step or said means for error image evaluation includes the step of calculating the contrast information for the pixels in the template image.
  • Figure 1 shows a schematic diagram of the system used in the current invention.
  • FIG. 2 shows the flowchart of the current inspection algorithm.
  • Figure 3 shows a corner of the LCD panel in an image for visualizing the process of corner point detection.
  • Figure 4 shows the mapping between an LCD pattern in an image and a rectangle representing an ideal LCD panel.
  • FIG 1 shows the system set-up for the current invention.
  • An LCD panel 10 is placed on an inspection platform 16, facing a color camera 13.
  • a computer 15 instructs an LCD panel driver 12 to display a pattern on the LCD panel 10.
  • the displayed pattern is captured by the camera 13 and sent to the computer 15.
  • the computer 15 executes the inspection program to detect for any defect on the LCD panel 10. Template images for comparison are stored in a storage unit 14.
  • the flowchart of the inspection algorithm is shown in Figure 2. The processes in the flowchart are described below.
  • the four corner points of the LCD panel are located in the image and mapped to an ideal rectangle.
  • the LCD panel is lit with a uniform white pattern. The case around the LCD will appear relatively dark. Thus, the margins of the LCD panel can be easily detected.
  • the corner points are found by determining the two line equations of the two sides of the LCD panel that form a corner, followed by calculating the point of intersection between these two lines.
  • S 1 and S 2 form the two sides of a top-left corner.
  • Each side of the LCD panel is determined by finding two points on it, such as points A and B for the side S ⁇
  • Each point is detected by searching for an intensity change along a line positioned to intersect the expected side of the LCD panel. These two points determine the equation of a line that passes through them.
  • the two points that form a side of the quadrangle are positioned close to the corner point. This is done to minimize the error caused by image distortion due to imperfect lens .
  • the technique of image alignment is based on the direct linear transform (DLT) model.
  • DLT direct linear transform
  • the DLT model tells how a point in 3-D space is mapped to a point on the image plane.
  • the DLT mapping is expressed as:
  • the quadrangle 31 is the LCD pattern captured in a camera image. Each corner point detected on the image maps to the corresponding corner point of a rectangle 30 representing an ideal LCD panel.
  • the coordinate of rectangle 30 is specified on the XY-plane.
  • the XY-plane provides the common coordinate system for image subtraction.
  • the dimensions of this rectangle is defined by the user. For ease of manipulation, the dimensions of this rectangle are set to the integer numbers of horizontal ( ) and vertical (H) pixels that map to an image buffer. Ideally, the numbers of horizontal and vertical pixels in the rectangle should be equal to the resolution of the LCD panel.
  • Equations (1) and (2) There are eight parameters to be determined in equations (1) and (2); they are An, A i 2 ' A i A 2 i> A 22> A 2 4 A 31 andA 32 .
  • the four mappings of the corner points between the camera image and the ideal rectangle on the XY-plane will produce eight equations fromithe DLT equations. This allows the eight DLT parameters to be determined. In general, at least four non-collinear feature points are required to solve for the eight parameters.
  • the transformed images of the template image and the test image are subtracted pixel by pixel to obtain the error image.
  • the absolute value of subtraction is taken as the residue.
  • Every pixel on the error image is given an error score value indicating the extent of the difference at that pixel location between the two images involved in the subtraction process. Any error score higher than a pre-set threshold level indicates a pattern defect.
  • the error score is defined as:
  • h R (u,v) The magnitude of the error residue of the red band at coordinate (u,v).
  • h G (u,v) The magnitude of the error residue of the green band at coordinate (u,v).
  • h B (u,v) The magnitude of the error residue of the blue band at coordinate (u,v).
  • I R (u,v) The red intensity level at coordinate (u,v) on the template image.
  • I G (u,v) The green intensity level at coordinate (u,v) on the template image.
  • I B (u,v) The blue intensity level at coordinate (u,v) on the template image.
  • N Ri (u,v) The red intensity level of the i-th connected neighbour of (u,v) on the template image.
  • N G(i (u,v) The green intensity level of the i-th connected neighbour of (u,v) on the template image.
  • N B/i (u,v) The blue intensity level of the i-th connected neighbour of (u,v) on the template image.
  • the error score defined in (5) defines a quantitative measurement of pixel error, taking into consideration of the intensity discrepancy for the red, green and blue bands and the intensity contrast around a pixel.
  • the terms c R (u,v), c G (u,v) and c B (u,v) serve as measurements of intensity contrast around a pixel. These terms reduce the magnitudes of the error scores at pixel locations of high intensity contrast. This reduces the possibility of false alarms due to pattern miss-alignment.
  • This invention provides a general method and system for LCD inspection by pattern comparison.
  • the module on image alignment allows the LCD under inspection to be placed loosely on the inspection platform. This module also corrects for perspective effect and produces a 2-D image of the pattern that appears on the LCD panel.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Quality & Reliability (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Testing Of Optical Devices Or Fibers (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Liquid Crystal (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

This patent discloses the method and system design of an automated visual inspection system for liquid crystal displays (LCDs). Image defect is detected by comparing the image displayed by an LCD panel under inspection with a template image which the LCD panel is supposed to display. The LCD panel under inspection is allowed to be placed loosely on the inspection platform. The algorithm corrects for the effect of object pose and image perspective to produce a 2-D image of the pattern that appears on the LCD panel. Next, the two patterns are subtracted to obtain an error image. From the error image, pattern discrepancy is evaluated at every pixel location to detect for LCD defects.

Description

DESCRIPTION
Method and System of LCD Inspection by Pattern Comparison
Field of The Invention
This invention relates to machine vision methods for liquid crystal display (LCD) inspection by checking a pattern produced by an LCD under inspection against a template pattern.
Background of The Invention
LCD panels are commonly used in electronic devices to display graphics and texts for conveying messages to the user. In an LCD panel, an LCD cell may be physically damaged thus displaying an undesirable intensity output. An LCD cell may also display an undesirable intensity due to faulty wiring or damaged memory chip. For quality control, LCD panels are checked to ensure proper operations. Presently, inspection of LCD panel is commonly based on human operator. The main advantage of human inspection is its versatile capability towards various types of LCD defects. However, with human operators, the consistency of inspection may change from time to time. There will be rare occasions when small defects are missed by a tiring eye. Therefore, there is a need to develop an inspection system to automatically detect for defects on an LCD panel.
The majority of automated LCD inspection methods have been relying upon electrical checking of LCD cells. An example of such a method is disclosed in U.S. Pat. No. 5,528,163 (Takahashi). This method requires the LCD to be in a state before assembly for electrical probing. When the LCD panel is finally assembled and integrated with the main electronic device, another test will be required to check for proper integration. In this patent, we will focus on the visual inspection of LCD panel on the final integrated produc .
One technique of LCD inspection is pattern comparison. Two images, one captured of an ideal LCD and the other of an LCD under inspection, are subtracted to obtain the difference. Any discrepancy between the two patterns indicates a defect in the LCD set, be it an LCD cell defect or an integration fault. One critical issue involved in this step is the miss-placement of the LCD set on the inspection platform. The miss-placement of LCD set will cause pattern miss-alignment between the two images under subtraction, thus leading to false alarms.
Many automated visual LCD inspection systems assume negligible placement error of the LCD panel and provide no compensation for it. One example of such a method is disclosed in U.S. Pat. No. 4,870,357 (Young et al . ) . It is costly and technically difficult to ensure placement repeatability to a high precision of LCD sets on an inspection platform. Therefore, it is desirable to align patterns for subtraction instead of using precision placement equipment.
The method disclosed in U.S. Pat. No. 4,942,539 (McGee et al.) is a general method of pose determination of 3-D objects. This method can be applied to the current problem of LCD miss-placement by determining the pose of the LCD set under inspection and reconstructing its 2-D pattern from the image. However, this method requires a calibration phase for the camera which involves a high precision 3-D structure. This structure is costly to build and the whole system requires careful setting up.
The U.S. Pat. No. 5,696,550 (Aoki et al.) discloses a method of pose and perspective correction using linear interpolation. Linear approximation of the non-linear perspective transformation is employed. This method is efficient but contains approximation error.
The patterns of two images involved in subtraction need to be aligned on a common reference frame before subtraction is carried out. The alignment process requires the consideration of the effects of object pose and image perspective. Next, the residue of subtraction needs to be analyzed to differentiate between regions of pattern difference from regions of no pattern difference, and between actual residues (due to pattern discrepancy) from false residues (due to image miss-alignment and noise) .
Disclosure of The Invention
To correct for the effects of pose and perspective, the LCD pattern in an image is mapped to an ideal rectangle. A camera model which relates a world point to its image point is used to derive the above mapping. The ideal rectangle, which is specified in the world coordinate, provides the common reference frame for image comparison. All images are transformed from the image coordinate to the common reference frame before subtraction. An error score is evaluated at every point on the resultant image of image subtraction. To account for subtraction residue due to slight miss-alignment of images, the contrast information of the original image pattern is used to suppress the error scores around high contrast regions .
That is, The present invention is a method for detecting defects in the pattern displayed by a liquid crystal display (LCD), comprising the steps of: generating a pattern on said LCD; generating a camera image containing the whole panel of said
LCD; determining the locations of at least four non-collinear feature points in said camera image; determining the transformation parameters between the coordinate system of said camera image and a 2-D coordinate system on a plane in the 3-D space; transforming said camera image to said plane; subtracting the transformed image with a template pattern to produce an error image; and evaluating the residue in said error image for any pattern defect.
The present invention is also directed to a vision system for detecting defects in the pattern displayed by a liquid crystal display (LCD), said system comprising: an LCD panel driver for generating patterns on said LCD; a CCD camera for generating camera images containing the whole panel of said LCD; means for determining the locations of at least four non- collinear feature points in said camera image; means for determining the transformation parameters between the coordinate system of said camera image and a 2-D coordinate system on a plane in the 3-D space; means for transforming said camera image to said plane; means for subtracting the transformed image with a template pattern to produce an error image; and means for evaluating the residue in said error image for any pattern defect.
Other embodiments of the present invention are as follows: i) In the method or system as described above, said feature points are the corner points of the frame of said LCD.
ii) In the method or system as described above, said plane is a plane parallel to the XY-plane of the 3-D space.
iii) In the method or system as described above, said XY-plane is a plane that coincides with said LCD panel.
iv) In the method or system as described above, said template pattern is generated by said transformation or said means for transformation from a camera image of an ideal LCD pattern to said plane.
v) In the method or system as described above, said step of subtraction or said means for subtraction takes the absolute value of difference as the result of processing.
vi) In the method or system as described above, said evaluation step or said means for error image evaluation includes the step of calculating the contrast information for the pixels in the template image.
Brief Description of The Drawings
Figure 1 shows a schematic diagram of the system used in the current invention.
Figure 2 shows the flowchart of the current inspection algorithm.
Figure 3 shows a corner of the LCD panel in an image for visualizing the process of corner point detection.
Figure 4 shows the mapping between an LCD pattern in an image and a rectangle representing an ideal LCD panel.
Preferred Embodiments of The Invention
Before inspection is put on-line, all template patterns produced by a good LCD panel are captured. These images will be compared against that produced by an LCD panel under inspection. The images captured of an LCD panel under inspection will be referred to as test images. The pose of the LCD set under inspection may not be secured on the inspection platform. Therefore, both template and test images under comparison must be transformed into a common reference frame for alignment before subtraction. After image subtraction, an image of the residue errors is produced. This image is referred to as the error image. A scoring formula which measures the extent of residue error is evaluated at every pixel on the error image. The pixels with score values higher than a pre-set threshold level are determined to be defective.
Figure 1 shows the system set-up for the current invention. An LCD panel 10 is placed on an inspection platform 16, facing a color camera 13. A computer 15 instructs an LCD panel driver 12 to display a pattern on the LCD panel 10. The displayed pattern is captured by the camera 13 and sent to the computer 15. The computer 15 executes the inspection program to detect for any defect on the LCD panel 10. Template images for comparison are stored in a storage unit 14. The flowchart of the inspection algorithm is shown in Figure 2. The processes in the flowchart are described below.
orne Detection (process 20)
To derive the mapping between the image coordinate and the common reference frame, the four corner points of the LCD panel are located in the image and mapped to an ideal rectangle. For corner point detection, the LCD panel is lit with a uniform white pattern. The case around the LCD will appear relatively dark. Thus, the margins of the LCD panel can be easily detected. The corner points are found by determining the two line equations of the two sides of the LCD panel that form a corner, followed by calculating the point of intersection between these two lines. In Figure 3, S1 and S2 form the two sides of a top-left corner. Each side of the LCD panel is determined by finding two points on it, such as points A and B for the side S^ Each point is detected by searching for an intensity change along a line positioned to intersect the expected side of the LCD panel. These two points determine the equation of a line that passes through them. For better accuracy, the two points that form a side of the quadrangle are positioned close to the corner point. This is done to minimize the error caused by image distortion due to imperfect lens .
DLT Parameters Calculation (process 21)
The technique of image alignment is based on the direct linear transform (DLT) model. A reference to this calibration technique can be found in
Y.I.Abdel-Aziz and H.M.Karara, "Direct linear transformation from comparator coordinates into object space coordinates in close-range photogrammetry" , Proc. Symposium on Close Range Photogrammetry , Urbana, Illinois, pp.1-18, January 1971.
The DLT model tells how a point in 3-D space is mapped to a point on the image plane. By restricting the 3-D object to the XY-plane (i.e. taking Z=0), since the LCD panel is flat, the DLT mapping is expressed as:
AUX + A12 Y + A14 u = ( 1 ) A31X + A32Y + 1
v = .21-^*- "^ -^ 22 *^~ 24 ( 2 )
A31X + A32Y + 1
where (u,v) refers to an image coordinate and (X,Y) refers to its corresponding world coordinate on the XY-plane. Referring to Figure 4 , the quadrangle 31 is the LCD pattern captured in a camera image. Each corner point detected on the image maps to the corresponding corner point of a rectangle 30 representing an ideal LCD panel. The coordinate of rectangle 30 is specified on the XY-plane. The XY-plane provides the common coordinate system for image subtraction. The dimensions of this rectangle is defined by the user. For ease of manipulation, the dimensions of this rectangle are set to the integer numbers of horizontal ( ) and vertical (H) pixels that map to an image buffer. Ideally, the numbers of horizontal and vertical pixels in the rectangle should be equal to the resolution of the LCD panel.
There are eight parameters to be determined in equations (1) and (2); they are An, Ai2' Ai A 2i> A 22> A24 A31andA32. The four mappings of the corner points between the camera image and the ideal rectangle on the XY-plane will produce eight equations fromithe DLT equations. This allows the eight DLT parameters to be determined. In general, at least four non-collinear feature points are required to solve for the eight parameters.
Tmage Transformation (process 22)
Given an image point (u,v), the terms X and Y can be rearranged to the left-hand-sides of equations (1) and (2) as:
χ = (u - A14)(A22 - vA32) - (A12 - uA32)(v - A24)
(Au - uA31)(A22 - vA32) - (A12 - uA32)(A21 - vA31)
Y = (v " A24 )( Aιι ~ uA3i ) ~ ( A2i - vA31 )(u - A14 ) (Au - uA31)(A22 - vA32 ) - (A12 - uA32 )(A21 - vA31 ) These two equations form the reverse transformation equations for transforming an image point to a point on the XY-plane. All images involved in subtraction are subject to this transformation.
Tmage Subtraction (process 23)
The transformed images of the template image and the test image are subtracted pixel by pixel to obtain the error image. To avoid negative numbers, the absolute value of subtraction is taken as the residue.
Error Score Calculation (process 24)
Due to system noise and numerical error of computation, the two patterns under subtraction may not be perfectly aligned. This slight miss-alignment of patterns will produce small error residues on the error image at the pixel locations of high intensity contrast. Therefore, the judgement of error residues must take this into account and tolerate for the error residues which appear at high intensity contrast locations where the error residues may be contributed by pattern miss-alignment.
Every pixel on the error image is given an error score value indicating the extent of the difference at that pixel location between the two images involved in the subtraction process. Any error score higher than a pre-set threshold level indicates a pattern defect. The error score is defined as:
Score(u,v)=max{hR ( u, v)- cR(u ,v) , hG(u,v) -αcG (u,v),hB(u,v)- αcB(u,v)} (5) where α = 2, a scaling factor. hR(u,v) = The magnitude of the error residue of the red band at coordinate (u,v). hG(u,v) = The magnitude of the error residue of the green band at coordinate (u,v). hB(u,v) = The magnitude of the error residue of the blue band at coordinate (u,v). cR(u,v) = maxi=1,../8{ IR(u,v) - NR(i(u,v) } cG(u,v) = maxi=ι../8{ IG(u,v) - NGιi(u,v) } cB(u,v) = maxi=1/..,8{ IB( ,v) - NBfi(u,v) }, where
IR(u,v) = The red intensity level at coordinate (u,v) on the template image. IG(u,v) = The green intensity level at coordinate (u,v) on the template image.
IB(u,v) = The blue intensity level at coordinate (u,v) on the template image. NRi(u,v)= The red intensity level of the i-th connected neighbour of (u,v) on the template image. NG(i(u,v)= The green intensity level of the i-th connected neighbour of (u,v) on the template image.
NB/i(u,v)= The blue intensity level of the i-th connected neighbour of (u,v) on the template image.
The error score defined in (5) defines a quantitative measurement of pixel error, taking into consideration of the intensity discrepancy for the red, green and blue bands and the intensity contrast around a pixel. The terms cR(u,v), cG(u,v) and cB(u,v) serve as measurements of intensity contrast around a pixel. These terms reduce the magnitudes of the error scores at pixel locations of high intensity contrast. This reduces the possibility of false alarms due to pattern miss-alignment.
Possible Utilisation in Industry of The Invention
This invention provides a general method and system for LCD inspection by pattern comparison. The module on image alignment allows the LCD under inspection to be placed loosely on the inspection platform. This module also corrects for perspective effect and produces a 2-D image of the pattern that appears on the LCD panel.

Claims

1 ) A method for detecting defects in the pattern displayed by a liquid crystal display (LCD), comprising the steps of: generating a pattern on said LCD; generating a camera image containing the whole panel of said
LCD; determining the locations of at least four non-collinear feature points in said camera image; determining the transformation parameters between the coordinate system of said camera image and a 2-D coordinate system on a plane in the 3-D space; transforming said camera image to said plane; subtracting the transformed image with a template pattern to produce an error image; and evaluating the residue in said error image for any pattern defect.
2 ) The method as in claim 1 , wherein said feature points are the corner points of the frame of said LCD.
3 ) The method as in claim 1 , wherein said plane is a plane parallel to the XY-plane of the 3-D space.
4) The method as in claim 3, wherein said XY-plane is a plane that coincides with said LCD panel.
5) The method as in claim 1, wherein said template pattern is generated by said transformation from a camera image of an ideal LCD pattern to said plane.
6 ) The method as in claim 1 , wherein said step of subtraction takes the absolute value of difference as the result of processing.
7) The method as in claim 1, wherein said evaluation step includes the step of calculating the contrast information for the pixels in the template image.
8) A vision system for detecting defects in the pattern displayed by a liquid crystal display (LCD), said system comprising: an LCD panel driver for generating patterns on said LCD; a CCD camera for generating camera images containing the whole panel of said LCD; means for determining the locations of at least four non- collinear feature points in said camera image; means for determining the transformation parameters between the coordinate system of said camera image and a 2-D coordinate system on a plane in the 3-D space; means for transforming said camera image to said plane; means for subtracting the transformed image with a template pattern to produce an error image; and means for evaluating the residue in said error image for any pattern defect.
9) The system as in claim 8, wherein said feature points are the corner points of the frame of said LCD.
10 ) The system as in claim 8 , wherein said plane is a plane parallel to the XY-plane of the 3-D space.
11) The system as in claim 10, wherein said XY-plane is a plane that coincides with said LCD panel.
12) The system as in claim 8, wherein said template pattern is generated by said means for transformation from a camera image of an ideal LCD pattern to said plane.
13) The system as in claim 8, wherein said means for subtraction takes the absolute value of difference as the result of processing.
14) The system as in claim 8, wherein said means for error image evaluation includes the means for calculating the contrast information for the pixels in the template image.
PCT/JP1999/005118 1999-09-20 1999-09-20 Method and system of lcd inspection by pattern comparison WO2001022070A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2001525192A JP2003510568A (en) 1999-09-20 1999-09-20 LCD inspection method and LCD inspection apparatus by pattern comparison
PCT/JP1999/005118 WO2001022070A1 (en) 1999-09-20 1999-09-20 Method and system of lcd inspection by pattern comparison

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP1999/005118 WO2001022070A1 (en) 1999-09-20 1999-09-20 Method and system of lcd inspection by pattern comparison

Publications (1)

Publication Number Publication Date
WO2001022070A1 true WO2001022070A1 (en) 2001-03-29

Family

ID=14236762

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP1999/005118 WO2001022070A1 (en) 1999-09-20 1999-09-20 Method and system of lcd inspection by pattern comparison

Country Status (2)

Country Link
JP (1) JP2003510568A (en)
WO (1) WO2001022070A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111665261A (en) * 2020-06-04 2020-09-15 安徽安视智能科技有限公司 Chip crystal grain detection method based on machine vision

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI321218B (en) * 2006-01-17 2010-03-01 R2D Technology Inc Device, system and method for measuring response time
JP4962763B2 (en) * 2006-09-21 2012-06-27 横河電機株式会社 Defect inspection apparatus and defect inspection method
KR100942379B1 (en) * 2009-06-30 2010-02-12 한국전력공사 Crack detection apparatus and method of box culvert for electric power transmission using three-dimension laser scanner
KR101974111B1 (en) * 2012-12-03 2019-05-02 엘지디스플레이 주식회사 Method and System for Testing Display Panel
KR101717768B1 (en) * 2015-06-17 2017-03-27 주식회사 쓰리디산업영상 Component inspecting method and apparatus
CN108801198B (en) * 2018-04-18 2020-09-04 威创集团股份有限公司 Device for displaying flatness detection of large wall and detection method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4926489A (en) * 1983-03-11 1990-05-15 Kla Instruments Corporation Reticle inspection system
EP0755024A2 (en) * 1995-07-20 1997-01-22 Nippon Telegraph And Telephone Corporation Method for positional matching of images and system for testing products by using the same
EP0777198A1 (en) * 1995-11-30 1997-06-04 Victor Company Of Japan, Limited Image processing apparatus
US5696550A (en) * 1994-07-14 1997-12-09 Advantest Corporation Image quality inspection system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4926489A (en) * 1983-03-11 1990-05-15 Kla Instruments Corporation Reticle inspection system
US5696550A (en) * 1994-07-14 1997-12-09 Advantest Corporation Image quality inspection system
EP0755024A2 (en) * 1995-07-20 1997-01-22 Nippon Telegraph And Telephone Corporation Method for positional matching of images and system for testing products by using the same
EP0777198A1 (en) * 1995-11-30 1997-06-04 Victor Company Of Japan, Limited Image processing apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ABDEL-AZIZ Y I ET AL: "DIRECT LINEAR TRANSFORMATION FROM COMPARATOR COORDINATES INTO OBJECT SPACE COORDINATES IN CLOSE-RANGE PHOTOGRAMMETRY", PROCEEDINGS SYMPOSIUM ON CLOSE RANGE PHOTOGRAMMETRY,XX,XX, January 1971 (1971-01-01), pages 1 - 18, XP000856509 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111665261A (en) * 2020-06-04 2020-09-15 安徽安视智能科技有限公司 Chip crystal grain detection method based on machine vision

Also Published As

Publication number Publication date
JP2003510568A (en) 2003-03-18

Similar Documents

Publication Publication Date Title
US5319459A (en) Method and apparatus for checking defect on display screen
KR0167843B1 (en) Image checking system and method of lcd
CN110579479A (en) PCB maintenance system and maintenance method based on false point defect detection
US8345950B2 (en) System and method for testing a multimeter
CN203232220U (en) Liquid crystal display panel detecting equipment
CN103792705B (en) Detecting method and detecting device for detecting substrate defects
US20190385301A1 (en) Panel light-on apparatus, panel light-on testing system and panel light-on testing method
CN103927749A (en) Image processing method and device and automatic optical detector
JPH04208834A (en) Method for inspecting liquid crystal panel
CN109949725A (en) A kind of AOI system image grayscale standardized method and system
CN115980012A (en) Medical detection circuit board gluing multi-angle detection system and detection method thereof
JP3924796B2 (en) Pattern position measuring method and measuring apparatus
WO2001022070A1 (en) Method and system of lcd inspection by pattern comparison
KR101980755B1 (en) Apparatus for automatic inspection of the color difference mura for the display panel and method for the same
US6014035A (en) Test system and test method for liquid crystal display device
US5638167A (en) Method of measuring the light amount of a display picture element, display screen inspecting method and display screen inspecting apparatus
JP2003167530A (en) Method and device for display picture inspection
CN110517616A (en) A kind of OLED display screen bad point exposure mask positioning system
CN115546140A (en) Display panel detection method and system and electronic device
CN115511791A (en) Liquid crystal grating function detection method and system
CN110763703A (en) Projection type system for assisting printed circuit board in quick positioning, fixed-point amplification and observation
CN112465780B (en) Method and device for monitoring abnormal film thickness of insulating layer
JP3311628B2 (en) Defect location device for thin display devices
KR100902301B1 (en) Defect inspection system
CN115079045B (en) Automatic detection short circuit breaking device for previous procedure image

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP SG US

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)