CN116912233B - Defect detection method, device, equipment and storage medium based on liquid crystal display screen - Google Patents
Defect detection method, device, equipment and storage medium based on liquid crystal display screen Download PDFInfo
- Publication number
- CN116912233B CN116912233B CN202311127504.5A CN202311127504A CN116912233B CN 116912233 B CN116912233 B CN 116912233B CN 202311127504 A CN202311127504 A CN 202311127504A CN 116912233 B CN116912233 B CN 116912233B
- Authority
- CN
- China
- Prior art keywords
- image
- defect
- color
- liquid crystal
- crystal display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000007547 defect Effects 0.000 title claims abstract description 171
- 239000004973 liquid crystal related substance Substances 0.000 title claims abstract description 124
- 238000001514 detection method Methods 0.000 title claims abstract description 86
- 238000003860 storage Methods 0.000 title claims abstract description 13
- 238000012937 correction Methods 0.000 claims abstract description 52
- 238000001914 filtration Methods 0.000 claims abstract description 30
- 239000003086 colorant Substances 0.000 claims abstract description 17
- 230000000877 morphologic effect Effects 0.000 claims abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 14
- 230000002159 abnormal effect Effects 0.000 claims description 46
- 238000006073 displacement reaction Methods 0.000 claims description 26
- 238000000034 method Methods 0.000 claims description 23
- 230000008859 change Effects 0.000 claims description 5
- 238000003702 image correction Methods 0.000 claims description 5
- 238000005520 cutting process Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 239000007787 solid Substances 0.000 description 6
- 239000000428 dust Substances 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 241000519995 Stachys sylvatica Species 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 230000002950 deficient Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003908 quality control method Methods 0.000 description 1
- ORFSSYGWXNGVFB-UHFFFAOYSA-N sodium 4-amino-6-[[4-[4-[(8-amino-1-hydroxy-5,7-disulfonaphthalen-2-yl)diazenyl]-3-methoxyphenyl]-2-methoxyphenyl]diazenyl]-5-hydroxynaphthalene-1,3-disulfonic acid Chemical compound COC1=C(C=CC(=C1)C2=CC(=C(C=C2)N=NC3=C(C4=C(C=C3)C(=CC(=C4N)S(=O)(=O)O)S(=O)(=O)O)O)OC)N=NC5=C(C6=C(C=C5)C(=CC(=C6N)S(=O)(=O)O)S(=O)(=O)O)O.[Na+] ORFSSYGWXNGVFB-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/1306—Details
- G02F1/1309—Repairing; Testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30121—CRT, LCD or plasma display
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Nonlinear Science (AREA)
- Quality & Reliability (AREA)
- Chemical & Material Sciences (AREA)
- Crystallography & Structural Chemistry (AREA)
- Optics & Photonics (AREA)
- Liquid Crystal Display Device Control (AREA)
Abstract
The invention belongs to the technical field of machine vision, and discloses a defect detection method, device and equipment based on a liquid crystal display screen and a storage medium. When the liquid crystal display screen is placed at a detection position and enters a detection state, a shooting image of the liquid crystal display screen is obtained, filtering processing is carried out on the shooting image, a filtering image of a defect area is obtained, morphological correction is carried out according to the filtering image, a correction image is obtained, image registration is carried out on the correction image, a defect area is obtained, a defect type is obtained according to the defect area, a series of operations are carried out on the shot image of the display screen, the correction image is obtained, the defect area is obtained according to the correction image, and display defects of which the defect type of the display screen is uneven due to brightness or display defects such as white points, black points, dark lines, bright lines, wrong colors and the like can be clearly obtained through image comparison.
Description
Technical Field
The present invention relates to the field of machine vision, and in particular, to a method, an apparatus, a device, and a storage medium for detecting defects based on a liquid crystal display.
Background
In the production process of the liquid crystal display, defect detection is an indispensable production link, and in the defect detection process, the quality of the liquid crystal display can be detected, and the display which does not meet the product quality requirement is removed, so the defect detection is an important means for improving the product quality.
In general, when the defect detection of the liquid crystal display screen is performed, the defect detection is performed by a manual mode, the subjectivity of the manual detection is high, the detection efficiency and the detection precision are relatively low, the detection error rate of the same quality inspector can be greatly increased along with the increase of the detection time, the quality control is not facilitated, the production cost can be increased if the human resources are continuously improved, and as an improvement method, an electrical parameter detection method is generally used at present, but the electrical parameter detection method cannot completely detect the defect of the display screen.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide a defect detection method, device, equipment and storage medium based on a liquid crystal display screen, and aims to solve the technical problem that the defect detection of the display screen is incomplete in the prior art.
In order to achieve the above object, the present invention provides a defect detection method based on a liquid crystal display, the method comprising the steps of:
when the liquid crystal display screen is placed at a detection position and enters a detection state, acquiring a shooting image of the liquid crystal display screen;
filtering the shot image to obtain a filtered image of the shot image;
carrying out morphological correction according to the filtered image to obtain a corrected image;
and carrying out image registration on the corrected image to obtain a defect area.
And obtaining the defect type according to the defect area.
Optionally, the performing image registration on the corrected image to obtain a defect area includes:
cutting the corrected image to obtain a shooting image of the display area of the display screen;
determining the current image color according to the current image displayed by the liquid crystal display;
determining an abnormal region in the photographed image of the display region of the display screen according to the image color;
extracting display colors in the abnormal region, and matching the display colors in the abnormal region with the image colors to obtain a color matching result;
and when the color matching is different, marking the abnormal region as a defect region.
Optionally, the extracting the display color in the abnormal area, and matching the display color in the abnormal area with the image color, to obtain a color matching result, includes:
when the display color in the abnormal region and the image color are different colors, a color matching result with difference in color display is obtained;
detecting the brightness of the display color and the image color in the abnormal area when the display color and the image color in the abnormal area are the same color;
and when the detection result is that the brightness of the display color in the abnormal area is inconsistent with the brightness of the image color, obtaining a color matching result with difference in brightness display.
Optionally, after marking the abnormal region as a defective region when the color matching is different, the method further includes:
performing contour recognition on the defect area to obtain contour features of the defect area;
determining the shape of a defect area according to the profile features;
classifying the shapes of the defect areas to obtain the defect types of the liquid crystal display screen.
Optionally, the filtering processing is performed on the captured image to obtain a filtered image of the captured image, including:
obtaining a pixel set of the shooting image according to pixels in the shooting image;
obtaining a pixel neighborhood set according to the pixel set and the pixels;
calculating a gray median of pixel gray values according to the pixel neighborhood set;
and obtaining a filtered image of the shot image according to the gray median.
Optionally, the performing morphological correction according to the filtered image to obtain a corrected image includes:
acquiring a display image of the display screen;
constructing a space coordinate system corresponding to the filtered image;
obtaining image coordinates of the display image according to the image size of the display image by taking the space coordinate system as a reference;
acquiring the spatial coordinates of the filtered image under the spatial coordinate system;
and correcting the filtered image according to the correction displacement to obtain a corrected image.
Optionally, the obtaining a correction displacement according to the image coordinates and the space coordinates, correcting the filtered image according to the correction displacement, and obtaining a corrected image includes:
obtaining an image scaling ratio according to the image coordinates and the space coordinates;
determining a pixel variation weight of the filtered image according to the image scaling ratio;
obtaining the correction displacement according to the pixel change weight;
and correcting the filtered image according to the correction displacement to obtain a corrected image.
In addition, in order to achieve the above object, the present invention also provides a defect detecting device based on a liquid crystal display, the defect detecting device based on a liquid crystal display includes:
the display screen detection module is used for acquiring a shooting image of the liquid crystal display screen when the liquid crystal display screen is placed at a detection position and enters a detection state;
the image filtering module is used for carrying out filtering processing on the shot image to obtain a filtered image of the defect area;
the image correction module is used for carrying out morphological correction according to the filtered image to obtain a corrected image;
the defect positioning module is used for carrying out image registration on the corrected image to obtain a defect area;
and the defect confirming module is used for obtaining the defect type according to the defect area.
In addition, in order to achieve the above object, the present invention also proposes a defect detecting device based on a liquid crystal display, the defect detecting device based on a liquid crystal display comprising: the defect detection system comprises a memory, a processor and a defect detection program based on the liquid crystal display, wherein the defect detection program based on the liquid crystal display is stored on the memory and can run on the processor, and the defect detection program based on the liquid crystal display is configured to realize the steps of the defect detection method based on the liquid crystal display.
In addition, in order to achieve the above object, the present invention also proposes a storage medium having stored thereon a defect detection program based on a liquid crystal display, which when executed by a processor, implements the steps of the defect detection method based on a liquid crystal display as described above.
When the liquid crystal display screen is placed at a detection position and enters a detection state, a shooting image of the liquid crystal display screen is obtained, filtering processing is carried out on the shooting image, a filtering image of a defect area is obtained, morphological correction is carried out according to the filtering image, a correction image is obtained, image registration is carried out on the correction image, a defect area is obtained, a defect type is obtained according to the defect area, a series of operations are carried out on the shot image of the display screen, the correction image is obtained, the defect area is obtained according to the correction image, and display defects of which the defect type of the display screen is uneven due to brightness or display defects such as white points, black points, dark lines, bright lines, wrong colors and the like can be clearly obtained through image comparison.
Drawings
FIG. 1 is a schematic diagram of a defect detection device based on a liquid crystal display in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flow chart of a first embodiment of a defect detection method based on a liquid crystal display according to the present invention;
FIG. 3 is a schematic diagram showing the mounting positions of a LCD and a camera according to an embodiment of a defect detecting method based on an LCD;
FIG. 4 is a flow chart of a second embodiment of a defect detection method based on a liquid crystal display according to the present invention;
FIG. 5 is a schematic diagram of an image in a spatial coordinate system according to an embodiment of a defect detection method based on a liquid crystal display according to the present invention;
FIG. 6 is a schematic diagram illustrating an image displacement correction method based on an embodiment of a defect detection method of the present invention;
fig. 7 is a block diagram of a first embodiment of a defect detecting device based on a liquid crystal display according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a defect detection device based on a liquid crystal display in a hardware operation environment according to an embodiment of the present invention.
As shown in fig. 1, the defect detecting apparatus based on a liquid crystal display may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 is not limiting of a liquid crystal display-based defect detection apparatus, and may include more or fewer components than shown, or certain components may be combined, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a defect detection program based on a liquid crystal display may be included in the memory 1005 as one type of storage medium.
In the defect detecting device based on a liquid crystal display screen shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the defect detection device based on the liquid crystal display screen can be arranged in the defect detection device based on the liquid crystal display screen, and the defect detection device based on the liquid crystal display screen calls the defect detection program based on the liquid crystal display screen stored in the memory 1005 through the processor 1001 and executes the defect detection method based on the liquid crystal display screen.
Referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of a defect detection method based on a liquid crystal display screen.
In this embodiment, the defect detection method based on the liquid crystal display screen includes the following steps:
step S10: and when the liquid crystal display screen is placed at the detection position and enters the detection state, acquiring a shooting image of the liquid crystal display screen.
It should be noted that, the execution body of the embodiment is a defect detection device based on a liquid crystal display, where the defect detection device based on a liquid crystal display has functions of data processing, data communication, program running, etc., and the defect detection device based on a liquid crystal display may be an integrated controller, a control computer, etc., or may be other devices with similar functions, which is not limited in this embodiment.
It should be understood that the detection position refers to a placement position of the liquid crystal display screen in a detection environment, the detection environment of the liquid crystal display screen is a dark environment, an ionization dust removal device can be adopted in the detection environment, and dust removal operation is performed before detection of the liquid crystal display screen, so that dust is prevented from interfering with detection results. Meanwhile, the directions of the liquid crystal display to be detected face to the same direction, and the area array CMOS color camera is arranged in the opposite direction of the liquid crystal display, so that the opposite shooting image of the liquid crystal display can be obtained in the detection process. Wherein the resolution of the area array CMOS color camera is consistent with the resolution of the liquid crystal display screen to be tested. Referring to fig. 3, fig. 3 is a schematic diagram of a mounting position of a liquid crystal display and a camera. When an area array CMOS color camera is deployed, the focal length of the camera needs to be adjusted, so that a picture shot by the color camera only comprises an inner frame and a display area of a liquid crystal display screen, and the inner frame is used for judging whether a complete display area is acquired or not. In order to ensure that the photographed image is disturbed by the outside as much as possible, the light source in the dark environment only comprises the liquid crystal display to be tested, and the light source is generated by the backlight of the liquid crystal display.
It can be understood that the detection state of the liquid crystal display screen is a solid color display in the working mode, and specifically may include solid black, solid white, solid red, solid green and solid blue.
In a specific implementation, when the liquid crystal display screen is detected to reach the detection position, the liquid crystal display screen sequentially displays pure black, pure white, pure red, pure green and pure blue image contents when the liquid crystal display screen is in a working state, and when the liquid crystal display screen displays one pure color image, the camera area array COMS color camera acquires the current displayed image pair of the liquid crystal display screen within a preset time to obtain a shooting image of the liquid crystal display screen, wherein the preset time is determined according to specific conditions, and is preferably 1 second in order to ensure stable display. The liquid crystal display screen is connected with the area array CMOS camera through the defect detection equipment based on the liquid crystal display screen, the defect detection equipment based on the liquid crystal display screen can control the display content and display time of the liquid crystal display screen, when the defect detection equipment based on the liquid crystal display screen sends the display content to the liquid crystal display screen, shooting information can be sent to the area array CMOS color camera after a certain time delay, so that the area array CMOS color camera can shoot the display area of the liquid crystal display screen, a shooting image is obtained, and the shooting image is transmitted to the defect detection equipment based on the liquid crystal display screen.
Step S20: and filtering the shot image to obtain a filtered image of the defect area.
The filtering image is to filter the photographed image to remove interference factors such as ionization interference occurring in the photographing process.
In a specific implementation, when the area array CMOS color camera is used for photographing the display area of the liquid crystal display screen, the area array CMOS color camera is possibly interfered by other ionization signals, and the area array CMOS color camera is also polluted by external noise in the image transmission process, so that the image can be denoised in a filtering mode to restore the image quality, and filtering modes such as Gaussian filtering, median filtering and the like can be adopted in the filtering process.
Further, the filtering processing is performed on the photographed image to obtain a filtered image of the photographed image, including:
obtaining a pixel set of the shooting image according to pixels in the shooting image;
obtaining a pixel neighborhood set according to the pixel set and the pixels;
calculating a gray median of pixel gray values according to the pixel neighborhood set;
and obtaining a filtered image of the shot image according to the gray median.
For an area array CMOS color camera with a resolution of 1920×1080, the captured image contains 1920×1080 pixels, a pixel set is obtained according to the pixel positions of the captured image, the pixels in the 3×3 range around the current pixel are combined into a neighborhood according to the positional relationship in the pixel set, the pixels with less than 8 pixels around are complemented with the current pixel, and the median of the gray scale in the neighborhood set is the median of the gray scale in the neighborhood set.
In a specific implementation, a neighborhood set of the pixel set may be constructed from the pixel set in the following manner, where in this embodiment, the neighborhood is constructed by selecting a neighborhood center X, and a neighborhood radius is 1:
wherein X is the neighborhood center and takes the value as，/>Is the neighborhood radius.
After the neighborhood set of the pixel set is obtained, the gray median value of the pixels in each neighborhood can be calculated, the gray values in the neighborhood are arranged in the order from big to small or from small to big, and the middle gray median value is selected as the gray value of the current neighborhood because the current neighborhood comprises 9 pixel values, and if the number of the pixel values in the neighborhood is even, the gray average value of the middle two pixels is used as the gray median value. And obtaining the gray median value of all pixels in the same mode, and obtaining a filtered image of the shot image according to the gray median value. Through median filtering, the blurring degree of the image can be reduced, and the information of the image can be well ensured.
Step S30: and carrying out morphological correction according to the filtered image to obtain a corrected image.
The morphological correction is an operation for performing an operation such as zooming on an image whose morphology is not standard so that the image can reach a predetermined standard, and the standard of the correction is the size of the display image of the liquid crystal display.
In a specific implementation, after the filtered image is obtained, detecting the resolution of the filtered image, judging the resolution of the filtered image and judging the resolution of the display image of the liquid crystal display screen, and judging the size difference between the filtered image and the display image. Meanwhile, the deflection angle of the liquid crystal display screen can be determined according to the imaging state of the image, when a certain angle offset exists at the placement position of the liquid crystal display screen, a certain included angle exists between the area array CMOS color camera and the display area, the two ends of the shot image are inconsistent, and the elevation angle of the liquid crystal display screen can be judged according to the same mode.
After the difference between the filtered image and the display image is obtained, the filtered image can be corrected according to the difference value to obtain a corrected image.
Step S40: and carrying out image registration on the corrected image to obtain a defect area.
It should be noted that, the defective area refers to an area where there is a difference between the calibration image and the display image, and this partial area corresponds to an area where the liquid crystal display may have a problem.
In a specific implementation, the correction image and the display image can be registered in the following specific ways: overlapping the corrected image and the display image in the same position relation, differencing the pixel points corresponding to the corrected image and the display image to obtain pixel differences in the same position, detecting the pixel differences after the registered pixel differences are obtained, determining the position where the pixel differences are different from adjacent pixels, and obtaining a defect area after the difference value of the whole image is traversed.
Step S50: and obtaining the defect type according to the defect area.
The defect types include white, black, dark, bright, and wrong defects.
In a specific implementation, according to the defect area, obtaining the defect type specifically includes: performing contour recognition on the defect area to obtain contour features of the defect area; and determining the shape of the defect area according to the contour features. Classifying the shapes of the defect areas to obtain the defect types of the liquid crystal display screen, performing contour detection on the defect areas to obtain the contour shapes of the defect areas, and obtaining the shape characteristics of the defects according to the contour shapes, wherein the shape characteristics can be specifically in the shape of points, lines and sheets. The current color type and brightness information, specifically white point, black point, wrong color and the like and defect types with higher brightness or lower brightness, can be determined according to the difference value of the pixels in the defect area.
In the embodiment, when the liquid crystal display screen is placed at a detection position and enters a detection state, a shot image of the liquid crystal display screen is acquired, filtering processing is performed on the shot image to obtain a filtered image of a defect area, morphological correction is performed according to the filtered image to obtain a corrected image, image registration is performed on the corrected image to obtain a defect area, a defect type is obtained according to the defect area, a series of operations are performed on the shot image of the display screen to obtain the corrected image, the defect area is obtained according to the corrected image, and display defects such as uneven display caused by brightness, or display defects such as white spots, black spots, dark lines, bright lines, and wrong colors of the display screen can be clearly obtained through image comparison.
Referring to fig. 4, fig. 4 is a flowchart illustrating a defect detecting method based on a liquid crystal display according to a second embodiment of the present invention.
Based on the first embodiment, the defect detection method based on the liquid crystal display according to the present embodiment further includes:
step S401: and cutting the corrected image to obtain a shooting image of the display area of the display screen.
Step S402: and determining the current image color according to the current image displayed by the liquid crystal display screen.
Step S403: and determining an abnormal region in the photographed image of the display region of the display screen according to the image color.
Step S404: and extracting the display color in the abnormal region, and matching the display color in the abnormal region with the image color to obtain a color matching result.
Step S405: and when the color matching is different, marking the abnormal region as a defect region.
In the specific implementation, the correction image is cut to obtain shooting images which all comprise the display area of the display screen, and in the process, the frame of the liquid crystal display screen is deleted from the image, so that interference to image registration is avoided. Meanwhile, the color of the current display is determined according to the image currently displayed on the display screen, the color of the corrected image is matched with the color of the displayed image of the display screen, and the pixel points with differences are marked. When the color matching is performed, the matching can be performed according to the RGB values of the pixels, and when the RGB values of the two pixels are different, the pixels with the differences are marked, and further, the recording can be performed according to the positions of the pixels. And detecting adjacent pixels of the marked pixel points, and obtaining a defect area according to the adjacent pixels with the marks when the pixels are the same as the marked pixel points.
Further, the extracting the display color in the abnormal area, and matching the display color in the abnormal area with the image color to obtain a color matching result, including:
when the display color in the abnormal region and the image color are different colors, a color matching result with difference in color display is obtained;
detecting the brightness of the display color and the image color in the abnormal area when the display color and the image color in the abnormal area are the same color;
and when the detection result is that the brightness of the display color in the abnormal area is inconsistent with the brightness of the image color, obtaining a color matching result with difference in brightness display.
In a specific implementation, a color includes, in addition to hue, lightness, also known as brightness. When comparing the color in the defect area with the display image, since the display screen obtains various colors by coordinating the three colors of red, green and blue when performing color display, and the corresponding brightness can be changed by applying different voltages to the single pixel point, when the difference exists between the pixels in the corrected image and the display image, the display of the liquid crystal display screen is problematic, including color display problem and brightness problem. And matching the display color in the abnormal region with the color of the image in the display screen, outputting a color matching result with difference in color display when the colors are inconsistent, detecting the brightness of the display color in the abnormal region and the image color when the display color in the abnormal region and the image color are the same, obtaining the color matching result with difference in brightness display when the detection result is that the brightness of the display color in the abnormal region is inconsistent with the brightness of the image color, and outputting the obtained color matching result to guide the restoration of the liquid crystal display screen.
Further, the performing morphological correction according to the filtered image to obtain a corrected image includes:
acquiring a display image of the display screen;
constructing a space coordinate system corresponding to the filtered image;
obtaining image coordinates of the display image according to the image size of the display image by taking the space coordinate system as a reference;
acquiring the spatial coordinates of the filtered image under the spatial coordinate system;
and correcting the filtered image according to the correction displacement to obtain a corrected image.
It should be noted that, the spatial coordinate system accurately describes the pixel point, and the specific pixel point can be determined through the coordinates.
In a specific implementation, referring to fig. 5, fig. 5 is a schematic diagram of an image in a spatial coordinate system. And constructing a space coordinate system according to the display image of the display screen, wherein the unit length of the space coordinate system is 1 pixel. The spatial coordinate system can be obtained by taking the vertex of the lower left corner of the display image as the origin of coordinates and taking the two sides of the lower left corner as the horizontal axis and the vertical axis of the coordinate system, and the coordinates of each pixel point of the display image can be obtained. Similarly, the filtered image is obtained according to the shot image obtained by the area array CMOS color camera, and the resolution of the two images is consistent because the area array CMOS color camera is in a positive relation with the liquid crystal display screen, so that the image sizes of the two images can be perfectly overlapped under normal conditions. In order to more accurately locate abnormal pixel points, therefore, the actual resolution of the filtered image needs to be judged, the filtered image is projected into a space coordinate system, the resolution of the filtered image and the coordinates of each pixel point are determined, when the coordinates of the pixel points of the filtered image are overlapped with the coordinates of the display image, the filtered image does not need to be additionally corrected, and the current filtered image is directly output to correct the image. When the coordinates of the pixel points of the filter image are not completely coincident with the coordinates of the display image, the error exists in the current placement position of the liquid crystal display screen, correction displacement is obtained according to the coordinate difference of the two images, and the filter image is corrected according to the correction displacement to obtain a corrected image.
Further, the obtaining a correction displacement according to the image coordinates and the space coordinates, correcting the filtered image according to the correction displacement, and obtaining a corrected image includes:
obtaining an image scaling ratio according to the image coordinates and the space coordinates;
determining a pixel variation weight of the filtered image according to the image scaling ratio;
obtaining the correction displacement according to the pixel change weight;
and correcting the filtered image according to the correction displacement to obtain a corrected image.
In a specific implementation, referring to fig. 6, fig. 6 is an image displacement correction schematic diagram. According to the image coordinates and the space coordinates, the pixel length of the filtered image and the pixel length of the displayed image can be obtained, before matching, the two images are required to be completely consistent in size, in this embodiment, the long side is taken as an example for explanation, when the filtered image and the displayed image cannot be completely matched, it is explained that the projection of the current filtered image in the coordinate system is smaller than the side length of the displayed image, the length of the displayed image is set to be L, the length of the filtered image is set to be X, then the obtained image scaling ratio is set to be L/(L-X), according to the scaling ratio, the weight that each pixel needs to be changed can be obtained, according to the weight, the correction displacement is obtained, and the correction displacement is determined as the position coordinates of the pixel point in the filtered image, specifically,
wherein,to correct displacement +.>Is the i-th pixel point from the origin.
Similarly, if the filtered images have similar differences in the other direction, the corrected displacement may be obtained according to the same scheme, and the corrected image may be obtained according to the obtained corrected displacement.
According to the embodiment, the correction is carried out on the filtered image, the correction parameters of the filtered image are obtained according to the difference of the image sizes between the filtered image and the display image, the filtered image is filtered according to the correction parameters to obtain the corrected image with the same size as the display image, after the corrected image is obtained, the color difference and the brightness difference between the two images can be obtained according to the matching of the corrected image and the display image, meanwhile, the specific defect type can be obtained according to the difference type, and the repairing work of the liquid crystal display screen is guided.
In addition, the embodiment of the invention also provides a storage medium, wherein the storage medium stores a defect detection program based on the liquid crystal display screen, and the defect detection program based on the liquid crystal display screen realizes the steps of the defect detection method based on the liquid crystal display screen when being executed by a processor.
Referring to fig. 7, fig. 7 is a block diagram illustrating a first embodiment of a defect detecting device based on a liquid crystal display according to the present invention.
As shown in fig. 7, a defect detecting device based on a liquid crystal display according to an embodiment of the present invention includes:
the display screen detection module 10 is used for acquiring a shooting image of the liquid crystal display screen when the liquid crystal display screen is placed at a detection position and enters a detection state;
an image filtering module 20, configured to perform filtering processing on the captured image to obtain a filtered image of the defect area;
an image correction module 30, configured to perform morphological correction according to the filtered image, so as to obtain a corrected image;
a defect positioning module 40, configured to perform image registration on the corrected image to obtain a defect area;
and a defect confirmation module 50, configured to obtain a defect type according to the defect area.
In the embodiment, when the liquid crystal display screen is placed at a detection position and enters a detection state, a shot image of the liquid crystal display screen is acquired, filtering processing is performed on the shot image to obtain a filtered image of a defect area, morphological correction is performed according to the filtered image to obtain a corrected image, image registration is performed on the corrected image to obtain a defect area, a defect type is obtained according to the defect area, a series of operations are performed on the shot image of the display screen to obtain the corrected image, the defect area is obtained according to the corrected image, and display defects such as uneven display caused by brightness, or display defects such as white spots, black spots, dark lines, bright lines, and wrong colors of the display screen can be clearly obtained through image comparison.
In an embodiment, the defect positioning module 40 is further configured to cut the corrected image to obtain a shot image of the display area of the display screen; determining the current image color according to the current image displayed by the liquid crystal display; determining an abnormal region in the photographed image of the display region of the display screen according to the image color; extracting display colors in the abnormal region, and matching the display colors in the abnormal region with the image colors to obtain a color matching result; and when the color matching is different, marking the abnormal region as a defect region.
In an embodiment, the defect positioning module 40 is further configured to obtain a color matching result with a difference in color display when the display color in the abnormal area and the image color are different; detecting the brightness of the display color and the image color in the abnormal area when the display color and the image color in the abnormal area are the same color; and when the detection result is that the brightness of the display color in the abnormal area is inconsistent with the brightness of the image color, obtaining a color matching result with difference in brightness display.
In an embodiment, the defect confirmation module 50 is further configured to perform contour recognition on the defect area to obtain a contour feature of the defect area; determining the shape of a defect area according to the profile features; classifying the shapes of the defect areas to obtain the defect types of the liquid crystal display screen.
In an embodiment, the image filtering module 20 is further configured to obtain a set of pixels of the captured image according to pixels in the captured image; obtaining a pixel neighborhood set according to the pixel set and the pixels; calculating a gray median of pixel gray values according to the pixel neighborhood set; and obtaining a filtered image of the defect area according to the gray median.
In one embodiment, the image correction module 30 is further configured to acquire a display image of the display screen; constructing a space coordinate system corresponding to the filtered image; obtaining image coordinates of the display image according to the image size of the display image by taking the space coordinate system as a reference; acquiring the spatial coordinates of the filtered image under the spatial coordinate system; and correcting the filtered image according to the correction displacement to obtain a corrected image.
In an embodiment, the image correction module 30 is further configured to obtain an image scaling ratio according to the image coordinates and the spatial coordinates; determining a pixel variation weight of the filtered image according to the image scaling ratio; obtaining the correction displacement according to the pixel change weight; and correcting the filtered image according to the correction displacement to obtain a corrected image.
It should be understood that the foregoing is illustrative only and is not limiting, and that in specific applications, those skilled in the art may set the invention as desired, and the invention is not limited thereto.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
It should be noted that the above-described working procedure is merely illustrative, and does not limit the scope of the present invention, and in practical application, a person skilled in the art may select part or all of them according to actual needs to achieve the purpose of the embodiment, which is not limited herein.
Furthermore, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of embodiments, it will be clear to a person skilled in the art that the above embodiment method may be implemented by means of software plus a necessary general hardware platform, but may of course also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. Read Only Memory (ROM)/RAM, magnetic disk, optical disk) and comprising several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (5)
1. The defect detection method based on the liquid crystal display screen is characterized by comprising the following steps of:
when the liquid crystal display screen is placed at a detection position and enters a detection state, acquiring a shooting image of the liquid crystal display screen;
filtering the shot image to obtain a filtered image of the shot image;
carrying out morphological correction according to the filtered image to obtain a corrected image;
performing image registration on the corrected image to obtain a defect area;
obtaining a defect type according to the defect area;
the filtering processing is performed on the photographed image to obtain a filtered image of the photographed image, including:
obtaining a pixel set of the shooting image according to pixels in the shooting image;
obtaining a pixel neighborhood set according to the pixel set and the pixels;
calculating a gray median of pixel gray values according to the pixel neighborhood set;
obtaining a filtered image of the photographed image according to the gray median;
the image registration of the corrected image to obtain a defect area comprises the following steps:
cutting the corrected image to obtain a shooting image of the display area of the display screen;
determining the current image color according to the current image displayed by the liquid crystal display;
determining an abnormal region in the photographed image of the display region of the display screen according to the image color;
when the display color in the abnormal region and the image color are different colors, a color matching result with difference in color display is obtained;
detecting the brightness of the display color and the image color in the abnormal area when the display color and the image color in the abnormal area are the same color;
when the detection result is that the brightness of the display color in the abnormal area is inconsistent with the brightness of the image color, obtaining a color matching result with difference in brightness display;
when the color matching result is that there is a difference, marking the abnormal region as a defect region;
the performing morphological correction according to the filtered image to obtain a corrected image includes:
acquiring a display image of the display screen;
constructing a space coordinate system corresponding to the filtered image;
obtaining image coordinates of the display image according to the image size of the display image by taking the space coordinate system as a reference;
acquiring the spatial coordinates of the filtered image under the spatial coordinate system;
obtaining an image scaling ratio according to the image coordinates and the space coordinates;
determining a pixel variation weight of the filtered image according to the image scaling ratio;
obtaining correction displacement according to the pixel change weight;
and correcting the filtered image according to the correction displacement to obtain a corrected image.
2. The method of claim 1, wherein obtaining a defect type from the defect area comprises:
performing contour recognition on the defect area to obtain contour features of the defect area;
determining the shape of a defect area according to the profile features;
classifying the shapes of the defect areas to obtain the defect types of the liquid crystal display screen.
3. A defect detecting device based on a liquid crystal display screen, characterized in that the defect detecting device based on a liquid crystal display screen comprises:
the display screen detection module is used for acquiring a shooting image of the liquid crystal display screen when the liquid crystal display screen is placed at a detection position and enters a detection state;
the image filtering module is used for carrying out filtering processing on the shooting image to obtain a filtering image of the shooting image;
the image correction module is used for carrying out morphological correction according to the filtered image to obtain a corrected image;
the defect positioning module is used for carrying out image registration on the corrected image to obtain a defect area;
the defect confirming module is used for obtaining the defect type according to the defect area;
the filtering processing is performed on the photographed image to obtain a filtered image of the photographed image, including:
obtaining a pixel set of the shooting image according to pixels in the shooting image;
obtaining a pixel neighborhood set according to the pixel set and the pixels;
calculating a gray median of pixel gray values according to the pixel neighborhood set;
obtaining a filtered image of the photographed image according to the gray median;
the image registration of the corrected image to obtain a defect area comprises the following steps:
cutting the corrected image to obtain a shooting image of the display area of the display screen;
determining the current image color according to the current image displayed by the liquid crystal display;
determining an abnormal region in the photographed image of the display region of the display screen according to the image color;
when the display color in the abnormal region and the image color are different colors, a color matching result with difference in color display is obtained;
detecting the brightness of the display color and the image color in the abnormal area when the display color and the image color in the abnormal area are the same color;
when the detection result is that the brightness of the display color in the abnormal area is inconsistent with the brightness of the image color, obtaining a color matching result with difference in brightness display;
when the color matching result is that there is a difference, marking the abnormal region as a defect region;
the performing morphological correction according to the filtered image to obtain a corrected image includes:
acquiring a display image of the display screen;
constructing a space coordinate system corresponding to the filtered image;
obtaining image coordinates of the display image according to the image size of the display image by taking the space coordinate system as a reference;
acquiring the spatial coordinates of the filtered image under the spatial coordinate system;
obtaining an image scaling ratio according to the image coordinates and the space coordinates;
determining a pixel variation weight of the filtered image according to the image scaling ratio;
obtaining correction displacement according to the pixel change weight;
and correcting the filtered image according to the correction displacement to obtain a corrected image.
4. A defect detection apparatus based on a liquid crystal display, the apparatus comprising: a memory, a processor and a liquid crystal display based defect detection program stored on the memory and executable on the processor, the liquid crystal display based defect detection program configured to implement the steps of the liquid crystal display based defect detection method of any one of claims 1 to 2.
5. A storage medium, wherein a defect detection program based on a liquid crystal display is stored on the storage medium, and the defect detection program based on a liquid crystal display realizes the steps of the defect detection method based on a liquid crystal display according to any one of claims 1 to 2 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311127504.5A CN116912233B (en) | 2023-09-04 | 2023-09-04 | Defect detection method, device, equipment and storage medium based on liquid crystal display screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311127504.5A CN116912233B (en) | 2023-09-04 | 2023-09-04 | Defect detection method, device, equipment and storage medium based on liquid crystal display screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116912233A CN116912233A (en) | 2023-10-20 |
| CN116912233B true CN116912233B (en) | 2024-02-13 |
Family
ID=88353397
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311127504.5A Active CN116912233B (en) | 2023-09-04 | 2023-09-04 | Defect detection method, device, equipment and storage medium based on liquid crystal display screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116912233B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117116173B (en) * | 2023-10-25 | 2024-01-16 | 深圳市汇宝翔科技有限公司 | Quality detection method of liquid crystal display screen |
| CN117670886B (en) * | 2024-02-01 | 2024-05-14 | 深圳市欧灵科技有限公司 | Display screen defect detection method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104749184A (en) * | 2013-12-31 | 2015-07-01 | 研祥智能科技股份有限公司 | Automatic optical detection method and automatic optical detection system |
| CN108205210A (en) * | 2016-12-19 | 2018-06-26 | 南京理工大学 | LCD defect detecting systems and method based on Fourier plum forests and characteristic matching |
| CN108550121A (en) * | 2018-03-30 | 2018-09-18 | 哈尔滨工程大学 | A kind of sediment sonar image processing method based on medium filtering and wavelet transformation |
| CN110895806A (en) * | 2019-07-25 | 2020-03-20 | 研祥智能科技股份有限公司 | Method and system for detecting screen display defects |
| CN114757913A (en) * | 2022-04-15 | 2022-07-15 | 电子科技大学 | Display screen defect detection method |
| CN114913121A (en) * | 2022-03-31 | 2022-08-16 | 联想(北京)有限公司 | Screen defect detection system and method, electronic device and readable storage medium |
| CN115330789A (en) * | 2022-10-13 | 2022-11-11 | 潍坊歌尔电子有限公司 | Screen defect detection method, device, equipment and readable storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8331650B2 (en) * | 2010-07-29 | 2012-12-11 | Sharp Laboratories Of America, Inc. | Methods, systems and apparatus for defect detection |
-
2023
- 2023-09-04 CN CN202311127504.5A patent/CN116912233B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104749184A (en) * | 2013-12-31 | 2015-07-01 | 研祥智能科技股份有限公司 | Automatic optical detection method and automatic optical detection system |
| CN108205210A (en) * | 2016-12-19 | 2018-06-26 | 南京理工大学 | LCD defect detecting systems and method based on Fourier plum forests and characteristic matching |
| CN108550121A (en) * | 2018-03-30 | 2018-09-18 | 哈尔滨工程大学 | A kind of sediment sonar image processing method based on medium filtering and wavelet transformation |
| CN110895806A (en) * | 2019-07-25 | 2020-03-20 | 研祥智能科技股份有限公司 | Method and system for detecting screen display defects |
| CN114913121A (en) * | 2022-03-31 | 2022-08-16 | 联想(北京)有限公司 | Screen defect detection system and method, electronic device and readable storage medium |
| CN114757913A (en) * | 2022-04-15 | 2022-07-15 | 电子科技大学 | Display screen defect detection method |
| CN115330789A (en) * | 2022-10-13 | 2022-11-11 | 潍坊歌尔电子有限公司 | Screen defect detection method, device, equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116912233A (en) | 2023-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116912233B (en) | Defect detection method, device, equipment and storage medium based on liquid crystal display screen | |
| US6292593B1 (en) | Image synthesizing device and method | |
| CN108760767B (en) | Large-size liquid crystal display defect detection method based on machine vision | |
| CN109752394B (en) | High-precision detection method and system for defects of display screen | |
| EP2417419B1 (en) | Digital optical comparator and corresponding digital comparison method | |
| CN109100363B (en) | Method and system for distinguishing defects of attached foreign matters from dust | |
| CN111025701B (en) | Curved surface liquid crystal screen detection method | |
| JP2008506174A (en) | Method, system, program module and computer program product for restoration of color components in an image model | |
| CN112669394A (en) | Automatic calibration method for vision detection system | |
| JP2005331929A5 (en) | ||
| CN113286135A (en) | Image correction method and apparatus | |
| CN111707456A (en) | Optical machine definition testing method and testing device | |
| CN112611343A (en) | Chip flatness detection device for 5G circulator and detection method thereof | |
| JP2009229197A (en) | Linear defect detecting method and device | |
| CN113538431B (en) | Display screen flaw positioning method and device, terminal equipment and system | |
| JP2003168103A (en) | Method and device for detecting line defect of picture, and method for correcting image data | |
| JP2009036582A (en) | Inspection method, inspection device and inspection program of plane display panel | |
| CN111369513B (en) | Abnormality detection method, abnormality detection device, terminal equipment and storage medium | |
| JP2002328096A (en) | Program, method, and system for detecting crack defect generated on structure | |
| CN113570578A (en) | Lens ghost phenomenon detection method and device | |
| KR20100126015A (en) | Method for inspecting defect of the pixels in display panel device by image | |
| CN108848358B (en) | Method and device for correcting color convergence errors | |
| CN115684012A (en) | Visual inspection system, calibration method, device and readable storage medium | |
| JP2005140655A (en) | Method of detecting stain flaw, and stain flaw detector | |
| CN109870293B (en) | Detection method and detection device for display panel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |