CN116229856B - Automatic control screen detection system and method for computer - Google Patents
Automatic control screen detection system and method for computer Download PDFInfo
- Publication number
- CN116229856B CN116229856B CN202310518195.8A CN202310518195A CN116229856B CN 116229856 B CN116229856 B CN 116229856B CN 202310518195 A CN202310518195 A CN 202310518195A CN 116229856 B CN116229856 B CN 116229856B
- Authority
- CN
- China
- Prior art keywords
- screen
- computer
- detection
- pixel
- brightness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 197
- 238000000034 method Methods 0.000 title claims abstract description 14
- 230000007547 defect Effects 0.000 claims abstract description 65
- 230000005540 biological transmission Effects 0.000 claims abstract description 41
- 238000010586 diagram Methods 0.000 claims description 23
- 238000004364 calculation method Methods 0.000 claims description 18
- 238000007689 inspection Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 10
- 238000007781 pre-processing Methods 0.000 claims description 9
- 230000002950 deficient Effects 0.000 claims description 6
- 238000005516 engineering process Methods 0.000 claims description 4
- 238000004519 manufacturing process Methods 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 abstract description 3
- 238000012549 training Methods 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 2
- 238000005315 distribution function Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000002310 reflectometry Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/006—Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses an automatic control screen detection system and method for a computer, which belong to the field of screen detection, and the current screen detection method is divided into manual detection, traditional machine vision detection and machine learning detection, and has the problems of long time consumption and failure in judging the position of an unqualified pixel according to quality detection information; the invention provides a scheme that circuit detection, defect detection and quality detection are carried out on a computer screen, a gray level image of an irradiated screen is acquired in the quality detection, tristimulus values and brightness uniformity of each pixel are calculated by utilizing pixel coordinate information and pixel width and height, the computer screen with unqualified brightness uniformity is processed, position information of unqualified pixels is accurately acquired by comparing brightness difference, color difference and qualified threshold values of the pixels, and the screen is automatically grasped to a qualified transmission belt or a unqualified transmission belt by utilizing detection results, so that detection efficiency and accuracy are improved.
Description
Technical Field
The invention belongs to the field of screen detection, and particularly relates to an automatic control screen detection system and method for a computer.
Background
The screen detection technology for the computer comprises manual detection, traditional machine vision based and machine learning based, the manual detection is time-consuming and labor-consuming, the risk of misjudgment exists, and the most commonly used method is the last two. The traditional machine vision method is that the background and the defects of the collected image are segmented through digital image processing, so that a defect image is obtained, the shape and the size of the defect are obtained through an image processing method, and then the classification of the defect is realized through the characteristics of morphology, gray information and the like of the defect; the machine learning-based method is characterized in that a large number of sample features are manufactured into a training data set, training of a model is completed by a computer, and then a model file is deployed on equipment to realize defect identification. The traditional method has the problems of long time consumption and incapability of judging the positions of unqualified pixels according to quality detection information.
For example, chinese patent with the publication number CN107749268B discloses a screen detection method and apparatus, the method includes: collecting a detection image; determining defect points in the detected image; selecting any two target defect points with the distance between the two points smaller than a preset distance threshold value; determining pixel points in a first preset area corresponding to the first line segment according to the first line segment formed by any two target defect points; and if the pixel points in the first preset area meet the defect conditions, determining that the screen to be detected has special defects. The embodiment of the application realizes the automatic detection of the special defects.
If the Chinese patent with the publication number of CN110850227B discloses a screen detection device and a screen detection method, the device comprises a conveying belt, a positioning jacking device arranged below the conveying belt and a detection device arranged above the conveying belt, wherein the positioning jacking device comprises a blocking component and a jacking component, the detection device comprises a fixing frame, a vertical lifting cylinder, a connecting plate, an X-axis drive, a Y-axis drive and a detection pen, the vertical lifting cylinder is arranged on the fixing frame, the connecting plate is connected to the lower end of the vertical lifting cylinder, the detection pen is connected with the connecting plate by means of the X-axis drive and the Y-axis drive, and the lower surface of the connecting plate is also connected with a compression component. Through setting up blocking assembly and jacking subassembly, make the screen that awaits measuring stop and by rising on the conveyer belt to can seamless and current screen production water line butt joint, need not artifical unloading, improve detection efficiency. In addition, through compressing tightly the subassembly with the screen that awaits measuring fixed, can prevent that the screen from taking place to skew or dropping when the marking off detects on the screen of detecting pen.
The problems proposed in the background art exist in the above patents: the method and the system have the advantages that the time consumption is long, a large amount of data training is needed, and the positions of unqualified pixels cannot be judged according to quality detection information.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides an automatic control screen detection system for a computer, which is characterized in that firstly, circuit detection is carried out on a screen for the computer, then defect detection is carried out on the screen for the computer which is qualified in circuit detection, finally, quality detection is carried out on the screen for the computer which is qualified in circuit detection and defect detection, the brightness uniformity and color of the screen for the computer are detected, a quality detection strategy is provided, an acquired gray level image is processed, the brightness and the maximum brightness of each pixel of the screen with the brightness uniformity lower than a threshold value are compared, the pixel with the brightness difference and the color difference higher than the threshold value are positioned, the pixel coordinate is obtained, the detection information is displayed in a display screen, the detection is comprehensive, the detection efficiency and accuracy are improved, and the position of the unqualified pixel is judged.
In order to achieve the above purpose, the present invention provides the following technical solutions:
an automatically controlled screen inspection system for a computer, comprising:
the computer screen module is used for producing a computer screen to be detected;
the detection platform module is used for placing a platform of a screen for a computer, an integrating sphere standard light source and a color filter are placed at the bottom of the platform to illuminate the screen for the computer to lighten, and an industrial camera is placed at the top of the platform to collect images;
the circuit detection module is used for detecting electric elements and wiring of a screen for a computer;
the defect detection module is used for analyzing and identifying the screen luminous image for the computer, detecting the defects of the screen for the computer and classifying the defects;
the quality detection module is used for detecting the luminous brightness and color of a screen for a computer by utilizing a quality detection strategy, calculating the brightness and color of each pixel by utilizing a tristimulus value, calculating the brightness uniformity, namely the ratio of the average brightness value to the maximum brightness of the pixels, screening out a screen with unqualified brightness uniformity, comparing the brightness and color of a single pixel in the screen with the qualified brightness uniformity with a threshold value, and positioning the coordinate position of the unqualified pixel;
and the transmission module is used for conveying and transporting the computer screen, grabbing the computer screen by using a mechanical arm, and placing the computer screen on the detection table and the transmission belt.
Specifically, the detection platform module includes:
the placing table is used for placing the screen for the computer and is convenient for detection;
the standard light source of the integrating sphere, ideal homogeneous area light source, its luminance and chromaticity of light outlet are equal everywhere, locate and place the lower end of the desk, is used for shining the screen for said computer;
the color filter is used for filtering the integrating sphere standard light source to obtain monochromatic light;
the industrial camera is arranged at the upper end of the placing table and is used for shooting and collecting the illuminated screen image for the computer;
the automatic control unit is used for automatically controlling the mechanical arm to grasp the screen for the computer according to the detection result and placing the screen on the qualified transmission belt and the unqualified transmission belt;
the display screen is used for displaying screen parameter information for a computer, circuit detection, defect detection and quality detection result information, and comprises an unqualified type when a detection result is unqualified;
and the data transmission unit is used for transmitting detection output results of the circuit detection module, the defect detection module and the quality detection module to the automatic control unit.
Specifically, the circuit detection module includes:
and the circuit detection unit is used for acquiring a circuit diagram of the screen for the computer, detecting wiring between the electrical elements of the circuit diagram and the electrical elements and transmitting an output result to the automatic control unit.
Specifically, the defect detection module includes:
and the defect detection unit is used for detecting whether the screen for the computer has defects, the positions of the defects and the types of the defects.
Specifically, the quality detection module includes:
the quality detection unit is used for detecting whether the brightness and the color of the screen for the computer are qualified or not, processing the acquired gray level image, comparing the brightness of each pixel of the screen with the brightness uniformity lower than a threshold value with the maximum brightness, positioning the pixel with the brightness difference and the color difference higher than the threshold value, obtaining the pixel coordinate and displaying the detection information in the display screen, and specifically comprises the following steps:
step A: shielding the light source by the color filter, enabling the light source to emit monochromatic light to irradiate the computer screen, collecting the illuminated computer screen gray image by the industrial camera, and preprocessing the gray image;
and (B) step (B): setting gray image to have s×p pixels, wherein the coordinates, width and height of the center of the pixel in the ith row and the jth column are respectively、/>、/>The pixel of the ith row and the jth column is divided into m×n sub-pixels, and the tristimulus value +.>、/>、/>；
Step C: converting the tristimulus value of each pixel in the image into 8-bit RGB color in proportion, wherein the tristimulus value of each pixel is、/>、/>The 8-bit RGB calculation formula is:
，/>，/>，
wherein,,、/>、/>the maximum tristimulus value in the image;
step D: setting the tristimulus value of the light source as、/>、/>Calculating tristimulus value of light source, obtaining 8-bit RGB value of light source according to color filter parameter>、/>、/>；
Step E: calculating luminance uniformity of ith row and jth column pixelsThe calculation formula is as follows:
，
wherein,,luminance value representing pixel point with coordinates (i, j), is +.>Setting the qualified brightness uniformity threshold value as +.>When +.about.all pixels in the screen>At the time, the calculated gray image、/>、/>And->、/>、/>Making a brightness difference, and calculating gray level image +.>、/>、/>And->、/>、/>Making color difference, setting threshold value of brightness difference as 2, threshold value of color difference as +.>When the brightness difference or the color difference exceeds the threshold range, finding out unqualified pixel points according to the pixel center coordinates, displaying detection result information in a display screen, and automatically controlling a mechanical arm to grasp the screen to an unqualified transmission belt by an automatic control unit.
The step B calculates the tristimulus value of the pixel of the ith row and the jth column、/>、/>The following calculation formula is adopted:
，
，
，
wherein,,、/>、/>XYZ stimulus values of pixels of the ith row and jth column, respectively, < >>、/>、/>The XYZ stimulus value scale factors are respectively expressed in +.>，/>、/>、/>Gray values of the nth row and the nth column pixel points in the XYZ stimulus value gray level diagram are respectively +.>Is noise figure->、/>、/>Exposure time when the industrial camera shoots XYZ stimulus value gray scale map is respectively +.>The pixel brightness for the ith row and jth column.
Specifically, the transmission module includes:
the to-be-detected transmission belt is used for transmitting the to-be-detected computer screen to the detection table;
the qualified transmission belt is used for conveying a computer screen with qualified circuit detection, defect detection and quality detection;
the unqualified conveyor belt is used for conveying a computer screen with unqualified circuit detection, defect detection and quality detection;
the engine is used for driving the to-be-detected conveying belt, the qualified conveying belt and the unqualified conveying belt to move;
and the mechanical arm is used for grabbing a screen for a computer and placing the screen into a detection table or a conveying belt.
Specifically, the computer-used automatic control screen detection system comprises an automatic control screen detection method, and the automatic control screen detection method specifically comprises the following steps:
s1: the automatic control unit controls the mechanical arm to grasp the screen for the computer and place the screen on the conveyor belt to be detected, and controls the engine to drive the conveyor belt to be detected to move and convey the conveyor belt to the detection table;
s2: the method comprises the steps of performing circuit detection, placing a computer screen on a placing table, obtaining a circuit diagram of the computer screen, obtaining the names, positions and connection relations among chip elements in the computer screen circuit diagram by using an image processing technology, comparing the chip element names, positions and connection relations with a correct computer screen production circuit diagram, wherein a comparison result is incorrect, the circuit detection is unqualified, an automatic control unit controls a mechanical arm to grasp the computer screen and place the computer screen on an unqualified transmission belt, the comparison result is correct, the circuit detection is qualified, and screen defect detection is started;
s3: performing defect detection on a computer screen with qualified circuit detection, starting an integrating sphere standard light source to enable the integrating sphere standard light source to illuminate the computer screen, collecting a gray level image of the illuminated computer screen by using an industrial camera, preprocessing the image, namely denoising and image enhancement, segmenting the preprocessed image, extracting and processing the characteristics of the segmented picture, outputting the identified defects and defect classification results, and controlling a mechanical arm to grasp the computer screen to be placed on a disqualified transmission belt if the mechanical arm is defective, and starting quality detection if the mechanical arm is defective;
s4: the quality detection method comprises the steps of carrying out quality detection on a computer screen with qualified and nondefective circuit detection, calculating tristimulus values, brightness uniformity and chromaticity of all pixels in an image by using pixel coordinates and width and height, setting a brightness uniformity threshold, comparing brightness and chromaticity of all pixels when the brightness uniformity threshold is lower than the brightness uniformity threshold, setting a brightness difference threshold and a chromaticity difference threshold, positioning the brightness difference or the chromaticity difference higher than the threshold to the pixel according to the pixel coordinates, transmitting unqualified detection information to a display screen for display, and controlling a mechanical arm to place the unqualified quality detection screen on an unqualified transmission belt by an automatic control unit.
Specifically, the step S4 includes a quality detection policy, where the quality detection policy includes the following specific steps:
s401: shielding the light source by the color filter, enabling the light source to emit monochromatic light to irradiate the computer screen, collecting the illuminated computer screen gray image by the industrial camera, and preprocessing the gray image;
s402: setting gray image to have s×p pixels, wherein the coordinates, width and height of the center of the pixel in the ith row and the jth column are respectively、/>、/>The pixel of the ith row and the jth column is divided into m multiplied by n sub-pixel points, and the tristimulus value of the pixel of the ith row and the jth column is calculated according to the following calculation formula:
，
，
，
wherein,,、/>、/>XYZ stimulus values of pixels of the ith row and jth column, respectively, < >>、/>、/>XYZ spines respectivelyProportional coefficient of excitation value in ∈>，/>、/>、/>Gray values of the nth row and the nth column sub-pixel points in the XYZ stimulus value gray level diagram are respectively +.>Is noise figure->、/>、/>Exposure time when the industrial camera shoots XYZ stimulus value gray scale map is respectively +.>Pixel brightness for the ith row and jth column;
s403: converting the tristimulus value of each pixel in the image into 8-bit RGB color in proportion, wherein the tristimulus value of each pixel is、/>、/>The 8-bit RGB calculation formula is:
，/>，/>，
wherein,,、/>、/>the maximum tristimulus value in the image;
s404: calculating tristimulus value of light source、/>、/>The calculation formula is as follows:
，
wherein W represents a tristimulus value, w=x g ,Y g ,Z g (a, b) is the wavelength range of visible light,for the wavelength of the light source,for the light source wavelength measurement interval, k is a normalization factor,>，/>for spectral power distribution function, +.>For object reflectivity, +.>And->The color matching functions of CIE1931 and CIE1964 respectively, and the RGB value of 8 bits of the light source is obtained according to the parameters of the color filter to be +.>、/>、/>；
S405: calculating luminance uniformityThe calculation formula is as follows:
wherein,,luminance value representing pixel point with coordinates (i, j), is +.>Setting the qualified brightness uniformity threshold value as +.>When +.about.all pixels in the screen>At the time, the calculated gray image、/>、/>And->、/>、/>Making a brightness difference, and calculating gray level image +.>、/>、/>And->、/>、/>Making color difference, setting threshold value of brightness difference as 2, threshold value of color difference as +.>When the brightness difference or the color difference exceeds the threshold range, finding out unqualified pixel points according to the pixel center coordinates, displaying detection result information in a display screen, and automatically controlling a mechanical arm to grasp the screen to an unqualified transmission belt by an automatic control unit.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention optimizes and improves the structure, operation steps and flow of the existing screen detection system for the computer, the whole improved system has the advantages of short time consumption and labor saving, and the detection accuracy is improved;
2. the invention detects the circuit, the defect and the quality of the screen for the computer, identifies the unqualified type, displays the detected unqualified type through the display screen, automatically controls the mechanical arm to grasp the screen to the unqualified transmission belt or the qualified transmission belt according to the detection result, and improves the comprehensiveness and the efficiency of the detection;
3. the invention provides a quality detection strategy, which is to collect a gray level image of an illuminated screen, preprocess the gray level image, calculate the tristimulus value of each pixel of the gray level image to obtain brightness uniformity and color value, and determine the positions of unqualified pixels and pixel coordinates by comparing the brightness difference and the color difference of each pixel in the screen for a computer with the brightness uniformity lower than a threshold range.
Drawings
FIG. 1 is a schematic diagram of a detection flow of the automatic control of a computer screen according to the present invention;
FIG. 2 is a block diagram of a screen inspection system for a computer according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments.
Referring to fig. 1 and 2, an embodiment of the present invention is provided: an automatically controlled screen inspection system for a computer, comprising:
the detection platform module is used for placing a platform of a screen for a computer, an integrating sphere standard light source and a color filter are placed at the bottom of the platform to illuminate the screen for the computer to lighten, and an industrial camera is placed at the top of the platform to collect images;
the circuit detection module is used for detecting electric elements and wiring of a screen for a computer;
the defect detection module is used for analyzing and identifying the screen luminous image for the computer, detecting the defects of the screen for the computer and classifying the defects;
the quality detection module is used for detecting the luminous brightness and color of a screen for a computer by utilizing a quality detection strategy, calculating the brightness and color of each pixel by utilizing a tristimulus value, calculating the brightness uniformity, namely the ratio of the average brightness value to the maximum brightness of the pixels, screening out a screen with unqualified brightness uniformity, comparing the brightness and color of a single pixel in the screen with the qualified brightness uniformity with a threshold value, and positioning the coordinate position of the unqualified pixel;
and the transmission module is used for conveying and transporting the computer screen, grabbing the computer screen by using a mechanical arm, and placing the computer screen on the detection table and the transmission belt.
The detection platform module comprises:
the placing table is used for placing the screen for the computer and is convenient for detection;
the standard light source of the integrating sphere, ideal homogeneous area light source, its luminance and chromaticity of light outlet are equal everywhere, locate and place the lower end of the desk, is used for shining the screen for said computer;
the color filter is used for filtering the integrating sphere standard light source to obtain monochromatic light;
the industrial camera is arranged at the upper end of the placing table and is used for shooting and collecting the illuminated screen image for the computer;
the automatic control unit is used for automatically controlling the mechanical arm to grasp the screen for the computer according to the detection result and placing the screen on the qualified transmission belt and the unqualified transmission belt;
the display screen is used for displaying screen parameter information for a computer, circuit detection, defect detection and quality detection result information, and comprises an unqualified type when a detection result is unqualified;
and the data transmission unit is used for transmitting detection output results of the circuit detection module, the defect detection module and the quality detection module to the automatic control unit.
The circuit detection module includes:
and the circuit detection unit is used for acquiring a circuit diagram of the screen for the computer, detecting wiring between the electrical elements of the circuit diagram and the electrical elements, and transmitting a detection output result to the automatic control unit.
The defect detection module comprises:
and the defect detection unit is used for detecting whether the screen for the computer has defects, the positions of the defects and the types of the defects.
The quality detection module comprises:
the quality detection unit is used for detecting whether the brightness and the color of the screen for the computer are qualified or not, processing the acquired gray level image, comparing the brightness of each pixel of the screen with the brightness uniformity lower than a threshold value with the maximum brightness, positioning the pixel with the brightness difference and the color difference higher than the threshold value, obtaining the pixel coordinate and displaying the detection information in the display screen, and specifically comprises the following steps:
step A: shielding the light source by the color filter, enabling the light source to emit monochromatic light to irradiate the computer screen, collecting the illuminated computer screen gray image by the industrial camera, and preprocessing the gray image;
and (B) step (B): setting gray image to have s×p pixels, wherein the coordinates, width and height of the center of the pixel in the ith row and the jth column are respectively、/>、/>The pixel of the ith row and the jth column is divided into m×n sub-pixels, and the tristimulus value +.>、/>、/>；
Step C: converting the tristimulus value of each pixel in the image into 8-bit RGB color in proportion, wherein the tristimulus value of each pixel is、/>、/>The 8-bit RGB calculation formula is:
，/>，/>，
wherein,,、/>、/>the maximum tristimulus value in the image;
step D: setting the tristimulus value of the light source as、/>、/>Calculating tristimulus value of light source, obtaining 8-bit RGB value of light source according to color filter parameter>、/>、/>；
Step E: calculating luminance uniformity of ith row and jth column pixelsThe calculation formula is as follows:
，
wherein,,luminance value representing pixel point with coordinates (i, j), is +.>Setting the qualified brightness uniformity threshold value as +.>When +.about.all pixels in the screen>At the time, the calculated gray image、/>、/>And->、/>、/>Making a brightness difference, and calculating gray level image +.>、/>、/>And->、/>、/>Making color difference, setting threshold value of brightness difference as 2, threshold value of color difference as +.>When the brightness difference or the color difference exceeds the threshold range, finding out unqualified pixel points according to the pixel center coordinates, displaying detection result information in a display screen, and automatically controlling a mechanical arm to grasp the screen to an unqualified transmission belt by an automatic control unit.
The step B calculates the tristimulus value of the pixel of the ith row and the jth column、/>、/>The following calculation formula is adopted:
，
，
，
wherein,,、/>、/>XYZ stimulus values of pixels of the ith row and jth column, respectively, < >>、/>、/>The XYZ stimulus value scale factors are respectively expressed in +.>，/>、/>、/>Gray values of the nth row and the nth column pixel points in the XYZ stimulus value gray level diagram are respectively +.>Is noise figure->、/>、/>Exposure time when the industrial camera shoots XYZ stimulus value gray scale map is respectively +.>The pixel brightness for the ith row and jth column.
The transmission module includes:
the to-be-detected transmission belt is used for transmitting the to-be-detected computer screen to the detection table;
the qualified transmission belt is used for conveying a computer screen with qualified circuit detection, defect detection and quality detection;
the unqualified conveyor belt is used for conveying a computer screen with unqualified circuit detection, defect detection and quality detection;
the engine is used for driving the to-be-detected conveying belt, the qualified conveying belt and the unqualified conveying belt to move;
and the mechanical arm is used for grabbing a screen for a computer and placing the screen into a detection table or a conveying belt.
Referring to fig. 1 and 2, an embodiment of the present invention is provided: an automatically controlled screen detection system for a computer, comprising an automatically controlled screen detection method for a computer, comprising the steps of:
s1: the automatic control unit controls the mechanical arm to grasp the screen for the computer and place the screen on the conveyor belt to be detected, and controls the engine to drive the conveyor belt to be detected to move and convey the conveyor belt to the detection table;
s2: the method comprises the steps of performing circuit detection, placing a computer screen on a placing table, obtaining a circuit diagram of the computer screen, obtaining the names, positions and connection relations among chip elements in the computer screen circuit diagram by using an image processing technology, comparing the chip element names, positions and connection relations with a correct computer screen production circuit diagram, wherein a comparison result is incorrect, the circuit detection is unqualified, an automatic control unit controls a mechanical arm to grasp the computer screen and place the computer screen on an unqualified transmission belt, the comparison result is correct, the circuit detection is qualified, and screen defect detection is started;
s3: performing defect detection on a computer screen with qualified circuit detection, starting an integrating sphere standard light source to enable the integrating sphere standard light source to illuminate the computer screen, collecting a gray level image of the illuminated computer screen by using an industrial camera, preprocessing the image, namely denoising and image enhancement, segmenting the preprocessed image, extracting and processing the characteristics of the segmented picture, outputting the identified defects and defect classification results, and controlling a mechanical arm to grasp the computer screen to be placed on a disqualified transmission belt if the mechanical arm is defective, and starting quality detection if the mechanical arm is defective;
s4: the quality detection method comprises the steps of carrying out quality detection on a computer screen with qualified and nondefective circuit detection, calculating tristimulus values, brightness uniformity and chromaticity of all pixels in an image by using pixel coordinates and width and height, setting a brightness uniformity threshold, comparing brightness and chromaticity of all pixels when the brightness uniformity threshold is lower than the brightness uniformity threshold, setting a brightness difference threshold and a chromaticity difference threshold, positioning the brightness difference or the chromaticity difference higher than the threshold to the pixel according to the pixel coordinates, transmitting unqualified detection information to a display screen for display, and controlling a mechanical arm to place the unqualified quality detection screen on an unqualified transmission belt by an automatic control unit.
Referring to fig. 1 and 2, an embodiment of the present invention is provided: an automatically controlled screen detection system for a computer, wherein the step S4 comprises a quality detection strategy, and the quality detection strategy comprises the following specific steps:
s401: shielding the light source by the color filter, enabling the light source to emit monochromatic light to irradiate the computer screen, collecting the illuminated computer screen gray image by the industrial camera, and preprocessing the gray image;
s402: setting gray image to have s×p pixels, wherein the coordinates, width and height of the center of the pixel in the ith row and the jth column are respectively、/>、/>The pixel of the ith row and the jth column is divided into m multiplied by n sub-pixel points, and the tristimulus value +.>、/>、/>The calculation formula is as follows:
，
，
，
wherein,,、/>、/>XYZ stimulus values of pixels of the ith row and jth column, respectively, < >>、/>、/>The XYZ stimulus value scale factors are respectively expressed in +.>，/>、/>、/>Gray values of the nth row and the nth column pixel points in the XYZ stimulus value gray level diagram are respectively +.>Is noise figure->、/>、/>Exposure time when the industrial camera shoots XYZ stimulus value gray scale map is respectively +.>Pixel brightness for the ith row and jth column;
s403: converting the tristimulus value of each pixel in the image into 8-bit RGB color in proportion, wherein the tristimulus value of each pixel is、/>、/>The 8-bit RGB calculation formula is:
，/>，/>，
wherein,,、/>、/>the maximum tristimulus value in the image;
s404: calculating tristimulus value of light source as、/>、/>The calculation formula is as follows:
wherein W represents a tristimulus value, w=x g ,Y g ,Z g (a, b) is the wavelength range of visible light,for the wavelength of the light source,for the light source wavelength measurement interval, k is a normalization factor,>，/>for spectral power distribution function, +.>For object reflectivity, +.>And->The color matching functions of CIE1931 and CIE1964 respectively, and the RGB value of 8 bits of the light source is obtained according to the parameters of the color filter to be +.>、/>、/>；/>
S405: calculating luminance uniformityThe calculation formula is as follows:
wherein,,to represent the luminance value of the pixel with coordinates (i, j)>Setting the qualified brightness uniformity threshold value as +.>When +.about.all pixels in the screen>At the time, the calculated gray image、/>、/>And->、/>、/>Making a brightness difference, and calculating gray level image +.>、/>、/>And->、/>、/>Making color difference, setting threshold value of brightness difference as 2, threshold value of color difference as +.>When the brightness difference or the color difference exceeds the threshold range, finding out unqualified pixel points according to the pixel center coordinates, displaying detection result information in a display screen, and automatically controlling a mechanical arm to grasp the screen to an unqualified transmission belt by an automatic control unit.
The foregoing description is of the preferred embodiment of the present application and is not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents, alternatives, and alternatives falling within the spirit and scope of the invention.
Claims (6)
1. An automatic control screen detection method for a computer is characterized by comprising the following steps:
s1: the automatic control unit controls the mechanical arm to grasp the screen for the computer and place the screen on the conveyor belt to be detected, and controls the engine to drive the conveyor belt to be detected to move and convey the conveyor belt to the detection table;
s2: the method comprises the steps of performing circuit detection, placing a computer screen on a placing table, obtaining a circuit diagram of the computer screen, obtaining the names, positions and connection relations among chip elements in the computer screen circuit diagram by using an image processing technology, comparing the chip element names, positions and connection relations with a correct computer screen production circuit diagram, wherein a comparison result is incorrect, the circuit detection is unqualified, an automatic control unit controls a mechanical arm to grasp the computer screen and place the computer screen on an unqualified transmission belt, the comparison result is correct, the circuit detection is qualified, and screen defect detection is started;
s3: performing defect detection on a computer screen with qualified circuit detection, starting an integrating sphere standard light source to enable the integrating sphere standard light source to illuminate the computer screen, collecting a gray level image of the illuminated computer screen by using an industrial camera, preprocessing the image, namely denoising and image enhancement, segmenting the preprocessed image, extracting and processing the characteristics of the segmented picture, outputting the identified defects and defect classification results, and controlling a mechanical arm to grasp the computer screen to be placed on a disqualified transmission belt if the mechanical arm is defective, and starting quality detection if the mechanical arm is defective;
s4: the method comprises the steps of performing quality detection on a computer screen with qualified and nondefective circuit detection, calculating tristimulus values, brightness uniformity and chromaticity of all pixels in an image by using pixel coordinates and width and height, setting a brightness uniformity threshold, comparing brightness and chromaticity of all pixels when the brightness uniformity threshold is lower than the brightness uniformity threshold, setting a brightness difference threshold and a chromaticity difference threshold, positioning the brightness difference or the chromaticity difference higher than the threshold to the pixel according to the pixel coordinates, transmitting unqualified detection information to a display screen for display, and controlling a mechanical arm to place the unqualified quality detection screen on a disqualified transmission belt by an automatic control unit;
the quality detection strategy in step S4 specifically includes the following steps:
s401: shielding the light source by the color filter, enabling the light source to emit monochromatic light to irradiate the computer screen, collecting the illuminated computer screen gray image by the industrial camera, and preprocessing the gray image;
s402: setting gray image to have s×p pixels, wherein the coordinates, width and height of the center of the pixel in the ith row and the jth column are respectively、/>、/>The pixel of the ith row and the jth column is divided into m×n sub-pixels, and the tristimulus value +.>、/>、/>；
S403: converting the tristimulus value of each pixel in the image into 8-bit RGB color in proportion, wherein the tristimulus value of each pixel is、/>、/>The 8-bit RGB calculation formula is:
，/>，/>，
wherein,,、/>、/>the maximum tristimulus value in the image;
s404: setting the tristimulus value of the light source as、/>、/>Calculating tristimulus value of light source, obtaining 8-bit RGB value of light source according to color filter parameter>、/>、/>；
S405: calculating luminance uniformity of ith row and jth column pixelsThe calculation formula is as follows:
，
wherein,,luminance value representing pixel point with coordinates (i, j), is +.>Setting the qualified brightness uniformity threshold value as +.>When +.about.all pixels in the screen>At this time, the calculated gray-scale image +.>、、/>And->、/>、/>Making a brightness difference, and calculating gray level image +.>、/>、/>And->、/>、/>Making color difference, setting threshold value of brightness difference as 2, threshold value of color difference as +.>When the brightness difference or the color difference exceeds the threshold range, finding out unqualified pixel points according to the pixel center coordinates, displaying detection result information in a display screen, and automatically controlling a mechanical arm to grasp the screen to an unqualified transmission belt by an automatic control unit;
step S402 of calculating tristimulus values of the pixels of the ith row and the jth column、/>、/>The following calculation formula is adopted:
，
，
，
wherein,,、/>、/>XYZ stimulus values of pixels of the ith row and jth column, respectively, < >>、/>、/>The XYZ stimulus value scale factors are respectively expressed in +.>，/>、/>、/>Gray values of the nth row and the nth column pixel points in the XYZ stimulus value gray level diagram are respectively +.>Is noise figure->、/>、/>Exposure time when the industrial camera shoots XYZ stimulus value gray scale map is respectively +.>The pixel brightness for the ith row and jth column.
2. An automatically controlled screen inspection system for a computer, comprising:
the detection platform module is used for placing a platform of a screen for a computer, an integrating sphere standard light source and a color filter are placed at the bottom of the platform to illuminate the screen for the computer to lighten, and an industrial camera is placed at the top of the platform to collect images;
the circuit detection module is used for detecting electric elements and wiring of a screen for a computer;
the defect detection module is used for analyzing and identifying the screen luminous image for the computer, detecting the defects of the screen for the computer and classifying the defects;
the quality detection module is used for detecting the luminous brightness and color of a screen for a computer, calculating the brightness and color of each pixel by using a tristimulus value, calculating the brightness uniformity, namely the ratio of the average brightness value to the maximum brightness value of the pixels, screening out a screen with unqualified brightness uniformity, comparing the brightness and color of a single pixel in the screen with the qualified brightness uniformity with a threshold value, and positioning the coordinate position of the unqualified pixel;
the transmission module is used for conveying and transporting the computer screen, grabbing the computer screen by using a mechanical arm, and placing the computer screen on the detection table and the transmission belt;
the quality detection module comprises:
the quality detection unit is used for detecting whether the brightness and the color of the screen for the computer are qualified or not, processing the acquired gray level image, comparing the brightness of each pixel of the screen with the brightness uniformity lower than a threshold value with the maximum brightness, positioning the pixel with the brightness difference and the color difference higher than the threshold value, obtaining the pixel coordinate and displaying the detection information in the display screen, and specifically comprises the following steps:
step A: shielding the light source by the color filter, enabling the light source to emit monochromatic light to irradiate the computer screen, collecting the illuminated computer screen gray image by the industrial camera, and preprocessing the gray image;
and (B) step (B): setting gray image to have s×p pixels, wherein the coordinates, width and height of the center of the pixel in the ith row and the jth column are respectively、/>、/>The pixel of the ith row and the jth column is divided into m×n sub-pixels, and the tristimulus value +.>、/>、/>；
Step C: converting the tristimulus value of each pixel in the image into 8-bit RGB color in proportion, wherein the tristimulus value of each pixel is、/>、/>The 8-bit RGB calculation formula is:
，/>，/>，
wherein,,、/>、/>the maximum tristimulus value in the image;
step D: setting the tristimulus value of the light source as、/>、/>Calculating tristimulus value of light source, obtaining 8-bit RGB value of light source according to color filter parameter>、/>、/>；
Step E: calculating luminance uniformity of ith row and jth column pixelsThe calculation formula is as follows:
，
wherein,,luminance value representing pixel point with coordinates (i, j), is +.>Setting the qualified brightness uniformity threshold value as +.>When +.about.all pixels in the screen>At this time, the calculated gray-scale image +.>、、/>And->、/>、/>Making a brightness difference, and calculating gray level image +.>、/>、/>And->、/>、/>Making color difference, setting threshold value of brightness difference as 2, threshold value of color difference as +.>When the brightness difference or the color difference exceeds the threshold range, finding out unqualified pixel points according to the pixel center coordinates, displaying detection result information in a display screen, and automatically controlling a mechanical arm to grasp the screen to an unqualified transmission belt by an automatic control unit;
the step B calculates the tristimulus value of the pixel of the ith row and the jth column、/>、/>The following calculation formula is adopted:
，
，
，
wherein,,、/>、/>XYZ stimulus values of pixels of the ith row and jth column, respectively, < >>、/>、/>The XYZ stimulus value scale factors are respectively expressed in +.>，/>、/>、/>Gray values of the nth row and the nth column pixel points in the XYZ stimulus value gray level diagram are respectively +.>Is noise figure->、/>、/>Exposure time when the industrial camera shoots the XYZ stimulus value gray scale image is respectively,/>the pixel brightness for the ith row and jth column.
3. The computer-implemented automatic control screen inspection system of claim 2, wherein the inspection station module comprises:
a placement table for placing the screen for a computer;
the standard light source of the integrating sphere, ideal homogeneous area light source, its luminance and chromaticity of light outlet are equal everywhere, locate and place the lower end of the desk, is used for shining the screen for said computer;
the color filter is used for filtering the integrating sphere standard light source to obtain monochromatic light;
the industrial camera is arranged at the upper end of the placing table and is used for shooting and collecting the illuminated screen image for the computer;
the automatic control unit is used for automatically controlling the mechanical arm to grasp the screen for the computer according to the detection result and placing the screen on the qualified transmission belt and the unqualified transmission belt;
the display screen is used for displaying screen parameter information for a computer, circuit detection, defect detection and quality detection result information, and comprises an unqualified type when a detection result is unqualified;
and the data transmission unit is used for transmitting detection output results of the circuit detection module, the defect detection module and the quality detection module to the automatic control unit.
4. The computer-implemented automatic control screen inspection system of claim 3, wherein the circuit inspection module comprises:
and the circuit detection unit is used for acquiring a circuit diagram of the screen for the computer, detecting wiring between the electrical elements of the circuit diagram and the electrical elements, and transmitting a detection output result to the automatic control unit.
5. The computer-implemented automatic control screen inspection system of claim 4, wherein the defect detection module comprises:
and the defect detection unit is used for detecting whether the screen for the computer has defects, the positions of the defects and the types of the defects.
6. The computer-implemented automatic control screen inspection system according to claim 5, wherein the transmission module comprises:
the to-be-detected transmission belt is used for transmitting the to-be-detected computer screen to the detection table;
the qualified transmission belt is used for conveying a computer screen with qualified circuit detection, defect detection and quality detection;
the unqualified conveyor belt is used for conveying a computer screen with unqualified circuit detection, defect detection and quality detection;
the engine is used for driving the to-be-detected conveying belt, the qualified conveying belt and the unqualified conveying belt to move;
and the mechanical arm is used for grabbing a screen for a computer and placing the screen into a detection table or a conveying belt.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310518195.8A CN116229856B (en) | 2023-05-10 | 2023-05-10 | Automatic control screen detection system and method for computer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310518195.8A CN116229856B (en) | 2023-05-10 | 2023-05-10 | Automatic control screen detection system and method for computer |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116229856A CN116229856A (en) | 2023-06-06 |
| CN116229856B true CN116229856B (en) | 2023-07-28 |
Family
ID=86589573
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310518195.8A Active CN116229856B (en) | 2023-05-10 | 2023-05-10 | Automatic control screen detection system and method for computer |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116229856B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117686828A (en) * | 2023-12-11 | 2024-03-12 | 南京熊猫电子制造有限公司 | Labview-based white household appliance display and control board online test system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101464187A (en) * | 2007-12-18 | 2009-06-24 | 三星电子株式会社 | Light sensor test unit, method of testing light sensor using the same and display apparatus |
| JP2010266502A (en) * | 2009-05-12 | 2010-11-25 | Casio Computer Co Ltd | Device for manufacturing display device and method for manufacturing display device |
| WO2016002561A1 (en) * | 2014-06-30 | 2016-01-07 | ウシオ電機株式会社 | Light source device and projector |
| CN108234975A (en) * | 2017-12-29 | 2018-06-29 | 花花猫显示科技有限公司 | Combination color homogeneity and consistency control method based on video camera |
| CN110197635A (en) * | 2019-06-04 | 2019-09-03 | 厦门天马微电子有限公司 | A kind of display device and its driving method and electronic equipment |
| CN113691312A (en) * | 2021-08-11 | 2021-11-23 | 华南理工大学 | Method and system for designing multi-path light source spectrum |
| CN113848044A (en) * | 2021-11-26 | 2021-12-28 | 武汉精创电子技术有限公司 | Method for detecting brightness and chrominance consistency of display screen |
| CN114783388A (en) * | 2022-04-02 | 2022-07-22 | 深圳市华星光电半导体显示技术有限公司 | Method for adjusting chromaticity of display device and display device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005192162A (en) * | 2003-12-26 | 2005-07-14 | Konica Minolta Photo Imaging Inc | Image processing method, image processing apparatus, and image recording apparatus |
| JP5165802B1 (en) * | 2012-02-17 | 2013-03-21 | シャープ株式会社 | Video display device and television receiver |
| JP2017225011A (en) * | 2016-06-16 | 2017-12-21 | 富士フイルム株式会社 | Defective pixel correction system and defective pixel correction method |
| CN108470334B (en) * | 2018-03-20 | 2020-10-30 | 上海顺久电子科技有限公司 | Method and device for collecting screen brightness and chromaticity |
| CN109085174A (en) * | 2018-07-02 | 2018-12-25 | 北京百度网讯科技有限公司 | Display screen peripheral circuit detection method, device, electronic equipment and storage medium |
| CN216284063U (en) * | 2021-09-24 | 2022-04-12 | 南京欧晟新能源有限公司 | Pedal braking force detection device |
| CN115547270B (en) * | 2022-10-26 | 2023-05-09 | 深圳新视光电科技有限公司 | Color difference adjustment method, device, equipment and storage medium based on spectrum analysis |
-
2023
- 2023-05-10 CN CN202310518195.8A patent/CN116229856B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101464187A (en) * | 2007-12-18 | 2009-06-24 | 三星电子株式会社 | Light sensor test unit, method of testing light sensor using the same and display apparatus |
| JP2010266502A (en) * | 2009-05-12 | 2010-11-25 | Casio Computer Co Ltd | Device for manufacturing display device and method for manufacturing display device |
| WO2016002561A1 (en) * | 2014-06-30 | 2016-01-07 | ウシオ電機株式会社 | Light source device and projector |
| CN108234975A (en) * | 2017-12-29 | 2018-06-29 | 花花猫显示科技有限公司 | Combination color homogeneity and consistency control method based on video camera |
| CN110197635A (en) * | 2019-06-04 | 2019-09-03 | 厦门天马微电子有限公司 | A kind of display device and its driving method and electronic equipment |
| CN113691312A (en) * | 2021-08-11 | 2021-11-23 | 华南理工大学 | Method and system for designing multi-path light source spectrum |
| CN113848044A (en) * | 2021-11-26 | 2021-12-28 | 武汉精创电子技术有限公司 | Method for detecting brightness and chrominance consistency of display screen |
| CN114783388A (en) * | 2022-04-02 | 2022-07-22 | 深圳市华星光电半导体显示技术有限公司 | Method for adjusting chromaticity of display device and display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116229856A (en) | 2023-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110389127B (en) | System and method for identifying metal ceramic parts and detecting surface defects | |
| CN103217436B (en) | Backlight module group defect detection method and equipment | |
| CN110044405B (en) | Automatic automobile instrument detection device and method based on machine vision | |
| CN110567976B (en) | Mobile phone cover plate silk-screen defect detection device and detection method based on machine vision | |
| CN109872309B (en) | Detection system, method, device and computer readable storage medium | |
| CN116229856B (en) | Automatic control screen detection system and method for computer | |
| CN107945184A (en) | A kind of mount components detection method positioned based on color images and gradient projection | |
| CN106501272B (en) | Machine vision soldering tin positioning detection system | |
| CN114638797A (en) | Method and device for detecting copper surface defects based on linear array camera | |
| CN111932504B (en) | Edge contour information-based sub-pixel positioning method and device | |
| CN111261079B (en) | Method for detecting abnormal phenomena of bright and dark spots | |
| CN112819844B (en) | Image edge detection method and device | |
| CN112394064A (en) | Point-line measuring method for screen defect detection | |
| CN106971393A (en) | The phenotype measuring method and system of a kind of corn kernel | |
| CN109461156B (en) | Threaded sealing plug assembly detection method based on vision | |
| KR20140075042A (en) | Apparatus for inspecting of display panel and method thereof | |
| CN112561875A (en) | Photovoltaic cell panel coarse grid detection method based on artificial intelligence | |
| CN113763322B (en) | Pin Pin coplanarity visual detection method and device | |
| CN115165925A (en) | PCB detection device with marking function, marking method, equipment and medium | |
| CN111458345A (en) | Visual detection mechanism for defects of mask | |
| CN212409647U (en) | Internal thread hole detection device | |
| CN103091332B (en) | Detection method and detection system of U-shaped powder pipe based on machine vision | |
| CN114820597B (en) | Smelting product defect detection method, device and system based on artificial intelligence | |
| CN114383815A (en) | Method for rapidly detecting pixel out-of-control point of display screen | |
| CN115546141A (en) | Small sample Mini LED defect detection method and system based on multi-dimensional measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |