WO2020007118A1 - 显示屏外围电路检测方法、装置、电子设备及存储介质 - Google Patents
显示屏外围电路检测方法、装置、电子设备及存储介质 Download PDFInfo
- Publication number
- WO2020007118A1 WO2020007118A1 PCT/CN2019/085912 CN2019085912W WO2020007118A1 WO 2020007118 A1 WO2020007118 A1 WO 2020007118A1 CN 2019085912 W CN2019085912 W CN 2019085912W WO 2020007118 A1 WO2020007118 A1 WO 2020007118A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- peripheral circuit
- defect detection
- image
- display
- defect
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/006—Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/956—Inspecting patterns on the surface of objects
- G01N21/95607—Inspecting patterns on the surface of objects using a comparative method
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/28—Testing of electronic circuits, e.g. by signal tracer
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/1306—Details
- G02F1/1309—Repairing; Testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/0008—Industrial image inspection checking presence/absence
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
- G01N2021/8883—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges involving the calculation of gauges, generating models
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N2021/9513—Liquid crystal panels
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/12—Circuits of general importance; Signal processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30121—CRT, LCD or plasma display
Definitions
- the invention relates to a defect detection technology, in particular to a method, a device, an electronic device and a storage medium for detecting a peripheral circuit of a display screen.
- the detection of the peripheral circuits of the display screen mainly uses manual detection or machine-assisted manual detection methods.
- the manual inspection method refers to relying on the naked eyes of industry experts to observe the pictures collected from the production environment to give a judgment;
- the machine-assisted manual inspection method refers to the use of a quality inspection system that has solidified the experience of industry experts to first inspect the periphery of the display screen. The circuit image is inspected, and pictures that are suspected of defects are preliminarily screened. Then, industry experts perform manual detection and judgment on pictures that are suspected of defects.
- the invention provides a method, a device, an electronic device and a storage medium for detecting a peripheral circuit of a display screen, so as to overcome the existing subjective influencing factors of the display circuit peripheral circuit defect detection method, resulting in low detection accuracy and system performance. Poor and low business expansion capabilities.
- a method for detecting a peripheral circuit of a display screen including:
- the quality inspection request including a display peripheral circuit image collected by an image acquisition device on the display peripheral circuit production line;
- the defect detection model is an instance segmentation Mask RCNN algorithm using a historical defect display peripheral circuit image. Obtained by training
- the quality of the display peripheral circuit corresponding to the display peripheral circuit image is determined according to the defect detection result.
- the method before the inputting the peripheral circuit image of the display screen into a defect detection model to obtain a defect detection result, the method further includes:
- the method before the enlarging or reducing the image of the peripheral circuit of the display screen, the method further includes:
- image preprocessing on the display peripheral circuit image, wherein the image preprocessing includes one or more of the following processing:
- the step of inputting the image to be tested into a defect detection model to obtain a defect detection result includes:
- the image to be tested is input to the defect detection model running on the detection model server to obtain a defect detection result.
- the defect detection result includes: a category of each defect, and / or a contour position of each defect;
- the determining the quality of the display peripheral circuit corresponding to the display peripheral circuit image according to the defect detection result includes:
- the quality of the display peripheral circuit corresponding to the display peripheral circuit image is determined.
- the display peripheral circuit image and the defect detection result are input into the defect detection model in order to optimize the defect detection model.
- a second aspect of the present application provides a display circuit peripheral circuit detection device, including:
- a receiving module configured to receive a quality detection request sent by a console deployed on a display peripheral circuit production line, where the quality detection request includes a display peripheral circuit image collected by an image acquisition device on the display peripheral circuit production line;
- a pre-processing module is used to enlarge or reduce the image of the peripheral circuit of the display screen to obtain an image to be tested whose size is consistent with the input size requirement of the defect detection model, wherein the defect detection model is a historical defect display peripheral circuit image Instance segmentation Mask RCNN algorithm training;
- a processing module configured to input the image to be tested into a defect detection model to obtain a defect detection result
- a determining module configured to determine, according to the defect detection result, the quality of the display peripheral circuit corresponding to the display peripheral circuit image.
- the processing module is further configured to: prior to the input of the display peripheral circuit image into the defect detection model to obtain a defect detection result, use a historical defect
- the actual pixel category of the display peripheral circuit image is used for the Mask RCNN algorithm training on the defect detection model, so that the defect detection model can predict the pixel category of the historical defect display peripheral circuit image output from the actual pixel classification.
- the loss value between pixel categories is lower than a preset loss threshold.
- the preprocessing module is further configured to perform an operation on the display peripheral circuit image before the display peripheral circuit image is enlarged or reduced.
- Image preprocessing includes one or more of the following processes: trimming, cutting, and rotating.
- the processing module is specifically configured to determine a detection model server that bears processing resources according to a load balancing policy; and input the image to be tested to the A defect detection result is obtained in the defect detection model on the detection model server.
- the defect detection result includes: a category of each defect, and / or a contour position of each defect;
- the determining module is specifically configured to determine the quality of the display peripheral circuit corresponding to the display peripheral circuit image according to the production stage information and the defect detection result.
- the processing module is further configured to determine a quality of a display peripheral circuit corresponding to the display peripheral circuit image according to the defect detection result. After good or bad, if it is determined that the display peripheral circuit is a damaged circuit, perform one or more of the following operations:
- the display peripheral circuit image and the defect detection result are input into the defect detection model in order to optimize the defect detection model.
- a third aspect of the present application provides an electronic device including a processor, a memory, and a computer program stored on the memory and executable on the processor.
- the processor executes the program, the first aspect as described above and The method according to any one of the various possible implementations of the first aspect.
- a fourth aspect of the present application provides a storage medium, where the storage medium stores instructions, and when it runs on a computer, causes the computer to execute as described in the first aspect and any one of the various possible implementation manners of the first aspect Methods.
- the display peripheral circuit detection method, device, electronic equipment and storage medium provided by the present invention receive a quality detection request sent by a console deployed on a display peripheral circuit production line, and the quality detection request includes the display peripheral A peripheral circuit image of a display screen collected by an image acquisition device on a circuit production line; the peripheral circuit image of the display screen is enlarged or reduced to obtain an image to be tested whose size is consistent with the input size requirement of the defect detection model, wherein the defect detection model It is obtained by performing an example segmentation algorithm MASK and RCNN on the historical defect display peripheral circuit image; inputting the image to be tested into a defect detection model to obtain a defect detection result; and determining the display peripheral circuit image according to the defect detection result
- the quality of the corresponding display peripheral circuits is good or bad.
- the defect detection model is obtained by performing MASK and RCNN training on the peripheral circuit image of the historical defect display, the defect detection results obtained by using the defect detection model have high classification accuracy, strong intelligence, system performance, and business.
- the scalability is high, which solves the problems of low detection accuracy, poor system performance, and low business expansion ability due to the large subjective influence factors in the existing method for detecting defects in peripheral circuits of display screens.
- FIG. 1 is a schematic structural diagram of a display circuit peripheral circuit detection system according to an embodiment of the present invention.
- FIG. 2 is a schematic flowchart of a first embodiment of a method for detecting a peripheral circuit of a display screen according to an embodiment of the present application
- FIG. 3 is a schematic flowchart of a second embodiment of a method for detecting a peripheral circuit of a display screen according to an embodiment of the present application
- FIG. 4 is a schematic structural diagram of an embodiment of a display circuit peripheral circuit detecting device according to an embodiment of the present application.
- FIG. 5 is a schematic structural diagram of an embodiment of an electronic device according to an embodiment of the present invention.
- the size of the sequence number of each process does not mean the order of execution.
- the execution order of each process should be determined by its function and internal logic.
- the implementation process constitutes any limitation.
- B corresponding to A means that B is associated with A, and B can be determined according to A. Determining B according to A does not mean determining B only based on A, but also determining B based on A and / or other information. The matching between A and B is that the similarity between A and B is greater than or equal to a preset threshold.
- the overall intelligent automation level of the 3C industry (3C industry refers to the information appliance industry that integrates the application of the three major technology products of computers, communications, and consumer electronics) is low. Analysis shows that most manufacturers use two types of detection methods for mobile phone screens: manual detection methods and machine-assisted manual detection methods.
- the manual detection method refers to relying on the naked eyes of industry experts to observe the images collected from the production environment for judgment. This method is subject to human subjective influence factors, has low detection efficiency, and has a large damage to the human eye. Because the generating circuit of the display peripheral circuit is generally a dust-free environment, workers need to prepare for cleaning before entering, and wear dust-free clothes, which may also adversely affect the health and safety of workers.
- the machine-assisted manual detection method can also be referred to as the detection method based on the liquid crystal module detection equipment.
- the specific principle is: first, the non-defective image is filtered by a quality inspection system with certain judgment ability, and then the industry experts will The image is detected.
- quality inspection systems are mostly developed for expert systems and feature engineering systems, which means that experts have solidified their experience in the quality inspection system to make them have certain automation capabilities. Therefore, the machine-assisted manual detection method not only has low accuracy and poor system performance, and cannot cover all the detection standards of the manufacturer. Moreover, this method is also inefficient, and it is easy to miss and misjudge, and it is difficult to reuse the image data after detection. Dig.
- the characteristics and determination rules are solidified into the machine based on the experience of industry experts, and it is difficult to iterate with the development of the business. As a result of the development of the production process, the detection accuracy of the quality inspection system is getting more and more Low, and may even drop to a completely unusable state.
- the characteristics of the quality inspection system are pre-cured in the hardware by third-party suppliers. When upgrading, not only the production line needs to be significantly modified, but it is also expensive, and it has obvious shortcomings in terms of security, standardization, and scalability. , It is not conducive to the optimization and upgrade of the display peripheral circuit production line, and the business expansion capability is low.
- both the manual detection method and the machine-assisted manual detection method have the following disadvantages: Not only are they inefficient and prone to misjudgment, but the industrial data generated by these two methods are not easy to store, manage, and reuse for secondary mining.
- the embodiment of the present application develops an automatic, high-precision, adaptively modified and upgraded display peripheral circuit detection method, which uses image acquisition equipment to collect real-time data on the display peripheral circuit production line. Display peripheral circuit image, real-time detection and judgment of the surface quality of the display peripheral circuit. If a defect is detected in the display peripheral circuit collected by the current image acquisition device, the position of each defect in the picture and the Category, the embodiment of the present application distinguishes defective individuals from similar types of defects.
- the defects described in the embodiments of the present application may include, but are not limited to, different types of defect problems including point defects, foreign object defects, and scratch defects. Not one by one here.
- the example segmentation Mask RCNN algorithm is a two-stage framework.
- the first stage scans the image and generates proposals (proposals, that is, regions that may contain a target).
- the second stage classifies proposals and generates them. Bounding box and mask.
- Mask R-CNN is an extension of Faster R-CNN and was proposed by the same author last year.
- Faster RCNN is a popular object detection framework, and Mask RCNN extends it into an instance segmentation framework.
- Mask RCNN is a new convolutional network based on Faster RCNN architecture. It completes instance segmentation in one fell swoop. This method completes high-quality instance segmentation while effectively targeting.
- the Mask RCNN algorithm is mainly to extend the original Faster-RCNN, add a branch to use the existing detection to perform parallel prediction on the target.
- this network structure is relatively easy to implement and train, and can be easily applied to other fields, such as object detection, segmentation, and keypoint detection of people.
- FIG. 1 is a schematic structural diagram of a display circuit peripheral circuit detection system according to an embodiment of the present invention.
- the method for detecting a peripheral circuit of a display screen provided by the present invention is used to perform defect detection on the peripheral circuit of a display screen.
- the display peripheral circuit detection system mainly includes a console 12, a server group 13, a controller 14, a database 15, a trainer 16, and an image acquisition device 11 deployed on a display peripheral circuit production line.
- the image acquisition device 11 collects the display peripheral circuit images on the display peripheral circuit production line
- the console 12 receives the display peripheral circuit images collected by the image acquisition device 11 and sends the display peripheral circuit images to the server group 13
- the detection model server 130 inputs the received display peripheral circuit image into the defect detection model running itself to obtain the defect detection result
- the controller 14 receives the defect detection result of the detection model server 130 and combines it with the production stage
- the information gives a business response
- the controller 14 may also store the defect detection result in the database 15 as a log.
- the display peripheral circuit images collected by the image acquisition device 11 can also be directly stored in the database 15 as raw data for training the defect detection model.
- the trainer 16 extracts the historical defect display peripheral circuit images in the database and trains the defect detection model based on the Mask RCNN algorithm.
- the above database 15 may include a production database 151 and a training database 152.
- the production database 151 may receive and save the defect detection results sent by the controller 14 and the display screen peripheral circuit images collected by the image acquisition device 11.
- the training database 152 may The historical defect display peripheral circuit image and the corresponding original display peripheral circuit image extracted from the production database 151 are stored, so that the trainer 16 trains to obtain a defect detection model with high detection accuracy.
- the trainer 16 in the embodiment of the present application may be a training engine implemented by hardware and / or software functions, as a training tool for a defect detection model.
- the display peripheral circuit detection system of the embodiment of the present application may further include other physical modules such as a processor, a memory, and the embodiment is not limited thereto.
- FIG. 2 is a schematic flowchart of a first embodiment of a method for detecting a peripheral circuit of a display screen according to an embodiment of the present application.
- the method shown in FIG. 2 may be implemented by a software device, a hardware device, or a combination of software and hardware. installation. Including steps S101 to S104, the details are as follows:
- S101 Receive a quality detection request sent by a console deployed on a display peripheral circuit production line, where the quality detection request includes a display peripheral circuit image collected by an image acquisition device on the display peripheral circuit production line.
- a plurality of different devices such as an image acquisition device, a console, a server group, a controller, and a database are deployed on the display peripheral circuit production line.
- the image acquisition device can be a high-precision image acquisition camera.
- multiple images can be collected during the production process. Display peripheral circuit image corresponding to the display peripheral circuit.
- the console deployed on the display peripheral circuit production line can send quality to the server group with the defect detection model deployed on the display peripheral circuit production line.
- the quality detection request includes a display peripheral circuit image collected by the image acquisition device, so that a server in the server group that receives the quality detection request processes the received display peripheral circuit image.
- S102 Enlarge or reduce the image of the peripheral circuit of the display screen to obtain an image to be tested whose size is consistent with the input size requirement of the defect detection model.
- the defect detection model is obtained by training an instance segmentation Mask RCNN algorithm using a historical defect display peripheral circuit image.
- the defect detection model trained by instance segmentation Mask RCNN has a size requirement for the input image. Once the size of the input image does not match the size of the model input requirement, the defect detection model will not be able to process it.
- the peripheral circuit graphics of the display screen are first performed before entering the defect detection model. Scaling processing so that the size of the image to be tested is consistent with the input size requirement of the defect detection model.
- Enlarging or reducing the image of the peripheral circuit of the display screen can be understood as the constant enlargement or reduction of pixels, or it can be understood as the reduction or enlargement of pixel reduction. Pixels that are too high may exceed the processing capability of the defect detection model. Therefore, when the pixels of the display peripheral circuit image are too high, you can also perform pixel reduction processing on the display peripheral circuit image first, which is not limited here.
- the server receiving the quality inspection request obtains the display peripheral circuit image in the quality inspection request, and performs pre-processing of enlargement or reduction to obtain an image to be tested whose size is consistent with the input size requirement of the defect detection model. Then the image to be tested is input into a defect detection model running on the server, and the defect detection model performs defect detection, and then the defect detection result is obtained.
- image preprocessing may be performed on the image of the display peripheral circuit, wherein the image preprocessing includes the following processing: One or more of: trimming, cutting, rotating.
- the image acquisition device deployed on the display peripheral circuit production line is generally a high-precision camera. Therefore, the image of the display peripheral circuit captured by the image acquisition device may be large in size, high in pixels, or in different positions. Suitable etc. Therefore, after receiving the display peripheral circuit image included in the quality detection request sent by the console, it is necessary to preprocess the display peripheral circuit image according to the actual situation. For example, if the peripheral area of the peripheral circuit image of the display screen is large, at this time, the peripheral circuit image of the display screen may be trimmed to retain a useful part of the peripheral circuit image of the display screen.
- the defect detection model running on the server is obtained by training the Segment RCNN algorithm on the peripheral circuit image of the historical defect display.
- this embodiment uses the Mask RCNN algorithm to perform instance segmentation.
- Instance segmentation refers to letting the computer perform segmentation based on the individual instances of the image, that is, to distinguish each defect and identify the type of each defect.
- the defect detection model adopts a MASK RCNN structure.
- the display peripheral circuit image on the display peripheral circuit production line is used as the input of the defect detection model.
- the MASK RCNN structure of the defect detection model is used to identify the characteristics of each pixel in the display peripheral circuit image, and the display peripheral circuit is obtained. Which pixels in the image are normal pixels, which pixels are defective pixels, and which type of defect are the defective pixels.
- a model training process may be further included before the image of the display peripheral circuit is input into a defect detection model to obtain a defect detection result.
- the MASK RCNN algorithm training may be performed on the defect detection model with the actual pixel category of the peripheral circuit image of the historical defect display screen, so that the defect detection model outputs The loss value between the predicted pixel category and the actual pixel category is lower than a preset loss threshold.
- the loss value can be understood as the total loss value
- the defect detection model is a combined training of the candidate area loss value, area category loss value, area boundary loss value, and pixel instance loss value of the historical defect display screen image, so that A result that the total loss value of the candidate region loss value, the region category loss value, the region boundary loss value, and the pixel instance loss value meets a preset loss threshold.
- the candidate area loss value refers to a loss value between a selected defect area and an actual defect area in the historical defect display screen image
- the area category loss value refers to a predicted defect category and an actual defect area in the selected defect area.
- Loss value between defect categories the region boundary loss value refers to the loss value between the predicted defect boundary and the actual defect boundary in the selected defect area
- the pixel instance loss value refers to the historical defect display screen image The loss value between the predicted pixel instance and the actual pixel instance.
- the embodiment of the present application can use the MASK RCNN model to have high robustness to the deformation, blurring, and lighting changes of the display peripheral circuit image collected by the image acquisition device on the display peripheral circuit production line, and it is useful for classification tasks. Higher generalizability.
- the organization of the MASK RCNN model required for training the defect detection model may be different, which can be performed according to the actual situation It is determined that this embodiment does not limit it.
- the quality of the display peripheral circuit corresponding to the display peripheral circuit image may be determined according to the defect detection result.
- the defect detection result may include: a category of each defect, and / or a contour position of each defect.
- the defect detection result that can be obtained by the defect detection model can include the defect category (there are several types of defects on the display peripheral circuit), the defect location (the specificity of each defect) Pixel position), the contour of the defect (the contour shape of each defect).
- the presentation of the defect detection results can be understood as: the defect detection model outputs a segmentation map, which is identified by the first color as normal pixels, the second color identifies the first defect, the second color identifies the second defect, and the first defect And the second defect can be the same type of defect, or it can be a different type of defect.
- the defect detection result of detecting two types of defects for example, it can be a segmentation map with white as the background color and containing blue and green patches, where white represents pixels in a normal area, and blue represents a point-like defect. Pixels of the area, green represents pixels of another point-like defect.
- the MASK RCNN model is pixel recognition, so various types of defect patterns can be obtained from the defect detection results, which can be understood as the contour shapes of various types of defects and their pixel locations in the display peripheral circuit image.
- S104 (determining the quality of the display peripheral circuit corresponding to the display peripheral circuit image according to the defect detection result) may be replaced by: determining the display screen according to the production stage information and the defect detection result.
- the quality of the peripheral circuit of the display screen corresponding to the peripheral circuit image is good or bad.
- a variety of different production stage information such as the manufacturer, production environment, and type of display peripheral circuits may obtain different defect detection results during the display peripheral circuit detection process.
- the production stages they undergo are different. Therefore, when analyzing the defect detection results obtained above, it is necessary to combine the production stage information of each display peripheral circuit to determine the quality of the display peripheral circuits. Good or bad.
- the defect detection model in the embodiment of the present application can detect several types of defect types in the display peripheral circuit image and the specific number of each type of defect, that is, the defect detection model obtained by using the MASK RCNN algorithm can Distinguish between different defective individuals belonging to the same category.
- the method for detecting a peripheral circuit of a display screen receives a quality detection request sent by a console deployed on a display peripheral circuit production line, and the quality detection request includes data collected by an image acquisition device on the display peripheral circuit production line.
- the display peripheral circuit image is input to the defect detection model to obtain a defect detection result, and the quality of the display peripheral circuit corresponding to the display peripheral circuit image is determined according to the defect detection result. Since the above defect detection model is obtained by training the MASK and RCNN algorithm on the peripheral circuit image of the historical defect display, the defect detection results obtained by using the defect detection model have high classification accuracy, strong intelligence, and improved system performance. High business scalability.
- FIG. 3 it is a schematic flowchart of a second embodiment of a method for detecting a peripheral circuit of a display screen according to an embodiment of the present application.
- the above S104 inputting the image to be tested into a defect detection model to obtain a defect detection result
- steps S301-S302 can be implemented through steps S301-S302, as follows:
- S301 Determine a detection model server that carries processing resources according to a load balancing policy.
- a server group is deployed on the display peripheral circuit production line.
- the number of servers in the server group may be multiple, and each server runs a defect detection model.
- the defect detection model running on each server is the same. Therefore, each server can receive the quality inspection request sent by the console, and then can use the defect detection model carried by itself to process the image of the display peripheral circuit. Quality Inspection.
- the console can also send a quality detection request to any server in the server group in real time.
- the load balancing can be performed according to a preset load Strategy, determine a server from the server group as a detection model server that carries processing resources, that is, load balancing and scheduling in real time according to the deployment of the defect detection model on the display peripheral circuit production line.
- the above-mentioned peripheral circuit image of the display screen may be input into the defect detection model running on the detection model server,
- the defect detection model is used to detect defects in the peripheral circuit image of the display screen, and then the defect detection results are obtained.
- the defect detection model is obtained by a training module training a preset pixel category and an actual pixel category in a peripheral circuit image of a historical defect display screen.
- the method for detecting a peripheral circuit of a display screen determines a detection model server carrying processing resources according to a load balancing policy, and inputs the image to be tested into a defect detection model running on the detection model server to obtain a defect.
- the detection result can achieve load balancing on the server, improve the detection efficiency of the display peripheral circuit image, and improve the performance of the display peripheral circuit detection system.
- the method may further include the following steps:
- the display peripheral circuit image and the defect detection result are input into the defect detection model in order to optimize the defect detection model.
- the tester may preset a solution when the display peripheral circuit is determined to be a bad screen according to the production scenario and production stage information of the display peripheral circuit, for example, the controller sends the The manager sends an alarm message, and / or stores the above-mentioned defect detection result as a log in the production database through the controller, and / or, sends a production control instruction to the console through the controller to eliminate the defect, and / or,
- the display peripheral circuit image and the above-mentioned defect detection result are input into the above-mentioned defect detection model in order to optimize the above-mentioned defect detection model and the like.
- an alarm message may be issued to enable production management.
- the developer locates the category and location of the defect in time, and gives a solution.
- the above-mentioned defect detection result may be stored in the production database as a log by the controller, that is, the category of each defect of the peripheral circuit of the display screen , And / or the contour position of each defect is stored as a log in the production database, which can be filtered into the training database, and the training module (which can be a software program such as a training engine) updates the above according to the defective display peripheral circuit image Defect detection model.
- a production control instruction may also be sent to the console through the controller to eliminate the defect. That is, the inspection model server that carries the defect inspection model can determine the cause of the defect through the controller, and then adjust the production process accordingly, that is, the inspection model server sends the production control instruction to the console through the controller to eliminate the periphery of the display screen. Defects in the circuit to reduce the probability of damage to the circuit.
- the image of the peripheral circuit of the display screen and the defect detection result may be directly input into the defect detection model in order to optimize the defect detection model. That is, the image of the display peripheral circuit corresponding to the damaged circuit is directly used as the training set of the defect detection model to optimize the defect detection model, thereby improving the detection accuracy of the defect detection model.
- the embodiments of the present application are not limited to the above-mentioned one or more operations that can be performed by the detection model server when it is determined that the peripheral circuit of the display screen is a damaged circuit, which can be determined according to the actual situation, and will not be repeated here.
- the operation steps corresponding to the display peripheral circuit detection method may also be distributed to the above.
- Multiple different devices to perform For example, the image acquisition device collects the display peripheral circuit image, and the console sends the display peripheral circuit image collected by the image acquisition device to the detection model server in the server group according to the load balancing strategy, and the defect detection running on the detection model server is performed.
- the model performs preset preprocessing on the peripheral circuit images of the display screen, and then performs defect detection, and gives the defect detection results.
- the detection model server can send the defect detection results to the controller.
- the controller combines the actual business scenario and responds to the requirements of the above-mentioned defect detection results according to business requirements, such as alarms, storage logs, and control. Production control instructions, etc.
- the controller can also store the defect detection results and the above-mentioned response processing behavior as logs in the production database, so that the training module updates according to the display peripheral circuit image and defect detection results in the training database.
- the training database stores data such as the peripheral circuit image of the display screen with defects and corresponding defect detection results, which are selected from the production database.
- the defect detection model running on the server can be gradually replaced by a small-traffic online method, so as to achieve the purpose of dynamically expanding and generalizing the defect detection model with business scene and production stage information.
- the display peripheral circuit detection method in the embodiment of the present application runs for a period of time on the display peripheral circuit production line, the accuracy of the above defect detection and defect location can be reviewed manually through the information in the production database, and then the above training database is updated. Retrain the defect detection model to improve the accuracy of defect detection.
- the display circuit peripheral circuit detecting device provided in the embodiment of the present application may mainly include a receiving module 41, a pre-processing module 42, a processing module 43, and a determining module 44.
- the receiving module 41 is configured to receive a quality detection request sent by a console deployed on a display peripheral circuit production line, and the quality detection request includes a display peripheral collected by an image acquisition device on the display peripheral circuit production line. Circuit image.
- the pre-processing module 42 is configured to enlarge or reduce the image of the peripheral circuit of the display screen to obtain an image to be tested whose size is consistent with the input size requirement of the defect detection model.
- the defect detection model is a historical defect display peripheral circuit.
- the image is obtained by training the MASK RCNN algorithm on instance segmentation.
- the processing module 43 is configured to input the image to be tested into a defect detection model to obtain a defect detection result.
- a determining module 44 is configured to determine, according to the defect detection result, the quality of a display screen peripheral circuit corresponding to the display screen peripheral circuit image.
- the device for detecting peripheral circuits of the display screen in the embodiment shown in FIG. 4 may be correspondingly used to execute the steps in the method embodiment shown in FIG. 2.
- the implementation principles and technical effects are similar, and will not be repeated here.
- the processing module 43 is further configured to, before the defect detection result is obtained by inputting the image of the display peripheral circuit into the defect detection model, compare the actual pixel category of the image of the peripheral circuit of the historical defect display with the actual pixel type.
- the defect detection model is trained by the MASK RCNN algorithm, so that the loss value between the predicted pixel type of the defect detection model for the historical defect display peripheral circuit image output and the actual pixel type is lower than a preset Loss threshold.
- the preprocessing module 42 is further configured to perform image preprocessing on the display peripheral circuit image before zooming in or out of the display peripheral circuit image, where the image preprocessing includes One or more of the following: trimming, cutting, rotating.
- the processing module 43 is specifically configured to determine a detection model server carrying processing resources according to a load balancing policy; and input the image to be tested into the defect detection model running on the detection model server Get defect detection results.
- the defect detection result includes: a category of each defect, and / or a contour position of each defect.
- the determining module 44 is specifically configured to determine the quality of the display peripheral circuit corresponding to the display peripheral circuit image according to the production stage information and the defect detection result.
- the processing module 43 is further configured to, after determining the quality of the display peripheral circuit corresponding to the display peripheral circuit image according to the defect detection result, determine the display peripheral circuit To damage the circuit, do one or more of the following:
- the display peripheral circuit image and the defect detection result are input into the defect detection model in order to optimize the defect detection model.
- the device for detecting peripheral circuits of a display screen of the foregoing device embodiment may be used to execute the implementation solutions of the method embodiments shown in FIG. 2 to FIG.
- the electronic device includes a processor 51, a memory 52, and a computer program.
- the memory 52 is configured to store the computer program, and the memory may also be a flash memory.
- the computer program is, for example, an application program, a functional module, and the like that implement the above method.
- the processor 51 is configured to execute a computer program stored in the memory to implement each step performed by the electronic device in the foregoing method. For details, refer to related descriptions in the foregoing method embodiments.
- the memory 52 may be independent or integrated with the processor 51.
- the electronic device may further include:
- the bus 53 is configured to connect the memory 52 and the processor 51.
- the present application also provides a storage medium.
- the storage medium has instructions stored therein, which when run on a computer, cause the computer to execute the method in the method embodiments shown in FIG. 2 to FIG. 3.
- the storage medium may be a computer storage medium or a communication medium.
- Communication media include any medium that facilitates transfer of a computer program from one place to another.
- Computer storage media can be any available media that can be accessed by a general purpose or special purpose computer.
- a storage medium is coupled to the processor such that the processor can read information from, and write information to, the readable storage medium.
- the storage medium may also be an integral part of the processor.
- the processor and the storage medium may be located in application specific integrated circuits (Application Specific Integrated Circuits, ASIC for short).
- the ASIC may reside in a user equipment.
- the processor and the storage medium may also exist as discrete components in a communication device.
- the present application also provides a program product, which includes a computer program stored in a storage medium.
- At least one processor of the display peripheral circuit detection device may read the computer program from a storage medium, and the at least one processor executes the computer program to cause the display peripheral circuit detection device to execute the method in the method embodiments shown in FIGS.
- the processor may be a central processing unit (English: Central Processing Unit, CPU for short), or other general-purpose processors, digital signal processors (English: Digital Signal Processor, Abbreviation: DSP), Application Specific Integrated Circuit (English: Application Specific Integrated Circuit, Abbreviation: ASIC), etc.
- a general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps combined with the method disclosed in the present application can be directly embodied as being executed by a hardware processor, or executed and completed by a combination of hardware and software modules in the processor.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- Pathology (AREA)
- Analytical Chemistry (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- Nonlinear Science (AREA)
- Optics & Photonics (AREA)
- Signal Processing (AREA)
- Crystallography & Structural Chemistry (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Computer Hardware Design (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
- Controls And Circuits For Display Device (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
Claims (14)
- 一种显示屏外围电路检测方法,其特征在于,包括:接收部署在显示屏外围电路生产线上的控制台发送的质量检测请求,所述质量检测请求中包含所述显示屏外围电路生产线上的图像采集设备采集的显示屏外围电路图像;将所述显示屏外围电路图像放大或缩小,得到大小与缺陷检测模型的输入大小要求一致的待测图像,其中,所述缺陷检测模型是用历史缺陷显示屏外围电路图像进行实例分割Mask RCNN算法训练得到的;将所述待测图像输入到缺陷检测模型中得到缺陷检测结果;根据所述缺陷检测结果确定所述显示屏外围电路图像对应的显示屏外围电路的质量好坏。
- 根据权利要求1所述的方法,其特征在于,在所述将所述显示屏外围电路图像输入到缺陷检测模型中得到缺陷检测结果之前,还包括:以历史缺陷显示屏外围电路图像的实际像素类别对所述缺陷检测模型进行所述Mask RCNN算法训练,以使所述缺陷检测模型对所述历史缺陷显示屏外围电路图像输出的预测像素类别,与所述实际像素类别之间的损失值低于预设损失阈值。
- 根据权利要求1所述的方法,其特征在于,在所述将所述显示屏外围电路图像放大或缩小之前,还包括:对所述显示屏外围电路图像进行图像预处理,其中,所述图像预处理包括下述处理中的一项或多项:裁边、剪切、旋转。
- 根据权利要求1-3任一项所述的方法,其特征在于,所述将所述待测图像输入到缺陷检测模型中得到缺陷检测结果,包括:根据负载均衡策略,确定承载处理资源的检测模型服务器;将所述待测图像输入到运行在所述检测模型服务器上的所述缺陷检测模型中得到缺陷检测结果。
- 根据权利要求1-3任一项所述的方法,其特征在于,所述缺陷检测结果,包括:每个缺陷的类别,和/或各缺陷的轮廓位置;所述根据所述缺陷检测结果确定所述显示屏外围电路图像对应的显示屏外围电路的质量好坏,包括:根据生产阶段信息以及所述缺陷检测结果,确定所述显示屏外围电路图像对应的显示 屏外围电路的质量好坏。
- 根据权利要求1-3任一项所述的方法,其特征在于,在所述根据所述缺陷检测结果确定所述显示屏外围电路图像对应的显示屏外围电路的质量好坏之后,还包括:若确定所述显示屏外围电路为损坏电路,则执行以下一项或多项操作:通过控制器向生产管理者发送报警信息;通过控制器将所述缺陷检测结果作为日志存储到生产数据库中;通过控制器向所述控制台发送生产控制指令以便消除缺陷;将所述显示屏外围电路图像和所述缺陷检测结果输入到所述缺陷检测模型中以便优化所述缺陷检测模型。
- 一种显示屏外围电路检测装置,其特征在于,包括:接收模块,用于接收部署在显示屏外围电路生产线上的控制台发送的质量检测请求,所述质量检测请求中包含所述显示屏外围电路生产线上的图像采集设备采集的显示屏外围电路图像;预处理模块,用于将所述显示屏外围电路图像放大或缩小,得到大小与缺陷检测模型的输入大小要求一致的待测图像,其中,所述缺陷检测模型是用历史缺陷显示屏外围电路图像进行实例分割Mask RCNN算法训练得到的;处理模块,用于将所述待测图像输入到缺陷检测模型中得到缺陷检测结果;确定模块,用于根据所述缺陷检测结果确定所述显示屏外围电路图像对应的显示屏外围电路的质量好坏。
- 根据权利要求7所述的装置,其特征在于,所述处理模块,还用于在所述将所述显示屏外围电路图像输入到缺陷检测模型中得到缺陷检测结果之前,以历史缺陷显示屏外围电路图像的实际像素类别对所述缺陷检测模型进行所述Mask RCNN算法训练,以使所述缺陷检测模型对所述历史缺陷显示屏外围电路图像输出的预测像素类别,与所述实际像素类别之间的损失值低于预设损失阈值。
- 根据权利要求7所述的装置,其特征在于,所述预处理模块,还用于在所述将所述显示屏外围电路图像放大或缩小之前对所述显示屏外围电路图像进行图像预处理,其中,所述图像预处理包括下述处理中的一项或多项:裁边、剪切、旋转。
- 根据权利要求7-9任一项所述的装置,其特征在于,所述处理模块,具体用于根据负载均衡策略,确定承载处理资源的检测模型服务器; 将所述待测图像输入到运行在所述检测模型服务器上的所述缺陷检测模型中得到缺陷检测结果。
- 根据权利要求7-9任一项所述的装置,其特征在于,所述缺陷检测结果,包括:每个缺陷的类别,和/或各缺陷的轮廓位置;所述确定模块,具体用于根据生产阶段信息以及所述缺陷检测结果,确定所述显示屏外围电路图像对应的显示屏外围电路的质量好坏。
- 根据权利要求7-9任一项所述的装置,其特征在于,所述处理模块,还用于在所述根据所述缺陷检测结果确定所述显示屏外围电路图像对应的显示屏外围电路的质量好坏之后,若确定所述显示屏外围电路为损坏电路,则执行以下一项或多项操作:通过控制器向生产管理者发送报警信息;通过控制器将所述缺陷检测结果作为日志存储到生产数据库中;通过控制器向所述控制台发送生产控制指令以便消除缺陷;将所述显示屏外围电路图像和所述缺陷检测结果输入到所述缺陷检测模型中以便优化所述缺陷检测模型。
- 一种电子设备,包括处理器、存储器及存储在所述存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现如上述权利要求1-6任一项所述的方法。
- 一种存储介质,其特征在于,所述存储介质中存储有指令,当其在计算机上运行时,使得计算机执行如权利要求1-6任一项所述的方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019563795A JP7025452B2 (ja) | 2018-07-02 | 2019-05-08 | ディスプレイスクリーン周辺回路の検出方法、ディスプレイスクリーン周辺回路の検出装置、電子機器及び記憶媒体 |
KR1020197034316A KR102320371B1 (ko) | 2018-07-02 | 2019-05-08 | 디스플레이 스크린 주변 회로 검출 방법, 장치, 전자기기 및 저장매체 |
US16/995,898 US20200380899A1 (en) | 2018-07-02 | 2020-08-18 | Method and apparatus for detecting peripheral circuit of display screen, electronic device, and storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810709836.7A CN109085174A (zh) | 2018-07-02 | 2018-07-02 | 显示屏外围电路检测方法、装置、电子设备及存储介质 |
CN201810709836.7 | 2018-07-02 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/995,898 Continuation US20200380899A1 (en) | 2018-07-02 | 2020-08-18 | Method and apparatus for detecting peripheral circuit of display screen, electronic device, and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020007118A1 true WO2020007118A1 (zh) | 2020-01-09 |
Family
ID=64836902
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/085912 WO2020007118A1 (zh) | 2018-07-02 | 2019-05-08 | 显示屏外围电路检测方法、装置、电子设备及存储介质 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20200380899A1 (zh) |
JP (1) | JP7025452B2 (zh) |
KR (1) | KR102320371B1 (zh) |
CN (1) | CN109085174A (zh) |
WO (1) | WO2020007118A1 (zh) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111402250A (zh) * | 2020-03-26 | 2020-07-10 | 中国联合网络通信集团有限公司 | 基于边缘计算的机器视觉缺陷检测方法和平台 |
CN113256570A (zh) * | 2021-05-10 | 2021-08-13 | 郑州轻工业大学 | 基于人工智能的视觉信息处理方法、装置、设备及介质 |
CN113256623A (zh) * | 2021-06-29 | 2021-08-13 | 南昌工程学院 | 一种基于改进mask rcnn的fpc缺陷检测方法 |
WO2022019110A1 (ja) * | 2020-07-21 | 2022-01-27 | 株式会社シバサキ | プログラム、情報処理装置、情報処理方法及びモデル生成方法 |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109085174A (zh) * | 2018-07-02 | 2018-12-25 | 北京百度网讯科技有限公司 | 显示屏外围电路检测方法、装置、电子设备及存储介质 |
CN111402214A (zh) * | 2020-03-07 | 2020-07-10 | 西南交通大学 | 基于神经网络的接触网吊弦载流环断裂缺陷自动检测方法 |
US11435298B2 (en) * | 2020-07-24 | 2022-09-06 | Hewlett Packard Enterprise Development Lp | Circuit board anomaly indication |
CN112712504B (zh) * | 2020-12-30 | 2023-08-15 | 广东粤云工业互联网创新科技有限公司 | 基于云端的工件检测方法及系统、计算机可读存储介质 |
CN112816496B (zh) * | 2021-01-05 | 2022-09-23 | 广州市华颉电子科技有限公司 | 一种汽车域控制器的接口装配质量自动光学检测方法及装置 |
CN114943855A (zh) * | 2021-02-09 | 2022-08-26 | 富泰华工业(深圳)有限公司 | 图像分类标注方法、装置、电子设备及存储介质 |
US20220318667A1 (en) * | 2021-03-30 | 2022-10-06 | Accenture Global Solutions Limited | Intelligent real-time defect prediction, detection, and ai driven automated correction solution |
CN116229856B (zh) * | 2023-05-10 | 2023-07-28 | 山西晋聚轩科技有限公司 | 一种计算机用自动控制的屏幕检测系统及方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107886500A (zh) * | 2017-10-13 | 2018-04-06 | 北京邮电大学 | 一种基于机器视觉和机器学习的产品生产监控方法及系统 |
CN108090897A (zh) * | 2017-12-18 | 2018-05-29 | 川亿电脑(深圳)有限公司 | 印刷线路板缺陷的检测方法、检测装置及存储介质 |
CN108230317A (zh) * | 2018-01-09 | 2018-06-29 | 北京百度网讯科技有限公司 | 钢板缺陷检测分类方法、装置、设备及计算机可读介质 |
CN109085174A (zh) * | 2018-07-02 | 2018-12-25 | 北京百度网讯科技有限公司 | 显示屏外围电路检测方法、装置、电子设备及存储介质 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3920003B2 (ja) * | 2000-04-25 | 2007-05-30 | 株式会社ルネサステクノロジ | 検査データ処理方法およびその装置 |
KR20090131000A (ko) * | 2008-06-17 | 2009-12-28 | 아주하이텍(주) | 플렉시블 인쇄회로기판의 통합 검사 시스템 및 그 방법 |
CN101726493B (zh) * | 2009-12-02 | 2012-07-18 | 中国建筑材料科学研究总院 | 一种水泥基材料收缩与开裂性能检测方法及装置 |
US8995747B2 (en) * | 2010-07-29 | 2015-03-31 | Sharp Laboratories Of America, Inc. | Methods, systems and apparatus for defect detection and classification |
WO2016004063A1 (en) * | 2014-06-30 | 2016-01-07 | Amazon Technologies, Inc. | Feature processing recipes for machine learning |
US10650508B2 (en) * | 2014-12-03 | 2020-05-12 | Kla-Tencor Corporation | Automatic defect classification without sampling and feature selection |
JP2018005640A (ja) * | 2016-07-04 | 2018-01-11 | タカノ株式会社 | 分類器生成装置、画像検査装置、及び、プログラム |
JP2018045673A (ja) * | 2016-09-09 | 2018-03-22 | 株式会社Screenホールディングス | 分類器構築方法、画像分類方法、分類器構築装置および画像分類装置 |
CN108073932A (zh) * | 2016-11-16 | 2018-05-25 | 中国科学院沈阳计算技术研究所有限公司 | 一种基于Gabor滤波的工件图像特征提取与识别方法 |
US10685295B1 (en) * | 2016-12-29 | 2020-06-16 | X Development Llc | Allocating resources for a machine learning model |
WO2018191698A1 (en) * | 2017-04-13 | 2018-10-18 | Instrumental, Inc. | Method for predicting defects in assembly units |
CN107561738B (zh) * | 2017-08-30 | 2020-06-12 | 湖南理工学院 | 基于fcn的tft-lcd表面缺陷快速检测方法 |
CN107729882A (zh) * | 2017-11-19 | 2018-02-23 | 济源维恩科技开发有限公司 | 基于图像识别的情绪识别判定方法 |
CN108089753B (zh) * | 2017-12-28 | 2021-03-09 | 安徽慧视金瞳科技有限公司 | 一种利用Faster-RCNN对指尖位置进行预测的定位方法 |
-
2018
- 2018-07-02 CN CN201810709836.7A patent/CN109085174A/zh active Pending
-
2019
- 2019-05-08 WO PCT/CN2019/085912 patent/WO2020007118A1/zh active Application Filing
- 2019-05-08 KR KR1020197034316A patent/KR102320371B1/ko active IP Right Grant
- 2019-05-08 JP JP2019563795A patent/JP7025452B2/ja active Active
-
2020
- 2020-08-18 US US16/995,898 patent/US20200380899A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107886500A (zh) * | 2017-10-13 | 2018-04-06 | 北京邮电大学 | 一种基于机器视觉和机器学习的产品生产监控方法及系统 |
CN108090897A (zh) * | 2017-12-18 | 2018-05-29 | 川亿电脑(深圳)有限公司 | 印刷线路板缺陷的检测方法、检测装置及存储介质 |
CN108230317A (zh) * | 2018-01-09 | 2018-06-29 | 北京百度网讯科技有限公司 | 钢板缺陷检测分类方法、装置、设备及计算机可读介质 |
CN109085174A (zh) * | 2018-07-02 | 2018-12-25 | 北京百度网讯科技有限公司 | 显示屏外围电路检测方法、装置、电子设备及存储介质 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111402250A (zh) * | 2020-03-26 | 2020-07-10 | 中国联合网络通信集团有限公司 | 基于边缘计算的机器视觉缺陷检测方法和平台 |
WO2022019110A1 (ja) * | 2020-07-21 | 2022-01-27 | 株式会社シバサキ | プログラム、情報処理装置、情報処理方法及びモデル生成方法 |
JP7391285B2 (ja) | 2020-07-21 | 2023-12-05 | 株式会社シバサキ | プログラム、情報処理装置、情報処理方法及びモデル生成方法 |
CN113256570A (zh) * | 2021-05-10 | 2021-08-13 | 郑州轻工业大学 | 基于人工智能的视觉信息处理方法、装置、设备及介质 |
CN113256623A (zh) * | 2021-06-29 | 2021-08-13 | 南昌工程学院 | 一种基于改进mask rcnn的fpc缺陷检测方法 |
CN113256623B (zh) * | 2021-06-29 | 2021-10-26 | 南昌工程学院 | 一种基于改进mask rcnn的fpc缺陷检测方法 |
Also Published As
Publication number | Publication date |
---|---|
JP2020530126A (ja) | 2020-10-15 |
US20200380899A1 (en) | 2020-12-03 |
KR20200004822A (ko) | 2020-01-14 |
JP7025452B2 (ja) | 2022-02-24 |
CN109085174A (zh) | 2018-12-25 |
KR102320371B1 (ko) | 2021-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020007118A1 (zh) | 显示屏外围电路检测方法、装置、电子设备及存储介质 | |
US11380232B2 (en) | Display screen quality detection method, apparatus, electronic device and storage medium | |
US11488294B2 (en) | Method for detecting display screen quality, apparatus, electronic device and storage medium | |
WO2020007119A1 (zh) | 显示屏外围电路检测方法、装置、电子设备及存储介质 | |
EP3937128A2 (en) | Image defect detection method and apparatus, electronic device, storage medium and product | |
CN110060237B (zh) | 一种故障检测方法、装置、设备及系统 | |
CN111507958B (zh) | 目标检测方法、检测模型的训练方法及电子设备 | |
CN109064446A (zh) | 显示屏质量检测方法、装置、电子设备及存储介质 | |
CN109087281A (zh) | 显示屏外围电路检测方法、装置、电子设备及存储介质 | |
CN108961239A (zh) | 连铸坯质量检测方法、装置、电子设备及存储介质 | |
CN115131283A (zh) | 目标对象的缺陷检测、模型训练方法、装置、设备及介质 | |
CN116385430A (zh) | 一种机器视觉瑕疵检测方法、装置、介质及设备 | |
JP7446060B2 (ja) | 情報処理装置、プログラム及び情報処理方法 | |
CN113537037A (zh) | 路面病害识别方法、系统、电子设备及存储介质 | |
CN117351472A (zh) | 烟叶信息检测方法、装置及电子设备 | |
KR20220151130A (ko) | 영상 처리 방법, 장치, 전자 기기, 저장 매체 및 컴퓨터 프로그램 | |
CN109087282A (zh) | 显示屏外围电路检测方法、装置、电子设备及存储介质 | |
CN112001336A (zh) | 行人越界报警方法、装置、设备及系统 | |
CN117349734B (zh) | 水表设备识别方法、装置、电子设备及存储介质 | |
CN115542100B (zh) | 绝缘子故障检测方法、装置、设备及介质 | |
CN116259092A (zh) | 无人机航拍人脸识别方法、系统、设备以及可读存储介质 | |
CN117789109A (zh) | 一种工业场景下无人值守的异常行为检测方法和系统 | |
CN114842073A (zh) | 图像数据扩增方法、装置、设备、介质和计算机程序产品 | |
CN116123040A (zh) | 一种基于多模态数据融合的风机叶片状态检测方法及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2019563795 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20197034316 Country of ref document: KR Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19831442 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19831442 Country of ref document: EP Kind code of ref document: A1 |