CN116128789A - Display module detection method, device and system and storage medium - Google Patents

Display module detection method, device and system and storage medium Download PDF

Info

Publication number
CN116128789A
CN116128789A CN202111345516.6A CN202111345516A CN116128789A CN 116128789 A CN116128789 A CN 116128789A CN 202111345516 A CN202111345516 A CN 202111345516A CN 116128789 A CN116128789 A CN 116128789A
Authority
CN
China
Prior art keywords
image
display module
color
light emitting
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111345516.6A
Other languages
Chinese (zh)
Inventor
曹乾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jinan Yushi Intelligent Technology Co ltd
Original Assignee
Jinan Yushi Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jinan Yushi Intelligent Technology Co ltd filed Critical Jinan Yushi Intelligent Technology Co ltd
Priority to CN202111345516.6A priority Critical patent/CN116128789A/en
Publication of CN116128789A publication Critical patent/CN116128789A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration using local operators
    • G06T5/30Erosion or dilatation, e.g. thinning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/187Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30121CRT, LCD or plasma display

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
  • Quality & Reliability (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

A display module detection method, the said display module includes the luminescent unit of multiple colors, the said display module detection method includes: acquiring a single-color image of a display module; acquiring a color channel image according to the single-base color image; and determining a lighted light-emitting unit area according to the color channel image, determining the number of lighted light-emitting units according to the lighted light-emitting unit area, and determining whether abnormal light-emitting units exist according to the number of light-emitting units. According to the scheme provided by the embodiment, the detection of the light emitting unit can be realized through the color channel image.

Description

Display module detection method, device and system and storage medium
Technical Field
The present disclosure relates to display technologies, and in particular, to a method, an apparatus, a system, and a storage medium for detecting a display module.
Background
Due to the processing technology, after the production of the small-pitch light emitting diode (Light Emitting Diode, LED) module board, the phenomenon of short-circuit caterpillars as shown in fig. 1 may occur: a pin of the driving integrated circuit (IntegratedCircuit, IC) is broken or cold-welded to cause a class A short-circuit caterpillar (lamp bead normally kills the short-circuit caterpillar), and a signal of the pin of the driving integrated circuit is short-circuited with other signals or the internal short-circuit of the lamp bead causes a class B short-circuit caterpillar (lamp bead normally shines the short-circuit caterpillar). Therefore, after the LED module board is produced, the display problem is detected in time, and corresponding overhaul treatment is carried out, so that the product quality can be ensured.
Disclosure of Invention
The embodiment of the application provides a display module detection method, a device and a system and a storage medium, which can detect the abnormality of a display module.
The embodiment of the application provides a display module assembly detection method, display module assembly includes the luminescence unit of multiple colour, display module assembly detection method includes:
acquiring a single-color image of a display module;
acquiring a color channel image according to the single-base color image;
and determining a lighted light-emitting unit area according to the color channel image, determining the number of lighted light-emitting units according to the lighted light-emitting unit area, and determining whether abnormal light-emitting units exist according to the number of light-emitting units.
In an exemplary embodiment, the acquiring a color channel image from the single-base color image includes:
acquiring an image of a color channel which is the same as the color of the single-base color image according to the single-base color image, wherein the image is called a first image;
the determining the lighted lighting unit area according to the color channel image, and determining the number of lighted lighting units according to the lighted lighting unit area includes:
determining a lighted light emitting unit area according to the first image, which is called a first light emitting unit area, and determining the lighted light emitting unit number according to the first light emitting unit area, which is called a first light emitting unit number;
The determining whether the abnormal light emitting unit exists according to the number of the light emitting units comprises the following steps:
and determining whether abnormal light-emitting unit normally-off exists or not according to the number of the first light-emitting units and the number of the light-emitting units which are the same as the color of the single-base color image when the display module normally displays.
In an exemplary embodiment, the acquiring a color channel image from the single-base color image includes:
acquiring a second image and/or a third image according to the single-primary-color image, wherein the second image is an image of one of the color channels with a color different from that of the single-primary-color image, and the third image is an image of the other of the color channels with a color different from that of the single-primary-color image; the determining the lighted lighting unit area according to the color channel image, and determining the number of lighted lighting units according to the lighted lighting unit area includes:
determining a lighted lighting unit area according to the second image, which is called a second lighting unit area, and determining the lighted lighting unit number according to the second lighting unit area, which is called a second lighting unit number;
and/or determining a lit light emitting unit area according to the third image, which is called a third light emitting unit area, and determining the lit light emitting unit number according to the third light emitting unit area, which is called a third light emitting unit number;
The determining whether the abnormal light emitting unit exists according to the number of the light emitting units comprises the following steps:
and determining whether the abnormal brightness of the light emitting units exists according to the number of the second light emitting units and/or the number of the third light emitting units.
In an exemplary embodiment, before the obtaining the color channel image according to the single-base color image, the method further includes:
performing Gaussian filtering processing on the single-base-color image;
in an exemplary embodiment, the determining the lighted lighting unit region according to the color channel image includes:
carrying out morphological corrosion treatment on the color channel image, and carrying out binarization treatment on the image subjected to the morphological corrosion treatment to obtain a binary image;
carrying out connected domain analysis on the binary image to obtain a connected domain set; and taking the connected domains with the areas larger than or equal to a preset threshold value in the connected domain set as the lighted luminous unit areas.
In an exemplary embodiment, determining whether there is a abnormal light emitting unit in the display module according to the first light emitting unit number and the first color light emitting unit number when the display module displays normally includes:
when the difference value between the number of the light emitting units of the first color and the number of the first light emitting units is larger than or equal to the number of the light emitting units controlled by a single scanning control pin of the display module, the light emitting units of the first color are abnormal.
In an exemplary embodiment, the determining whether there is a lighting unit normally-bright abnormality according to the second lighting unit number and/or the third lighting unit number includes:
when the number of the second light-emitting units is larger than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the second color light-emitting units are abnormal in brightness;
and/or when the number of the third light-emitting units is greater than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the third color light-emitting units are always abnormal in brightness.
The embodiment of the disclosure provides a display module detection device, which comprises a memory and a processor, wherein the memory stores a program, and the program realizes the display module detection method according to any one of the embodiments when being read and executed by the processor.
Embodiments of the present disclosure provide a computer readable storage medium storing one or more programs executable by one or more processors to implement the display module detection method described in any of the above embodiments.
The embodiment of the disclosure provides a display module detecting system, including above-mentioned display module detecting device, still include: environment sending card, environment receiving card box, sweep sign indicating number device and image acquisition equipment, wherein:
The display module detection device is configured to determine a corresponding image configuration file according to the model of the display module, and send the image configuration file to an environment receiving card box body through the environment sending card; and sending a control instruction to the environment receiving card box body through the environment sending card; and controlling the image acquisition equipment to acquire images and receiving the single-primary-color images acquired by the image acquisition equipment; the code scanning device is controlled to scan the bar code of the display module, bar code information of the display module sent by the code scanning device is received, the bar code information is stored, and a detection result of the display module is stored based on the bar code information;
the environment transmitting card is configured to receive the image configuration file and the control instruction sent by the display module detecting device and transmit the image configuration file and the control instruction to the environment receiving card box body;
the environment receiving card box body is configured to receive the image configuration file and the control instruction, and control the display module to display according to the control instruction and the image configuration file;
the image acquisition equipment is configured to acquire a single-base-color image of the display module according to the control of the display module detection device and send the single-base-color image to the display module detection device;
The code scanning device is configured to scan the bar code of the display module to obtain bar code information of the display module according to the control of the display module detection device, and send the bar code information to the display module control device.
Compared with the related art, the embodiment of the application comprises a display module detection method, wherein the display module comprises a plurality of light-emitting units with different colors, and the display module detection method comprises the following steps: acquiring a single-color image of a display module; acquiring a color channel image according to the single-base color image; and determining a lighted light-emitting unit area according to the color channel image, determining the number of lighted light-emitting units according to the lighted light-emitting unit area, and determining whether abnormal light-emitting units exist according to the number of light-emitting units. According to the scheme provided by the embodiment, the detection of the light emitting unit can be realized through the color channel image.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application. Other advantages of the present application may be realized and attained by the structure particularly pointed out in the written description and drawings.
Drawings
The accompanying drawings are included to provide an understanding of the technical aspects of the present application, and are incorporated in and constitute a part of this specification, illustrate the technical aspects of the present application and together with the examples of the present application, and not constitute a limitation of the technical aspects of the present application.
FIG. 1 is a schematic image of different shorted caterpillars;
FIG. 2 is a flowchart of a method for detecting a display module according to an exemplary embodiment;
FIG. 3 is an image schematic diagram of different display modes provided by an exemplary embodiment;
FIG. 4 is a flowchart of a method for detecting a display module (detecting a light-emitting unit is turned off) according to an exemplary embodiment;
FIG. 5 is a schematic diagram illustrating a process of processing an image during detection of a display module according to an exemplary embodiment;
FIG. 6 is a flowchart of a method for detecting a display module according to an exemplary embodiment (light-emitting unit normally-on detection);
FIG. 7 is a schematic diagram illustrating a process of processing an image during detection of a display module according to an exemplary embodiment;
FIG. 8 is a schematic diagram of a combination of detection of class A and class B shorted caterpillars according to an example embodiment;
FIG. 9 is a block diagram of a display module detection system according to an exemplary embodiment;
fig. 10 is a flowchart of a method for detecting a display module according to an exemplary embodiment.
Detailed Description
The present application describes a number of embodiments, but the description is illustrative and not limiting and it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the embodiments described herein. Although many possible combinations of features are shown in the drawings and discussed in the detailed description, many other combinations of the disclosed features are possible. Any feature or element of any embodiment may be used in combination with or in place of any other feature or element of any other embodiment unless specifically limited.
The present application includes and contemplates combinations of features and elements known to those of ordinary skill in the art. The embodiments, features and elements of the present disclosure may also be combined with any conventional features or elements to form a unique inventive arrangement as defined in the claims. Any feature or element of any embodiment may also be combined with features or elements from other inventive arrangements to form another unique inventive arrangement as defined in the claims. Thus, it should be understood that any of the features shown and/or discussed in this application may be implemented alone or in any suitable combination. Accordingly, the embodiments are not to be restricted except in light of the attached claims and their equivalents. Further, various modifications and changes may be made within the scope of the appended claims.
Furthermore, in describing representative embodiments, the specification may have presented the method and/or process as a particular sequence of steps. However, to the extent that the method or process does not rely on the particular order of steps set forth herein, the method or process should not be limited to the particular sequence of steps described. Other sequences of steps are possible as will be appreciated by those of ordinary skill in the art. Accordingly, the particular order of the steps set forth in the specification should not be construed as limitations on the claims. Furthermore, the claims directed to the method and/or process should not be limited to the performance of their steps in the order written, and one skilled in the art can readily appreciate that the sequences may be varied and still remain within the spirit and scope of the embodiments of the present application.
At present, manual visual inspection is used to detect display problems, detection accuracy and detection efficiency are low, a test process is not controlled, and along with the increase of product requirements, detection leakage risks are more serious. In an exemplary embodiment of the present disclosure, the above display problem may be automatically detected, so as to improve detection accuracy and test efficiency; in addition, the test result can be brought into a database, so that the problem analysis and the traceability are facilitated, and the product quality of the small-space LED module board is ensured.
Fig. 2 is a flowchart of a method for detecting a display module according to an embodiment of the disclosure. As shown in fig. 2, in this embodiment, the display module includes a light emitting unit with multiple colors, and the method for detecting the display module includes:
step 201, obtaining a single-base-color image of a display module;
step 202, obtaining a color channel image according to the single-base color image;
and step 203, determining a lighted light emitting unit area according to the color channel image, determining the number of lighted light emitting units according to the lighted light emitting unit area, and determining whether the light emitting units are abnormal according to the number of the light emitting units.
According to the scheme provided by the embodiment, whether the light emitting unit is abnormal or not can be determined according to the single-primary-color image.
In an exemplary embodiment, the display module may be, for example, an LED module board, but the embodiments of the present disclosure are not limited thereto, and may be other types of display modules, such as an organic light emitting display module, etc.
In an exemplary embodiment, the display module may include, for example, a red light emitting unit, a green light emitting unit, and a blue light emitting unit. The red mode image is obtained when only the red light emitting unit is lighted, the green mode image is obtained when only the green light emitting unit is lighted, the blue mode image is obtained when only the blue light emitting unit is lighted, and the single-primary color image is an image when only one color light emitting unit is lighted, namely, the red mode image, the blue mode image or the green mode image.
In an exemplary embodiment, the acquiring the single primary color image of the display module may include:
the method includes the steps of acquiring a red mode image when a display module only lights up a red light emitting unit (a display mode at this time is referred to as a red display mode), acquiring a green mode image when the display module only lights up a green light emitting unit (a display mode at this time is referred to as a green display mode), and acquiring a blue mode image when the display module only lights up a blue light emitting unit (a display mode at this time is referred to as a blue display mode). The single-primary-color image of each color can be obtained, and the detection of the light-emitting units of each color can be realized. However, the embodiments of the present disclosure are not limited thereto, and only a single-color image of one or more colors may be acquired to realize detection of one or more light emitting units.
In an exemplary embodiment, the acquiring a color channel image from the single-base color image includes:
acquiring an image of a color channel which is the same as the color of the single-base color image according to the single-base color image, wherein the image is called a first image;
the determining the lighted lighting unit area according to the color channel image, and determining the number of lighted lighting units according to the lighted lighting unit area includes:
Determining a lighted light emitting unit area according to the first image, which is called a first light emitting unit area, and determining the lighted light emitting unit number according to the first light emitting unit area, which is called a first light emitting unit number;
the determining whether the abnormal light emitting unit exists according to the number of the light emitting units comprises the following steps:
and determining whether abnormal light-emitting unit normally-off exists or not according to the number of the first light-emitting units and the number of the light-emitting units which are the same as the color of the single-base color image when the display module normally displays. For example, the single-primary color image is a red image, and the number of light emitting units with the same color as the single-primary color image is the number of red light emitting units.
The scheme provided by the embodiment can realize the abnormal detection of the light-emitting unit.
A complete RGB image consisting of three channels red (R), green (G), blue (B) which co-operate to produce the complete image; the RGB image was image channel split into R, G, B three single channel images.
In an exemplary embodiment, an image of a color channel having the same color as that of the single-color image is acquired from the single-color image, for example, when the single-color image is a red mode image, an image composed of pixel values of a red channel is acquired. Similarly, when the single-color image is a green-mode image, an image composed of pixel values of a green channel is acquired.
In an exemplary embodiment, the acquiring a color channel image from the single-base color image includes:
acquiring a second image and/or a third image according to the single-primary-color image, wherein the second image is an image of one of the color channels with a color different from that of the single-primary-color image, and the third image is an image of the other of the color channels with a color different from that of the single-primary-color image; for example, if the single primary color image is a red mode image, a blue channel image and/or a green channel image outside the red channel are obtained;
the determining the lighted lighting unit area according to the color channel image, and determining the number of lighted lighting units according to the lighted lighting unit area includes:
determining a lighted lighting unit area according to the second image, which is called a second lighting unit area, and determining the lighted lighting unit number according to the second lighting unit area, which is called a second lighting unit number;
and/or determining a lit light emitting unit area according to the third image, which is called a third light emitting unit area, and determining the lit light emitting unit number according to the third light emitting unit area, which is called a third light emitting unit number;
The determining whether the abnormal light emitting unit exists according to the number of the light emitting units comprises the following steps:
and determining whether the abnormal brightness of the light emitting units exists according to the number of the second light emitting units and/or the number of the third light emitting units.
According to the scheme provided by the embodiment, whether the light-emitting unit is normally bright or not can be detected through other color channels.
In an exemplary embodiment, before the obtaining the color channel image according to the single-base color image, the method further includes:
and carrying out Gaussian filtering processing on the single-base-color image.
Noise can be removed through Gaussian filtering, and subsequent processing is facilitated. When the resolution of the image capturing apparatus is high, the gain is large and the noise is large, and therefore, noise removal can be performed by gaussian filtering. Embodiments of the present disclosure are not limited thereto and other filtering methods may be used to remove noise.
In an exemplary embodiment, the determining the lighted lighting unit region according to the color channel image includes:
obtaining a binary image according to the color channel image;
carrying out connected domain analysis on the binary image to obtain a connected domain set; and taking the connected domains with the areas larger than or equal to a preset threshold value in the connected domain set as the lighted luminous unit areas.
The connected region generally refers to an image region which is formed by foreground pixel points with the same pixel value and adjacent positions in the image; the connected region analysis refers to finding and marking each connected region in an image, enabling each individual connected region to form an identified block, and acquiring geometric parameters such as outline, mass center, area, perimeter and the like of the blocks.
In the present embodiment, the lighted light emitting unit region is determined by connected domain analysis, but the embodiment of the present disclosure is not limited thereto, and the lighted light emitting unit region may be determined by the following hough circle detection method.
Carrying out Hough circle detection on the binary image to obtain a circular set, wherein the circular set is all detected circles; after the Hough circle is detected, the radius value of the circle is distributed within a certain threshold value, if the threshold value is set as [ Minradius, maxRadius ], all circles in the circle set are traversed, and if the radius is within the threshold value, the circle is used as the lighted light-emitting unit area.
The hough circle detection considers that each non-zero pixel point on the image is a potential point on a circle, and by generating an accumulated coordinate plane and setting an accumulated weight to position the circle, a circular curve in the image can be detected and the circle center coordinate and the circle radius of the circular curve can be determined.
In an exemplary embodiment, the preset threshold value may be, for example, an area of one light emitting unit, but is not limited thereto, and may be greater than the area of one light emitting unit. When the areas of the light emitting units of different colors are different, different preset thresholds may be set.
In an exemplary embodiment, the obtaining a binary image from a color channel image includes:
and carrying out morphological corrosion treatment on the color channel image, and carrying out binarization treatment on the image subjected to the morphological corrosion treatment to obtain a binary image. The morphological corrosion treatment can remove some large noise points which cannot be eliminated by Gaussian filtering in the image, and the efficiency of subsequent image processing is improved. However, the embodiment of the present disclosure is not limited thereto, and the binarization process may be directly performed without performing the morphological etching process to obtain the binary image.
In an exemplary embodiment, determining whether there is a light emitting unit abnormality according to the number of light emitting units of the first light emitting unit and the number of light emitting units of the color corresponding to the primary color image of the display module includes:
when the difference value between the number of the light emitting units of the first color and the number of the first light emitting units is larger than or equal to the number of the light emitting units controlled by a single scanning control pin of the display module, the light emitting units of the first color are abnormal. For example, the single-primary color image is a red mode image, the number of red light emitting units is M, the number of first light emitting units determined according to the red channel image is N, the number of light emitting units controlled by a single scanning control pin of the display module is T, and M-N is more than or equal to T, so that the red light emitting units are frequently deactivated abnormally. A single base color image of each color may be judged to determine whether or not there is a normally-off abnormality in each color light emitting unit.
In an exemplary embodiment, the determining whether there is a lighting unit normally-bright abnormality according to the second lighting unit number and/or the third lighting unit number includes:
when the number of the second light-emitting units is larger than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the second color light-emitting units are abnormal in brightness; and/or when the number of the third light-emitting units is greater than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the third color light-emitting units are always abnormal in brightness.
For example, the single-primary-color image is a red-mode image, the second color is green, the third color is blue, the other color channel images comprise a green channel image and a blue channel image, and when the number of the second light-emitting units determined according to the green channel image is greater than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the green light-emitting units are normally bright abnormally; when the number of the third light-emitting units determined according to the blue channel image is greater than or equal to the number of the light-emitting units controlled by the single scanning control pin of the display module, the blue light-emitting units are always abnormal in brightness.
The implementation of the technical scheme of the embodiment of the disclosure is described below by taking the display module as an LED module board as an example. In this embodiment, the light emitting unit is an LED lamp bead.
The shorted caterpillars are divided into two types: a type of short-circuit caterpillar (lamp bead frequent short-circuit caterpillar) caused by broken pins or cold welding appears on one pin of the driving IC, and B type of short-circuit caterpillar (lamp bead frequent bright short-circuit caterpillar) caused by short-circuit of one pin signal of the driving IC and other signals or internal short-circuit of the lamp bead. The two different types of short-circuit caterpillars have different causes and corresponding image characteristics, so that the types and causes of the short-circuit caterpillars can be accurately detected only by performing image processing respectively.
Class a short-circuited caterpillar: the phenomenon of broken pins or cold welding of one pin of the driving IC can cause the lamp beads driven by the pin to be unlit, if forty-eight lamp beads are scanned, a row of forty-eight lamp beads are abnormal, namely the quantity T of the light emitting units controlled by a single scanning control pin of the display module is 48. For the short-circuit caterpillar in the situation, the LED module board is controlled to switch the display modes and display red, green and blue modes respectively, as shown in fig. 3, a red channel image of a red mode image, a green channel of a green mode image and a blue channel of a blue mode image are respectively acquired, whether all the lamp beads of the three color channels are lighted or not is respectively detected, and the type of the caterpillar can be intercepted.
Fig. 4 is a flowchart of a method for detecting a display module according to an exemplary embodiment. As shown in fig. 4, the method for detecting a display module provided in this embodiment includes:
step 401, controlling an LED module board to display red, green and blue modes respectively, and collecting a red mode image, a green mode image and a blue mode image;
step 402, performing smoothing processing on the acquired image;
a smoothing processing mode is to carry out Gaussian filtering on an acquired image so as to remove noise of a detected image and reduce unnecessary feature detection, and in addition, the influence of the noise on subsequent Otsu threshold segmentation can be removed;
step 403, performing channel segmentation on the smoothed image to obtain corresponding color channel images, namely respectively obtaining a red channel image of a red mode image, a green channel image of a green mode image and a blue channel image of a blue mode image;
step 404, performing morphological erosion processing on the red channel image, the green channel image and the blue channel image;
parameters in the morphological erosion process may be selected as desired or may be selected by test means.
The morphological corrosion treatment can remove some large noise points which cannot be eliminated by Gaussian filtering treatment in the image, improve the efficiency of subsequent image processing, avoid forming a plurality of invalid small areas after the subsequent Otsu threshold segmentation, and reduce the calculation amount of subsequent connected domain analysis. However, the embodiments of the present disclosure are not limited thereto, and morphological corrosion treatment may not be performed, and small regions may be screened out by an area threshold after connected domain analysis.
Step 405, obtaining a binary image according to the morphologically corroded color channel image;
the binary image acquisition mode is as follows: dividing an image into a foreground part and a background part through Otsu threshold segmentation, wherein the image is a binary image after Otsu threshold segmentation; however, the embodiments of the present disclosure are not limited thereto, and the binary image may be obtained by other methods, for example, a segmentation threshold may be preset, and binarization may be implemented according to the segmentation threshold to obtain the binary image.
Otsu threshold segmentation is also called an Otsu method, which is an efficient algorithm for binarizing images, and is also called a maximum inter-class variance method, because the inter-class variance of foreground and background images is the maximum after image binarization segmentation is performed according to the threshold value obtained by the Otsu method. Otsu threshold segmentation is simple and fast to calculate and is not affected by image brightness and contrast.
Step 406, connected domain analysis, which is to perform connected domain analysis on the binary image to obtain the number and the area of the connected domains;
step 407, carrying out statistical analysis on the connected domain, screening the connected domain through a preset threshold value, regarding the connected domain with the area larger than or equal to the preset threshold value as a lighted lamp bead area, determining the number of the lighted lamp beads as N according to the lighted lamp bead area and the area of a single lamp bead, wherein one lamp bead usually corresponds to a plurality of pixel points of an image, the number of the lamp beads with single color of a normal module board is recorded as M, if M-N is larger than or equal to T, in the embodiment, T is 48, executing step 408, and if M-N is smaller than T, executing step 409;
Step 408, determining an abnormal position according to the position outside the lighted bulb area when the class A short-circuit caterpillar appears in the current display mode, and ending;
step 409, the current display mode is finished without the occurrence of the class a shorted caterpillars.
As shown in a class a shorted caterpillar in fig. 5, the pin G of the driving IC breaks the pins, which causes the green lamp beads driven by the pins to be unlit (the module board is 48-scan, there is a row of 48 green lamp beads to be unlit), firstly, the green mode image is subjected to gaussian filtering, then the green channel image of the green mode image is obtained, the green channel image is subjected to morphological corrosion, otsu threshold segmentation and connected domain analysis, finally, the connected domain is screened by a preset threshold to obtain a lit lamp bead area, the number n= 18384 of lit lamp beads is determined according to the lit lamp bead area and the area of a single lamp bead, the total number m=18434 of the green lamp beads of the module board is M-n=48-48, if the module board has a class a shorted caterpillar, the green lamp beads are normally annihilated abnormally, and the other two display modes are the same and are not repeated. Fig. 5 (a) is a green-mode image, fig. 5 (b) is a gaussian-filtered image of the green-mode image, fig. 5 (c) is a green-channel image obtained by image-channel segmentation of the gaussian-filtered image, fig. 5 (d) is a morphologically eroded image of the green-channel image, and fig. 5 (e) is a binary image obtained by Otsu threshold segmentation of the morphologically eroded image; fig. 5 (f) shows an image obtained by performing connected domain analysis and area screening on a binary image.
Class B short-circuited caterpillar: a certain pin signal of the driving IC is short-circuited with other signals or the interior of the lamp beads is short-circuited, so that the driving IC can light the short-circuited lamp beads in a row, and if the driving IC scans in forty-eight times, forty-eight lamp beads in a row are abnormal. For the short-circuit caterpillar in the situation, the module board can be controlled to display red, green and blue modes, a green channel image and a blue channel image of a red mode image, a red channel image and a blue channel image of a green mode image and a red channel image and a green channel image of a blue mode image are respectively acquired, and the number of the lighted lamp beads of other color channel images corresponding to the three display modes is respectively detected, so that the type of the caterpillar can be intercepted.
Fig. 6 is a flowchart of a method for detecting a display module according to an exemplary embodiment. As shown in fig. 6, the method for detecting a display module provided in this embodiment includes:
step 601, controlling an LED module board to display red, green and blue modes respectively, and collecting a red mode image, a green mode image and a blue mode image;
step 602, performing smoothing processing on the acquired image;
a smoothing processing mode is to carry out Gaussian filtering on an acquired image so as to remove noise of a detected image and reduce unnecessary feature detection, and in addition, the influence of the noise on subsequent Otsu threshold segmentation can be removed;
Step 603, performing channel segmentation on the smoothed image to obtain other color channel images, namely, respectively obtaining a green channel image and a blue channel image of a red mode image, a red channel image and a blue channel image of a green mode image, and a red channel image and a green channel image of a blue mode image;
step 604, performing morphological erosion processing on the red channel image, the green channel image and the blue channel image;
step 605, obtaining a binary image according to the morphologically corroded color channel image;
step 606, connected domain analysis, which is to perform connected domain analysis on the binary image to obtain the number and the area of the connected domains;
step 607, performing statistical analysis on the connected domain, screening the connected domain through a preset threshold, regarding the connected domain with the area larger than or equal to the preset threshold as a lighted lamp bead area, determining the number of the lighted lamp beads according to the lighted lamp bead area and the area of the single lamp bead, and marking the number as N1 and N2 respectively, if N1 is more than or equal to T=48 or N2 is more than or equal to T=48, executing step 608, and if N1 is less than T and N2 is less than T, executing step 609;
step 608, determining the abnormal position according to the area of the lighted lamp bead when the current display mode has the appearance of the class B short-circuit caterpillar, and ending;
Step 609, the current display mode is ended without the occurrence of the class B shorted caterpillars.
For example, for a red mode image, a green channel image and a blue channel image are obtained, the number of the lighting lamp beads is determined to be N1 according to the green channel image, the number of the lighting lamp beads is determined to be N2 according to the blue channel image, if N1 is more than or equal to T=48, a B-path short-circuit caterpillar appears, and the green lamp beads are normally on abnormally; if N2 is more than or equal to T=48, the B-path short-circuit caterpillar appears, and the blue lamp beads are always on abnormally.
As shown in the B-type shorted caterpillar in fig. 7, pin B and pin G of the driving IC are shorted, which causes the blue beads to be lighted while the green beads are lighted (48 scans of the module board, a row of 48 beads show anomalies). Firstly, carrying out Gaussian filtering on a blue display module image, then acquiring a green channel and a red channel of a blue mode image, respectively carrying out morphological corrosion, otsu threshold segmentation and connected domain analysis on the green channel image and the red channel image, and finally screening the connected domain through a preset threshold value to obtain the number of the lighted lamp beads which are respectively as follows: n1=48 (obtained from green channel image) and n2=0 (obtained from red channel image), indicating that the B-type short circuit caterpillar appears, and the green lamp bead is abnormal in normal lighting. The other two display modes are the same and will not be described again. Fig. 7 (a) is a blue-mode image, fig. 7 (b 1) is a green-channel image obtained by image channel segmentation of a gaussian-filtered blue-mode image, fig. 7 (b 2) is a red-channel image obtained by image channel segmentation of a gaussian-filtered blue-mode image, fig. 7 (c 1) is an image obtained by morphological erosion of a green-channel image, fig. 7 (c 2) is an image obtained by morphological erosion of a red-channel image, and fig. 7 (d 1) is a binary image obtained by Otsu threshold segmentation of a morphologically eroded green-channel image; FIG. 7 (d 1) is a binary image obtained by Otsu thresholding the morphologically eroded red channel image; fig. 7 (e 1) is an image obtained by performing connected domain analysis and area screening on a binary image of a green channel image, and fig. 7 (e 2) is an image obtained by performing connected domain analysis and area screening on a binary image of a red channel image. In the present embodiment, an image after gaussian filtering of the blue mode image is not shown.
By integrating the above-mentioned A-class and B-class short-circuit caterpillar image detection methods, a short-circuit caterpillar detection scheme as shown in FIG. 8 can be obtained.
As shown in fig. 8, a red channel image, a green channel image, and a blue channel image of a red mode image may be acquired, a class a short-circuit caterpillar detection is performed for the red channel image, and a class B short-circuit caterpillar detection is performed for the green channel image and the blue channel image;
acquiring a green channel image, a red channel image and a blue channel image of a green mode image, detecting class A short-circuit caterpillars of the green channel image, and detecting class B short-circuit caterpillars of the red channel image and the blue channel image;
obtaining a blue channel image, a red channel image and a green channel image of a blue mode image, detecting class A short-circuit caterpillars of the blue channel image, and detecting class B short-circuit caterpillars of the red channel image and the green channel image;
according to the display module detection method provided by the embodiment, the class A and the class B short-circuit caterpillars are detected for the three display mode images respectively, so that the types and the causes of the short-circuit caterpillars can be accurately determined, and maintenance personnel can conveniently and rapidly and accurately locate corresponding problems.
The embodiment of the disclosure provides a display module detection device, which comprises a memory and a processor, wherein the memory stores a program, and the program realizes the display module detection method according to any one of the embodiments when being read and executed by the processor.
Embodiments of the present disclosure provide a computer readable storage medium storing one or more programs executable by one or more processors to implement the display module detection method described in any of the above embodiments.
Fig. 9 is a block diagram of a display module detection system according to an exemplary embodiment of the present disclosure. As shown in fig. 9, the display module detection system may include: display module detection device, sweep a yard device, environment send card, environment receiving card box, image acquisition equipment (such as industry camera and camera lens), power (including primary power, DC12V power etc. for example, connect to outside commercial power (such as AC 220V)) etc.. The display module detection device is connected to the environment sending card, the code scanning device and the image acquisition equipment. The environment sending card is connected to the environment receiving card box body, the display module to be tested can be arranged on the environment receiving card box body, the power supply supplies power for the display module detection system, the display module detection device controls the whole detection system to act, records test data and performs image processing and analysis, wherein:
The display module detection device is configured to determine a corresponding image configuration file according to the model of the display module, and send the image configuration file to an environment receiving card box body through the environment sending card; and sending a control instruction to the environment receiving card box body through the environment sending card; and controlling the image acquisition equipment to acquire images and receiving the single-primary-color images acquired by the image acquisition equipment; the environment transmitting card is configured to receive the image configuration file and the control instruction sent by the display module detecting device and transmit the image configuration file and the control instruction to the environment receiving card box body; in addition, the display module detection device also executes the display module detection method;
the environment receiving card box body is configured to receive the image configuration file and the control instruction, and control the display module to display according to the control instruction and the image configuration file;
the image acquisition equipment is configured to acquire a single-base-color image of the display module according to the control of the display module detection device and send the single-base-color image to the display module detection device.
The display module detection device can be realized by a computer, for example.
The display module detection device and the environment sending card can be connected with a network port (such as a connector network port) through a serial port (COM), and the environment sending card can be connected with the receiving card box body through a network cable; the display module detection device can send a command to the environment receiving card box body through the serial port to control the LED module board to switch the display mode; the display module detection device can load the image configuration file into the environment receiving card box body through the network port.
In an exemplary embodiment, the display module detection system may further include a code scanning device, wherein:
the display module detection device is further configured to control the code scanning device to scan the bar code of the display module, receive the bar code information of the display module sent by the code scanning device, store the bar code information, and store the detection result of the display module based on the bar code information;
the code scanning device is configured to scan the bar code of the display module to obtain bar code information of the display module according to the control of the display module detection device, and send the bar code information to the display module control device.
In an exemplary embodiment, the code scanning device is, for example, a code scanning gun. The display module detection device can generate a detection scheme according to bar code information.
Fig. 10 is a flowchart of a method for detecting a display module according to an exemplary embodiment. As shown in fig. 10, the method for detecting a display module provided in this embodiment includes:
in step 1001, after the environment is ready, a test environment is initialized, including: the display module detection device in the detection system is respectively in communication connection with the environment sending card and the image acquisition equipment;
step 1002, a display module detecting device receives a model of a module board to be detected selected by a user, and loads an image configuration file corresponding to the model of the module board to be detected into an environment receiving card box;
in step 1003, the display module detecting device controls the code scanning device to scan the bar code of the module board to be detected, obtains the bar code information of the module board, stores the bar code information, and can store the detection result of the module board based on the bar code information.
Step 1004, controlling the module board to be tested to switch display modes (the module board needs to switch 3 display modes, namely red, green and blue respectively);
step 1005, collecting an image of the current display mode;
Step 1006, detecting the short-circuit caterpillar according to the current display mode image;
for the detection method, please refer to the foregoing embodiment, and not described in detail, at least one of the class a shorted caterpillar detection and the class B shorted caterpillar detection may be performed. In this embodiment, a class a short-circuit caterpillar detection and a class B short-circuit caterpillar detection are performed.
Step 1007, saving the detection result in the current display mode;
wherein, the detection result in the current display mode can be displayed on the display screen. However, the embodiments of the present disclosure are not limited thereto and may not be displayed.
Step 1008, determine if all display modes are processed? If yes, go to step 1009, if not, go to step 1004, and go to the detection of the next display mode;
step 1009, judging whether the detection results of all the display modes are normal (i.e. whether the shorted caterpillars are not present), if so, executing step 1010, otherwise, executing step 1011;
step 1010, judging that the module board is normal, outputting normal indication information of the module board, and ending;
in step 1011, it is determined that the module board is abnormal, and module board abnormality indication information may be output, where the module board abnormality indication information may include an abnormal display mode, a specific abnormal lamp bead position, and the like.
The scheme provided by the embodiment can realize automatic detection of abnormal display of the display module, and improves detection accuracy and test efficiency; the test process is recorded, and the test result is incorporated into the database, so that the problem analysis and the traceability are facilitated; the test fixture is not influenced by ambient light, the light supplementing environment is not needed to be considered, the test fixture can work in a complex environment, the type and the cause of the short-circuit caterpillar can be accurately determined, the problem module board is intercepted, and maintenance personnel can conveniently and rapidly locate corresponding hardware problems.
The scheme provided by the embodiment of the disclosure can be applied to a factory/laboratory scene, and can automatically detect the phenomenon of the short-circuit caterpillar of the module board, thereby improving the detection accuracy and the test efficiency; in addition, the test result is brought into the database, so that problem analysis and tracing are facilitated, and the product quality of the module board is guaranteed.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, functional modules/units in the apparatus, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed cooperatively by several physical components. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.

Claims (10)

1. The display module assembly detection method, the said display module assembly includes the luminescent unit of multiple colors, characterized by, the said display module assembly detection method includes:
acquiring a single-color image of a display module;
acquiring a color channel image according to the single-base color image;
and determining a lighted light-emitting unit area according to the color channel image, determining the number of lighted light-emitting units according to the lighted light-emitting unit area, and determining whether abnormal light-emitting units exist according to the number of light-emitting units.
2. The method according to claim 1, wherein the acquiring the color channel image from the single-color image includes:
acquiring an image of a color channel which is the same as the color of the single-base color image according to the single-base color image, wherein the image is called a first image;
the determining the lighted lighting unit area according to the color channel image, and determining the number of lighted lighting units according to the lighted lighting unit area includes:
determining a lighted light emitting unit area according to the first image, which is called a first light emitting unit area, and determining the lighted light emitting unit number according to the first light emitting unit area, which is called a first light emitting unit number;
The determining whether the abnormal light emitting unit exists according to the number of the light emitting units comprises the following steps:
and determining whether abnormal light-emitting unit normally-off exists or not according to the number of the first light-emitting units and the number of the light-emitting units which are the same as the color of the single-base color image when the display module normally displays.
3. The method according to claim 1, wherein the acquiring the color channel image from the single-color image includes:
acquiring a second image and/or a third image according to the single-primary-color image, wherein the second image is an image of one of the color channels with a color different from that of the single-primary-color image, and the third image is an image of the other of the color channels with a color different from that of the single-primary-color image;
the determining the lighted lighting unit area according to the color channel image, and determining the number of lighted lighting units according to the lighted lighting unit area includes:
determining a lighted lighting unit area according to the second image, which is called a second lighting unit area, and determining the lighted lighting unit number according to the second lighting unit area, which is called a second lighting unit number; and/or the number of the groups of groups,
Determining a lighted lighting unit area according to the third image, which is called a third lighting unit area, and determining the lighted lighting unit number according to the third lighting unit area, which is called a third lighting unit number;
the determining whether the abnormal light emitting unit exists according to the number of the light emitting units comprises the following steps:
and determining whether the abnormal brightness of the light emitting units exists according to the number of the second light emitting units and/or the number of the third light emitting units.
4. A method for detecting a display module according to any one of claims 1 to 3, wherein before the color channel image is obtained from the single-color image, the method further comprises:
and carrying out Gaussian filtering processing on the single-base-color image.
5. A display module group detection method according to any one of claims 1 to 3, wherein the determining the lighted lighting unit region according to the color channel image includes:
carrying out morphological corrosion treatment on the color channel image, and carrying out binarization treatment on the image subjected to the morphological corrosion treatment to obtain a binary image;
carrying out connected domain analysis on the binary image to obtain a connected domain set; and taking the connected domains with the areas larger than or equal to a preset threshold value in the connected domain set as the lighted luminous unit areas.
6. The method according to claim 2, wherein determining whether there is a light emitting unit abnormality in normal display according to the first light emitting unit number and the first color light emitting unit number includes:
when the difference value between the number of the light emitting units of the first color and the number of the first light emitting units is larger than or equal to the number of the light emitting units controlled by a single scanning control pin of the display module, the light emitting units of the first color are abnormal.
7. The method according to claim 3, wherein determining whether there is a lighting unit normal-lighting abnormality according to the second lighting unit number and/or the third lighting unit number includes:
when the number of the second light-emitting units is larger than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the second color light-emitting units are abnormal in brightness;
and/or when the number of the third light-emitting units is greater than or equal to the number of the light-emitting units controlled by a single scanning control pin of the display module, the third color light-emitting units are always abnormal in brightness.
8. A display module detection apparatus comprising a memory and a processor, wherein the memory stores a program which, when read and executed by the processor, implements the display module detection method according to any one of claims 1 to 7.
9. A computer-readable storage medium storing one or more programs executable by one or more processors to implement the display module detection method of any one of claims 1 to 7.
10. A display module inspection system comprising the display module inspection apparatus of claim 8, further comprising: environment sending card, environment receiving card box, sweep sign indicating number device and image acquisition equipment, wherein:
the display module detection device is configured to determine a corresponding image configuration file according to the model of the display module, and send the image configuration file to an environment receiving card box body through the environment sending card; and sending a control instruction to the environment receiving card box body through the environment sending card; and controlling the image acquisition equipment to acquire images and receiving the single-primary-color images acquired by the image acquisition equipment; the code scanning device is controlled to scan the bar code of the display module, bar code information of the display module sent by the code scanning device is received, the bar code information is stored, and a detection result of the display module is stored based on the bar code information;
The environment transmitting card is configured to receive the image configuration file and the control instruction sent by the display module detecting device and transmit the image configuration file and the control instruction to the environment receiving card box body;
the environment receiving card box body is configured to receive the image configuration file and the control instruction, and control the display module to display according to the control instruction and the image configuration file;
the image acquisition equipment is configured to acquire a single-base-color image of the display module according to the control of the display module detection device and send the single-base-color image to the display module detection device;
the code scanning device is configured to scan the bar code of the display module to obtain bar code information of the display module according to the control of the display module detection device, and send the bar code information to the display module control device.
CN202111345516.6A 2021-11-15 2021-11-15 Display module detection method, device and system and storage medium Pending CN116128789A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111345516.6A CN116128789A (en) 2021-11-15 2021-11-15 Display module detection method, device and system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111345516.6A CN116128789A (en) 2021-11-15 2021-11-15 Display module detection method, device and system and storage medium

Publications (1)

Publication Number Publication Date
CN116128789A true CN116128789A (en) 2023-05-16

Family

ID=86310397

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111345516.6A Pending CN116128789A (en) 2021-11-15 2021-11-15 Display module detection method, device and system and storage medium

Country Status (1)

Country Link
CN (1) CN116128789A (en)

Similar Documents

Publication Publication Date Title
CN106409196B (en) LED display control card fault detection method
CN105241638A (en) Vision-based quick LED module brightness uniformity detection method
CN110335273B (en) Detection method, detection device, electronic apparatus, and medium
CN107402218A (en) Microdefect detection method, device and the equipment of CF substrates
KR20210006276A (en) Image processing method for flicker mitigation
CN112395928A (en) Method for automatically detecting equipment state operation
CN111612839B (en) Color lamp position identification method, system, device and storage medium
CN106204602B (en) The anti-part detection method of element and system
JP2001229381A (en) Image processing check system and its method
CN110910372A (en) Deep convolutional neural network-based uniform light plate defect detection method
CN113785181A (en) OLED screen point defect judgment method and device, storage medium and electronic equipment
WO2023108545A1 (en) Method for constructing defect detection model of micro led array panel, apparatures for dectectig pixel defect and devices
CN111523551A (en) Binarization method, device and equipment for blue object
CN110675650A (en) Parking space state monitoring method
CN102507008A (en) Multi-template automatic optical color detection method
CN116128789A (en) Display module detection method, device and system and storage medium
CN108663371B (en) Method and system for detecting dust and foreign matters on display panel
CN112748118B (en) Detection system and detection method for display panel
CN112164221B (en) Image data mining method, device and equipment and road side equipment
CN117437170A (en) LED light source defect detection method and system
CN107552415B (en) A kind of orange petal method for sorting applied to orange petal sorter
JP7155870B2 (en) VEHICLE DETECTION APPARATUS AND METHOD AND ELECTRONICS
CN112987356A (en) Method and device for false detection and filtering of foreign matters at bottom of liquid crystal panel
CN111915601B (en) Abnormality test method, device and system for intelligent terminal
CN110378327B (en) Target detection device and method with auxiliary significant features added

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination