CN115475770A

CN115475770A - Screen detection method, screen detection device and storage medium

Info

Publication number: CN115475770A
Application number: CN202110604041.1A
Authority: CN
Inventors: 高颖
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2021-05-31
Filing date: 2021-05-31
Publication date: 2022-12-16

Abstract

The disclosure relates to a screen detection method, a screen detection device and a storage medium. The screen detection method is applied to a screen detection device, the screen detection device comprises a movable vision system, the movable vision system comprises an image acquisition device, a coaxial light source and a strip-shaped parallel light source, and the screen detection method comprises the following steps: responding to the triggering of the screen detection device to carry out screen detection, controlling the coaxial light source and the strip-shaped parallel light source to form a combined light source, and irradiating the surface of the screen to be detected; controlling the image acquisition device to acquire an image of the illumination area of the combined light source on the surface of the screen to be detected to obtain a detection image; and sending the detection image to image processing equipment for screen detection, and receiving a screen detection result sent by the image processing equipment. The detection of the hidden appearance defects such as pits and/or indentations of the flexible screen can be realized through the method.

Description

Screen detection method, screen detection device and storage medium

Technical Field

The present disclosure relates to the field of screen appearance detection technologies, and in particular, to a screen detection method, a screen detection apparatus, and a storage medium.

Background

With the development of science and technology, the hardware structure of terminals such as mobile phones is continuously updated and iterated. Among them, the flexible screen terminal with screen folding feature is popular to users due to its characteristics such as convenience for carrying, and is also the mainstream at present.

In the related art, before the flexible screen or the flexible screen terminal leaves a factory, the appearance flatness of the flexible screen is generally required to be detected, so as to prevent the flexible screen with the defect of appearance flatness from flowing into the market. In the related art, a more noticeable appearance flatness defect such as a scratch, a burr, or a crease can be recognized, but a more concealed appearance flatness defect such as a pit or an indentation cannot be recognized.

Disclosure of Invention

To overcome the problems in the related art, the present disclosure provides a screen detecting method, a screen detecting apparatus, and a storage medium.

According to a first aspect of the embodiments of the present disclosure, there is provided a screen detection method applied to a screen detection apparatus, where the screen detection apparatus includes a movable vision system, the movable vision system includes an image acquisition device, a coaxial light source, and a bar-shaped parallel light source, and the screen detection method includes:

responding to the triggering of the screen detection device to carry out screen detection, controlling the coaxial light source and the strip-shaped parallel light source to form a combined light source, and irradiating the surface of the screen to be detected; controlling the image acquisition device to acquire an image of the illumination area of the combined light source on the surface of the screen to be detected to obtain a detection image; and sending the detection image to image processing equipment for screen detection, and receiving a screen detection result sent by the image processing equipment.

In one embodiment, the controlling the coaxial light source and the bar-shaped parallel light source to form a combined light source for irradiating the surface of the screen to be measured includes: controlling the coaxial light source to emit first illumination light, controlling the strip-shaped parallel light source to emit second illumination light, and illuminating the surface of the screen to be measured by the first illumination light and the second illumination light together; the wavelength of the first irradiation light is at least including the wavelength in the infrared light wavelength range, and the wavelength of the second irradiation light is at least including the wavelength in the blue light wavelength range.

In one embodiment, the bar-shaped parallel light source comprises a plurality of bar-shaped parallel light sources; before sending the detection image to an image processing device for screen detection, the method further comprises: and if the definition of the detected image is determined not to meet the preset image definition, adjusting part of the strip-shaped parallel light sources in the plurality of strip-shaped parallel light sources, and acquiring the detected image again.

In one embodiment, the mobile vision system further comprises a backlight source, and the screen inspection method further comprises: starting the backlight source, and controlling the backlight source to irradiate the screen to be tested; and controlling the image acquisition device to acquire an image of the backlight source in an irradiation area of the surface of the screen to be detected to obtain a detection image.

In one embodiment, before controlling the image capturing device to capture the image, the method further comprises: and determining that the light intensity of the scene where the mobile visual system is currently located is smaller than a preset light intensity threshold value.

In one embodiment, the method further comprises: responding to the screen detection result that the screen is qualified, and sending the screen to be detected to an assembly work station; and in response to the screen detection result being unqualified, taking out the screen to be detected and placing the screen to be detected in an unqualified product flow channel.

According to a second aspect of the embodiments of the present disclosure, there is provided a screen detection method applied to an image processing apparatus, the method including:

receiving a detection image sent by a screen detection device, wherein the detection image is acquired by an image acquisition device of the screen detection device in an irradiation area of a combined light source formed by a coaxial light source and a strip-shaped parallel light source on the surface of the screen to be detected; determining a grayscale image of the detection image; performing edge detection on the gray-scale image based on a first-order differential operator and a second-order differential operator to obtain a screen detection result of the detected image corresponding to the defect area; and sending the screen detection result to the screen detection device.

In one embodiment, determining a grayscale image of the detected image comprises: extracting an ROI (region of interest) in the detected image, and preprocessing the ROI to obtain a preprocessed image; based on different region division rules, performing region division on the preprocessed image to obtain a divided image at least comprising a first image and a second image, wherein the first image and the second image are region images obtained by dividing based on different region division rules; respectively determining corresponding information entropies at the same pixel position in the first image and the second image; and determining the image corresponding to the pixel position with the minimum information entropy as the gray level image of the detection image.

According to a third aspect of the embodiments of the present disclosure, there is provided a screen inspection apparatus, including a movable vision system, the movable vision system including an image acquisition device, a coaxial light source, and a bar-shaped parallel light source, the screen inspection apparatus including:

the control unit responds to the triggering of the screen detection device to carry out screen detection, controls the coaxial light source and the strip-shaped parallel light source to form a combined light source and irradiates the surface of a screen to be detected; the image acquisition unit is used for controlling the image acquisition device to acquire images of the irradiation area of the combined light source on the surface of the screen to be detected to obtain a detection image; and the communication unit is used for sending the detection image to image processing equipment for screen detection and receiving a screen detection result sent by the image processing equipment.

In one embodiment, the control unit controls the coaxial light source and the strip-shaped parallel light source to form a combined light source to irradiate the surface of the screen to be measured by adopting the following modes: controlling the coaxial light source to emit first illumination light, controlling the strip-shaped parallel light source to emit second illumination light, and illuminating the surface of the screen to be measured by the first illumination light and the second illumination light together; the wavelength of the first irradiation light is at least including the wavelength in the infrared light wavelength range, and the wavelength of the second irradiation light is at least including the wavelength in the blue light wavelength range.

In one embodiment, the strip-shaped parallel light source comprises a plurality of strip-shaped parallel light sources, and the image acquisition unit is further configured to: and before the detection image is sent to image processing equipment for screen detection, if the definition of the detection image is determined not to meet the definition of a preset image, adjusting part of the strip-shaped parallel light sources in the plurality of strip-shaped parallel light sources, and acquiring the detection image again.

In one embodiment, the mobile vision system further comprises a backlight, and the control unit is further configured to: starting the backlight source, and controlling the backlight source to irradiate the screen to be tested; and controlling the image acquisition device to acquire an image of the backlight source in an irradiation area of the surface of the screen to be detected to obtain a detection image.

In one embodiment, the screen detection apparatus further includes a determination unit, and the determination unit is configured to: before controlling the image acquisition device to acquire images, determining that the light intensity of the scene where the movable visual system is located is smaller than a preset light intensity threshold value.

In one embodiment, the screen inspection apparatus further comprises a screening unit, and the screening unit is configured to: responding to the screen detection result that the screen is qualified, and sending the screen to be detected to an assembly work station; and in response to the screen detection result that the screen is unqualified, taking out the screen to be detected and placing the screen to be detected in an unqualified product flow channel.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a screen detecting apparatus, the apparatus including:

the communication unit is used for receiving a detection image sent by a screen detection device, wherein the detection image is an image acquired by an image acquisition device of the screen detection device in an irradiation area of a combined light source formed by a coaxial light source and a strip-shaped parallel light source on the surface of the screen to be detected, and sending a screen detection result to the screen detection device; a determination unit configured to determine a grayscale image of the detection image; and the detection unit is used for carrying out edge detection on the gray level image based on a first-order differential operator and a second-order differential operator to obtain a screen detection result of the detected image corresponding to the defect area.

In one embodiment, the determining unit determines the grayscale image of the detection image as follows: extracting an ROI (region of interest) region in the detection image, and preprocessing the ROI region to obtain a preprocessed image; based on different region division rules, performing region division on the preprocessed image to obtain a divided image at least comprising a first image and a second image, wherein the first image and the second image are region images obtained by dividing based on different region division rules; respectively determining corresponding information entropies at the same pixel position in the first image and the second image; and determining the image corresponding to the pixel position with the minimum information entropy as the gray level image of the detection image.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a screen detecting apparatus including:

a processor; a memory for storing processor-executable instructions;

wherein the processor is configured to: the screen detection method of the first aspect or any one of the embodiments of the first aspect is performed.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a screen detecting apparatus including:

a processor; a memory for storing processor-executable instructions;

wherein the processor is configured to: the screen detection method of the second aspect or any one of the embodiments of the second aspect is performed.

According to a seventh aspect of the embodiments of the present disclosure, there is provided a storage medium, in which instructions are stored, and when the instructions in the storage medium are executed by a processor of a screen detection apparatus, the screen detection apparatus is enabled to execute the first aspect or the screen detection method described in any one of the implementations of the first aspect.

According to an eighth aspect of the embodiments of the present disclosure, there is provided a storage medium having instructions stored therein, which when executed by a processor of an image processing apparatus, enable the image processing apparatus to perform the screen detection method described in the second aspect or any one of the embodiments of the second aspect.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: under the condition that screen detection is needed, the coaxial light source and the strip-shaped parallel light source are controlled to form a combined light source to irradiate the surface of the screen to be detected, so that the outline and the depth of the appearance defect of the screen to be detected can be well highlighted. Furthermore, the image acquisition equipment is controlled to acquire the image of the irradiation area of the combined light source on the surface of the screen to be detected, so that a detection image with clear outline and depth of the defect can be obtained. The detection image is sent to the image processing equipment for screen detection, so that the image processing equipment can accurately identify the appearance defects of the surface of the screen to be detected, and a more accurate screen detection result is obtained.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic diagram illustrating a screen detecting device and an image processing apparatus according to an exemplary embodiment.

FIG. 2 is a flow chart illustrating a method of screen detection according to an exemplary embodiment.

FIG. 3 is a flow chart illustrating another screen detection method according to an exemplary embodiment.

FIG. 4 is a flow chart illustrating yet another screen detection method according to an exemplary embodiment.

Fig. 5 is a flowchart illustrating yet another screen detection method according to an exemplary embodiment.

FIG. 6 is a flowchart illustrating a method of screen size detection, according to an example embodiment.

FIG. 7 is a flowchart illustrating a screen detection method according to an exemplary embodiment.

FIG. 8 is a flowchart illustrating a method of determining a grayscale image according to an exemplary embodiment.

Fig. 9 is a schematic diagram illustrating region division of a detection image according to an exemplary embodiment.

FIG. 10 is a flow diagram illustrating a screen detection according to an example embodiment.

Fig. 11 is a flowchart illustrating screen detection based on an image processing apparatus according to an exemplary embodiment.

FIG. 12 is a block diagram illustrating a screen detection apparatus according to an exemplary embodiment.

FIG. 13 is a block diagram illustrating another screen detection apparatus according to an example embodiment.

Fig. 14 is a block diagram illustrating yet another screen detecting device according to an exemplary embodiment.

Fig. 15 is a block diagram illustrating yet another screen detecting device according to an exemplary embodiment.

FIG. 16 illustrates a block diagram of an apparatus for screen appearance detection according to an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are only a subset of the embodiments of the present disclosure, and not all embodiments. The embodiments described below with reference to the accompanying drawings are illustrative and intended to explain the present disclosure, and should not be construed as limiting the present disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure. Embodiments of the present disclosure are described in detail below with reference to the drawings.

The screen detection method provided by the embodiment of the disclosure can be applied to a scene of detecting the screen of a terminal such as a mobile phone. For example, the method can be applied to a screen detection scene before shipment of a screen production plant, a screen detection scene before assembly of a screen assembly plant, a screen detection scene in a screen assembly process, and a screen detection scene before shipment after completion of screen assembly.

With the continuous development and maturity of scientific technology, compared with a terminal installed with a Glass hard screen (CG), a terminal with a Flexible Cover Window (FCW) is popular with users due to the characteristics of being foldable, convenient to carry and the like, and is also the current mainstream.

In the related art, since the surface of the flexible screen is a thin film, damage is easily caused during production and/or assembly, and more obvious appearance defects such as creases, scratches and/or burrs or more concealed appearance defects such as pits and/or indentations are caused. Therefore, before the flexible screen leaves the factory, the flexible screen is usually required to be subjected to appearance inspection so as to prevent the flexible screen with appearance defects from entering the market.

A screen detection device in the related art can effectively identify more obvious appearance defects such as creases, scratches, burrs and the like, but cannot identify more concealed appearance defects such as pits and/or indentations and the like. For example, the flexible screen may be scanned by a screen inspection device in the related art to obtain a scanned image of the screen. And judging whether the screen has appearance defects or not by carrying out image processing on the scanned image. Wherein, aiming at more obvious appearance defects, the detection requirement can be met only by lower laser scanning precision. However, for the hidden appearance defects such as pits and/or indentations, the accuracy requirement for laser scanning is very high, and the laser scanning accuracy in the related art cannot meet the detection requirement. Therefore, the screen inspection apparatus in the related art cannot effectively identify relatively concealed appearance defects such as pits and/or indentations.

In the related art, in order to ensure the factory quality of the flexible screen, the appearance of the flexible screen needs to be detected in a manual detection manner, so as to identify relatively hidden appearance defects such as pits and/or indentations. According to the method, operators spend a great deal of time and energy to identify the appearance flatness defects of the flexible screen, the efficiency and the accuracy are low, and the hourly capacity (Unit Per Hour, UPH) and the shipment quality of product assembly units are seriously affected.

The embodiment of the disclosure provides a screen detection method, when appearance detection needs to be performed on a flexible screen, a coaxial light source and a bar-shaped parallel light source are controlled to form a combined light source, the surface of the flexible screen is irradiated, the outline and the depth of an appearance defect of the flexible screen can be better highlighted, and then image acquisition equipment is controlled to acquire an image of the combined light source in an irradiation area on the surface of the flexible screen, so that a detection image with clear outline and depth of the defect is obtained. The detection image is sent to the image acquisition equipment for appearance detection, so that the detection of relatively hidden appearance defects such as pits and/or indentations of the flexible screen can be realized.

Fig. 1 is a schematic diagram of a screen detecting Device and an image processing apparatus according to an exemplary embodiment, as shown in fig. 1, the screen detecting Device mainly includes a Charge Coupled Device (CCD) (i.e., an image capturing apparatus), an image processing apparatus, a telecentric lens, an infrared coaxial light source, a blue strip combined light source, a backlight source, a carrier, a conveyor belt, an optical fiber sensor, a suction cup, and a screen assembling apparatus. In one example, when the flexible screen is located within an image acquisition range of the CCD camera, the flexible screen may be irradiated by a combined light source formed by the infrared coaxial light source and the blue strip light source, and a detection image is acquired by the CCD camera. And sending the detection image to image processing equipment, further carrying out screen detection through the image processing equipment, and sending a screen detection result to a screen detection device after determining the detection result. The screen detection device judges whether the flexible screen is a qualified product or not according to the received screen detection result. And then the flexible screen which does not meet the requirement is moved out of the conveyor belt through the product sucker, or the flexible screen which meets the requirement is conveyed into the next station through the conveyor belt. The flexible screen meeting the requirements is assembled by the screen assembling equipment at the next work station or taken away from the factory by an operator.

Fig. 2 is a flowchart illustrating a screen inspection method according to an exemplary embodiment, where the screen inspection method is applied to a screen inspection apparatus including a movable vision system, as shown in fig. 2, and includes the following steps. Wherein, the movable visual system can comprise an image acquisition device, a coaxial light source and a strip-shaped parallel light source.

In step S11, in response to the screen detection device being triggered to perform screen detection, the coaxial light source and the strip-shaped parallel light source are controlled to form a combined light source, and the surface of the screen to be detected is irradiated.

In step S12, the image acquisition device is controlled to acquire an image of the illumination area of the combined light source on the surface of the screen to be detected, so as to obtain a detection image.

In step S13, the detection image is transmitted to the image processing apparatus for screen detection, and the screen detection result transmitted by the image processing apparatus is received.

In the embodiment of the present disclosure, the coaxial light source may be understood as a light source whose irradiation direction is the same as the optical axis direction of the image capturing device, and the bar-shaped parallel light source may be understood as a light source whose irradiation direction is different from the optical axis direction of the image capturing device. In one example, the degree of difference of the pixel gray values of different surface depths can be highlighted in the acquired detection image by irradiating the surface of the screen to be detected with coaxial light. The surface of the screen to be detected is irradiated by the strip-shaped parallel light, so that a clear appearance defect outline can be obtained in the acquired detection image. Through the method and the device, the depth distribution and the texture of the surface of the screen to be detected can be more clearly highlighted in the detected image, and further the image processing equipment can effectively identify the hidden appearance defects such as pits and/or indentations of the screen to be detected.

In the screen detection method provided by the embodiment of the disclosure, the screen detection device can perform an action matched with the screen detection result on the screen to be detected according to the received screen detection result. For example, the screen to be tested may be sent to the assembly station in the case that the screen inspection result is qualified. For another example, the screen to be tested may be taken out and placed in the unqualified product flow channel when the screen detection result is unqualified.

Fig. 3 is a flowchart illustrating another screen sensing method according to an exemplary embodiment, and as shown in fig. 3, the screen sensing method further includes step S14a and step S14b.

In step S14a, in response to the screen test result being qualified, the screen to be tested is sent to the assembly station.

In step S14b, in response to the screen detection result being unqualified, the screen to be tested is taken out and placed in an unqualified product flow channel.

Through the screen detecting method and the screen detecting device, the screen to be detected with qualified screen detecting results can be sent to the assembling work station for subsequent assembling, and the screen to be detected with unqualified screen detecting results is eliminated.

In one example, the coaxial light source may emit light having a wavelength at least including a wavelength in an infrared light wavelength range, and the bar-shaped parallel light source may emit light having a wavelength at least including a wavelength in a blue light wavelength range.

In one embodiment, the combined light of the infrared coaxial light source and the blue strip-shaped parallel light source may be used to irradiate the surface of the screen to be measured. The combined light of the infrared coaxial light source and the blue strip-shaped parallel light source is used as an optimal combined light, so that the difference degree of pixel gray values of different surface depths can be better highlighted, and the appearance defect outline can be better highlighted.

Fig. 4 is a flowchart illustrating another screen detection method according to an exemplary embodiment, and as shown in fig. 4, implementation processes of step S22 and step S23 in the screen detection method provided in the embodiment of the present disclosure are similar to the implementation processes of step S12 and step S13 shown in fig. 2, and are not repeated herein.

In step S21, in response to the screen detection device being triggered to perform screen detection, the coaxial light source is controlled to emit first illumination light, and the bar-shaped parallel light source is controlled to emit second illumination light, and the surface of the screen to be detected is illuminated by the first illumination light and the second illumination light together.

The wavelength of the first irradiation light is at least including the wavelength in the infrared light wavelength range, and the wavelength of the second irradiation light is at least including the wavelength in the blue light wavelength range.

According to the screen detection method provided by the embodiment of the disclosure, the surface of the screen to be detected is irradiated by the infrared coaxial light and the strip-shaped parallel blue light together, so that the obtained detection image can better meet the screen detection requirement.

In the embodiment of the present disclosure, by performing image acquisition by an image acquisition device, a detection image with insufficient definition may be obtained. In one example, the illumination brightness of the bar-shaped parallel light source can be adjusted, so that the image acquisition device can obtain a clear detection image. For example, for a screen detection device comprising a plurality of strip-shaped parallel light sources, the illumination brightness of the strip-shaped parallel light sources can be adjusted by adjusting part of the strip-shaped parallel light sources.

Fig. 5 is a flowchart illustrating another screen detection method according to an exemplary embodiment, and as shown in fig. 5, implementation processes of step S31, step S32, and step S34 in the screen detection method provided in the embodiment of the present disclosure are similar to execution processes of step S11, step S12, and step S13 shown in fig. 2, and are not described again here.

In step S33, in a case where it is determined that the sharpness of the detection image does not satisfy the preset image sharpness, a part of the plurality of bar-shaped parallel light sources is adjusted, and the detection image is reacquired.

In one example, adjusting part of the strip-shaped parallel light sources in the plurality of strip-shaped parallel light sources may be adjusting the illumination brightness or on/off of the part of the strip-shaped parallel light sources, or adjusting the gap between the strip-shaped parallel light sources. For example, if the preset image definition is insufficient and the illumination brightness of the bar-shaped parallel light source is too high, the image acquisition device can acquire an image with sufficient definition by reducing the illumination brightness of the bar-shaped parallel light source or turning off part of the bar-shaped parallel light source.

The method and the device can ensure the definition of the acquired detection image and meet the screen detection requirement of the image processing equipment.

The screen detection method provided by the embodiment of the disclosure can be used for carrying out size detection on a screen.

Fig. 6 is a flowchart illustrating a method for screen size detection, according to an exemplary embodiment, as shown in fig. 6, including the following steps.

In step S41, the backlight is turned on, and the backlight is controlled to illuminate the screen to be tested.

In one example, the backlight source of the screen detecting device may be a white light source.

In step S42, the image acquisition device is controlled to acquire an image of the illumination area of the backlight source on the surface of the screen to be measured, so as to obtain a detection image.

In the embodiment of the disclosure, the backlight source irradiates the screen to be detected, so that the edge profile of the screen to be detected can be highlighted. In one example, a white light source may be used as a backlight source, and the backlight source is controlled to illuminate the screen to be measured with the illumination direction as shown in fig. 1. In the process that the backlight source irradiates the surface of the screen to be measured, in an image acquired by the image acquisition equipment, a non-screen area is whitish and bright, and a screen area is dark, so that the edge profile of the screen to be measured is highlighted. The screen detection method provided by the embodiment of the disclosure can be used for detecting the size of a screen, and can also be used for detecting the size of a middle frame and/or a battery cover of a terminal such as a mobile phone.

In an example, before the image acquisition device is controlled to acquire an image of an irradiation area of the backlight source on the surface of the screen to be detected, the combined light source may be turned off, so as to reduce the influence of the combined light source on the accuracy of the screen size detection.

In the embodiment of the disclosure, for screens of different colors, images with the definition meeting the requirements can be acquired by the image acquisition equipment in a mode of adjusting the light source. Specifically, the illumination brightness and/or the illumination wavelength of each light source in the combined light source may be adjusted, so that the image capturing device can capture a clear image. The backlight source can be started under the condition that the combined light source is used for irradiating the screen to be detected and a clear image cannot be obtained, and the combined light source and the backlight source are controlled to irradiate the screen to be detected together, so that the image acquisition equipment can acquire the clear image.

In one example, before the image capturing device is controlled to capture an image, the light intensity of the scene where the mobile visual system is currently located may be detected. In one embodiment, the image capturing device may be controlled to capture the image when it is determined that the light intensity of the scene in which the mobile visual system is currently located is less than a preset light intensity threshold.

The screen detection method provided by the embodiment of the disclosure can perform image processing on the detection image, identify the appearance defects of the screen, and further realize screen detection.

Fig. 7 is a flowchart illustrating a screen detecting method, as shown in fig. 7, applied to an image processing apparatus, according to an exemplary embodiment, including the following steps.

In step S51, a detection image sent by the screen detection device is received, where the detection image is an image collected by an image collection device of the screen detection device in an irradiation area of a combined light source formed by the coaxial light source and the strip-shaped parallel light source on the surface of the screen to be detected.

In step S52, a grayscale image of the detection image is determined.

In step S53, edge detection is performed on the grayscale image based on the first order differential operator and the second order differential operator, so as to obtain a screen detection result of the detected image corresponding to the defect region.

In step S54, the screen detection result is transmitted to the screen detecting device.

In the embodiment of the present disclosure, the screen detection result may be determined by a pre-entered screen detection standard. For example, in the case of determining a first order differential operator and a second order differential operator, the first order differential operator may be compared with a standard first order differential operator, and the second order differential operator may be compared with a standard second order differential operator, thereby determining a degree of differential operator difference between the first order differential operator and the second order differential operator and a standard value. In an embodiment, the screen detection result may be determined according to the difference degree of the differential operators obtained by the comparison. For example, the screen detection result may be determined to be qualified in a case where the differential operator difference degree does not exceed a preset range. For another example, the screen detection result may be determined to be not qualified in a case where the differential operator difference degree exceeds a preset range.

In the embodiment of the disclosure, the edge detection is performed on the gray-scale image through the first order differential operator and the second order differential operator, so that a screen detection result with higher accuracy can be obtained. In an example, the edge detection is performed on the gray-scale image through a first-order differential operator and a second-order differential operator, which may be by taking an intersection of an image corresponding to the first-order differential operator and an image corresponding to the second-order differential operator to obtain an intersection image, and further determining a highlighted area in the intersection image as a defect area of the screen.

In the embodiment of the present disclosure, region of interest (ROI) screening may be performed on the detection image, and the detection image may be preprocessed. In an example, after the detection image is preprocessed, the detection image is subjected to region division to obtain detection images divided by different region division rules, and a grayscale image for screen detection is determined in the images by calculating information entropy.

For convenience of description, the images obtained by different region division rules are referred to as a first image and a second image. The first image and the second image use different region division rules.

Fig. 8 is a flowchart illustrating a method of determining a grayscale image, according to an exemplary embodiment, as shown in fig. 8, including the following steps.

In step S61, an ROI region in the detected image is extracted, and the ROI region is preprocessed to obtain a preprocessed image.

In step S62, based on different region division rules, the pre-processed image is subjected to region division to obtain a divided image at least including a first image and a second image, where the first image and the second image are region images obtained by division based on different region division rules.

In step S63, the corresponding information entropies at the same pixel position in the first image and the second image are determined, respectively.

In step S64, the image corresponding to the pixel position where the information entropy is minimum is determined as the grayscale image of the detection image.

In the embodiment of the disclosure, the region of interest of the detection image can be screened, the region needing screen detection is reduced, and the detection image is preprocessed to eliminate the noise of the detection image. In one example, the effect of noise is removed by a filtering method combining gaussian filtering and median filtering. For example, it is possible to use

The method of (3) performs gaussian filtering noise reduction on the detected image. Wherein σ _x Indicates the standard deviation, sigma, of each line of pixels in the detected image _y Denotes the standard deviation u of each column of pixels in the detected image _x Means and u representing the pixels of each row in the detected image _y Representing the mean value of the pixels of each column in the test image. The noise and the brightness unevenness of the detected image can be reduced by the present disclosure.

In the screen detection method provided by the embodiment of the disclosure, the image corresponding to the pixel with the minimum information entropy has the most obvious difference degree of the corresponding pixel gray value between the position with the defect and the position without the defect in the screen. The image is used for screen detection, and the outline and the depth of the screen defect can be accurately identified. In one example, the following two region division rules may be used to perform region division on the detection image.

A first rule: the number of pixels selected in each column of each divided area is a, and the number of pixels selected in each row is b.

And a second rule: the number of the selected pixels in each column of each divided area is b, and the number of the selected pixels in each row is a.

For convenience of description, rule one is denoted as I ₁ = (a, b), record rule two as I ₂ = (b, a). In one embodiment, a may be 100 and b may be 50. If it isWith I ₁ Dividing the detection image into regions to obtain a first image, and dividing the first image into I regions ₂ And carrying out region division on the detection image to obtain a second image. After the detection image is subjected to the region division, histogram equalization may be performed on each divided region in the first image, and each divided region in the second image, where the gray distribution between the first image after the histogram equalization process and the second image after the histogram equalization process is different.

In one example, after the histogram equalization process, the desired grayscale image may be determined by calculating the entropy of the pixel information. For example, as shown in FIG. 9, P1 is selected in the first image and P2 is selected in the second image, where P1 and P2 correspond to the same pixel location in the first and second images. In one embodiment, P may be passed _ij ＝f(i,j)/N ² Determines the overall characteristics of the grey value at the pixel position of P1 and/or P2 and the grey distribution of the surrounding pixels. Where i represents the pixel gray scale value for the calculated pixel position, 0<＝i<And =255.j represents the neighborhood pixel gray value of the calculated pixel position, 0<＝j<And =255.f (i, j) is the frequency of occurrence of the feature binary group (i, j), and N is the scale of the image.

In another embodiment, after determining the pixel gray distribution integration characteristics of P1 and P2, the pixel gray distribution integration characteristics can be determined

The information entropy of P1 and/or P2 is calculated. And if the information entropy H1 corresponding to the P1 is smaller than the information entropy H2 corresponding to the P2, determining the pixel point corresponding to the P1 as the pixel point of the gray image required by the screen detection at the pixel position corresponding to the P1. Under the condition of determining the pixel points of each pixel position of the gray image, the gray image required by screen detection can be obtained.

Fig. 10 is a flowchart illustrating a screen inspection according to an exemplary embodiment, where, as shown in fig. 10, in a case where a screen defect inspection needs to be performed on a flexible screen, the flexible screen may be placed into a carrier by way of manual feeding, and is conveyed to a collection field of a CCD camera by a conveyor belt. The flexible screen is irradiated by an illumination system (namely an infrared coaxial light source and a blue strip-shaped parallel light source), image acquisition is carried out by a CCD camera to obtain a detection image, the detection image is sent to image processing equipment for screen detection, and appearance defects such as pits, indentations, scratches and/or foreign matters of the flexible screen can be detected. If the size of the flexible screen is required to be measured, the infrared coaxial light source and the blue strip-shaped parallel light source can be turned off, and the backlight source (white light) is turned on to irradiate the flexible screen. The CCD camera is used for image acquisition, and the acquired detection image is sent to the image processing equipment for screen detection, so that the size of the flexible screen can be determined. If the flexible screen is determined to be a qualified product by the image processing device, the flexible screen is conveyed to the next station by a conveyor belt (for example, an operator takes the flexible screen out of a factory or conveys the flexible screen into an assembly device for assembly).

Fig. 11 is a flowchart illustrating a screen inspection based on an image processing device according to an exemplary embodiment, where as shown in fig. 11, an inspection image for detecting the appearance defect of the flexible screen is sent to the image processing device, and the image is subjected to image processing to extract the ROI region, so as to eliminate the non-effective region. And performing geometric transformation (rotation and/or translation) on the image after the ROI area is extracted, and adjusting the position of the image so as to facilitate subsequent image processing. And performing noise reduction processing on the image by means of Gaussian filtering and median filtering to reduce the influence of texture and brightness unevenness in the image on screen detection. Furthermore, the image is subjected to region division and histogram equalization to determine the pixel with the minimum information entropy corresponding to each pixel position in the image, and then a gray level image for determining the screen defect region is obtained. And determining the outline of the screen defect region by calculating a first-order differential operator of the gray level image. And determining the texture structure of the screen depth change by calculating a second order differential operator of the gray level image. And determining the defect area of the flexible screen to be detected in a mode of combining the first order differential operator and the second order differential operator.

Through the screen detection method and the screen detection device, the flexible screen can be subjected to screen detection, and more obvious appearance defects such as scratches, creases and/or burrs and more concealed appearance defects such as pits and/or indentations can be identified. In addition, the size detection can be carried out on the flexible screen, the terminal with the flexible screen and other devices or components through the method and the device.

Based on the same conception, the embodiment of the disclosure also provides a screen detection device.

It is understood that, in order to implement the above functions, the screen detecting apparatus provided in the embodiments of the present disclosure includes a hardware structure and/or a software module corresponding to the execution of each function. The disclosed embodiments can be implemented in hardware or a combination of hardware and computer software, in combination with the exemplary elements and algorithm steps disclosed in the disclosed embodiments. Whether a function is performed in hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

Fig. 12 is a block diagram illustrating a screen detection apparatus according to an exemplary embodiment. Referring to fig. 12, the apparatus 100 includes a movable vision system including an image pickup device, a coaxial light source, and a bar-shaped parallel light source, and the apparatus 100 includes a control unit 101, an image pickup unit 102, and a communication unit 103.

And the control unit 101 is used for responding to the triggering of the screen detection device to carry out screen detection, controlling the coaxial light source and the strip-shaped parallel light source to form a combined light source, and irradiating the surface of the screen to be detected. And the image acquisition unit 102 is used for controlling the image acquisition device to acquire an image of the irradiation area of the combined light source on the surface of the screen to be detected so as to obtain a detection image. And the communication unit 103 is used for sending the detection image to the image processing device for screen detection and receiving the screen detection result sent by the image processing device.

In one embodiment, the control unit 101 controls the coaxial light source and the strip-shaped parallel light source to form a combined light source to irradiate the surface of the screen to be measured by the following method: and controlling the coaxial light source to emit first irradiation light, controlling the strip-shaped parallel light source to emit second irradiation light, and irradiating the surface of the screen to be measured by the first irradiation light and the second irradiation light together. The wavelength of the first irradiation light is at least including the wavelength in the infrared light wavelength range, and the wavelength of the second irradiation light is at least including the wavelength in the blue light wavelength range.

In one embodiment, the bar-shaped parallel light source includes a plurality of bar-shaped parallel light sources, and the image capturing unit 102 is further configured to: and adjusting part of the strip-shaped parallel light sources in the plurality of strip-shaped parallel light sources and re-collecting the detection image if the definition of the detection image is determined not to meet the preset image definition before the detection image is sent to the image processing equipment for screen detection.

In one embodiment, the mobile vision system further includes a backlight, and the control unit 101 is further configured to: and starting the backlight source, and controlling the backlight source to irradiate the screen to be detected. And controlling the image acquisition device to acquire an image of the backlight source in an irradiation area of the surface of the screen to be detected to obtain a detection image.

FIG. 13 is a block diagram illustrating another screen detection apparatus according to an example embodiment. Referring to fig. 13, the apparatus 100 further includes a determination unit 104.

And the determining unit 104 is configured to determine that the light intensity of the scene where the mobile visual system is currently located is smaller than a preset light intensity threshold before controlling the image capturing device to capture the image.

Fig. 14 is a block diagram illustrating yet another screen sensing apparatus according to an exemplary embodiment. Referring to fig. 14, the apparatus 100 further includes a screening unit 105.

And the screening unit 105 responds to the screen detection result that the screen is qualified, and sends the screen to be detected to the assembly work station for subsequent assembly in the assembly work station. And in response to the screen detection result being unqualified, taking out the screen to be detected and placing the screen to be detected in an unqualified product flow channel.

Fig. 15 is a block diagram illustrating yet another screen detecting device according to an exemplary embodiment. Referring to fig. 15, the apparatus 200 is applied to an image processing device and includes a communication unit 201, a determination unit 202, and a detection unit 203.

The communication unit 201 is configured to receive a detection image sent by the screen detection device, the detection image is an image collected by an image collection device of the screen detection device in an irradiation area of a combined light source formed by the coaxial light source and the strip-shaped parallel light source on the surface of the screen to be detected, and the screen detection result is sent to the screen detection device. A determining unit 202 for determining a grayscale image of the detected image. The detection unit 203 is configured to perform edge detection on the grayscale image based on the first order differential operator and the second order differential operator to obtain a screen detection result of the detected image corresponding to the defect area.

In one embodiment, the determining unit 202 determines the grayscale image of the detected image as follows: and extracting an ROI (region of interest) region in the detected image, and preprocessing the ROI region to obtain a preprocessed image. And performing region division on the preprocessed image based on different region division rules to obtain a divided image at least comprising a first image and a second image, wherein the first image and the second image are region images obtained by dividing based on different region division rules. And respectively determining corresponding information entropies at the same pixel position in the first image and the second image. And determining the image corresponding to the pixel position with the minimum information entropy as a gray level image of the detection image.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 16 illustrates a block diagram of an apparatus 300 for screen appearance detection, according to an example embodiment. For example, the apparatus 300 may be a screen detection apparatus or an image processing device.

Referring to fig. 16, the apparatus 300 may include one or more of the following components: a processing component 302, a memory 304, a power component 306, a multimedia component 308, an audio component 310, an input/output (I/O) interface 312, a sensor component 314, and a communication component 316.

The processing component 302 generally controls overall operation of the device 300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 302 may include one or more processors 320 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 302 can include one or more modules that facilitate interaction between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate interaction between the multimedia component 308 and the processing component 302.

The memory 304 is configured to store various types of data to support operations at the apparatus 300. Examples of such data include instructions for any application or method operating on device 300, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 304 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 306 provide power to the various components of device 300. The power components 306 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the apparatus 300.

The multimedia component 308 includes a screen that provides an output interface between the device 300 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 308 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 300 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 310 is configured to output and/or input audio signals. For example, audio component 310 includes a Microphone (MIC) configured to receive external audio signals when apparatus 300 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 304 or transmitted via the communication component 316. In some embodiments, audio component 310 also includes a speaker for outputting audio signals.

The I/O interface 312 provides an interface between the processing component 302 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 314 includes one or more sensors for providing various aspects of status assessment for the device 300. For example, the sensor assembly 314 may detect the open/closed status of the device 300, the relative positioning of components, such as a display and keypad of the device 300, the sensor assembly 314 may also screen detect a change in the position of the device 300 or a component of the device 300, the presence or absence of user contact with the device 300, orientation or acceleration/deceleration of the device 300, and a change in the temperature of the device 300. Sensor assembly 314 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 316 is configured to facilitate wired or wireless communication between the apparatus 300 and other devices. The device 300 may access a wireless network based on a communication standard, such as WiFi,4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 316 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 316 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 304 comprising instructions, executable by the processor 320 of the apparatus 300 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

It is understood that "a plurality" in this disclosure means two or more, and other words are analogous. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. The singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It will be further understood that the terms "first," "second," and the like, are used to describe various information and should not be limited by these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the terms "first," "second," etc. are used interchangeably throughout. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.

It will be further understood that, unless otherwise specified, "connected" includes direct connections between the two without the presence of other elements, as well as indirect connections between the two with the presence of other elements.

It is further to be understood that while operations are depicted in the drawings in a particular order, this is not to be understood as requiring that such operations be performed in the particular order shown or in serial order, or that all illustrated operations be performed, to achieve desirable results. In certain environments, multitasking and parallel processing may be advantageous.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice in the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A screen detection method is applied to a screen detection device, the screen detection device comprises a movable visual system, the movable visual system comprises an image acquisition device, a coaxial light source and a strip-shaped parallel light source, and the screen detection method comprises the following steps:

responding to the triggering of the screen detection device to carry out screen detection, controlling the coaxial light source and the strip-shaped parallel light source to form a combined light source, and irradiating the surface of the screen to be detected;

controlling the image acquisition device to acquire an image of the illumination area of the combined light source on the surface of the screen to be detected to obtain a detection image;

and sending the detection image to image processing equipment for screen detection, and receiving a screen detection result sent by the image processing equipment.

2. The screen detection method of claim 1, wherein controlling the coaxial light source and the strip-shaped parallel light source to form a combined light source to irradiate the surface of the screen to be detected comprises:

controlling the coaxial light source to emit first illumination light, controlling the strip-shaped parallel light source to emit second illumination light, and illuminating the surface of the screen to be measured by the first illumination light and the second illumination light together;

3. The screen detecting method according to claim 1 or 2, wherein the bar-shaped parallel light source includes a plurality of bar-shaped parallel light sources;

before sending the detection image to an image processing device for screen detection, the method further comprises:

and if the definition of the detected image does not meet the preset image definition, adjusting part of the strip-shaped parallel light sources in the plurality of strip-shaped parallel light sources, and acquiring the detected image again.

4. The screen inspection method of claim 1, further comprising a backlight in the movable vision system, the screen inspection method further comprising:

starting the backlight source, and controlling the backlight source to irradiate the screen to be tested;

and controlling the image acquisition device to acquire the image of the backlight source in the irradiation area of the surface of the screen to be detected to obtain a detection image.

5. The screen detecting method according to claim 4, wherein before controlling the image capturing device to perform image capturing, the method further comprises:

and determining that the light intensity of the scene where the mobile visual system is currently located is smaller than a preset light intensity threshold value.

6. The screen detection method of claim 5, further comprising:

sending the screen to be detected to an assembly work station in response to the screen detection result being qualified;

and in response to the screen detection result that the screen is unqualified, taking out the screen to be detected and placing the screen to be detected in an unqualified product flow channel.

7. A screen detection method applied to an image processing apparatus, the method comprising:

receiving a detection image sent by a screen detection device, wherein the detection image is acquired by an image acquisition device of the screen detection device in an irradiation area of a combined light source formed by a coaxial light source and a strip-shaped parallel light source on the surface of a screen to be detected;

determining a grayscale image of the detection image;

performing edge detection on the gray-scale image based on a first-order differential operator and a second-order differential operator to obtain a screen detection result of the detected image corresponding to the defect area;

and sending the screen detection result to the screen detection device.

8. The screen detecting method of claim 7, wherein determining a grayscale image of the detected image comprises:

extracting an ROI (region of interest) region in the detection image, and preprocessing the ROI region to obtain a preprocessed image;

based on different region division rules, performing region division on the preprocessed image to obtain a divided image at least comprising a first image and a second image, wherein the first image and the second image are region images obtained by dividing based on different region division rules;

respectively determining corresponding information entropies at the same pixel position in the first image and the second image;

and determining the image corresponding to the pixel position with the minimum information entropy as the gray level image of the detection image.

9. The screen detection device is characterized by comprising a movable visual system, wherein the movable visual system comprises an image acquisition device, a coaxial light source and a strip-shaped parallel light source, and the screen detection device comprises:

the control unit is used for responding to the triggering of the screen detection device to carry out screen detection, controlling the coaxial light source and the strip-shaped parallel light source to form a combined light source and irradiating the surface of the screen to be detected;

the image acquisition unit is used for controlling the image acquisition device to acquire an image of the illumination area of the combined light source on the surface of the screen to be detected to obtain a detection image;

and the communication unit is used for sending the detection image to image processing equipment for screen detection and receiving a screen detection result sent by the image processing equipment.

10. The screen detecting device according to claim 9, wherein the control unit controls the coaxial light source and the strip-shaped parallel light source to form a combined light source to irradiate the surface of the screen to be detected by adopting the following modes:

11. The screen detecting device according to claim 9 or 10, wherein the bar-shaped parallel light source comprises a plurality of bar-shaped parallel light sources, and the image capturing unit is further configured to:

and before the detection image is sent to image processing equipment for screen detection, if the definition of the detection image is determined not to meet the definition of a preset image, adjusting part of the strip-shaped parallel light sources in the plurality of strip-shaped parallel light sources, and acquiring the detection image again.

12. The screen detecting device according to claim 9, wherein the movable vision system further comprises a backlight source, and the control unit is further configured to:

and controlling the image acquisition device to acquire an image of the backlight source in an irradiation area of the surface of the screen to be detected to obtain a detection image.

13. The screen detecting device according to claim 12, characterized in that the screen detecting device further comprises a determining unit configured to:

before controlling the image acquisition device to acquire images, determining that the light intensity of the scene where the movable visual system is located is smaller than a preset light intensity threshold value.

14. The screen detecting device according to claim 13, further comprising a screening unit configured to:

15. A screen detecting apparatus, characterized in that the apparatus comprises:

the communication unit is used for receiving a detection image sent by the screen detection device, wherein the detection image is an image acquired by an image acquisition device of the screen detection device in an irradiation area of a combined light source formed by a coaxial light source and a strip-shaped parallel light source on the surface of a screen to be detected, and sending a screen detection result to the screen detection device;

a determination unit configured to determine a grayscale image of the detection image;

and the detection unit is used for carrying out edge detection on the gray-scale image based on a first-order differential operator and a second-order differential operator to obtain a screen detection result of the detected image corresponding to the defect area.

16. The screen detecting device according to claim 15, wherein the determining unit determines the gradation image of the detection image in such a manner that:

17. A screen detecting apparatus, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to: performing the screen detecting method of any one of claims 1 to 6 or performing the screen detecting method of any one of claims 7 to 8.

18. A storage medium having stored therein instructions that, when executed by a processor, enable a screen detection apparatus to execute the screen detection method of any one of claims 1 to 6 or enable an image processing device to execute the screen detection method of any one of claims 7 to 8.