CN116721046A

CN116721046A - Screen abnormal brightness detection method and device and storage medium

Info

Publication number: CN116721046A
Application number: CN202210168250.0A
Authority: CN
Inventors: 罗冰
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2022-02-23
Filing date: 2022-02-23
Publication date: 2023-09-08

Abstract

The disclosure provides a method and a device for detecting abnormal brightness of a screen, and a storage medium, wherein the method comprises the following steps: acquiring a screen display image of an electronic display device; carrying out gray scale processing on the screen display image to obtain a corresponding gray scale image; constructing an attribute matrix of the screen display image based on the gray values of each pixel in the gray image; comparing the attribute matrix of the screen display image with a standard attribute matrix corresponding to the screen display image to obtain matrix difference information; and responding to the matrix difference information to accord with a preset abnormal brightness condition, and determining the screen display image as an abnormal brightness image. The screen abnormal brightness detection method provided by the embodiment of the disclosure avoids the complex operation process that the existing screen abnormal brightness detection method needs to strictly depend on a color analyzer and needs manual or extra means to analyze the brightness information recorded by the color analyzer, reduces the use of hardware, and improves the detection efficiency.

Description

Screen abnormal brightness detection method and device and storage medium

Technical Field

The technical scheme of the disclosure relates to the technical field of multimedia data detection, in particular to a method and a device for detecting abnormal brightness of a screen and a storage medium.

Background

Because the display effect of the electronic display devices such as the current mobile phone is more and more abundant, the complexity of the display module of the electronic display device is higher and higher, if the abnormal brightness and darkness detection of the screen such as the abnormal brightness and darkness of the screen is not carried out sufficiently, the abnormal brightness and darkness phenomenon of the screen is easily caused, so that extremely poor experience is brought to a user, and the image of a product and the public praise of the user are influenced.

In the existing method for detecting abnormal brightness of a screen, manual operation is simulated by a manipulator, a high-speed camera records video, and a color analyzer is used for recording brightness information of a display process of a screen of an electronic display device. And then manually analyzing the brightness information recorded by the color analyzer to judge whether the screen display of the electronic display device is abnormal.

The existing method for detecting abnormal brightness of the screen mainly depends on a color analyzer, and needs manual or additional means to analyze brightness information recorded by the color analyzer, so that the operation process is complex, the equipment dependence is strong, and great inconvenience is brought to detection of abnormal brightness of the screen of the electronic display equipment.

Disclosure of Invention

In view of this, an embodiment of the disclosure provides a method and apparatus for detecting abnormal brightness of a screen, and a storage medium.

According to a first aspect of the present disclosure, a method for detecting abnormal brightness of a screen is provided, the method comprising:

acquiring a screen display image of an electronic display device;

carrying out gray scale processing on the screen display image to obtain a corresponding gray scale image;

constructing an attribute matrix of the screen display image based on each pixel gray value in the gray image, wherein the attribute matrix is used for representing the distribution of the pixel gray values in the gray image;

comparing the attribute matrix of the screen display image with a standard attribute matrix corresponding to the screen display image to obtain matrix difference information;

and responding to the matrix difference information to accord with a preset abnormal brightness condition, and determining the screen display image to be an abnormal brightness image.

In combination with any one of the embodiments provided in the present disclosure, the acquiring a screen display image of an electronic display device includes:

acquiring a video sequence obtained by the electronic display device in the process of receiving screen operation, wherein the video sequence comprises multi-frame screen display images of the electronic display device;

And extracting one frame of the screen display image from the video sequence.

In connection with any of the embodiments provided in the present disclosure,

the gray processing is performed on the screen display image to obtain a corresponding gray image, which comprises the following steps:

selecting a screen display image of a predetermined area from the screen display images as an analysis sub-image for detecting abnormal brightness of the screen;

and carrying out gray processing on the analysis sub-image to obtain a gray image corresponding to the analysis sub-image.

In combination with any one of the embodiments provided in the present disclosure, the constructing the attribute matrix of the screen display image based on the gray values of each pixel in the gray image includes:

for the gray image, acquiring pixel gray values of pixels in the gray image;

obtaining attribute information of the pixel gray value of the gray image based on the pixel gray value;

and constructing an attribute matrix of the screen display image according to the pixel gray value and/or the attribute information.

In combination with any one of the embodiments provided in the present disclosure, the comparing the attribute matrix of the screen display image with the standard attribute matrix corresponding to the screen display image to obtain matrix difference information includes:

Respectively comparing the attribute matrix of the screen display image with matrix element values corresponding to matrix positions in a standard attribute matrix corresponding to the screen display image to obtain a comparison result corresponding to the matrix positions;

and determining matrix difference information according to each comparison result in the attribute matrix and the standard attribute matrix.

In combination with any one of the embodiments provided in the present disclosure, the determining, in response to the matrix difference information meeting a preset abnormal brightness condition, that the screen display image is an abnormal brightness image includes:

determining that the screen display image is an abnormal brightness image in response to the number of target comparison results in the matrix difference information accords with a preset abnormal brightness condition; the target comparison result is a comparison result meeting preset conditions.

In combination with any one of the embodiments provided in the present disclosure, the abnormal brightness image includes an abnormally bright image and an abnormally dark image; the target comparison result comprises a first comparison result and a second comparison result, wherein the first comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is higher than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix, and the second comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is lower than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix;

And determining that the screen display image is an abnormal brightness image according to the response that the number of the target comparison results meets a preset abnormal brightness condition, wherein the method comprises the following steps:

acquiring the first comparison result from the comparison results;

if the number of the first comparison results reaches a preset number condition, determining that the screen display image is an abnormally bright image;

or, obtaining the second comparison result from each comparison result;

and if the number of the second comparison results reaches a preset number condition, determining that the screen display image is an abnormal dark image.

In combination with any one of the embodiments provided in the present disclosure, if the number of the first comparison results reaches a preset number condition, determining that the screen display image is an abnormally bright image includes:

if the number of the first comparison results reaches a preset number value, determining that the screen display image is an abnormally bright image;

or if the proportion of the number of the first comparison results to the total number of the comparison results reaches a preset proportion value, determining that the screen display image is an abnormally bright image.

In combination with any one of the embodiments provided in the present disclosure, if the number of the second comparison results reaches a preset number condition, determining that the screen display image is an abnormally dark image includes:

If the number of the second comparison results reaches a preset number value, determining that the screen display image is an abnormal dark image;

or if the proportion of the number of the second comparison results to the total number of the comparison results reaches a preset proportion value, determining that the screen display image is an abnormal dark image.

According to a second aspect of the present disclosure, there is provided a screen abnormal brightness detection apparatus including:

the screen display image acquisition module is used for acquiring a screen display image of the electronic display device;

the gray processing module is used for carrying out gray processing on the screen display image to obtain a corresponding gray image;

the attribute matrix construction module is used for constructing an attribute matrix of the screen display image based on each pixel gray value in the gray image, and the attribute matrix is used for representing the distribution of the pixel gray values in the gray image;

the comparison module is used for comparing the attribute matrix of the screen display image with the standard attribute matrix corresponding to the screen display image to obtain matrix difference information;

and the abnormal brightness image determining module is used for determining that the screen display image is an abnormal brightness image in response to the matrix difference information accords with a preset abnormal brightness condition.

According to a third aspect of the present disclosure, there is provided a computer readable storage medium storing machine readable instructions that, when invoked and executed by a processor, cause the processor to implement a screen anomaly brightness detection method of any embodiment of the present disclosure.

According to a fourth aspect of the present disclosure, there is provided an electronic device comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to perform the screen anomaly brightness detection method of any of the embodiments of the present disclosure.

The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:

according to the screen abnormal brightness detection method, the corresponding gray level image is obtained through gray level processing of the screen display image, the attribute matrix is built based on the gray level values of all pixels in the gray level image, matrix difference information is obtained after the attribute matrix of the screen display image is further compared with the standard attribute matrix corresponding to the screen display image, whether the matrix difference information meets preset abnormal brightness conditions is judged, and whether the screen display image is the abnormal brightness display image is further determined. The method avoids the complex operation process that the existing screen abnormal brightness detection method is strictly dependent on a color analyzer and needs manual or extra means to analyze the brightness information recorded by the color analyzer, reduces the use of hardware and improves the detection efficiency.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a system architecture diagram of a screen anomaly brightness detection system according to an exemplary embodiment of the present disclosure;

FIG. 2 is a flowchart of a screen anomaly brightness detection method according to an exemplary embodiment of the present disclosure;

fig. 3 is a schematic diagram of a structure of a screen abnormal brightness detection apparatus according to an exemplary embodiment of the present disclosure;

fig. 4 is a schematic structural view of an electronic device according to an exemplary embodiment of the present disclosure.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.

Fig. 1 is a system architecture diagram of a screen anomaly brightness detection system according to an exemplary embodiment of the present disclosure, and as shown in fig. 1, the system may include a manipulator 11, a high-speed camera 12, a computer 13, and an electronic display device 14.

In an alternative example, the communication of information between the manipulator 11 and the computer 13, between the high-speed camera 12 and the computer 13, and between the computer 13 and the electronic display device 14 may be implemented through a network. Embodiments of the present disclosure are not limited to a particular form of the network. For example, the network may be a local area network, wide area network, intranet, internet, mobile telephone network, virtual private network, cellular or other mobile communications network, bluetooth, NFC, or any combination thereof.

In an alternative example, the image displayed on the screen of the electronic display device during the operation of the manipulator 11 on the electronic display device 14 according to the preset operation may be acquired by the high-speed camera 12, and then the image is calculated and decided by the computer, so as to determine whether the abnormal brightness of the screen exists during the operation. If so, the scene is quickly saved by issuing instructions to the electronic display device 14 to trigger the operations such as screenshot, so that the subsequent related staff can analyze the abnormal brightness condition of the screen and find the root cause and the corresponding solution, thereby ensuring the screen display quality of the display device.

It should be noted that the system architecture of the screen anomaly detection system provided in the above embodiments is merely illustrative, and the present disclosure may also include other forms of system architectures, which will be described in the following embodiments, and will not be described in detail herein.

The following describes in detail a screen abnormal brightness detection method according to an embodiment of the present disclosure with reference to the accompanying drawings.

Fig. 2 is a flowchart of a screen abnormal brightness detection method according to an exemplary embodiment of the present disclosure. As shown in fig. 2, the exemplary embodiment method may include the steps of:

step S201, a screen display image of the electronic display device is acquired.

In an alternative example, a video sequence of images recorded by a high-speed camera and displayed by the electronic display device during the process of running an operation script for triggering the electronic display device to execute a preset screen operation may be acquired.

The preset screen operation includes, but is not limited to, opening a micro letter, opening a vacation video, triggering fingerprint unlocking, etc.

And then extracting video frames from the video according to the reproduction probability of different scenes and different rates to serve as the screen display image.

Existing high-speed cameras can capture 114 frames of video frames at most one second. In this example, the probability of recurrence is relatively high due to some scenarios. For example, in a fingerprint unlocking scene, there is a problem with the code itself of the fingerprint unlocking operation section, so that a screen abnormal brightness situation occurs in each fingerprint unlocking process. At this time, the rate of extracting video frames may be set lower, for example, 20fps, that is, 20 frames of video frames may be extracted as the screen display image in one second. Therefore, the calculated amount is reduced, and the efficiency of detecting abnormal brightness of the screen is improved.

Since the reproduction probability of some scenes is relatively low, at this time, the rate of extracting images may be set to be high, for example, 90fps, that is, 90 frames of video frames may be extracted as the screen display image in one second. Thereby increasing the probability of acquiring an abnormal brightness image of the screen.

In an optional example, before the electronic display device runs the operation script, a screen recording function of the electronic display device can be started, so that video of an image displayed by the electronic display device in the process of running the operation script is obtained, and then the screen recording of the electronic display device is uploaded to a computer for subsequent operation at intervals of a specific time period. Therefore, the environment construction step is simplified, and the cost for detecting abnormal brightness of the screen is reduced.

The method for acquiring the video of the image displayed by the electronic display device in the process of running the operation script is not particularly limited.

In an alternative example, the manipulator may operate the electronic display device according to a preset operation, and at the same time, the video of the image displayed by the electronic display device during the operation process of receiving the manipulator is obtained through the high-speed camera or through the screen recording function of the electronic display device.

The manner in which the electronic display device is screen-operated is not particularly limited by the present disclosure.

Step S202, gray scale processing is carried out on the screen display image, and a corresponding gray scale image is obtained.

The gray scale process may retain some general information of the color, including contour information and gray scale values. The gray scale process is used as a preprocessing step of the screen display image, and preparation can be made for later image analysis.

In an alternative example, after acquiring the screen display image in the process of receiving the screen operation by the electronic display device, the screen display image of the predetermined area may be selected as an analysis sub-image for detecting abnormal brightness of the screen from among the screen display images according to detection requirements of different scenes.

For example, in a scenario of triggering unlocking of a mobile phone fingerprint, the upper half part of the screen display image or the lower half part of the screen display image may be obtained according to specific positions of unlocking of mobile phone fingerprints of different types, and the obtained upper half part or the obtained lower half part of the screen display image may be used as the analysis sub-image for detecting abnormal brightness of the screen.

In this example, all selectable items that select the predetermined area may be presented to the relevant staff, and the relevant staff may perform the frame selection according to a specific scenario. Or, each area of the screen display image may be divided by a coordinate manner and displayed to a relevant worker, and the relevant worker selects the predetermined area according to a specific scene input.

In an alternative example, before the image displayed by the electronic display device is recorded by using the high-speed camera, the relevant staff can adjust the position of the area recorded by the high-speed camera according to a specific scene, so that the video containing only the image of the position of the analysis sub-image for detecting the abnormal brightness of the screen is directly obtained.

In an alternative example, after selecting the screen display image of the predetermined area as the analysis sub-image for detecting the abnormal brightness of the screen, the analysis sub-image may be subjected to gray processing to obtain the corresponding gray image. Therefore, the range of gray processing on the image is reduced, the calculated amount is reduced, and the working efficiency of the computer is improved.

Step S203, constructing an attribute matrix of the screen display image based on the gray values of each pixel in the gray image.

Wherein the attribute matrix is used to characterize the distribution of pixel gray values in the gray image.

And calculating the gray value of each pixel in the gray image for the gray image obtained after gray processing.

In an alternative example, the attribute matrix of the screen display image may be constructed according to gray values of respective pixels in the gray image.

Specifically, the gray value of each pixel in the gray image may be used as a matrix element value of the corresponding position, or the gray value of a part of pixels may be extracted according to a certain rule to be used as a matrix element value of the attribute matrix.

For example, a gray value of one pixel may be selected as a matrix element value of the attribute matrix every 5 pixels from the upper left corner of the gray image, or a gray value of one pixel may be selected as a matrix element value of the attribute matrix every 10 pixels from the upper left corner of the gray image. The present disclosure is not particularly limited thereto.

In an alternative example, the specific position of each pixel gray value in the gray image may be recorded while the attribute matrix of the screen display image is constructed according to the pixel gray value in the gray image. So that when the pixel dead pixel is found in the subsequent analysis process, the specific position of the pixel dead pixel is accurately found and processed.

Wherein the specific position of the pixel gray value in the gray image can be represented as follows:

and establishing a coordinate system by taking the upper left corner of the gray image as an origin, taking the right corner as the positive direction of the X axis and taking the downward direction as the positive direction of the Y axis, thereby obtaining and recording XY values corresponding to each pixel value.

In an alternative example, the attribute information of the pixel gray values in the gray image may be obtained according to the gray values of the pixels in the gray image.

The attribute information may include, but is not limited to, the median, mode, average, etc. of the pixel gray values in the gray image. And further constructing an attribute matrix of the screen display image according to the attribute information such as the median, the mode, the average number and the like of the pixel gray values.

When the gray level image is the gray level image corresponding to the screen display image, the median, the mode and the average number of the pixel gray level values in the gray level image are calculated according to the gray level values of all pixels in the gray level image corresponding to the screen display image.

For example, if the pixel gray values in the gray image of the screen display image include: 102. 124, 126. The median calculated according to the gray values of all pixels in the gray image corresponding to the screen display image is 124, the mode is 124, and the average is 119.

When the gray level image is the gray level image corresponding to the analysis sub-image, the median, the mode and the average number of the gray level values of the pixels in the gray level image are calculated according to the gray level values of all the pixels in the gray level image corresponding to the analysis sub-image. In an alternative example, the attribute matrix of the screen display image may be constructed according to the gray value of each pixel in the gray image and attribute information of the gray value of the pixel in the gray image obtained according to the gray value of each pixel in the gray image. I.e. the attribute matrix may include both the gray values of the pixels and the attribute information.

The distribution of the pixel gray values in the gray image can be reflected whether the gray value of the pixel in the gray image is used as the matrix element value of the attribute matrix of the screen display image or the attribute information of the pixel gray value in the gray image is used as the matrix element value of the attribute matrix of the screen display image. Providing basis for the subsequent judgment of whether the screen display image is an abnormal brightness image. Accordingly, the disclosure does not specifically limit the content of the matrix element values in the attribute matrix.

In an alternative example, the attribute matrix of the screen display image may be a 3×3 matrix or a 9×9 matrix, and the form of the attribute matrix of the screen display image is not specifically limited in this disclosure.

Step S204, comparing the attribute matrix of the screen display image with the standard attribute matrix corresponding to the screen display image to obtain matrix difference information.

When the related staff detects the abnormal brightness of the screen display image of the electronic display device, for each scene, a standard attribute matrix of the corresponding screen display image provided by the developer exists. The standard attribute matrix is used for representing the distribution condition of pixel gray values in gray images corresponding to the screen display images when the brightness of the screen display images of the electronic display device is normal under the scene.

Under different scenes, the standard attribute matrixes corresponding to the screen display images of the electronic display device are different.

In an alternative example, after the attribute matrix of the screen display image is acquired, the attribute matrix of the screen display image may be compared with matrix element values corresponding to matrix positions in a standard attribute matrix corresponding to the screen display image, so as to obtain a comparison result corresponding to the matrix positions.

For example, the attribute matrix of the screen display image and the standard attribute matrix of the screen display image are both 2×2 matrices, and at this time, the matrix element values of the first row and the first column in the attribute matrix may be compared with the matrix element values of the first row and the first column in the standard attribute matrix, and the matrix element values of the first row and the second column in the attribute matrix may be compared with the matrix element values of the first row and the second column in the standard attribute matrix, so as to obtain the comparison result corresponding to the positions of the first row and the first column and the first row and the second column. Wherein the first row and the first column in the matrix in the above example may be referred to as one matrix position, and the second row and the second column in the matrix may be referred to as another matrix position. The comparison of the attribute matrix and the second row matrix element values in the standard attribute matrix is the same as the comparison of the first row matrix element values, and will not be repeated.

The comparison result corresponding to the matrix position is used for representing the difference between the matrix element values of the attribute matrix of the screen display image and the matrix position corresponding to the standard attribute matrix, and further, the matrix difference information can be determined according to the comparison results of the attribute matrix and the standard attribute matrix.

For example, the attribute matrix and the standard attribute matrix of the screen display image may be 2×2 matrices, and matrix element values in the attribute matrix are 102, 158, 156, 123 in order from the upper left corner. The matrix element values of the standard attribute matrix are 108, 160, 162 and 134 in sequence from the upper left corner. Comparing the attribute matrix with matrix element values corresponding to matrix positions in the standard attribute matrix, wherein the obtained results are as follows: -6, -2, -6, -11, i.e. the comparison result corresponding to the matrix position.

Because the comparison results corresponding to the matrix positions are-6, -2, -6 and-11 in sequence, the matrix difference information may be that the number of matrix element values of the matrix element values in the attribute matrix of the screen display image is 4, where the pixel brightness represented by the matrix element values is lower than the pixel brightness represented by the matrix element values in the standard attribute matrix.

In an alternative example, a threshold value corresponding to each matrix element value in the standard attribute matrix corresponding to the screen display image may be acquired first. The threshold may include a high threshold and a low threshold, and this example is described taking the acquired threshold as the high threshold.

The threshold value is used for representing the maximum value of each matrix element value in the standard attribute matrix corresponding to the screen display image acceptable in the scene. And constructing a second standard attribute matrix by the threshold value corresponding to each matrix element value.

For example, the standard attribute matrix corresponding to the screen display image is a 2×2 matrix, matrix element values in the standard attribute matrix are 102, 162, 158, and 109 from the top left corner in sequence, and the threshold values corresponding to the respective matrix element values may be 112, 172, 168, and 119. And constructing the second standard attribute matrix by the corresponding threshold value.

Wherein the setting of the threshold value is different due to different positioning of the electronic display device.

For example, there is a relatively high level of stringency when setting the threshold of the electronic display device. The difference between the matrix element values embodied in the attribute matrix and the corresponding threshold values is small, for example, when the matrix element values in the attribute matrix are 102, the threshold value corresponding to the matrix element 102 may be set to 104. Therefore, detection of abnormal brightness of the screen of the electronic display device is stricter, and stability of the screen display effect of the electronic display device is guaranteed.

For another example, there is a relatively low level of stringency when setting the threshold of the electronic display device. The difference between the matrix element values embodied in the attribute matrix and the corresponding threshold values may be large, for example, when the matrix element values in the attribute matrix are 102, the threshold value corresponding to the matrix element 102 may be set to 112.

For the case where the acquired threshold is a low threshold, similar to the case where the acquired threshold is a high threshold described above, the disclosure will not be described in detail, and specifically, reference may be made to any of the foregoing embodiments.

After the second standard attribute matrix is constructed, the attribute matrix of the screen display image and the matrix element values corresponding to the matrix positions in the second standard attribute matrix can be respectively compared to obtain comparison results corresponding to the matrix positions, and matrix difference information is determined based on the comparison results of the attribute matrix and the second standard attribute matrix.

Step S205, in response to the matrix difference information meeting a preset abnormal brightness condition, determining that the screen display image is an abnormal brightness image.

In an alternative example, the screen display image may be determined to be an abnormal brightness image when the number of target comparison results in the matrix difference information meets a preset abnormal brightness condition.

The target comparison result is a comparison result meeting a preset condition, and the abnormal brightness image comprises an abnormal bright image and an abnormal dark image.

In an alternative example, the preset condition may be: the pixel brightness represented by the matrix element value of the attribute matrix is higher than the pixel brightness represented by the matrix element value of the corresponding matrix position in the standard attribute matrix, or the pixel brightness represented by the matrix element value of the attribute matrix is lower than the pixel brightness represented by the matrix element value of the corresponding matrix position in the standard attribute matrix.

In this example, the target comparison result may include a first comparison result and a second comparison result, where the first comparison result may be a comparison result that a pixel luminance represented by a matrix element value that conforms to the attribute matrix is higher than a pixel luminance represented by a matrix element value corresponding to a matrix position in the standard attribute matrix, and the second comparison result may be a comparison result that a pixel luminance represented by a matrix element value that conforms to the attribute matrix is lower than a pixel luminance represented by a matrix element value corresponding to a matrix position in the standard attribute matrix.

The gray value in a gray image is a value indicating the brightness of the gray image, i.e., the color depth of the dots in a black-and-white image, typically ranges from 0 to 255, with white being 255 and black being 0. The gray value refers to the brightness of a single pixel, and a larger gray value indicates a brighter pixel. Thus, in this example, the first comparison result may be obtained by comparing the magnitude of the matrix element value of the attribute matrix with the matrix element value of the corresponding matrix position in the standard attribute matrix.

Specifically, the first comparison result may be obtained, and when the number of the first comparison results reaches a preset number condition, it is determined that the screen display image is an abnormally bright image. The preset quantity condition is the abnormal brightness condition.

In an alternative example, the preset number condition may be: the number of the first comparison results reaches a preset number value. And when the number of the first comparison results reaches a preset number value, determining that the screen display image is an abnormally bright image.

For example, the preset number condition may be: the number of first comparison results reaches 5. Therefore, when the number of the first comparison results reaches 5, that is, 5 or more, it is determined that the screen display image is an abnormally bright image.

In an alternative example, the preset number condition may be: the ratio of the number of the first comparison results to the total number of the comparison results reaches a preset ratio value. And determining that the screen display image is an abnormally bright image when the proportion of the number of the first comparison results to the total number of the comparison results reaches a preset proportion value.

For example, the preset number condition may be: the number of the first comparison results is up to one third of the total number of the comparison results. In this example, the attribute matrix and the standard attribute matrix of the screen display image are both 20×20 matrices, that is, the number of the total comparison results is 400, and the number of the obtained first comparison results is 160, which is two fifths of the total number of the comparison results. Since two-fifths are greater than one third, it can be determined that the screen display image is an abnormally bright image.

In particular, different manufacturers have different levels of stringency in determining whether the screen display image is an abnormal brightness image. For example, some manufacturers often desire that the screen display image of an electronic display device exhibit an ultra-high stability image. Some manufacturers have a strong inclusion of the screen display image of the electronic display device due to the performance of the electronic display device.

Therefore, in practical application, when the attribute matrices of the screen display images are all 10×10 matrices. Some manufacturers can set the preset quantity conditions as follows: the number value of the first comparison result reaches 1, or may be set to: the number of the first comparison results is up to one percent of the total number of the comparison results. And when the preset quantity conditions are set, some manufacturers can set as follows: the number value of the first comparison result reaches 30, or may be set as: the number of the first comparison results is up to one third of the total number of the comparison results.

Alternatively, the second comparison result may be obtained from the respective comparison results. And when the number of the second comparison results reaches a preset number condition, determining that the screen display image is an abnormally dark image.

The preset number condition may be that the number of the second comparison results reaches a preset number value. And when the number of the second comparison results reaches a preset number value, determining that the image is an abnormally dark image. Or, the preset number condition may further be that the ratio of the number of the second comparison results to the total number of the comparison results reaches a preset ratio value. That is, when the proportion of the number of the second comparison results to the total number of the comparison results reaches a preset proportion value, the screen display image is determined to be an abnormally dark image.

Since the method of determining the screen display image as an abnormally dark image is similar to the method of determining the screen display image as an abnormally bright image described above, this example will not be described in detail, and reference will be made to any of the foregoing embodiments for further details.

According to the screen abnormal brightness detection method, the corresponding gray level image is obtained through gray level processing of the screen display image, the attribute matrix is built based on the gray level values of all pixels in the gray level image, matrix difference information is obtained after the attribute matrix of the screen display image is further compared with the standard attribute matrix corresponding to the screen display image, whether the matrix difference information meets preset abnormal brightness conditions is judged, and whether the screen display image is the abnormal brightness display image is further determined. The method avoids the complex operation process that the existing screen abnormal brightness detection method depends on a color analyzer and needs manual or extra means to analyze the brightness information recorded by the color analyzer, reduces the use of hardware and reduces the detection cost. The feasibility and the effectiveness of the screen abnormal brightness detection method are improved, and the detection efficiency is improved.

For the foregoing method embodiments, for simplicity of explanation, the methodologies are shown as a series of acts, but one of ordinary skill in the art will appreciate that the present disclosure is not limited by the order of acts described, as some steps may occur in other orders or concurrently in accordance with the disclosure.

Further, those skilled in the art will also appreciate that the embodiments described in the specification are all alternative embodiments, and that the acts and modules referred to are not necessarily required by the present disclosure.

Corresponding to the embodiment of the application function implementation method, the disclosure also provides an embodiment of the application function implementation device and a corresponding terminal.

Fig. 3 is a schematic structural view of a screen abnormal brightness detection apparatus in an exemplary embodiment of the present disclosure, and as shown in fig. 3, the screen abnormal brightness detection apparatus may include:

a screen display image acquisition module 31 for acquiring a screen display image of the electronic display device;

the gray processing module 32 is configured to perform gray processing on the screen display image to obtain a corresponding gray image;

an attribute matrix construction module 33, configured to construct an attribute matrix of the screen display image based on the gray values of each pixel in the gray image, where the attribute matrix is used to characterize a distribution of the gray values of the pixels in the gray image;

A comparison module 34, configured to compare the attribute matrix of the screen display image with a standard attribute matrix corresponding to the screen display image, so as to obtain matrix difference information;

an abnormal brightness image determining module 35, configured to determine that the screen display image is an abnormal brightness image in response to the matrix difference information meeting a preset abnormal brightness condition.

Optionally, the screen display image acquisition module 31, when used for acquiring a screen display image of the electronic display device, includes:

and extracting one frame of the screen display image from the video sequence.

Optionally, the gray-scale processing module 32, when configured to perform gray-scale processing on the screen display image to obtain a corresponding gray-scale image, includes:

Optionally, the attribute matrix construction module 33, when configured to construct an attribute matrix of the screen display image based on gray values of respective pixels in the gray image, includes:

for the gray image, acquiring pixel gray values of pixels in the gray image;

Optionally, the comparing module 34, when configured to compare the attribute matrix of the screen display image with the standard attribute matrix corresponding to the screen display image, obtains matrix difference information, includes:

Optionally, the abnormal brightness image determining module 35, when configured to determine that the screen display image is an abnormal brightness image in response to the matrix difference information meeting a preset abnormal brightness condition, includes:

Optionally, the abnormal brightness image includes an abnormal bright image and an abnormal dark image; the target comparison result comprises a first comparison result and a second comparison result, wherein the first comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is higher than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix, and the second comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is lower than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix;

the abnormal brightness image determining module, when determining that the screen display image is an abnormal brightness image in response to the number of the target comparison results meeting a preset abnormal brightness condition, includes:

acquiring the first comparison result from the comparison results;

Or, obtaining the second comparison result from each comparison result;

Optionally, the abnormal image determining module 35, when determining that the screen display image is an abnormally bright image if the number of the first comparison results reaches a preset number condition, includes:

Optionally, the abnormal image determining module 35, when determining that the screen display image is an abnormal dark image if the number of the second comparison results reaches a preset number condition, includes:

For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the elements described above as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the objectives of the disclosed solution. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

Accordingly, an embodiment of the present disclosure provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to:

acquiring a screen display image of an electronic display device;

Fig. 4 is a schematic diagram of an electronic device 400, according to an example embodiment. For example, electronic device 400 may be a user device, and may be embodied as a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a wearable device such as a smart watch, smart glasses, smart bracelets, smart running shoes, and the like.

Referring to fig. 4, an electronic device 400 may include one or more of the following components: a processing component 402, a memory 404, a power supply component 406, a multimedia component 408, an audio component 410, an input/output (I/O) interface 412, a sensor component 414, and a communication component 416.

The processing component 402 generally controls overall operation of the electronic device 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 402 can include one or more modules that facilitate interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate interaction between the multimedia component 408 and the processing component 402.

Memory 404 is configured to store various types of data to support operations at device 400. Examples of such data include instructions for any application or method operating on electronic device 400, contact data, phonebook data, messages, pictures, videos, and the like. The memory 404 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply component 406 provides power to the various components of the electronic device 400. The power components 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 400.

The multimedia component 408 includes a screen that provides an output interface between the electronic device 400 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only a boundary of a touch or a sliding action but also a duration and a pressure related to the touch or the sliding operation. In some embodiments, the multimedia component 408 includes a front camera and/or a rear camera. When the electronic device 400 is in an operational mode, such as a shooting mode or a video mode, the front-facing camera and/or the rear-facing camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 410 is configured to output and/or input audio signals. For example, the audio component 410 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 400 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 404 or transmitted via the communication component 416. In some embodiments, audio component 410 further includes a speaker for outputting audio signals.

The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 414 includes one or more sensors for providing status assessment of various aspects of the electronic device 400. For example, the sensor assembly 414 may detect an on/off state of the electronic device 400, a relative positioning of the components, such as a display and keypad of the electronic device 400, the sensor assembly 414 may also detect a change in position of the electronic device 400 or a component of the electronic device 400, the presence or absence of a user's contact with the electronic device 400, an orientation or acceleration/deceleration of the electronic device 400, and a change in temperature of the electronic device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 416 is configured to facilitate communication between the electronic device 400 and other devices, either wired or wireless. The electronic device 400 may access a wireless network based on a communication standard, such as WiFi,4G or 5G,4G LTE, 5G NR, or a combination thereof. In one exemplary embodiment, the communication component 416 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 416 described above further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, there is also provided a non-transitory computer readable storage medium, such as memory 404 including instructions that, when executed by processor 420 of electronic device 400, enable electronic device 400 to perform a method of selection of an interaction, the method comprising:

Acquiring a screen display image of an electronic display device;

The non-transitory computer readable storage medium may be a ROM, random-access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for detecting abnormal brightness of a screen, the method comprising:

acquiring a screen display image of an electronic display device;

2. The method of claim 1, wherein the acquiring the screen display image of the electronic display device comprises:

And extracting one frame of the screen display image from the video sequence.

3. The method of claim 1, wherein the gray-scale processing the on-screen display image to obtain a corresponding gray-scale image comprises:

4. The method of claim 1, wherein constructing the attribute matrix of the screen display image based on the respective pixel gray values in the gray scale image comprises:

for the gray image, acquiring pixel gray values of pixels in the gray image;

5. The method according to claim 1, wherein comparing the attribute matrix of the screen display image with the standard attribute matrix corresponding to the screen display image to obtain matrix difference information includes:

6. The method of claim 5, wherein the determining that the screen display image is an abnormal brightness image in response to the matrix difference information meeting a preset abnormal brightness condition comprises:

7. The method of claim 6, wherein the abnormal brightness image comprises an abnormally bright image and an abnormally dark image; the target comparison result comprises a first comparison result and a second comparison result, wherein the first comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is higher than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix, and the second comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is lower than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix;

acquiring the first comparison result from the comparison results;

or, obtaining the second comparison result from each comparison result;

8. The method of claim 7, wherein determining that the on-screen display image is an abnormally bright image if the number of first comparison results reaches a preset number condition comprises:

9. The method of claim 7, wherein determining that the on-screen display image is an abnormally dark image if the number of second comparison results reaches a preset number condition comprises:

10. A screen abnormal brightness detection device, characterized in that the device comprises:

11. The apparatus of claim 10, wherein the screen display image acquisition module, when configured to acquire a screen display image of an electronic display device, comprises: acquiring a video sequence obtained by the electronic display device in the process of receiving screen operation, wherein the video sequence comprises multi-frame screen display images of the electronic display device;

and extracting one frame of the screen display image from the video sequence.

12. The apparatus of claim 10, wherein the gray scale processing module, when configured to perform gray scale processing on the screen display image to obtain a corresponding gray scale image, comprises:

13. The apparatus of claim 10, wherein the attribute matrix construction module, when configured to construct an attribute matrix for the screen display image based on the respective pixel gray values in the gray scale image, comprises:

for the gray image, acquiring pixel gray values of pixels in the gray image;

14. The apparatus according to claim 10, wherein the comparing module, when comparing the attribute matrix of the screen display image with the standard attribute matrix corresponding to the screen display image, obtains matrix difference information, includes:

15. The apparatus of claim 14, wherein the abnormal brightness image determining module, when configured to determine that the screen display image is an abnormal brightness image in response to the matrix difference information meeting a preset abnormal brightness condition, comprises:

16. The apparatus of claim 15, wherein the abnormal brightness image comprises an abnormally bright image and an abnormally dark image; the target comparison result comprises a first comparison result and a second comparison result, wherein the first comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is higher than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix, and the second comparison result is a comparison result that the pixel brightness represented by the matrix element value conforming to the attribute matrix is lower than the pixel brightness represented by the matrix element value corresponding to the matrix position in the standard attribute matrix;

acquiring the first comparison result from the comparison results;

or, obtaining the second comparison result from each comparison result;

17. The apparatus of claim 16, wherein the abnormal image determining module, when determining that the screen display image is an abnormally bright image if the number of the first comparison results reaches a preset number condition, includes:

18. The apparatus of claim 16, wherein the abnormal image determining module, when determining that the screen display image is an abnormal dark image if the number of the second comparison results reaches a preset number condition, comprises:

19. A non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor implements the steps of the method of any of claims 1 to 9.

20. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to perform the screen abnormality brightness detection method of any one of claims 1 to 9.