CN115390291A - Screen display state detection method, device and system and readable storage medium - Google Patents
Screen display state detection method, device and system and readable storage medium Download PDFInfo
- Publication number
- CN115390291A CN115390291A CN202211021208.2A CN202211021208A CN115390291A CN 115390291 A CN115390291 A CN 115390291A CN 202211021208 A CN202211021208 A CN 202211021208A CN 115390291 A CN115390291 A CN 115390291A
- Authority
- CN
- China
- Prior art keywords
- screen
- image
- display state
- determining
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/1306—Details
- G02F1/1309—Repairing; Testing
Landscapes
- Physics & Mathematics (AREA)
- Nonlinear Science (AREA)
- Chemical & Material Sciences (AREA)
- Crystallography & Structural Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses a method, a device and a system for detecting screen display states and a readable storage medium, wherein the method comprises the following steps: acquiring a display image of a screen to be detected shot by a camera in a test scene; acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template; and determining whether the display state of the screen to be detected is abnormal or not according to the difference image. The invention aims to improve the detection accuracy of the screen display state.
Description
Technical Field
The present invention relates to the field of screen detection, and in particular, to a method, an apparatus, a system and a readable storage medium for detecting a screen display status.
Background
With the maturity of LCD liquid crystal display technology, LCD liquid crystal screens are more and more widely used in various devices. When the screen is actually used, the screen inevitably goes through the processes of power-on and screen lighting, and when the screen is disturbed or the driving of screen software has errors, the screen-blooming phenomenon can be generated instantly.
In the related art, the method for detecting the screen splash phenomenon depends on observing whether the screen is abnormal or not when the screen is powered on or lightened manually. Because the abnormal picture has short occurrence time and very small probability, long-time continuous observation is usually needed, and attention is required to be highly concentrated during testing, the probability of false detection by manual detection is high, the cost is high, and the detection accuracy of the screen display state is low.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a screen display state detection method, a device and a system and a readable storage medium, aiming at achieving the effect of improving the detection accuracy of the screen display state.
In order to achieve the above object, the present invention provides a method for detecting a screen display state, the method comprising:
acquiring a display image of a screen to be detected shot by a camera in a test scene;
acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template;
and determining whether the display state of the screen to be detected is abnormal or not according to the difference image.
Optionally, the step of obtaining a matching template corresponding to the display image and determining a difference image between the display image and the matching template includes:
determining a first brightness value of each pixel point on the display image and determining a second brightness value of each pixel point on the matching template;
performing a difference operation on the first luminance value and the second luminance value;
and generating the difference image according to the difference operation result.
Optionally, after the step of obtaining a display image of the screen to be inspected shot by the camera in the test mode, the method includes:
determining the type of the test scene according to the display image;
when the type of the test scene is a screen-off scene, executing a step of acquiring a matching template corresponding to the display image and determining a difference image between the display image and the matching template;
when the type of the test scene is a restarting scene, dividing the display image into a plurality of sub-regions;
and determining whether the display state of the screen to be detected is abnormal or not according to the comparison result among the brightness values of the plurality of sub-areas.
Optionally, the step of determining whether the display state of the screen to be inspected has an abnormality according to the comparison result between the brightness values of the plurality of sub-regions includes:
determining a main image area and a background area of the display image;
dividing the main picture area into a plurality of first sub-areas;
determining a result of a comparison between luminance values of a plurality of said first sub-areas:
when the comparison result is not in a preset range, determining that the display state of the screen to be detected is abnormal;
when the comparison result is within a preset range, dividing the background area into a plurality of second sub-areas;
determining whether the brightness values of a plurality of the second sub-regions are greater than a preset brightness:
when the brightness value is larger than the preset brightness, determining that the display state of the screen to be detected is abnormal;
and when the brightness value is smaller than or equal to the preset brightness, determining that the display state of the screen to be detected is not abnormal.
Optionally, the step of determining the type of the test scene according to the display image includes:
determining the brightness and characteristics of the display image;
comparing the brightness and the features to the brightness and features of the matching template;
when the comparison result is within a preset range, determining that the type of the test scene is a screen-off scene:
and when the comparison result is not in a preset range, determining the type of the test scene as a restart scene.
Optionally, the step of obtaining a display image of the screen to be inspected shot by the camera in the test scene includes:
controlling the screen to be detected to be off when a matching template is displayed, and controlling the camera to shoot the screen to be off to obtain a first video; or alternatively
And controlling the to-be-detected screen to restart when the image is displayed, and controlling the camera to shoot and restart the process to obtain a second video: or
Controlling the to-be-detected screen to restart when a matching template is displayed, and controlling the shooting restart process of the camera to obtain a third video;
determining the display image from image frames of the first video, the second video, and the third video.
Optionally, before the step of acquiring the display image of the screen to be inspected shot by the camera in the test scene, the method further includes:
determining a second frequency of the camera according to the first frequency of the screen to be detected;
controlling the camera to shoot the screen to be detected to obtain a template image when the camera displays a matching template on the screen to be detected based on the second frequency;
and adjusting the shooting parameters of the camera according to the brightness value of the template image.
In addition, in order to achieve the above object, the present invention further provides a screen display state detection device, which includes a memory, a processor and a screen display state detection program stored in the memory and operable on the processor, wherein when the screen display state detection program is executed by the processor, the steps of the screen display state detection method as described above are implemented.
In addition, to achieve the above object, the present invention also provides a screen display state detection system, including:
the camera is used for shooting a screen to be tested;
a screen to be tested;
the screen display state detection device is the screen display state detection device.
Further, to achieve the above object, the present invention also provides a computer readable storage medium having stored thereon a screen display state detection program which, when executed by a processor, realizes the steps of the screen display state detection method as described above.
The embodiment of the invention provides a method, a device and a system for detecting the display state of a screen and a readable storage medium, wherein a display image of a screen to be detected shot by a camera in a test scene is acquired; acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template; and determining whether the display state of the screen to be detected is abnormal or not according to the difference image. The display image of the screen to be detected under the test setting scene is shot through the camera, then the display image corresponds to the matching template, a difference image is generated, the matching template is displayed on the test scene through the screen to be detected, the display image is obtained only by shooting through the shooting device, therefore, whether the display state of the screen is abnormal or not can be judged based on the difference image, and the detection accuracy of the display state of the screen can be improved.
Drawings
Fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for detecting a screen display status according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for detecting a screen display status according to another embodiment of the present invention;
fig. 4 is a schematic diagram of a restart scene display image according to an embodiment of the present invention;
FIG. 5 is a schematic view of a camera gain adjustment process according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a difference image of a screen-out scene according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the related art, the method for detecting the screen splash phenomenon mainly depends on observing whether the screen is abnormal or not when the screen is powered on or lightened manually. Because the abnormal picture has short occurrence time and very small probability, long-time continuous observation is usually needed, and attention is required to be highly concentrated during testing, the probability of false detection by manual detection is high, the cost is high, and the detection accuracy of the screen display state is low.
In order to improve the detection accuracy of the screen display state, the embodiment of the invention provides a screen display state detection method, a device, a system and a readable storage medium, wherein the method mainly comprises the following steps:
acquiring a display image of a screen to be detected shot by a camera in a test scene;
acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template;
and determining whether the display state of the screen to be detected is abnormal or not according to the difference image.
Therefore, the display image of the screen to be detected in the detection scene is shot through the camera, and then the display image corresponds to the matching template corresponding to the display image to generate a difference image, whether the display state of the screen is abnormal or not can be judged based on the difference image, and the detection accuracy of the display state of the screen can be improved.
The following detailed description of the claimed invention refers to the accompanying drawings.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be a screen display state detection device.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, memory 1003, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The memory 1003 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). The memory 1003 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the memory 1003, which is a kind of computer storage medium, may include therein an operating system and a screen display state detection program.
In the terminal shown in fig. 1, the processor 1001 may be configured to call the screen display state detection program stored in the memory 1003, and perform the following operations:
acquiring a display image of a screen to be detected shot by a camera in a test scene;
acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template;
and determining whether the display state of the screen to be detected is abnormal or not according to the difference image.
Further, the processor 1001 may call the screen display state detection program stored in the memory 1003, and also perform the following operations:
determining a first brightness value of each pixel point on the display image and determining a second brightness value of each pixel point on the matching template;
performing a difference operation on the first luminance value and the second luminance value;
and generating the difference image according to the difference operation result.
Further, the processor 1001 may call the screen display state detection program stored in the memory 1003, and also perform the following operations:
determining the type of the test scene according to the display image;
when the type of the test scene is a screen-off scene, executing a step of acquiring a matching template corresponding to the display image and determining a difference image between the display image and the matching template;
when the type of the test scene is a restart scene, dividing the display image into a plurality of sub-regions;
and determining whether the display state of the screen to be detected is abnormal or not according to the comparison result among the brightness values of the plurality of sub-areas.
Further, the processor 1001 may call the screen display state detection program stored in the memory 1003, and also perform the following operations:
determining a main image area and a background area of the display image;
dividing the main picture area into a plurality of first sub-areas;
determining a result of a comparison between luminance values of a plurality of said first sub-areas:
when the comparison result is not in a preset range, determining that the display state of the screen to be detected is abnormal;
when the comparison result is within a preset range, dividing the background area into a plurality of second sub-areas;
determining whether the brightness values of a plurality of the second sub-regions are greater than a preset brightness:
when the brightness value is larger than the preset brightness, determining that the display state of the screen to be detected is abnormal;
and when the brightness value is smaller than or equal to the preset brightness, determining that the display state of the screen to be detected is not abnormal.
Further, the processor 1001 may call the screen display state detection program stored in the memory 1003, and also perform the following operations:
determining the brightness and characteristics of the display image;
comparing the brightness and the features to the brightness and features of the matching template;
when the comparison result is within a preset range, determining that the type of the test scene is a screen-off scene:
and when the comparison result is not in a preset range, determining the type of the test scene as a restart scene.
Further, the processor 1001 may call the screen display state detection program stored in the memory 1003, and also perform the following operations:
controlling the screen to be detected to be off when a matching template is displayed, and controlling the camera to shoot the screen to be off to obtain a first video; or alternatively
And controlling the to-be-detected screen to restart when the image is displayed, and controlling the camera to shoot and restart the process to obtain a second video: or
Controlling the to-be-detected screen to restart when a matching template is displayed, and controlling the shooting restart process of the camera to obtain a third video;
determining the display image from image frames of the first video, the second video, and the third video.
Further, the processor 1001 may call the screen display state detection program stored in the memory 1003, and also perform the following operations:
determining a second frequency of the camera according to the first frequency of the screen to be detected;
controlling the camera to shoot the screen to be detected to obtain a template image when the camera displays a matched template on the screen to be detected based on the second frequency;
and adjusting the shooting parameters of the camera according to the brightness value of the template image.
With the maturity of LCD liquid crystal display technology, LCD liquid crystal screens are more and more widely used in various devices. When the screen is actually used, the screen inevitably goes through the processes of power-on and screen lighting, and when the screen is interfered or the screen software is driven to have errors, the screen-splash phenomenon can be caused instantly.
In the related art, the method for detecting the screen splash phenomenon depends on observing whether the screen is abnormal or not when the screen is powered on or lightened manually. Because the abnormal picture has short occurrence time and very small probability, long-time continuous observation is usually needed, and attention is required to be highly concentrated during testing, the probability of false detection by manual detection is high, the cost is high, a large amount of time is consumed, and the detection accuracy of the screen display state is low.
Hereinafter, the contents of the claims of the present invention are explained by specific exemplary embodiments so that those skilled in the art can better understand the scope of the claims of the present invention. It is to be understood that the following exemplary embodiments are not intended to limit the scope of the present invention, but are merely illustrative of the present invention.
Illustratively, referring to fig. 2, in an embodiment of the screen display state detection method of the present invention, the screen display state detection method includes the steps of:
s10, acquiring a display image of a screen to be detected shot by a camera in a test scene;
in this embodiment, the camera may be a high-speed industrial camera, and may capture a display image that changes at a high speed. Wait to examine the screen can be the LCD screen, is used for the VR screen usually, for example VR glasses etc. eye can be laminated to this type of screen, often divide into two blocks of screens on a left side, the right side, can detect two blocks of screens on a left side, the right side simultaneously. The power consumption is strictly controlled by using a battery, the power consumption is controlled by alternately switching on and off the left screen backlight lamp and the right screen backlight lamp at a high speed in actual operation, human eyes cannot feel the screen state at the moment, and the display of alternating bright and dark at the left and right sides can be obtained when a high-speed camera shoots. In order to detect the display states of the screen to be detected in different test scenes, the camera shoots the screen to be detected and displays an image of the matched template in the test scene, and the image is a display image.
Optionally, controlling the screen to be detected to be off when the matching template is displayed, and controlling the camera to shoot the screen to be off to obtain a first video; or controlling the screen to be detected to restart when the image is displayed, and controlling the camera shooting restart process to obtain a second video: or controlling the to-be-detected screen to restart when the matching template is displayed, and controlling the shooting restart process of the camera to obtain a third video; determining the display image from image frames of the first video, the second video, and the third video.
The screen to be detected can be tested under two test scenes, the two test scenes can be separately tested or can be tested at the same time, the first test scene is a screen extinguishing scene, namely, the screen to be detected is controlled to be extinguished when the matched template is displayed, the screen is turned from bright screen to extinguished when the matched template is displayed on the screen to be detected, the screen extinguishing process of the screen to be detected is shot through a camera, a first video is obtained, and the first video is obtained. The second test scenario is a restart scenario, that is, the screen to be tested is controlled to restart when displaying an image, the displayed image is arbitrary, but when restarting, the screen to be tested displays a boot image, as shown in fig. 4, a large area of the boot image is a completely black image, and a difference image is not generated corresponding to a matching template corresponding to the boot image, so that a method for confirming the display state of other screens is required in the restart scenario. The restarting scene and the screen extinguishing scene can be carried out at the same stage, the screen extinguishing scene is a process that a screen is turned on to off, the restarting scene is a process that the screen is turned on to off and then turned on, the process can comprise a process that the screen extinguishing scene is turned on to off, the restarting scene is restarted when the matching template is displayed on the screen to be detected, a third video of the process is obtained through a camera, in order to shoot the abnormal condition of the screen as far as possible, the process of turning off the screen or restarting can be repeatedly carried out when the matching template is displayed, and the video is obtained. The image for each frame of the first video, the second video, or the third video may be taken as a display image. It is understood that the camera capture speed needs to reach an integer multiple of the screen refresh speed.
The camera, wait to examine the screen and can set up in one set of test fixture, test fixture mainly constitutes including high-speed industry camera, the adjustable fixed platform of high accuracy, and the cooperation subassembly contains camera bellows, illuminometer etc.. Before the test is carried out, the exposure time and gain value of the camera need to be adjusted by adjusting and measuring with a luminometer so that the light of a dark box is within 1 lux. Adjusting the exposure time and the gain value under different frame rates of the display screen to obtain a correlation combination among the refresh frequency of the screen to be tested, the exposure time of the camera and the gain value of the camera, before testing, setting shooting parameters of the camera according to the correlation combination, including the exposure time and the gain value, so that the brightness of the shot display image is preset brightness, for example 53, and shooting the display image in a test scene by using the set shooting parameters.
Optionally, determining a second frequency of the camera according to the first frequency of the screen to be inspected; controlling the camera to shoot the screen to be detected to obtain a template image when the camera displays a matched template on the screen to be detected based on the second frequency; and adjusting the shooting parameters of the camera according to the brightness value of the template image.
The shooting parameters of the camera that need to be adjusted may include Gain values, since there is a little difference in each screen brightness, whereas the present embodiment provides brightness-affected detection of the screen display state. And the higher the screen refresh frequency, the shorter the corresponding camera exposure time, and the lower the brightness of the display image taken with the reduced exposure time. Therefore, before testing, calibration needs to be performed according to the camera Gain value corresponding to each refreshing frequency of the screen to be tested, so that the shooting brightness is the same as that of the actual screen, and the Gain value obtained through calibration is used in subsequent actual testing.
For convenience of testing, before testing, the correlation combination between the refresh frequency of the screen to be tested and the gain value of the camera can be obtained according to the calibration steps, and the gain value of the camera shooting parameter can be directly determined in the subsequent testing based on the correlation combination and the refresh frequency.
Specifically, shooting parameters corresponding to the screen to be detected under a plurality of refreshing frequencies are respectively determined. For example, 72Hz, 80Hz, 90Hz, 120Hz, taking 72Hz as an example, referring to fig. 5, the refresh frequency of the screen to be checked is set to 72Hz; setting the camera to be a 1/3 refreshing frequency (24 Hz) exposure value, and shooting an image to obtain a standard brightness template T; calculating to obtain a brightness value TB1 (the value is 53) of the standard brightness template T; setting the camera to be 72Hz, taking a picture, and calculating to obtain the brightness 72B of the shot image; if 72B is greater than TB1, subtracting 1 from the camera Gain value, and if 72B is less than TB1, adding 1 to the camera Gain value; repeat 4 to 5 times until the difference between 72B and TB1 is the minimum, then record the Gain value at this time. Then the screen to be detected can be set to be 80Hz, 90Hz and 120Hz, the camera is set to be corresponding to the refreshing frequency to repeat 4-6 times, corresponding Gain values are respectively obtained, and the correlation between the Gain values and the refreshing frequency is stored as a correlation combination.
S20, acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template;
in this embodiment, the matching template corresponding to the display image is an image used for displaying the to-be-detected screen, and the camera shoots the to-be-detected screen of the to-be-detected screen when the matching template is displayed, so as to obtain the display image, where the display image includes an image of a matching template. However, after the screen to be detected is displayed, the display template and the matching template still have differences, and after the display image is aligned with the matching module, a difference image is generated according to the differences between the display image and the matching template.
Optionally, a positioning template is manufactured according to the matching template and used as an alignment operation of the image, so that the image is prevented from being shifted in the detection process. Prior to generating the difference image, the display image is positioned based on the positioning template so that the display image can be aligned with the matching template.
Optionally, determining a first brightness value of each pixel point on the display image, and determining a second brightness value of each pixel point on the matching template; performing a difference operation on the first luminance value and the second luminance value; and generating the difference image according to the difference operation result.
The image contents of the matching template and the display image are corresponding to each other, in order to detect whether a screen-blooming phenomenon exists on a screen to be detected, the brightness difference between the display image and the matching image needs to be compared, the brightness value of each pixel point on the display image is determined as a first brightness value, the brightness value of each point on the matching template is determined as a second brightness value, the corresponding relation between each pixel point on the display image and each pixel point on the display image is determined according to the alignment result of the display image and the matching template, the first brightness value and the second brightness value are compared one by one according to the corresponding relation to obtain the brightness difference value between the first brightness value and the second brightness value, a difference image is generated according to each brightness difference value, and referring to fig. 6, if a different color area or a different color line exists on fig. 6, the screen-blooming phenomenon exists on the screen to be detected.
And S30, determining whether the display state of the screen to be detected is abnormal or not according to the difference image.
In this implementation, the difference between the matching template and the display image is due to the to-be-detected screen, each point or area on the to-be-detected screen should be the same as other points and areas, and the influence on each pixel point on the matching template is the same, that is, the difference between the matching template and the display image is the same, if a pixel point different from other pixel points exists on the display image, it can be considered that the display state of the to-be-detected screen in the test scene is abnormal, a screen splash phenomenon exists, and belongs to a defective screen, specifically, the difference image can be subjected to patch analysis to obtain the number and the area of the difference area, based on the number and the area of the difference area, whether the display state of the to-be-detected screen is abnormal or not is determined according to the number and the area of the difference area, if the number and/or the area is less than or equal to a preset threshold, it is determined that the display state is qualified, and when the display state is qualified, it is determined that the display state of the to-be-detected screen is not abnormal; and if the number and/or the area are/is larger than the preset threshold value, determining that the display state is unqualified, and determining that the display state of the screen to be detected is abnormal.
For better understanding, the present embodiment provides a specific application scenario:
in order to test the display state of the VR screen in the screen-off scene, the method specifically includes the following steps:
(1) Manufacturing a matching template: selecting an image which is considered to be normal, distinguishing the image according to a left screen and a right screen, respectively manufacturing a matching template T _ L and a matching template T _ R, carrying out gray processing on the templates, and selecting an ROI (region of interest).
(2) Positioning a display image: and respectively manufacturing positioning templates for the left screen and the right screen according to the matching templates T _ L and T _ R, and using the positioning templates as the alignment operation of the images to prevent the images from deviating in the screen state detection process of the images.
(3) And (3) display image analysis: firstly, the used image needs to meet the brightness requirement during camera parameter calibration, then the image is grayed, and the image is calibrated according to the positioning template.
(4) And performing difference operation by using the calibrated image and the matching template, wherein if the two images are in complete contrast, a difference image with the brightness of 0 is obtained. If a certain difference exists between the two images, the difference image can be reflected, and finally, a rectangular frame is used for identifying the abnormal area.
The screen that awaits measuring is the VR screen, and the display image of VR screen need divide into about two regions, and based on this, under the black screen state, there are following eight kinds of testing results:
(1) Normal image: and comparing the display images on the two sides of the left and right screens of the VR with the corresponding matching templates to obtain no difference, and judging the condition as a normal condition.
(2) Normal image but overall image is darker: in the process of turning off the VR screen to turning on the VR screen, the process of image brightness change exists, the VR screen is not completely turned on and is just shot by a camera, the situation is caused to occur, and the situation is judged to be a normal situation. The specific detection scheme is as follows: the image is judged not to be in a black screen state through the brightness, but the overall brightness is far lower than that of a normal template. So a matching image can be identified using the screen-splash detection algorithm, but there will be a large difference image of the abnormal area, which is considered to be a normal situation.
(3) One side is normal and the other side is black: the phenomenon is that the sequence of playing pictures on two sides of a VR screen is not completely synchronous, so that a normal VR screen appears on one side and a full black phenomenon appears on the other side in the recording process of an industrial camera. The specific detection scheme is as follows: this kind of phenomenon is the normal condition at present, does not influence the performance of VR screen itself. And judging whether the image is a normal image or not by detecting the brightness of the screen, and judging that the left side of the displayed image is an abnormal side if the display state of the left side displayed image of the screen is normal.
(4) Local screen splash of the image: the phenomenon is a point or an area with an abnormal local position in the display process of the VR screen, and the phenomenon is considered to be abnormal. The specific detection scheme is as follows: after the difference value operation, a more obvious abnormal area can be found on the difference value image, and the range coordinate of the area is returned based on the difference value image. And marking the abnormal area in the display image according to the returned result.
(5) One side is full of screen, and one side is darker: this phenomenon is a case where an abnormality occurs on one side of the VR screen, and the other side is relatively dark. The specific detection scheme is as follows: firstly, whether the displayed image is totally black is determined through the brightness, if the displayed image is totally black, the side screen is in a black screen state, and if the image brightness reaches a certain threshold value, the displayed image is in a non-full black state. The screen state detection is normally performed on the display image on this side, if the display image can be considered as a normal image. And judging the two sides of the screen to be detected respectively to obtain corresponding matching results.
(6) One side is full of screen-patterned, and the other side is black: in the screen extinguishing process, the display states of the screens on the two sides are not completely synchronous, one side is in a completely black state, and the other side is in an abnormal screen splash state. This is considered to be a splash screen. The specific detection scheme is as follows: determining whether the screen is in a black screen state or not by judging the brightness of the two sides of the displayed image, and if the brightness is lower than a specified threshold value, indicating that the currently displayed image is in a full black state without detecting the screen state; if the brightness reaches the designated brightness threshold, indicating that the image is in a non-full-black state, and carrying out screen state detection; if the difference image is normal, the current image is a normal screen image, and the abnormality such as screen splash does not occur, and if the difference image is abnormal, the display image and the matching template have a larger difference, and the abnormal condition is judged at this moment.
(7) Both sides are the screen: and (4) the condition of screen splash appears on both sides of the image at the same time, and the display condition is determined as screen splash. The specific detection scheme is as follows: if the brightness of both sides of the displayed image is not in a completely black state, screen state detection is required. The difference images on the two sides are abnormal, and the situation is determined as a screen.
In the technical scheme disclosed by the embodiment, a display image of a screen to be detected shot by a camera in a test scene is acquired firstly; acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template; and determining whether the display state of the screen to be detected is abnormal or not according to the difference image. The display image of the screen to be detected in the detection scene is shot through the camera, then the display image corresponds to the matching template to generate a difference image, the matching template is displayed in the detection scene through the screen to be detected, the display image is obtained only after the matching template is shot through the shooting device, and therefore whether the display state of the screen is abnormal or not can be judged based on the difference image. Compared with a manual visual detection method, the screen display state detection method provided by the embodiment can improve accuracy and efficiency, and is more suitable for detecting screen splash.
Optionally, referring to fig. 3, based on any one of the above embodiments, in another embodiment of the screen display state detection method according to the present invention, the screen display state detection method further includes:
s40, determining the type of the test scene according to the display image;
in this embodiment, there are two test scenes of the screen to be tested, one is an off-screen scene and the other is a restart scene, and the screen display state detection algorithms of the display images corresponding to the off-screen scene and the restart scene are different, so that the test scenes of the display images should be distinguished. Specifically, the object, i.e., the display image, which needs to be detected in the screen-off scene and the restart scene is different. In the screen-off scene, the display image to be detected is the display image corresponding to the matching template, and in the restart scene, the display image to be detected is the display image corresponding to the startup image in the restart. By identifying the display image, the type of the display scene corresponding to the display image can be determined.
In an alternative embodiment, the operation parameters of the screen to be tested may also be obtained, and whether the test scene is turned off or restarted is determined according to the operation parameters, so as to determine the type of the test scene.
Optionally, determining the brightness and characteristics of the display image; comparing the brightness and the features to the brightness and features of the matching template; when the comparison result is within a preset range, determining that the type of the test scene is a screen-off scene: and when the comparison result is not in a preset range, determining the type of the test scene as a restart scene.
In this embodiment, brightness pre-judgment and feature point identification are performed on a display image, brightness and features of the display image are determined, and a test scene type corresponding to the display image is further determined by comparing the brightness and the features with brightness and features of a matching template.
S50, when the type of the test scene is an off-screen scene, executing the steps of acquiring a matching template corresponding to the display image and determining a difference image between the display image and the matching template;
optionally, if the type of the test scene is an off-screen scene, processing the display state by using a screen display state detection algorithm corresponding to the off-screen scene. Therefore, when the type of the test scene is determined to be the screen-off scene, the step of acquiring the matching template corresponding to the display image and determining the difference image between the display image and the matching template is executed.
Step S60, when the type of the test scene is a restart scene, dividing the display image into a plurality of sub-areas;
in this embodiment, if the type of the test scene is a restart scene, the display image of the test scene corresponds to a boot image, which is actually a template, and the operation in step S20 may be executed, but the boot image has a large black background area, and after being captured by the camera, the display image of the restart scene is difficult to be different from the boot image. The calculation is carried out according to the display image, the display image is divided into a plurality of sub-areas, and the plurality of sub-areas are compared.
And S70, determining whether the display state of the screen to be detected is abnormal or not according to the comparison result among the brightness values of the plurality of sub-areas.
The display image is divided into a plurality of sub-regions, the luminance values of the sub-regions should be similar to each other, and the difference between the maximum luminance value and the minimum luminance value should be within a preset range. And if the comparison result is not within the preset range, determining that the display state of the screen to be detected is abnormal, and if the comparison result is within the preset range, determining that the display state of the screen to be detected is normal.
Optionally, dividing the main map region into a plurality of first sub-regions; determining a comparison between luminance values of a plurality of said first sub-regions: when the comparison result is not within a preset range, determining that the display state of the screen to be detected is abnormal; when the comparison result is within a preset range, dividing the background area into a plurality of second sub-areas; determining whether the brightness values of a plurality of the second sub-regions are greater than a preset brightness: when the brightness value is larger than the preset brightness, determining that the display state of the screen to be detected is abnormal; and when the brightness value is smaller than or equal to the preset brightness, determining that the display state of the screen to be detected is not abnormal.
As shown in fig. 4, which is an example of a display image of a VR screen to be tested in a restart scene, there are a main region (an elliptical region) and a background region (other regions except the elliptical region), the luminance value difference between the main region and the background region is large, and the main region and the background region should be compared separately. The main region is compared first, and then the background region is compared. The image of the main image area is more obvious than the image of the background area, and if the brightness value comparison range of the sub-area of the main image area is not in the preset range, the abnormal display state of the screen to be detected can be directly determined, so that the calculation amount can be saved. If the main image area does not have the condition that the brightness value comparison range of the sub-area is within the preset range, the brightness value of the sub-area of the background area is further judged. The background area is black, the brightness value is 0 or lower, if the brightness value of the background area is greater than the preset brightness, it can be determined that the display state of the screen to be tested is abnormal, and if the brightness value of the sub-area of the background area is less than or equal to the preset brightness, it can be determined that the display state of the screen to be tested is normal.
For better understanding, the present embodiment provides a specific application scenario:
in order to test the display state of the VR screen in the restart scene, the method may specifically include the following steps:
(1) First, a matching template of the boot image is obtained, and then the positions of feature points in the template, such as the elliptical area in fig. 4, in the display image are calculated by matching the display image with the template.
(2) And (3) processing the successfully matched elliptical region in the step (1) as a main pattern region independently, wherein the processing process comprises the following steps: dividing the main image area into four parts, respectively calculating the brightness, calculating the difference between the maximum value and the minimum value of the brightness, if the difference is larger than a specified threshold value, the area is judged to have abnormal conditions, otherwise, the area is judged to be in a normal state.
(3) After the main image area successfully matched in the display image (1) is shielded, the rest background area is divided into 32 multiplied by 32 sub-areas through gridding pictures, then the brightness of each sub-area is judged, if the brightness value of the sub-area is larger than a specified threshold value, the sub-area is indicated to be an abnormal area, and the area is identified by using a rectangular frame.
(4) And (3) comprehensively judging the results of the two steps of (2) and (3) to finally give out, and judging whether the display image is in an abnormal display state or not.
In the technical solution disclosed in this embodiment, the type of the test scene is determined by the display image, when the type of the test scene is a screen-off scene, step S20 is executed, and when the test scene is a restart scene, the display state of the screen to be tested is determined by comparing the brightness values obtained according to the sub-regions of the display image. Therefore, according to the difference of the display images in different test scenes, the display images are processed by different algorithms in a targeted manner, the display states of the screen to be detected in different states are detected, and whether the screen is lost or not is detected, so that the accuracy of detecting the screen state is improved.
In addition, an embodiment of the present invention further provides a screen display state detection apparatus, where the screen display state detection apparatus includes a memory, a processor, and a screen display state detection program that is stored in the memory and is executable on the processor, and when the screen display state detection program is executed by the processor, the steps of the screen display state detection method according to the foregoing embodiments are implemented.
In addition, an embodiment of the present invention further provides a system for detecting a screen display state, where the system for detecting a screen display state includes:
the camera is used for shooting a screen to be tested;
a screen to be tested;
the screen display state detection device is the screen display state detection device.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a screen display state detection program is stored, and when the screen display state detection program is executed by a processor, the steps of the screen display state detection method described in the foregoing embodiments are implemented.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of other like elements in a process, method, article, or system comprising the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for causing the screen display state detection apparatus to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method for detecting a display state of a screen, the method comprising:
acquiring a display image of a screen to be detected shot by a camera in a test scene;
acquiring a matching template corresponding to the display image, and determining a difference image between the display image and the matching template;
and determining whether the display state of the screen to be detected is abnormal or not according to the difference image.
2. The screen display state detection method of claim 1, wherein the step of obtaining a matching template corresponding to the display image and determining a difference image between the display image and the matching template comprises:
determining a first brightness value of each pixel point on the display image and determining a second brightness value of each pixel point on the matching template;
performing a difference operation on the first luminance value and the second luminance value;
and generating the difference image according to the difference operation result.
3. The screen display state detection method of claim 1, wherein the step of acquiring a display image of the screen to be inspected in the test mode by the camera, after the step of acquiring, comprises:
determining the type of the test scene according to the display image;
when the type of the test scene is a screen-off scene, executing the steps of acquiring a matching template corresponding to the display image and determining a difference image between the display image and the matching template;
when the type of the test scene is a restarting scene, dividing the display image into a plurality of sub-regions;
and determining whether the display state of the screen to be detected is abnormal or not according to the comparison result among the brightness values of the plurality of sub-areas.
4. The screen display state detection method according to claim 3, wherein the step of determining whether there is an abnormality in the display state of the screen to be examined based on the comparison result between the luminance values of the plurality of sub-areas comprises:
determining a main image area and a background area of the display image;
dividing the main picture area into a plurality of first sub-areas;
determining a comparison between luminance values of a plurality of said first sub-regions:
when the comparison result is not within a preset range, determining that the display state of the screen to be detected is abnormal;
when the comparison result is within a preset range, dividing the background area into a plurality of second sub-areas;
determining whether the brightness values of a plurality of the second sub-regions are greater than a preset brightness:
when the brightness value is larger than the preset brightness, determining that the display state of the screen to be detected is abnormal;
and when the brightness value is smaller than or equal to the preset brightness, determining that the display state of the screen to be detected is not abnormal.
5. The screen display state detection method of claim 3, wherein the step of determining the type of the test scene from the display image comprises:
determining the brightness and characteristics of the display image;
comparing the brightness and the features to the brightness and features of the matching template;
when the comparison result is within a preset range, determining that the type of the test scene is a screen-off scene:
and when the comparison result is not in a preset range, determining the type of the test scene as a restart scene.
6. The screen display state detecting method of claim 1, wherein the step of acquiring the display image of the screen to be inspected in the test scene taken by the camera comprises:
controlling the screen to be detected to be off when a matching template is displayed, and controlling the camera to shoot the screen to be off to obtain a first video; or
And controlling the to-be-detected screen to restart when the image is displayed, and controlling the camera to shoot and restart the process to obtain a second video: or
Controlling the to-be-detected screen to restart when a matched template is displayed, and controlling the shooting restart process of the camera to obtain a third video;
determining the display image from image frames of the first video, the second video, and the third video.
7. The screen display state detection method of claim 1, wherein the step of acquiring a display image of the screen to be inspected in the test scene by the camera further comprises:
determining a second frequency of the camera according to the first frequency of the screen to be detected;
controlling the camera to shoot the screen to be detected to obtain a template image when the camera displays a matched template on the screen to be detected based on the second frequency;
and adjusting the shooting parameters of the camera according to the brightness value of the template image.
8. A screen display state detection device, characterized by comprising: a memory, a processor and a screen display state detection program stored on the memory and executable on the processor, the screen display state detection program when executed by the processor implementing the steps of the screen display state detection method of any one of claims 1 to 7.
9. A screen display status detection system, comprising:
the camera is used for shooting a screen to be detected;
a screen to be tested;
the screen display state detecting device according to claim 8.
10. A computer-readable storage medium, characterized in that a screen display state detection program is stored thereon, which when executed by a processor implements the steps of the screen display state detection method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211021208.2A CN115390291A (en) | 2022-08-24 | 2022-08-24 | Screen display state detection method, device and system and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211021208.2A CN115390291A (en) | 2022-08-24 | 2022-08-24 | Screen display state detection method, device and system and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115390291A true CN115390291A (en) | 2022-11-25 |
Family
ID=84123237
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211021208.2A Pending CN115390291A (en) | 2022-08-24 | 2022-08-24 | Screen display state detection method, device and system and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115390291A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116092402A (en) * | 2022-12-30 | 2023-05-09 | 翱瑞(深圳)科技有限公司 | Display screen verification system based on android system rapid verification function |
| CN116405661A (en) * | 2023-04-28 | 2023-07-07 | 可诺特软件(深圳)有限公司 | Smart television development performance testing method and device |
-
2022
- 2022-08-24 CN CN202211021208.2A patent/CN115390291A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116092402A (en) * | 2022-12-30 | 2023-05-09 | 翱瑞(深圳)科技有限公司 | Display screen verification system based on android system rapid verification function |
| CN116405661A (en) * | 2023-04-28 | 2023-07-07 | 可诺特软件(深圳)有限公司 | Smart television development performance testing method and device |
| CN116405661B (en) * | 2023-04-28 | 2023-09-29 | 可诺特软件(深圳)有限公司 | Smart television development performance testing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115390291A (en) | Screen display state detection method, device and system and readable storage medium | |
| US9177529B2 (en) | Method and device for determining afterimage level of display device | |
| US20150348467A1 (en) | Image processing method and apparatus | |
| US8238640B2 (en) | Display testing apparatus and method | |
| CN105301810A (en) | Screen defect detecting method and screen defect detecting device | |
| US11317067B2 (en) | Method and system for inspecting display image | |
| TWI758609B (en) | Image generation device and image generation method | |
| CN109801322A (en) | A kind of light leak test method and device | |
| CN111707456A (en) | Optical machine definition testing method and testing device | |
| CN117130186B (en) | LCD display screen flaw defect intelligent detection method | |
| CN114927109A (en) | Backlight source control method and device, display equipment and storage medium | |
| CN111385447A (en) | Image pickup apparatus and method of driving the same | |
| US10970846B1 (en) | Repairing method for Mura in display panel | |
| CN104658461A (en) | Method for testing light emission uniformity of display | |
| CN106441820B (en) | Display screen homogeneity testing method and system | |
| CN114764779A (en) | Computing device and defect detection method for near-eye display device | |
| KR101668039B1 (en) | Method for Light Test of Display Panel | |
| CN114638831B (en) | Image analysis method and device | |
| CN116243451A (en) | Focusing adjustment method and device | |
| CN107591138B (en) | Content display method and device | |
| JPH06236162A (en) | Test method for defect of color liquid crystal panel and device for test | |
| RU2346331C1 (en) | Method of automatic estimate of lcd data display correctness | |
| JP2005195515A (en) | Apparatus and method for inspecting flat panel display device | |
| US12013602B2 (en) | Method of detecting defective pixels in electronic displays | |
| CN116543670A (en) | Method and device for quantifying residual shadows by masking color gradation, and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |