CN117456861A

CN117456861A - Point screen detection method and system of point screen equipment, electronic equipment and storage medium

Info

Publication number: CN117456861A
Application number: CN202311540703.9A
Authority: CN
Inventors: 李成铭; 张瑞忠; 董丽颖
Original assignee: Megarobo Technologies Co Ltd
Current assignee: Megarobo Technologies Co Ltd
Priority date: 2023-11-17
Filing date: 2023-11-17
Publication date: 2024-01-26

Abstract

The embodiment of the application provides a dot screen detection method and system of dot screen equipment, electronic equipment and a storage medium. The method comprises the following steps: repeatedly executing the screen pointing judgment operation for preset times; judging the first times of successful screen pointing of the screen pointing equipment according to the preset times of screen pointing, and determining the screen pointing stability of the screen pointing equipment; the screen pointing judging operation comprises the following steps: acquiring a clicked image, wherein the clicked image is an image of a display screen acquired after the display screen is clicked by using a point screen device; determining a lighting pixel in a preset area based on the gray value of each pixel in the preset area of the lighted screen image and a preset gray threshold value, wherein the gray value of the lighting pixel is larger than the preset gray threshold value; counting the number of the lighted pixels; based on the number of lit pixels, it is determined whether the pointing device successfully points the screen. The detection method has the advantages of low detection cost and high detection efficiency, and the card control parameters of whether the display screen is lightened can be flexibly configured, so that the user experience is better.

Description

Point screen detection method and system of point screen equipment, electronic equipment and storage medium

Technical Field

The application relates to the technical field of hardware detection, in particular to a dot screen detection method of dot screen equipment, a dot screen detection system of the dot screen equipment, electronic equipment and a storage medium.

Background

A dot screen device is a device for lighting up a connected display to test whether the display has a failure. Before the display is inspected with the point-screen device, the point-screen device is typically inspected to ensure that the point-screen device is functioning well.

In the prior art, some schemes detect the dot screen stability of dot screen equipment by adopting a manual detection method. For example, after the screen pointing operation is performed on a normal display screen by using the screen pointing device to be detected, the human eye observes and records whether the display screen is lit or whether the display data of the display screen are displayed, and judges whether the screen pointing device works well according to the recorded data. This solution requires huge manpower costs and has a slow detection speed and a low detection efficiency. Other schemes use expensive detection equipment to detect the dot screen effect of the dot screen equipment. The scheme has high detection cost, fixed detection mode and difficult adaptation to different detection scenes.

Disclosure of Invention

The present invention has been made in view of the above-described problems. The application provides a dot screen detection method of dot screen equipment, a dot screen detection system of dot screen equipment, electronic equipment and a storage medium.

According to one aspect of the application, a dot screen detection method of dot screen equipment is provided, and the dot screen detection method is used for detecting whether the dot screen equipment lights up a normal display screen and displays a preset image. The dot screen detection method of the dot screen device comprises the following steps: repeatedly executing the screen pointing judgment operation for preset times; judging the first times of successful screen pointing of the screen pointing device according to the preset times of screen pointing, and determining the screen pointing stability of the screen pointing device; the screen pointing judging operation comprises the following steps: acquiring a clicked image, wherein the clicked image is an image of a display screen acquired after the display screen is clicked by using a point screen device; determining a lighting pixel in a preset area based on the gray value of each pixel in the preset area of the lighted screen image and a preset gray threshold value, wherein the gray value of the lighting pixel is larger than the preset gray threshold value; counting the number of the lighted pixels; based on the number of lit pixels, it is determined whether the pointing device successfully points the screen.

Illustratively, the preset image is a color image, and determining the lighting pixels in the preset area includes: converting color data of each pixel in the colored dotted screen image into a gray value; and determining pixels in the preset area, the gray value of which is larger than the preset gray threshold value, as the lighting pixels.

Illustratively, the method further comprises: acquiring a first image of a display screen on which a preset image is displayed; image segmentation is carried out on the first image so as to determine a position area of the display screen in the image, and the position area is used as a display screen area; and taking the image of the display screen area as the clicked image.

Illustratively, the method further comprises: and determining an area including the center of the image in the spotted screen image as a preset area, wherein the width of the preset area is smaller than the width of the spotted screen image, and the height of the preset area is smaller than the height of the spotted screen image.

Illustratively, the method further comprises the step of determining a preset gray threshold value: under the condition that the display screen is successfully clicked, acquiring a clicked screen test image of the display screen; image segmentation is carried out on the spot screen test image so as to determine a display screen area of a position area of a display screen in the image and a background area formed by all pixels positioned outside the display screen area; determining a first overall gray value of pixels in a display screen area and determining a second overall gray value of pixels in a background area; and determining a preset gray threshold based on the first and second integral gray values, wherein the preset gray threshold is greater than or equal to the second integral gray value and less than or equal to the first integral gray value.

Illustratively, the step of determining the preset gray threshold further comprises: under the condition that the display screen is successfully clicked, acquiring a clicked screen test image of the display screen; determining the gray value of pixels in a preset area of the dot screen test image; determining a lighting pixel in the preset area based on the gray value of the pixel in the preset area and the current preset gray threshold, wherein the pixel value of the lighting pixel is larger than the current preset gray threshold; based on the number of the lighted pixels, determining whether the screen is lighted successfully or not by the screen lighting equipment, if not, updating the current preset gray threshold; and executing the step of determining the lighted pixels in the preset area according to the updated preset gray threshold value until the successful point screen of the point screen equipment is determined.

Illustratively, determining whether the pointing device successfully points the screen based on the number of lit pixels includes: calculating the duty ratio of the lighted pixels in the preset area, and determining that the screen-pointing device fails to point the screen under the condition that the duty ratio is smaller than the duty ratio threshold value; and determining that the pointing device successfully points the screen when the duty ratio is greater than or equal to the duty ratio threshold.

Illustratively, determining the dot screen stability of the dot screen device based on the first number of successful dot screens of the dot screen device comprises: counting the first times of successful screen pointing of the screen pointing device determined in the screen pointing judging operation of the preset times; and determining the screen pointing stability of the screen pointing device based on the first times and the preset times.

According to still another aspect of the present application, there is also provided a dot screen detection system of a dot screen device, for detecting whether the dot screen device lights up a normal display screen and displays a preset image, including: the execution module is used for repeatedly executing the screen pointing judgment operation for the preset times; the determining module is used for determining the screen stability of the screen pointing device according to the first times of successful screen pointing of the screen pointing device according to the screen pointing of the preset times; the screen pointing judging operation comprises the following steps: acquiring a clicked image, wherein the clicked image is an image of a display screen acquired after the display screen is clicked by using a point screen device; determining a lighting pixel in a preset area based on the gray value of each pixel in the preset area of the lighted screen image and a preset gray threshold value, wherein the gray value of the lighting pixel is larger than the preset gray threshold value; counting the number of the lighted pixels; based on the number of lit pixels, it is determined whether the pointing device successfully points the screen.

According to yet another aspect of the present application, there is also provided an electronic device including a processor and a memory. The memory stores computer program instructions that, when executed by the processor, are configured to perform the dot screen detection method of the dot screen device described above.

According to still another aspect of the present application, there is also provided a storage medium, on which program instructions are stored, the program instructions being used, when executed, to perform the dot screen detection method of the dot screen device described above.

In the above scheme, by executing image processing and judging operations on the screen-clicked image of the display screen obtained after each screen-clicking operation, whether the screen-clicking operation of the screen-clicking equipment is successful or not can be determined. And the number of successful screen clicking operations of the screen clicking equipment is integrated, so that the screen clicking stability of the screen clicking equipment can be rapidly and accurately determined. The detection method is low in detection cost and high in detection efficiency, and can realize accurate real-time detection of the dot screen stability of the dot screen equipment. And the scheme determines whether the screen is successfully clicked every time according to the number of the lighted pixels with the gray value larger than the preset gray threshold value in the screen-clicked image. Because the preset gray threshold can be set, the card control parameters for stability judgment can be flexibly configured, so that the method and the device can be suitable for detection scenes of different types of point screen equipment in different test environments, and the application range of the scheme is wider.

The foregoing description is only an overview of the technical solutions of the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above-mentioned and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application will be given.

Drawings

The foregoing and other objects, features and advantages of the present application will become more apparent from the following more particular description of embodiments of the present application, as illustrated in the accompanying drawings. The accompanying drawings are included to provide a further understanding of embodiments of the application and are incorporated in and constitute a part of this specification, illustrate the application and not constitute a limitation to the application. In the drawings, like reference numerals generally refer to like parts or steps.

FIG. 1 shows a schematic flow chart of a dot screen detection method of a dot screen device according to one embodiment of the present application;

FIG. 2 illustrates a partial flow chart of a dot screen detection method of a dot screen device according to another embodiment of the present application;

FIG. 3 illustrates a flowchart of a method of dot screen detection by a dot screen device according to another embodiment of the present application;

FIG. 4 shows a schematic block diagram of a dot screen detection system of a dot screen device according to one embodiment of the present application;

Fig. 5 shows a schematic block diagram of an electronic device according to one embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, exemplary embodiments according to the present application will be described in detail below with reference to the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application and not all of the embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein. Based on the embodiments of the present application described herein, all other embodiments that may be made by one skilled in the art without the exercise of inventive faculty are intended to fall within the scope of protection of the present application.

As described above, in the dot screen detection scheme of the dot screen device in the prior art, after the dot screen device to be detected is used to dot the normal display screen, whether the display screen is lit up or the display data of the display screen is observed and recorded by human eyes, and whether the dot screen device is well operated is judged according to the recorded data, or the dot screen effect of the dot screen device is detected by adopting an expensive detection device. The manual detection method needs to consume huge labor cost, and has low detection speed and low detection efficiency. And the expensive detection equipment is used for detection, so that the detection cost is high, the detection mode is fixed, and the detection equipment is difficult to adapt to different detection scenes.

In order to at least partially solve the above technical problem, according to one aspect of the present application, there is provided a dot screen detection method of a dot screen device, for detecting whether the dot screen device lights up a normal display screen and displays a preset image. The display screen may be any existing or future developed display screen, including but not limited to a mobile phone display screen, a computer display screen, a television display screen, or the like, which can display imaging, and in the embodiment of the present application, the type, model, size, and the like of the display screen are not limited. However, in the present embodiment, the display screen is normal. In other words, in the embodiment of the application, the dot screen stability of the dot screen device is detected by using the good display screen which can be normally displayed. The dot screen device may be any existing or future developed dot screen device including, but not limited to, an image signal generator device PG, etc., and is not limited thereto as long as it has a function of lighting a normal display screen. The preset image may also be any suitable image input to the display screen, for example, may be a monochrome image, a checkerboard image, a stripe image, etc., which is not limited in this application.

Fig. 1 shows a schematic flow chart of a dot screen detection method of a dot screen device according to one embodiment of the present application. As shown in fig. 1, the dot screen detection method of the dot screen device includes the following steps S110 and S120.

Step S120, repeatedly executing the dot screen judging operation for the preset times. The preset times can be multiple times, and the preset times can be set arbitrarily according to actual requirements, and the preset times are not limited in the application. Taking 100 preset times as an example, 100 screen pointing judgment operations may be performed in this step.

Specifically, step S120 includes step S122, step S124, step S126, and step S128, which are cyclically executed. In other words, each time the dot screen judging operation includes the above four steps, which may be performed 100 times for the case where the preset number of times is 100 times.

Step S122, a screen-clicked image is acquired. The on-screen image is an image of the display screen acquired after the display screen is on-screen by the on-screen device. It should be noted that the on-screen image may be an image in which the display screen is successfully turned on, or may be an image in which the display screen is not successfully turned on. In other words, the on-screen image may be an image in which the display screen is in a state of being successfully lit and displaying a preset image, or may be an image in which the display screen is in a state of being turned off and not displaying any image.

The pointing device is illustratively connected to the display screen via a communication interface and may send a display signal to the display screen to display a preset image before each pointing operation is performed. After the display signal is sent by the dot screen device, the dot screen image of the normal display screen can be acquired through various suitable image acquisition modes. By way of example and not limitation, the display screen may be photographed by any suitable image capture device, such as a camera, to obtain a dotted screen image comprising the display screen. In this example, the position and angle at which the image capturing device captures the display screen may be arbitrarily set according to actual requirements, as long as the display screen can be completely captured. In a preferred embodiment, the image acquisition device may be placed in a preset position directly in front of the display screen by testing such that in the spotted screen image acquired by the image acquisition device with respect to the display screen, the display screen area is in the central area of the spotted screen image. It will be appreciated that in the case of, for example, a good communication interface, the normal display screen may be lit up and display a preset image after receiving the display signal. In this case, the acquired dot screen image may be a display screen image displaying a preset image. In the case of a failure of the communication interface, for example, the normal display may not receive the display signal, and thus the normal display may not be lit up, and thus no image is displayed. In this case, the acquired on-screen image may be an unlit display screen image (the display screen area is a dark area).

The dot screen image may be a color image or a gray scale image, which is not limited in this application. The spot screen image can be an original image directly acquired by the image acquisition device, can be an image which is based on the original image and can be an image after simple preprocessing operation is carried out on the original image. The preprocessing operations may include image cropping, image scaling, overall image gray scale adjustment, etc. processing operations that do not affect detection. The spot-screen image may have any suitable image format including, but not limited to, bmp format, jpeg format, rgb format, yuv format, or the like.

Step S124, determining the lighting pixels in the preset area based on the gray value of each pixel in the preset area of the dotted image and the preset gray threshold. The gray value of the lighting pixel is larger than a preset gray threshold value.

Alternatively, the spot-screened image may be a color image. For the case that the dotted screen image is a color image, the color image may be converted into a gray image, and then the lighting pixels in the preset area may be determined according to the gray value of each pixel in the converted gray image in the area corresponding to the position of the preset area and the preset gray threshold. Alternatively, a preset gray-scale conversion formula may be directly adopted to calculate the gray-scale value of each pixel in the preset area of the color dotted screen image. Then, the lit pixels in the preset area are determined according to the gray values of the respective pixels and the preset gray threshold value. Alternatively, the dotted screen image may be a gray image, and when the dotted screen image is a gray image, the lighting pixels in the preset area may be determined directly according to the gray values of the respective pixels in the preset area of the dotted screen image and the preset gray threshold value.

The preset area may be a display screen area in the clicked image. For the case where only the display screen region is included in the dotted image, the preset region may be the entire region or a partial region of the dotted image. For the case where the dotted image includes a display screen region and other regions, the preset region may be a partial region of the dotted image. In particular, the preset area may be a complete display screen area. Alternatively, the preset area may be a sub-area of the full display screen area. For example, the preset area may be a sub-area of a preset size in the complete display screen area. The preset size can be set arbitrarily according to actual requirements. For example, the preset size is 100 pixels, and the preset area may be a sub-area of 100 pixels including a center pixel of the display screen area.

The preset gray threshold can be set arbitrarily according to the actual detection requirement. For example, a certain number of test images may be acquired in advance. The test image may be a display screen image which successfully displays a preset image acquired by the image acquisition device when the manual determination of the success of the pointing screen is performed. Statistical analysis may then be performed on the gray values of the pixels of the display screen area in these test images to determine the appropriate preset gray threshold. The specific implementation of this scheme for determining the preset gray threshold will be explained later, and will not be described here again.

Taking the preset gray threshold value of 150 as an example, in this step, for each dot screen image, the gray value of each pixel in the preset area may be compared with the preset gray threshold value 150. And determining the lighting pixels in the preset area according to the comparison result. For example, a pixel having a gray value greater than 150 in the preset area may be directly determined as the lighting pixel.

Step S126, counting the number of the lighted pixels. Step S128, based on the number of the lighted pixels, it is determined whether the screen pointing device is successful in pointing the screen.

Taking the example that the preset gray threshold is 150 and the preset area is a sub-area of 100 pixels in the dot screen image, in step S126, any suitable pixel number obtaining method may be adopted, and the number of pixels in the preset area with gray values greater than 150 is counted. Then, in step S128, it may be determined whether the pointing device succeeds in pointing the screen using various suitable decision logic according to the counted number of lit pixels.

In one example, step S128 determines whether the pointing device successfully points the screen based on the number of lit pixels, including steps S128a, S128b, and S128c.

Step S128a, the duty ratio of the lighting pixels in the preset area is calculated.

And step S128b, determining that the point screen equipment fails in a point screen mode under the condition that the duty ratio is smaller than the duty ratio threshold value.

In step S128c, in the case that the duty ratio is greater than or equal to the duty ratio threshold value, it is determined that the pointing device successfully points the screen.

According to the embodiment of the application, the number of all pixel points in the preset area in the acquired dot screen image after the dot screen equipment is dot-screen can be counted. And the number of the lighted pixels in the area counted in step S126 may be regarded as the number of the lighted pixels in the area. Then, the ratio of the number of the lighted pixels to the number of all the pixels, that is, the duty ratio of the lighted pixels in the preset area is calculated. It is understood that the duty ratio may represent the illuminated rate of the pixel points in the preset area to some extent. Thus, the duty cycle may be further compared to a duty cycle threshold that is preset in advance to determine if the pointing device is successful. The duty ratio threshold can be set arbitrarily according to actual requirements, and different duty ratio thresholds can be set for different test requirements. For example, the duty cycle threshold may be any value between 80% and 98%. And if the duty ratio of the lightened pixels is larger than or equal to a preset duty ratio threshold value, determining that the operation of the screen is successful. And if the duty ratio of the lightened pixels is smaller than a preset duty ratio threshold value, determining that the operation of the screen is failed.

Specifically, taking a preset area as an image area of 100pixel in the spotted screen image as an example. The number of pixel points in the preset area may be 10000, and the duty ratio threshold may be 85%. In the screen-on image of the display screen obtained after the screen-on device is used for screen-on of the normal display screen, if the number of the lightened pixels (lightened pixels) in the preset area is greater than or equal to 8500, the successful screen-on operation of the screen at this time can be judged according to the condition that the ratio of the lightened pixels is greater than or equal to 85% of the ratio threshold. If the number of the lightened pixels (lightened pixels) in the preset area is less than 8500, the failure of the operation of the screen point is judged according to the condition that the duty ratio of the lightened pixels is less than the duty ratio threshold value of 85 percent.

According to the scheme, the duty ratio of the lighting pixels in the preset area in the screen-on image, which has the gray value larger than the preset gray threshold, is calculated, and whether the screen-on device is successful in screen-on or not is judged according to the comparison result of the duty ratio and the preset duty ratio threshold. The scheme has small calculated amount and higher calculation accuracy, thereby improving the efficiency and the accuracy of the dot screen detection.

For example, whether the current screen pointing device is successful or not may also be determined directly according to the number of the lighting pixels and the preset number threshold.

In one example, the dot screen judging operation of the preset number of times in step S120 may be sequentially performed one by one. The execution sequence of the dot screen judging operation is consistent with the sequence of the dot screen operation. The first clicked image may be acquired as a first clicked image of the display screen for the current operation of the pointing device after the first pointing operation is performed for the normal display screen. And steps S124, S126 and S128 may be performed with respect to the first on-screen image, and the result of whether the first on-screen operation is successful is recorded. And then, continuously executing the second point screen operation by using the point screen equipment, and collecting the point screen image of the display screen after the second point screen operation as a second point screen image. And performs step S124, step S126, and step S128 for the second tapped image. And circulating until the screen-pointing times of the screen-pointing equipment reach the preset times. The preset number is, for example, 100, and after the 100 th time of the screen pointing operation is performed by the screen pointing device, the screen-clicked image of the display screen may be acquired as the 100 th screen-clicked image. Alternatively, the order of the dot screen judging operations may be different from the order of the dot screen operations. For example, the dot screen operation on the normal display screen may be continuously performed 100 times using the dot screen device. After each spot-screen operation, the image of the display screen is acquired once, so that 100 spot-screen images can be collected at one time. Then, the above-described dot screen judging operations of step S124, step S126, and step S128 may be performed one by one for the collected 100 dot screen images. The dot screen judging operation can be executed according to the sequence of image acquisition, and the dot screen judging operation can be executed according to the random sequence. It will be appreciated that for the latter approach, the order of the dot screen judgment operations may be different from the order of the dot screen operations.

In another example, the dot screen judging operation of the preset number of times in step S120 may also be performed approximately synchronously. For example, the method of the above example may be adopted to obtain a preset number of on-screen images at a time, where the preset number is the same as the preset number of times, and different on-screen images are operated for on-screen at different moments. Then, the above-described step S124, step S126, and step S128 may be simultaneously performed on these screen-printed images. For example, the 100 screen-on images may be simultaneously input into the program loaded with the processing logic of the step S124, the step S126, and the step S128, and a processing result indicating whether the screen-on operation corresponding to each screen-on image is successful may be obtained, for example, the screen-on image corresponding to the screen-on operation is marked as successful.

Step S140, judging the first times of successful screen pointing of the screen pointing device according to the screen pointing of the preset times, and determining the screen pointing stability of the screen pointing device.

In this step, the first number of successful screen pointing operations of the screen pointing device may be determined according to the preset number of screen pointing operations, and any suitable determination logic may be used to determine the screen pointing stability of the screen pointing device.

In one example, step S140 determines the dot screen stability of the dot screen device based on the first number of successful dot screens of the dot screen device, including steps S141 and S142.

Step S141, counting the first times of successful screen pointing of the screen pointing device determined in the screen pointing judging operation of the preset times. Step S142, determining the screen stability of the screen pointing device based on the first times and the preset times.

In step S141, any suitable method may be used to count 100 times of the first times of the screen lighting device successfully lighting the screen. For example, in the embodiment in which a preset number of screen images are acquired at one time, the preset number is the same as the preset number, and different screen images are operated for the screen at different times, the number of screen images marked as successful screen clicking may be counted as the first number. Then, in step S142, any suitable determination logic may be used to determine the stability of the pointing device according to the first number of times and the preset number of times. For example, a ratio of the first number of times to the preset number of times may be calculated, resulting in a ratio of the number of times the dot screen was successful. And any suitable number of times scaling threshold may be preset. The dot screen stability of the dot screen device can be determined according to the dot screen success frequency ratio and the dot screen frequency ratio threshold value. Optionally, a frequency proportion threshold value can be set, and the stability judgment result of the dot screen can be divided into two-gear judgment results of good stability and poor stability. If the frequency ratio of successful screen pointing is greater than or equal to the frequency ratio threshold value, the screen pointing stability of the screen pointing device can be determined to be good; if the number ratio of successful screen pointing is smaller than the number ratio threshold, the poor screen pointing stability of the screen pointing device can be determined. For example, if the preset number of times is 100, the first number of times is 70, and the number of times proportion threshold is 80%, it may be determined that the dot screen stability of the dot screen device is poor according to the above-mentioned determination logic. Alternatively, a plurality of times ratio threshold values may be set, and the dot screen stability judgment result may be divided into a plurality of steps judgment result. For example, two times ratio thresholds may be set, and the dot screen stability determination result may be classified into three steps of determination results of good stability, general stability and poor stability. For example, the two count ratio thresholds are 60% and 80%, respectively, and the preset count is 100. The poor spot screen stability of the spot screen device can be determined according to the condition that the first time number is less than 60; the general stability of the point screen equipment can be determined according to the condition that the first time number is more than or equal to 60 and less than 80; and the stability of the point screen equipment can be determined to be good according to the condition that the first time number is greater than or equal to 80.

According to the scheme, the method for judging the dot screen stability of the dot screen equipment according to the first times of successful dot screen judgment in the operation and the preset times is small in calculated amount, high in calculation accuracy, simple and reasonable in judgment logic, and real-time and accurate detection of the dot screen stability of the dot screen equipment can be realized.

As described above, for the dot screen detection scheme in the prior art, one is a manual detection scheme, which requires a large labor cost, and the detection efficiency is also low and is prone to error, and the other is an equipment detection scheme, which is expensive in device and single in detection type. According to the detection scheme of the embodiment of the application, whether the screen pointing operation of the screen pointing device is successful or not can be determined by performing simple image processing and judging operations on the screen-clicked image of the display screen obtained after each screen pointing operation. And the number of successful screen clicking operations of the screen clicking equipment is integrated, so that the screen clicking stability of the screen clicking equipment can be rapidly and accurately determined. The detection method is low in detection cost and high in detection efficiency, and can realize real-time and accurate detection of the dot screen stability of the dot screen equipment. And the scheme determines whether the screen is successfully clicked every time according to the number of the lighted pixels with the gray value larger than the preset gray threshold value in the screen-clicked image. Because the preset gray threshold can be set, the card control parameters for stability judgment can be flexibly configured, so that the method and the device can be suitable for detecting scenes of different point screens aiming at different types of point screen equipment, and the application range of the scheme is wider.

In some embodiments, the method 100 further includes steps S121a, S121b, and S121c before the step S124 determines the lit pixels in the preset area.

Step S121a, a first image of a display screen on which a preset image has been displayed is acquired.

In step S121b, the first image is subjected to image segmentation to determine the location area of the display screen in the image as the display screen area.

Step S121c, the image of the display screen area is taken as the clicked image.

The first image may be an original image acquired by the image acquisition means. For example, after the normal display screen is dotted by the dotted device, the original image of the display screen acquired by the image acquisition device may include an imaging area of the display screen and may further include an imaging area of an object near the display screen, that is, the original image includes a display screen area and a non-display screen area. For example, the scene in which the image capturing device captures the original image of the display screen may be: the camera is placed right in front of a white wall with a distance of 2m from the white wall, and the display screen is placed between the white wall and the camera, for example, with a distance of 20cm from the white wall. In this way, the first image of the display screen captured by the camera after the pointing device points the display screen includes not only the imaging area of the display screen but also the imaging area of the white wall. In order to avoid interference of pixels of an imaging area of a non-display screen such as a white wall in the first image with the judgment result of the dot screen judgment operation, the first image may be processed to eliminate those pixels that may cause interference.

Specifically, in step S121b, various suitable image segmentation algorithms may be used to perform image segmentation on the first image to determine the display screen region in the first image. Image segmentation algorithms include, but are not limited to, threshold segmentation algorithms, region growing algorithms, edge detection algorithms, deep learning based image segmentation algorithms, and the like. For example, the first image may be input into a trained image segmentation model, and a mask image may be output from the model, where the mask image includes pixels with pixel values of 0 and pixels with pixel values of 1. For example, in the mask image, an image area formed by pixels having a pixel value of 1 may correspond to a display screen area in the first image. Thus, the display screen area in the first image can be determined. In step S121c, the first image may be cropped along the edges of the display screen area, and it is understood that the cropped image is composed of the pixels of the display screen.

In the scheme, the position of the display screen area in the first image of the acquired display screen is determined by an image segmentation method, and pixels of the non-display screen area in the first image are further removed, so that a dotted screen image is obtained. The scheme can effectively reduce the adverse effect of interference on the judgment of the pixel point screen in the image acquisition environment, and can also reduce the calculation amount of unnecessary calculation to a certain extent. And the method for determining the display screen area by the image segmentation method has higher processing speed and higher accuracy. Therefore, the detection efficiency of the dot screen detection is improved, and the detection precision is also improved.

By way of example and not limitation, the method 100 further includes step S123a. Step S123a, determining an area including the image center in the spotted screen image as a preset area. The width of the preset area is smaller than the width of the spotted screen image, and the height of the preset area is smaller than the height of the spotted screen image.

In one example, after the dot-on-screen image including only the display screen region is obtained using the methods of step S121a, step S121b, and step S121c described above, the center pixel of the dot-on-screen image may be first determined using various suitable methods. Then, the preset region may be determined according to the position of the center pixel and the region width and height of the preset region. Alternatively, the center pixel coordinates may be calculated from the width and height of the image. Let the width of the image be W and the height be H. Then the center pixel coordinate of the image is (W/2, h/2). Alternatively, the center pixel coordinates may also be calculated from the index of the image array. Assume that the width of the image is W, the height is H, and the pixel values are stored in a one-dimensional array in order from top left to bottom right. The index of the center pixel can be calculated by the following formula: index= (H/2) w+ (W/2). Where (H/2) denotes the position of the center pixel in the vertical direction and (W/2) denotes the position of the center pixel in the horizontal direction. Thus, the coordinates or index of the center pixel of the spotted screen image can be determined. Further, the position of the preset area may be determined according to the coordinates or index of the center pixel. The preset area may be an area of any size and any shape. Taking a rectangular area with a width a and a height b as an example of the preset area. The center pixel coordinates are (W/2, H/2), for example, and it can be determined that the vertex coordinates of the upper left corner of the preset area are (W/2-a/2, H/2-b/2).

In another example, after the dot-screen image including only the display screen region is obtained using the methods of step S121a, step S121b, and step S121c described above, the preset region may be determined directly according to the size of the dot-screen image and the shape and size of the preset region. Also taking a rectangular area with a preset area of 100 pixels as an example. Illustratively, the dot screen image may be pixelated to obtain a dot pattern composed of pixel dots, the dot pattern having x rows and y columns thereon. The preset area may be determined by the following formula: (Start_x: start_x+100, start_y: start_y+100); wherein start_x=x/2-50; start_y=y/2-50. Wherein start_x is the row where the upper edge of the preset area is located, and start_y is the column where the left edge of the preset area is located.

According to the embodiment of the application, the width of the preset area is smaller than the width of the dot screen image and the height of the preset area is smaller than the height of the dot screen image. In other words, the preset area is a local area in the clicked image. And the area center of the preset area determined by the method is the center of the display screen area, so that the preset area is an imaging area in the middle of the display screen. In general, the imaging effect in the middle of the display screen may represent the imaging effect of the display screen. The scheme can obviously reduce the calculated amount and obviously improve the detection efficiency on the basis of ensuring the accuracy of the dot screen detection.

In some embodiments, the method 100 further comprises the step of determining a preset gray threshold. The step of determining the preset gray threshold includes the following steps S123.1 to S123.4.

Step 123.1, under the condition that the display screen is successfully clicked, acquiring a clicked screen test image of the display screen. It will be appreciated that the implementation manner of this step is similar to that of step S120, and is the display screen image acquired after the point screen device performs the point screen operation on the display screen. For example, the images acquired in the two steps are acquired after the point screen device sends a display signal for displaying the same preset image to the display screen driver through the communication interface. But the execution condition of this step is different from that of step S120. This step is a test image acquired in the case where it is determined that the display screen is successfully lit, and step S120 acquires an image of the display screen regardless of whether the display screen is actually successfully lit.

Step S123.2, performing image segmentation on the spotted screen test image to determine a display screen region of a position region of the display screen in the image and a background region formed by all pixels located outside the display screen region. The implementation of this step is similar to the step S121b described above, and for brevity, the description is omitted here.

Step S123.3, determining a first global gray value of the pixels in the display screen area and determining a second global gray value of the pixels in the background area. The first and second global gray values may be determined using any suitable calculation method. In one example, an average of gray values of all pixels in an image of a display screen region may be calculated and taken as a first overall gray value. And the average value of the gray values of all pixels in the image of the background area can be calculated and used as a second integral gray value. Taking as an example the determination of a first global gray value of a pixel in a display screen area. All pixels in the display screen area may first be traversed and the gray value of each pixel acquired. The gray values for each pixel may then be summed to obtain a total gray value. The average gray value for each pixel in the display screen area is then calculated by dividing the total gray value by the total number of pixels in the display screen area. In other examples, the gray values of all pixels in the display screen area may be ranked, and then the ranked median gray value is found as the first overall gray value; alternatively, pixels at different locations in the display screen area may be assigned different weights, and then a weighted average method may be used to determine the first overall gray value. The method for determining the second integral gray scale value may be the same as the implementation manner for determining the first integral gray scale value, and will not be described herein.

Step S123.4, determining a preset gray threshold based on the first and second global gray values. The preset gray threshold is larger than or equal to the second integral gray value and smaller than or equal to the first integral gray value.

Since the display screen area in the display test image is the imaging area of the illuminated display screen, the image color brightness is brighter than the image color brightness of the background area. Thus, the first overall gray value of the display screen area is larger than the second overall gray value of the background area. In this step, a value range of the preset gray threshold may be set between the first integral gray value and the second integral gray value, so that the display screen area and the background area may be effectively distinguished.

For example, if the determined first overall gray value of the pixel in the display screen region is 180 and the second overall gray value of the pixel in the background region is 90, the preset gray threshold may be set to any value between 90 and 180. Alternatively, the preset gray value may be set as a mean value of the first and second overall gray values. For example, the preset gray threshold is set to 135. Alternatively, the preset gray threshold may be set to any other suitable value. For example, a suitable preset gray threshold may be further set according to the situation of the preset image. For example, if the preset image is overall bright, the preset gray threshold may be set slightly larger, and if the preset image is overall dark, the preset gray threshold may be set slightly smaller. Alternatively, the average value of the first integral gray value and the second integral gray value and the duty ratio of the pixels with the gray value smaller than the average value in the display screen area can be compared to determine the preset gray threshold. For example, if the duty ratio of the pixels with gray values smaller than the average value in the display screen area is smaller than the preset duty ratio, the average value may be directly used as the preset gray threshold value; if the duty cycle of the pixels in the display screen region having a gray value greater than or equal to the average value is greater than the preset duty cycle, it may be determined that the preset gray threshold is greater than the average value and less than the greater of the first and second overall gray values.

For example, a plurality of spot-screened test images may be acquired consecutively, wherein different spot-screened test images correspond to different times of spot-screening operations. The display signals sent by the dot screen device to the display can be the same, and the dot screen device drives the display to display the same preset image. The above steps S123.1 to S123.4 may be performed for each of the dot screen images, and a plurality of preset gray-scale thresholds corresponding to the plurality of dot screen images, respectively, may be determined, and then an average value of the plurality of preset gray-scale thresholds may be used as a preset gray-scale threshold for actual detection,

the preset gray threshold determined by the scheme is more accurate, so that the accuracy of the dot screen detection can be ensured. Moreover, the execution logic is simple, so that the calculation cost of the scheme is low.

Fig. 2 shows a partial flowchart of a dot screen detection method of a dot screen device according to another embodiment of the present application. As shown in fig. 2, the step of determining the preset gray threshold may further include steps S123.5 to S123.9. The above-described schemes of step S123.1 to step S123.4 can be regarded as a scheme of preliminarily determining the initial gradation threshold value, for example. After the initial gray threshold is initially determined, the initial gray threshold can be adjusted and updated by adopting the following calibration and update steps so as to obtain a more reasonable and more accurate preset gray threshold.

And step 123.5, acquiring a screen-clicked test image of the display screen under the condition that the display screen is successfully clicked. Alternatively, the on-screen test image acquired in this step may be the same as the on-screen test image acquired in step S123.1. In other words, if the on-screen test image is acquired by step S123.1, this step may not be performed, and the on-screen image acquired by step S123.1 may be directly utilized. Alternatively, the on-screen test image acquired in this step may be different from the on-screen test image acquired in step S123.1. For example, after step S123.1, one or more dot screen operations may be performed on the normal display screen using the dot screen device, and in the case where it is manually determined that the dot screen is successful, an image of the display screen that is actually successfully lit may be acquired.

Step S123.6, determining the gray value of the pixel in the preset area of the spotted screen test image. The gray values of the individual pixels in the preset area may be determined by any suitable method.

Step S123.7, determining the lighting pixels in the preset area based on the gray values of the pixels in the preset area and the current preset gray threshold. The gray value of the lighting pixel is larger than the current preset gray threshold value. The implementation of this step is similar to the scheme of determining the lighting pixel in step S124, and will not be described here again.

Step 123.8, determining whether the screen is successfully clicked by the screen-clicking device according to the number of the lightened pixels, and if not, updating the current preset gray threshold. The implementation manner of determining whether the screen pointing device is successful is similar to step S128, and will not be described herein. If it is determined that the pointing device fails to point the screen, the method can

Step 123.9, the step of determining the lighted pixels in the preset area is performed according to the updated preset gray threshold until the point screen device is successfully lighted. I.e. step S123.7 and step S123.8 are executed again according to the updated preset gray threshold until the pointing of the pointing device is successful according to the determination.

It can be appreciated that, when the screen-on-screen test image of the display screen is acquired, the brightness of the test image is easily affected by many factors such as underexposure, overexposure, or brightness of the environment where the camera is located, so that the preset gray threshold set through the above steps S123.1 to S123.4 may be inaccurate under special conditions. Therefore, the calibration updating can be performed on the preset gray threshold by a verification method, so that a more accurate preset gray threshold is determined.

For simplicity, the specific implementation of the above steps will be described using the example that the preset image is a red-filled RGB image. The current preset gray threshold is, for example, 76.245, and the preset area is, for example, a rectangular area including 100 pixels at the center of the display screen area. For example, after the dot screen device transmits a display signal for displaying a preset image to the display screen, a test image of the display screen may be acquired. Then, the display screen area in the test image can be determined by image segmentation or the like, and the position of a rectangular area including 100 pixels in the center of the display screen area is determined. In step S123.6, the color data of each pixel within the rectangular region in the test image may be converted into a gray value using a gray conversion formula. Then, in step S123.7, the gray value of each pixel in the rectangular area may be compared with the current preset gray threshold 76.245, respectively, and it is determined that the lit pixel in the rectangular area has a gray value greater than 76.245.

In step S123.8, the number of lit pixels may be counted, and if the number is greater than or equal to a preset number threshold (e.g., 8500), it may be determined that the current pointing device is successful. And the verification is successful, so that the numerical value of the preset gray threshold value is reasonable. In this step, if the number of the turned-on pixels is less than 8500, it is indicated that the screen of the screen pointing device fails according to the current judgment result of the preset gray threshold. And the current test image is obtained under the condition that the screen is successfully fixed manually, so that the deviation between the verification result and the true value can be determined, namely the verification failure is determined. And the preset gray threshold value may be updated by a suitable updating method. In one example, the preset value may be reduced according to directly reducing the current preset gray threshold. The preset value can be a smaller value, and can be set arbitrarily according to actual requirements. For example, the preset value may be 5, i.e., the current preset gray threshold 76.245 may be subtracted by 5 to obtain the updated preset gray threshold 71.245. In another example, the preset gray threshold may also be adjusted according to camera exposure and ambient brightness. When the camera exposure and the ambient brightness are both high, the preset gray threshold is correspondingly increased. Otherwise, when the exposure degree of the camera and the ambient brightness are low, the preset gray threshold value is correspondingly reduced. When the exposure of the camera and the ambient brightness are high and low, the preset gray threshold value is flexibly adjusted.

In step S123.9, the updated preset gray threshold (for example, 71.245) may be taken as the current preset gray threshold, and step S123.7 may be performed to compare the gray value of each pixel in the rectangular area determined previously with the current preset gray threshold 71.245, and determine the lit pixel in the rectangular area having the gray value greater than 71.245. Continuing with step S123.8, the number of lit pixels in the rectangular area having gray values greater than 71.245 is counted and compared to a size of 8500. If the number is greater than 8500, 71.245 is determined to be a preset gray threshold for formal detection. Otherwise, the preset gray threshold is updated again, and the steps S123.7 and S123.8 and … … are executed according to the updated preset gray threshold

The scheme for verifying and updating the preset gray threshold value can enable the preset gray threshold value used for actual detection to be in the most reasonable numerical range, so that whether the screen is successfully lightened by the screen-lighting equipment can be judged more accurately in the detection process, and the screen-lighting detection precision of the screen-lighting equipment is further improved.

In some embodiments, the preset image is a color image. Illustratively, step S124 determines the illuminated pixels in the preset area, including steps S124a and S124b. Step S124a, converting the color data of each pixel in the color dotted image into a gray value. In step S124b, pixels in the preset region having a gray value greater than the preset gray threshold are determined as the lighting pixels.

The preset image is a color image, and the display screen may be a display capable of displaying color pixels, so that the dotted image may also be a color image. For example, the dot-screen image is an RGB image, color data of three channels of each pixel in a preset area of the dot-screen image may be acquired in step S124a, and then the color data of each pixel may be converted into a gray value using any suitable gray conversion method. In one example, a cross-platform computer vision and machine learning software library algorithm (OPENCV algorithm) may be utilized to directly convert a colored, dot-screen image into a grayscale image, and grayscale values for individual pixels within a preset region in the grayscale image may be obtained based on the position of the preset region in the dot-screen image. In another example, a three-dimensional array of luminance values of RGB three channels corresponding to each pixel in a preset area of the colored dotted screen image may be acquired, and then the three-dimensional array may be converted into a two-dimensional array of gray values of each pixel using any suitable gray value algorithm. For example, a weighted average method (Weighted Average Method) can be used to calculate the gray value of the pixel. The brightness contributions of different color channels to the image may be different, and the gray value may be determined by a weighted average. A common weighted average method is to set the weight of the red channel to 0.299, the green channel to 0.587, and the blue channel to 0.114. Specifically, the gray value of each pixel can be calculated using the following formula: gray=r×0.299+g×0.587+b×0.114. Wherein Gray is expressed as a Gray value of the pixel, R is a brightness value of the pixel in a red channel, G is a brightness value of the pixel in a green channel, and B is a brightness value of the pixel in a blue channel. For example, the Maximum value Method (Maximum Method) may be used to set the luminance value of the channel having the largest luminance value among the three RGB channels as the gradation value. Alternatively, the luminance value of the channel with the smallest luminance value among the three RGB channels may be used as the gradation value by a Minimum Method (Minimum Method). Alternatively, an Average Method (Average Method) may be used to Average the luminance values of the pixels in the three RGB channels as the gray values.

The scheme has small calculated amount, and the gray value of the pixel in the dotted screen image can be rapidly and accurately determined no matter what color mode image is displayed by the display screen. And the scheme for judging whether the display screen is successfully lightened by using the gray value has smaller calculated amount and is more accurate. Therefore, the application range of the scheme is wider, and the detection efficiency and the detection precision are also better.

Fig. 3 shows a flowchart of a dot screen detection method of a dot screen device according to another embodiment of the present application. As shown in fig. 3, one or more test images of a normal display screen may be acquired prior to the formal detection. The test image may be a collected test image including a display screen in a case where it is manually determined that the pointing device successfully lights the display screen. Then, the positions of the display screen area and the background area in each test image can be determined by adopting an image segmentation method. The display screen area is an imaging area of the display screen, and the background area is other areas than the display screen area. The test image may be a color RGB image, and the following gray-scale conversion formula may be used to determine the gray-scale value of each pixel in the test image: gray=r×0.299+g×0.587+b×0.114. And the gray values of the pixels in the display screen area can be obtained therefrom, and then the gray values of the pixels can be averaged to obtain a first overall gray value. And the gray values of the pixels in the background area can be obtained, and the gray values of the pixels can be averaged to obtain a second integral gray value. Then, an initial gray threshold may be calculated from the first and second integral gray values. The initial gray threshold may be any value between the first and second global gray values. By way of example and not limitation, the initial gray threshold may be an average of the first and second global gray values. Then, the initial gray threshold may be used as a current preset gray threshold, and the method from step S123.5 to step S123.9 is adopted to calibrate and update the initial gray threshold, and the updated preset gray threshold is determined. The preset gray threshold is, for example, 150. Then, detection may be started according to the updated preset gray threshold. And sequentially executing the screen pointing judgment operation for the preset times on the display screen by using the screen pointing equipment. Specifically, after each point of the screen, a first image of the display screen may be acquired using a camera disposed directly in front of the display screen. The first image may then be input into a trained image segmentation model, segmenting the display screen region in the first image. For example, the first image may be cropped according to the position of the display screen region, resulting in a clicked image including only the display screen region. Then, the gray value of each pixel in the current dot-screen image can be calculated according to the gray conversion formula, the gray value of each pixel in the rectangular area including 100 pixels of the center of the image in the dot-screen image is obtained, and the gray value of each pixel is compared with the preset gray threshold (for example, 150). And pixels in the rectangular region having a gray value greater than 150 may be determined as illuminated pixels. The number of lit pixels may then be counted and a determination may be made as to whether the current pointing device is successful in pointing the screen based on the number of lit pixels. Then, it can be judged whether the number of times of the accumulated screen judging operation up to the present reaches the preset number of times. The preset times are 100 times, if the preset times are less than 100 times, the screen pointing operation is performed on the display screen by using the screen pointing device again so as to perform the screen pointing judgment operation again. Until the number of the screen clicking judging operations reaches 100. The 100 times of screen-clicking judgment operation may then be counted as the first time of screen-clicking success. And may determine whether the first number is greater than a number threshold. Taking the first time number of 85 as an example, if the first time number is greater than 85, it can be determined that the stability of the dot screen is good. If the first number is less than or equal to 85, it may be determined that the dot screen stability is poor.

According to still another aspect of the present application, a dot screen detection system of a dot screen device is also provided. The system is used for detecting whether the point screen device lights up a normal display screen and displaying a preset image. Fig. 4 shows a schematic block diagram of a dot screen detection system 400 of a dot screen device according to one embodiment of the present application. As shown in fig. 4, the spot-screen detection system 400 includes an execution module 410 and a determination module 420.

The execution module 410 is configured to repeatedly execute the dot screen judging operation for a preset number of times. The screen pointing judging operation comprises the following steps: acquiring a clicked image, wherein the clicked image is an image of a display screen acquired after the display screen is clicked by using a point screen device; determining a lighting pixel in a preset area based on the gray value of each pixel in the preset area of the lighted screen image and a preset gray threshold value, wherein the gray value of the lighting pixel is larger than the preset gray threshold value; counting the number of the lighted pixels; based on the number of lit pixels, it is determined whether the pointing device successfully points the screen.

The determining module 420 is configured to determine, according to the preset number of screen pointing operations, a first number of successful screen pointing operations of the screen pointing device, and determine a screen pointing stability of the screen pointing device.

According to yet another aspect of the present application, an electronic device is also provided. Fig. 5 shows a schematic block diagram of an electronic device 500 according to one embodiment of the present application. As shown in fig. 5, the electronic device 500 includes a processor 510 and a memory 520. The memory 520 has stored therein computer program instructions that, when executed by the processor 510, are configured to perform the dot screen detection method 100 of the dot screen apparatus described above.

According to still another aspect of the present application, there is also provided a storage medium on which program instructions are stored, the program instructions being configured to execute the dot screen detection method of the dot screen device described above when executed. The storage medium may include, for example, a storage component of a tablet computer, a hard disk of a personal computer, read-only memory (ROM), erasable programmable read-only memory (EPROM), portable read-only memory (CD-ROM), USB memory, or any combination of the foregoing storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.

Those skilled in the art can understand the specific implementation and beneficial effects of the dot screen detection system 400, the electronic device 500, and the storage medium of the dot screen device by reading the above description about the dot screen detection method 100 of the dot screen device, and for brevity, the description is omitted here.

Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the above illustrative embodiments are merely illustrative and are not intended to limit the scope of the present application thereto. Various changes and modifications may be made therein by one of ordinary skill in the art without departing from the scope and spirit of the present application. All such changes and modifications are intended to be included within the scope of the present application as set forth in the appended claims.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, e.g., the division of the elements is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple elements or components may be combined or integrated into another device, or some features may be omitted or not performed.

In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the present application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in order to streamline the application and aid in understanding one or more of the various inventive aspects, various features of the application are sometimes grouped together in a single embodiment, figure, or description thereof in the description of exemplary embodiments of the application. However, the method of this application should not be construed to reflect the following intent: i.e., the claimed application requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this application.

It will be understood by those skilled in the art that all of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or units of any method or apparatus so disclosed, may be combined in any combination, except combinations where the features are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features but not others included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the present application and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that some or all of the functions of some of the modules in the dot screen detection system of the dot screen device according to the embodiments of the present application may be implemented in practice using a microprocessor or Digital Signal Processor (DSP). The present application may also be embodied as device programs (e.g., computer programs and computer program products) for performing part or all of the methods described herein. Such a program embodying the present application may be stored on a computer readable medium, or may have the form of one or more signals. Such signals may be downloaded from an internet website, provided on a carrier signal, or provided in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the application, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names.

The foregoing is merely illustrative of specific embodiments of the present application and the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes or substitutions are intended to be covered by the scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A dot screen detection method of dot screen equipment, for detecting whether the dot screen equipment lights up a normal display screen and displays a preset image, comprising the following steps:

repeatedly executing the screen pointing judgment operation for preset times; and

judging the first times of successful screen pointing of the screen pointing equipment according to the preset times of screen pointing, and determining the screen pointing stability of the screen pointing equipment;

the screen pointing judging operation comprises the following steps:

acquiring a spotted screen image, wherein the spotted screen image is an image of the display screen acquired after the display screen is spotted by using the spotting screen device;

determining a lighting pixel in a preset area based on a gray value of each pixel in the preset area of the spotted screen image and a preset gray threshold value, wherein the gray value of the lighting pixel is larger than the preset gray threshold value;

counting the number of the lighting pixels;

and determining whether the screen pointing device is successful in pointing a screen based on the number of the lighted pixels.

2. The dot screen detection method of the dot screen apparatus according to claim 1, wherein the preset image is a color image,

the determining the lighting pixels in the preset area includes:

Converting color data of each pixel in the colored dot screen image into a gray value;

and determining pixels in the preset area, the gray value of which is larger than the preset gray threshold value, as the lighting pixels.

3. The dot screen detection method of the dot screen device according to claim 1, wherein the method further comprises:

acquiring a first image of the display screen on which the preset image is displayed;

image segmentation is carried out on the first image so as to determine a position area of the display screen in the image, and the position area is used as a display screen area; and

and taking the image of the display screen area as the clicked image.

4. A dot screen detection method of a dot screen device according to claim 3, the method further comprising:

determining an area including an image center in the spotted screen image as the preset area;

the width of the preset area is smaller than the width of the spotted screen image, and the height of the preset area is smaller than the height of the spotted screen image.

5. The dot screen detection method of the dot screen apparatus according to any one of claims 1 to 4, wherein the method further comprises the step of determining the preset gray threshold value:

Under the condition that the display screen is successfully clicked, acquiring a clicked screen test image of the display screen;

image segmentation is carried out on the spot screen test image so as to determine a display screen area of a position area of the display screen in the image and a background area formed by all pixels positioned outside the display screen area;

determining a first overall gray value of pixels in the display screen region and determining a second overall gray value of pixels in the background region; and

and determining the preset gray threshold based on the first integral gray value and the second integral gray value, wherein the preset gray threshold is greater than or equal to the second integral gray value and less than or equal to the first integral gray value.

6. The dot screen detection method of the dot screen device according to claim 5, wherein the step of determining the preset gray threshold further comprises:

determining the gray value of pixels in the preset area of the spotted screen test image;

determining a lighting pixel in the preset area based on the gray value of the pixel in the preset area and a current preset gray threshold, wherein the pixel value of the lighting pixel is larger than the current preset gray threshold;

Determining whether the screen is successfully clicked by the screen-clicking equipment based on the number of the lighted pixels, if not, updating the current preset gray threshold;

and executing the step of determining the lighted pixels in the preset area according to the updated preset gray threshold value until the successful screen pointing of the screen pointing device is determined.

7. The dot screen detection method of the dot screen device according to any one of claims 1 to 4, wherein the determining whether the dot screen device successfully dot screens based on the number of the lit pixels comprises:

calculating the duty ratio of the lighted pixels in the preset area;

determining that the screen-dropping equipment fails in screen dropping under the condition that the duty ratio is smaller than a duty ratio threshold value; and

and under the condition that the duty ratio is greater than or equal to the duty ratio threshold value, determining that the screen pointing device succeeds in pointing the screen.

8. The dot screen detection method of the dot screen device according to any one of claims 1 to 4, wherein the determining dot screen stability of the dot screen device according to a first number of successful dot screens of the dot screen device comprises:

counting the first times of successful screen pointing of the screen pointing device determined in the screen pointing judging operation of the preset times;

And determining the screen pointing stability of the screen pointing device based on the first times and the preset times.

9. A dot screen detection system of dot screen device for detecting whether the dot screen device lights up a normal display screen and displays a preset image, comprising:

the execution module is used for repeatedly executing the screen pointing judgment operation for the preset times;

the determining module is used for determining the screen stability of the screen pointing device according to the first times of successful screen pointing of the screen pointing device according to the screen pointing of the preset times;

the screen pointing judging operation comprises the following steps:

counting the number of the lighting pixels;

10. An electronic device comprising a processor and a memory, wherein the memory has stored therein computer program instructions which, when executed by the processor, are adapted to carry out the dot screen detection method of the dot screen device according to any one of claims 1 to 8.

11. A storage medium having stored thereon program instructions for performing the dot screen detection method of the dot screen device according to any one of claims 1 to 8 when run.