CN114913649A

CN114913649A - Display state monitoring method, device, equipment and computer readable storage medium

Info

Publication number: CN114913649A
Application number: CN202110181373.3A
Authority: CN
Inventors: 张晓翼
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-02-09
Filing date: 2021-02-09
Publication date: 2022-08-16

Abstract

The application provides a display state monitoring method, a display state monitoring device, a display state monitoring equipment and a computer readable storage medium; the method comprises the following steps: when the display state monitoring opportunity is determined to be reached, size information of a current display image in a target display device is obtained; determining N random numbers based on the size information, wherein N and each random number are positive integers; determining M pieces of location information based on the N random numbers; acquiring M pixel values corresponding to the M position information in the current display image; and determining display state information of the target display device based on the M pixel values, and sending the display state information to a server. Through the method and the device, the quality monitoring capability of the device on the display device can be improved, and the black/white screen problem of the device under the line can be monitored on the line by an application party.

Description

Display state monitoring method, device, equipment and computer readable storage medium

Technical Field

The present disclosure relates to internet technologies, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for monitoring a display status.

Background

With the continuous development of internet technology and mobile terminal technology, mobile intelligent terminals have become essential items for people's life, study and work. Compare in traditional cash payment, pay by credit card, mobile terminal payment, pay by credit card not only can avoid forgetting to take cash or forgetting to take the card and cause unable payment, can also remove from and make change for it is convenient more, swift to purchase.

At present, for mobile payment or face brushing payment, a face brushing/code scanning device is required to collect faces or payment identification codes, the face brushing/code scanning device can be a single-screen device, and a screen faces a customer so that the customer can brush faces or scan codes; or may be a dual screen device where one display is facing the customer to enable the customer to swipe a face or swipe a code and the other display is facing the merchant to enable the merchant to confirm whether the payment was successful. The off-line face brushing/code scanning equipment has various use scenes, the environment and the equipment state are often difficult to monitor, the problem of black screen caused by a memory, a hardware layer, a system layer and a software layer causes frequent feedback of merchants, and in the related technology, whether the equipment is turned on or not can be judged only through screen turning broadcast of the system, but black and white screens cannot be detected in time.

Disclosure of Invention

The embodiment of the application provides a display state monitoring method and device and a computer readable storage medium, which can improve the quality monitoring capability of equipment on a display device of the equipment and enable an application party to monitor the black/white screen problem of offline equipment online.

The technical scheme of the embodiment of the application is realized as follows:

the embodiment of the application provides a display state monitoring method, which comprises the following steps:

when the display state monitoring opportunity is determined to be reached, size information of a current display image in a target display device is obtained;

determining N random numbers based on the size information, wherein N and each random number are positive integers;

determining M pieces of location information based on the N random numbers;

acquiring M pixel values corresponding to the M position information in the current display image;

and determining display state information of the target display device based on the M pixel values, and sending the display state information to a server.

receiving display state information sent by a terminal;

when the display state information comprises an abnormal state identifier, determining abnormal times within a second preset time length;

and when the abnormal times reach a first time threshold value, sending a restart instruction to the terminal.

The embodiment of the application provides a display state monitoring device, includes:

the first acquisition module is used for acquiring the size information of the current display image in the target display device when the display state monitoring opportunity is determined to be reached;

a first determining module, configured to determine N random numbers based on the size information, where N and each random number are positive integers;

a second determining module, configured to determine M pieces of location information based on the N random numbers;

the second acquisition module is used for acquiring M pixel values corresponding to the M position information in the current display image;

and the third determining module is used for determining the display state information of the target display device based on the M pixel values and sending the display state information to a server.

In some embodiments, the third determining module is further configured to:

determining whether the M pixel values are all preset values;

if the M pixel values are all preset values, determining that the display state is an abnormal state;

acquiring own equipment identification, current timestamp and target display device identification;

and determining the equipment identifier, the current timestamp, the target display device identifier, the abnormal state identifier and the preset value as the display state information.

In some embodiments, the third determining module is further configured to:

if the M pixel values are not the preset values, determining that the display state is a normal state;

acquiring a self equipment identifier, a current timestamp and a target display device identifier;

and determining the equipment identifier, the current timestamp, the target display device identifier and the normal state identifier as the display state information.

In some embodiments, the first determining module is further configured to:

determining a length and a width of a currently displayed image based on the size information;

determining the length as a first threshold value, and determining P random numbers which are less than or equal to the first threshold value, wherein P is a positive integer less than N;

the width is determined as a second threshold value, and (N-P) random numbers less than or equal to the second threshold value are determined.

In some embodiments, the second determining module is further configured to:

determining a plurality of first random numbers which are smaller than or equal to a first threshold value from the N random numbers, and determining the plurality of first random numbers as first candidate coordinate values in the length direction;

determining a plurality of second random numbers which are less than or equal to a second threshold value from the N random numbers, and determining the plurality of second random numbers as second candidate coordinate values in the width direction;

determining M pieces of position information based on the first candidate coordinate value and the second candidate coordinate value.

In some embodiments, the target display device comprises a first display device and a second display device, and a communication connection is established between the first display device and the second display device.

In some embodiments, the apparatus further comprises:

the restarting module is used for responding to a restarting instruction to restart when receiving the restarting instruction sent by the server;

and the exception resolution module is used for displaying exception resolution based on the exception handling information when receiving the exception reason and the exception handling information sent by the server.

the first receiving module is used for receiving display state information sent by a terminal;

the fourth determining module is used for determining the abnormal times within a second preset time length when the display state information comprises the abnormal state identification;

and the first sending module is used for sending a restarting instruction to the terminal when the abnormal times reach a first time threshold value.

In some embodiments, the apparatus further comprises:

the fourth obtaining module is used for obtaining a second time of sending the restart instruction to the terminal within a second preset time length;

a fifth obtaining module, configured to obtain an operation log of the terminal within a second preset duration when the second time reaches a second time threshold;

and the reason output module is used for determining an abnormal reason based on the operation log and outputting the abnormal reason.

In some embodiments, the apparatus further comprises:

a sixth obtaining module, configured to obtain exception handling information corresponding to the exception cause;

and the second sending module is used for sending the abnormal reason and the abnormal processing information to the terminal so that the terminal can solve the problem of display abnormality based on the abnormal processing.

An embodiment of the present application provides an apparatus, including:

a memory for storing executable instructions;

and the processor is used for realizing the method provided by the embodiment of the application when executing the executable instructions stored in the memory.

The embodiment of the present application provides a computer-readable storage medium, which stores executable instructions for causing a processor to implement the method provided by the embodiment of the present application when the processor executes the executable instructions.

The embodiment of the application has the following beneficial effects:

after a terminal is started, when the monitoring time of the display state is reached, acquiring the size information of a current display image in a target display device, determining N random numbers based on the size information, wherein N and each random number are positive integers, determining M position information based on the N random numbers, and further acquiring M pixel values corresponding to the M position information in the current display image, wherein the M position information is determined based on the N random numbers, so that the M position information can be regarded as a random position, after the pixel values of the M random positions are acquired, determining the display state information of the target display device based on the M pixel values, and sending the display state information to a server, so that the display state of the display device of the terminal can be monitored in time, and a data source for reference is provided for background data analysis, the capability of the terminal in monitoring the quality of the black and white screen is improved, and the whole quality of the equipment is improved.

Drawings

Fig. 1 is a schematic diagram of a network architecture of a display status monitoring system according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a terminal provided in an embodiment of the present application;

fig. 3 is a schematic flow chart of an implementation of a display status monitoring method according to an embodiment of the present application;

fig. 4 is a schematic flow chart illustrating an implementation process of determining display state information based on M pixel values according to an embodiment of the present application;

fig. 5 is a schematic flowchart of another implementation of the display status monitoring method according to the embodiment of the present application;

FIG. 6 is a schematic diagram of a dual screen device;

fig. 7 is a schematic flow chart of another implementation of the screen monitoring method according to the embodiment of the present application.

Detailed Description

In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without making creative efforts fall within the protection scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

In the following description, references to the terms "first \ second \ third" are only to distinguish similar objects and do not denote a particular order, but rather the terms "first \ second \ third" are used to interchange specific orders or sequences, where appropriate, so as to enable the embodiments of the application described herein to be practiced in other than the order shown or described herein.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.

Before further detailed description of the embodiments of the present application, terms and expressions referred to in the embodiments of the present application will be described, and the terms and expressions referred to in the embodiments of the present application will be used for the following explanation.

1) The internet Of Things (IOT, internet Of Things) is an information carrier such as the internet and a traditional telecommunication network, and all common objects capable Of performing independent functions are interconnected and intercommunicated.

2) The double-screen device can be used as a face brushing payment device.

3) Runnable, android provides an interface for encapsulating tasks, which is typically used to implement the task of thread creation, but sometimes is treated as a task that executes independently on the main thread.

4) Handler, Handler is the mechanism that leads to the developer to participate in the message loop in the processing thread that introduces in Android.

5) An Android Interface Definition Language (AIDL) is a description Language for defining Communication interfaces between a server and a client, can be used to generate codes for Inter-Process Communication (IPC), and is a technical means for Android to provide to upper developers.

6) Service (Service), an application component that can perform long-running operations in the background without a user interface. Services may be launched by other application components (e.g., Activity), which once launched will run all the way in the background, even if the component that launched the service (Activity) has been destroyed. Service has two categories: local Service and Remote Service, the Service corresponding to the Local Service is started in the main thread of the current process, and the Remote Service is started in the main thread of the independent process, and the dotting Service for cross-IPC scheduling of the front and back screen processes is basically the Remote Service.

7) The IPC refers to some technologies or methods for transmitting data or signals between at least two processes or threads, and in the embodiment of the application, the IPC refers to a cross-process component based on aid id encapsulation in Android.

8) Application, Android provides an Application class, and the system initializes the class automatically whenever an Application is started. In the project, a singleton mode is adopted in some tool classes, the life cycle of the singleton mode is the same as that of the whole application program, and the Context reference is required directly or indirectly to perform the operation of acquiring the resource. Then we need a global Context, i.e. Application.

9) The front screen process and the back screen process refer to corresponding processes of the front screen and the back screen based on the double-screen device, and the front screen process and the front screen are in one-to-one correspondence with the back screen process and the back screen.

The present invention provides a method, an apparatus, a device and a computer readable storage medium for monitoring a display status, which can detect abnormal situations of a black screen or a white screen in time. In the following, an exemplary application will be explained when the device is implemented as a terminal.

Referring to fig. 1, fig. 1 is a schematic diagram of a network architecture of a display status monitoring system 100 according to an embodiment of the present disclosure, and as shown in fig. 1, the network architecture includes a server 200, a network 300, and a terminal 400, where the terminal 400 may be a face brushing device, the terminal 400 includes one or more display devices, in fig. 1, the terminal 400 includes one display device 410, the network 300 may be a wide area network or a local area network, or a combination of the two, and the terminal 400 is connected to the server 200 through the network 300.

After the terminal 400 is started up and starts up the relevant application, the display screen also finishes starting up and displaying the image, when the display state monitoring opportunity is reached, the terminal acquires the pixel values of a plurality of pixel points in the current display image of the display device 410, determines the display state information of the display device 410 according to the pixel values, and after the display state information of the display device 410 is acquired, sends the display state information to the server 200, so that the server 200 can acquire and monitor the display state of the display device 410 in time and process the display state in time when the display is abnormal.

In some embodiments, the server 200 may be an independent physical server, may also be a server cluster or a distributed system formed by a plurality of physical servers, and may also be a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, and a big data and artificial intelligence platform. The terminal 400 may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a vehicle-mounted device, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, which is not limited in the embodiment of the present invention.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a terminal 400 provided in an embodiment of the present application, where the terminal 400 shown in fig. 2 includes: at least one processor 410, memory 450, at least one network interface 420, and a user interface 430. The various components in the terminal 400 are coupled together by a bus system 440. It is understood that the bus system 440 is used to enable communications among the components. The bus system 440 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 440 in FIG. 2.

The Processor 410 may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc., wherein the general purpose Processor may be a microprocessor or any conventional Processor, etc.

The user interface 430 includes one or more output devices 431, including one or more speakers and/or one or more visual displays, that enable the presentation of media content. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, and the like. Memory 450 optionally includes one or more storage devices physically located remote from processor 410.

The memory 450 includes either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read Only Memory (ROM), and the volatile Memory may be a Random Access Memory (RAM). The memory 450 described in embodiments herein is intended to comprise any suitable type of memory.

In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, as exemplified below.

An operating system 451, including system programs for handling various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and handling hardware-based tasks;

a network communication module 452 for communicating to other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: bluetooth, wireless compatibility authentication (WiFi), and Universal Serial Bus (USB), and the like;

a presentation module 453 for enabling presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 431 (e.g., a display screen, speakers, etc.) associated with user interface 430;

an input processing module 454 for detecting one or more user inputs or interactions from one of the one or more input devices 432 and translating the detected inputs or interactions.

In some embodiments, the apparatus provided in this embodiment may be implemented in software, and fig. 2 illustrates a display status monitoring apparatus 455 stored in the memory 450, which may be software in the form of programs and plug-ins, and includes the following software modules: the first obtaining module 4551, the first determining module 4552, the second determining module 4553, the second obtaining module 4554 and the third determining module 4555, which are logical and thus may be arbitrarily combined or further divided according to the functions implemented.

The functions of the respective modules will be explained below.

In other embodiments, the apparatus provided in the embodiments of the present Application may be implemented in hardware, and for example, the apparatus provided in the embodiments of the present Application may be a processor in the form of a hardware decoding processor, which is programmed to perform the display status monitoring method provided in the embodiments of the present Application, for example, the processor in the form of the hardware decoding processor may be one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), Field Programmable Gate Arrays (FPGAs), or other electronic components.

The display state monitoring method provided by the embodiment of the present application will be described in conjunction with exemplary applications and implementations of the terminal provided by the embodiment of the present application.

An embodiment of the present application provides a method for monitoring a display state, which is applied to a terminal shown in fig. 1, and referring to fig. 3, fig. 3 is a schematic flow chart of the method for monitoring a display state provided in the embodiment of the present application, and will be described with reference to steps shown in fig. 3.

Step S101, when the display state monitoring time is determined to be reached, size information of a current display image in the target display device is obtained.

In some embodiments, before step S101, it is first determined whether the display state monitoring opportunity is reached, and when the display state monitoring opportunity is reached, a time length threshold for performing display state monitoring may be set in advance, and when a time interval between the time length and the time when the display state monitoring is performed last reaches the time length threshold, it is determined that the display state monitoring opportunity is reached, and at this time, size information of the currently displayed image in the target display device is acquired. The terminal may be provided with one, two or more display devices, and in some embodiments, when the terminal has two display devices, the target display device includes a first display device and a second display device, and a communication connection is established between the first display device and the second display device. Step S101 may be implemented to respectively obtain size information of each currently displayed image in the first display device and the second display device, and in some embodiments, when the terminal has a plurality of display devices, step S101 may be implemented to obtain size information of one or more currently displayed images in the plurality of display devices. The size information may be a length and a width of the currently displayed image, and in this embodiment, the length and the width of the currently displayed image may be represented by the number of pixels in the length direction and the width direction, for example, the size information of the currently displayed image may be 960 × 360.

Step S102, based on the size information, determining N random numbers.

Here, N and each random number are positive integers. When the step S102 is implemented, N random numbers may be obtained by using the length and the width of the currently displayed image as threshold values, for example, when N is 100, the length is 960, and the width is 360, 70 random numbers smaller than or equal to 960 may be determined, and 30 random numbers smaller than or equal to 360 may be determined.

Step S103, determining M pieces of position information based on the N random numbers.

M may be a positive integer less than or equal to N, and the position information may include coordinates in the length direction and coordinates in the width direction. In implementation, in step S103, M random numbers smaller than or equal to the image length may be determined from the N random numbers as M coordinates in the length direction, M random numbers smaller than or equal to the image width may be determined as M coordinates in the width direction, and then M position information may be determined according to the M coordinates in the length direction and the M coordinates in the width direction.

Step S104, obtaining M pixel values corresponding to the M position information in the current display image.

Here, since the M pieces of position information are determined with the length and width as the constraint conditions, the M pieces of position information are determined to correspond to pixel points in the currently displayed image, and in this step, the corresponding M pixel values are determined based on the M pieces of position information.

Step S105, determining display state information of the target display device based on the M pixel values, and sending the display state information to a server.

Here, when the step S105 is implemented, it may be first determined whether all M pixel values are preset values, where the preset values may be 0 or 255, and when all M pixel values are preset values, it is considered that the entire screen of the display device is a preset value, that is, the display state is a black screen or a white screen at this time, and it is determined that the display device is abnormal at this time, then the terminal identifier, the target display device identifier, and the current timestamp are obtained, and the abnormal state, the terminal identifier, the target display device identifier, the current timestamp, and the preset value are determined as display state information and sent to the server, so that the server obtains the display state of the terminal; and when the M pixel values are not all preset values, the display device is considered to be in a normal display state, and at the moment, the normal state, the terminal identifier, the target display device identifier and the current timestamp are determined as display state information and are sent to the server.

In some embodiments, when the display device has an abnormal display, it is not necessarily a black screen or a white screen, and therefore, when step S105 is implemented, it may also be determined whether all of the M pixel values are the same, when all of the M pixel values are the same, the display device may be considered to be in an abnormal display state, and when all of the M pixel values are not the same, the display device may be determined to be in a normal display state.

In the display state monitoring method provided in the embodiment of the application, after the terminal is started, when the monitoring reaches the display state monitoring opportunity, size information of a current display image in a target display device is obtained, N random numbers are determined based on the size information, N and each random number are positive integers, M position information is determined based on the N random numbers, and M pixel values corresponding to the M position information in the current display image are further obtained, since the M position information is determined based on the N random numbers, the M position information can be regarded as a random position, after the pixel values of the M random positions are obtained, display state information of the target display device is determined based on the M pixel values, and the display state information is sent to the server, so that the display state of the display device of the terminal can be monitored in time, and a data source which can be used for reference is provided for data analysis of the background, the capability of the terminal for monitoring the quality of the black and white screen is improved, and the overall quality of the equipment is improved.

In the embodiment of the present application, since the terminal itself may have one display device, or may have two or more display devices, when the terminal has two or more display devices, step S101 may be implemented by the following steps:

in step S1011A, when it is determined that the display state monitoring timing is reached, each size information of the currently displayed image in each display device is acquired.

In the embodiment of the present application, when the terminal has two or more display devices, it may be that the respective size information of the currently displayed image of all the display devices is acquired.

Correspondingly, in subsequent steps S102 to S105, based on the respective size information, N random number position information corresponding to each display device is respectively determined, and the number of random numbers determined by the display devices of different sizes may be different, then based on the N random numbers of each display device, M position information is determined, further M pixel values corresponding to the M position information in the current display image of each display device are respectively obtained, based on the M pixel values of each display device, display state information of each display device is respectively determined, and each display state information is sent to the server, and after receiving each display state information, the server respectively determines whether the display state of each display device is normal.

In some embodiments, when the terminal has two or more display devices, the step S101 may be implemented by:

in step S1011B, at least one target display device is determined.

Here, at least one target display device may be preset, and for example, when the terminal has two display devices, a front screen and a rear screen, respectively, the front screen may be set as the target display device.

In some embodiments, the usage situation with multiple display devices may also determine at least one target display device, for example, a display device whose number of times of screen saving within a certain period of time in the usage process is less than a preset threshold number may be determined as the target display device.

In step S1012B, each size information of the currently displayed image of each target display device is acquired.

In the embodiment of step S1011B and step S1012B, when the terminal has two or more display devices, a part of the display devices may be determined as target display devices from the two or more display devices, and each size information of the currently displayed image of each determined target display device may be acquired, so that the display devices to be monitored may be selected according to actual needs, and the flexibility of monitoring the display state may be improved.

In some embodiments, step S102 shown in fig. 3, when implemented, may be implemented by:

step S1021, based on the size information, determining the length and width of the current display image.

Here, the size information may be in the form of length-width, and thus the multiplier in the size information may be determined as the length and the multiplicand as the width. For example, the size information is 720 × 360, the length of the currently displayed image is 720, and the width is 360.

Step S1022, determine the length as a first threshold, and determine P random numbers that are less than or equal to the first threshold.

Here, P is a positive integer less than N. Since the length and width of the currently displayed image are generally different, it may be longer than the width or wider than the length. After the length and the width of a current display image are determined, when N random numbers are selected by taking the length and the width as thresholds, if the N random numbers are determined by taking the smaller value of the length and the width as a single threshold, the determined N random numbers are all smaller than or equal to the smaller value, so that when M random positions are determined based on the random numbers, the M random positions are in a square with the smaller value as the side length, the range is smaller, if the N random numbers are determined by taking the larger value of the length and the width as the single threshold, the possibility that the N random numbers are all larger than the smaller value exists, and the determined M random positions exceed the range of the current display image, so that the corresponding pixel value cannot be obtained.

Based on this, in the embodiment of the present application, the length and the width may be respectively determined as a first threshold and a second threshold, then a random number with P being smaller than or equal to the first threshold is randomly selected, P is a positive integer smaller than N, a value of P may be set based on N, for example, N/2, and a value of P may also be determined based on N, the length, and the width, further, when the length is greater than the width, P may be N × 0.7, and when the length is smaller than the width, P may be N × 0.3.

In step S1023, the width is determined as a second threshold value, and (N-P) random numbers less than or equal to the second threshold value are determined.

Here, after the P random numbers are determined based on the first threshold value, the remaining (N-P) random numbers are determined with the width as the second threshold value.

In some embodiments, after step S1021, step S1022 and step S1023 may not be performed, and step S1022' and step S1023 may be performed: '

In step S1022', the smaller of the length and the width is determined as a first threshold, and the larger of the length and the width is determined as a second threshold.

For example, if the length is greater than the width, then the width is a first threshold and the length is a second threshold.

In step S1023', Q random numbers smaller than or equal to the first threshold value are determined, and (N-Q) random numbers larger than the first threshold value and smaller than or equal to the second threshold value are determined.

Here, in order to ensure that there are both random numbers smaller than a small value and random numbers larger than a small value and smaller than a large value among the N random numbers, Q random numbers smaller than or equal to a first threshold value are selected, and the remaining (N-Q) random numbers larger than the first threshold value and smaller than or equal to a second threshold value are selected.

By the above-described steps S1021 to S1023, or by the steps S1021 to S1023', N random numbers can be determined in length and width, and the N random numbers include both a numerical value smaller than a smaller value of the length and the width and a numerical value larger than the smaller value and smaller than or equal to the larger value, thereby ensuring that the positions determined based on the N random numbers can be dispersed in each position of the currently displayed image.

In some embodiments, the step S103 "determining M position information based on the N random numbers" shown in fig. 3 may be implemented by:

step S1031, determining a plurality of first random numbers that are less than or equal to a first threshold from the N random numbers, and determining the plurality of first random numbers as first candidate coordinate values in a length direction.

Here, assuming that N is 100, the length is 720, and the width is 360, where 100 of 100 random numbers smaller than or equal to 720 are determined as the first candidate coordinate values in the length direction.

Step S1032 determines a plurality of second random numbers smaller than or equal to a second threshold value from the N random numbers, and determines the plurality of second random numbers as second candidate coordinate values in the width direction.

Taking the above example as a support, if there are 60 random numbers of less than or equal to 360 out of 100 random numbers, these 60 random numbers are determined as the second candidate coordinate values in the width direction.

In step S1033, M pieces of position information are determined based on the plurality of first candidate coordinate values and the plurality of second candidate coordinate values.

Here, assuming that there are a first candidate coordinate values and B second candidate coordinate values, a × B coordinates may be formed altogether, for example, 100 a and 60B coordinates may be formed into 6000 coordinates, and therefore after a plurality of first candidate coordinate values and a plurality of second candidate coordinate values are determined, M pieces of position information may be randomly determined from the plurality of first candidate coordinate values and the plurality of second candidate coordinate values.

Based on the above steps S1031 to S1033, M random position information may be determined by the determined N random numbers, so that the corresponding pixel values are determined based on the M random position information, thereby ensuring that the pixel values are randomly obtained, and further improving the accuracy of the display state.

In some embodiments, the "determining the display state information of the target display device based on the M pixel values" in step S105 shown in fig. 3 may be implemented by steps S1051 to S1057 shown in fig. 4, and the steps are explained below with reference to fig. 4.

Step S1051, determining whether the M pixel values are all preset values.

Here, the preset value may be 0 or 255, and in some embodiments, the preset value may be 0 and 255, that is, when the step S1051 is implemented, it may be determined whether all of the M pixel values are 0, and when all of the M pixel values are not 0, it may be determined whether all of the M pixel values are 255. When the M pixel values are all preset values, the process proceeds to step S1052; when the M pixel values are not equal to the preset values, the process proceeds to step S1055.

In step S1052, the display state is determined to be an abnormal state.

Here, since the M pieces of position information are determined by random numbers, the M pieces of pixel values should generally be different, and when the M pieces of pixel values are all preset values, it is considered that the pixel values of all the pixel points of the current display device are all preset values, that is, an abnormal display state is present.

Step S1053, acquiring the device identifier, the current timestamp, and the target display apparatus identifier of the device.

Here, in order to enable the server to comprehensively grasp the device information and the display apparatus information of the terminal, in step S1053, it is necessary to acquire a device identifier of itself, a current timestamp, and a target display apparatus identifier, where the device identifier of itself may be a device serial number, the current timestamp is a time for determining a display abnormal state, and the target display apparatus identifier may be a device serial number of the target display apparatus, or may be a front screen or a rear screen identifier.

Step S1054, determining the device identifier, the current timestamp, the target display apparatus identifier, the abnormal state identifier, and the preset value as the display state information.

When the display state is an abnormal state, not only the device identifier, the current timestamp, the target display apparatus identifier, and the abnormal state identifier need to be included as part of the display state information, but also a preset value needs to be included in the display state information so that the server can determine specific abnormal information.

In step S1055, it is determined that the display state is the normal state.

If the M pixel values are not all preset values, it is determined that the M pixel values are not the same, and therefore the display state at this time can be considered as a normal state.

Step S1056, acquiring the device identifier, the current timestamp, and the target display apparatus identifier of the mobile terminal.

Step S1057, determining the device identifier, the current timestamp, the target display apparatus identifier, and the normal state identifier as the display state information.

When the display state is the normal state, only the device identifier, the current timestamp, the target display apparatus identifier, and the normal state identifier need to be used as the display state information, and each pixel value does not need to be included in the display state information, so as to reduce the data transmission amount.

Through the steps S1051 to S1057, whether the display state of the target display device is normal or not can be determined based on whether the M pixel values are preset values or not, or whether the M pixel values are the same values, and the display state information can be determined, so as to provide an accurate data source for the data analysis of the background.

Based on the foregoing embodiments, an embodiment of the present application further provides a display status monitoring method, which is applied to the network architecture shown in fig. 1, and fig. 5 is a schematic diagram of another implementation flow of the display status monitoring method provided in the embodiment of the present application, where as shown in fig. 5, the flow includes:

step S501, the terminal is started, the display screen is started, and the related application is started.

Here, after the terminal is started, the display screens may be synchronously started, and when the terminal system is started, the related application may be started, for example, when the terminal system is an installation system, the related android application may be started.

Step S502, the terminal judges whether the display state monitoring opportunity is reached.

Here, when it is determined that the display state monitoring timing is reached, the flow proceeds to step S503; when it is determined that the display state monitoring timing has not been reached, the process returns to step S502.

In step S503, the terminal acquires size information of the currently displayed image in the target display device.

Here, the size information of the current display image may be the number of pixels in the length of the current display image by the number of pixels in the width of the current display image, and may be 720 × 360, for example.

In step S504, the terminal determines N random numbers based on the size information of the currently displayed image, respectively.

Here, N and each random number are positive integers, and each random number is smaller than or equal to the length or width of the currently displayed image.

And step S505, the terminal determines M pieces of position information based on the N random numbers.

In implementation, a plurality of first candidate coordinate values smaller than or equal to the length are determined from the N random numbers, a plurality of second candidate coordinate values smaller than or equal to the width are determined, and M pieces of position information are determined by using the plurality of first candidate coordinate values and the plurality of second candidate coordinate values, where M is a positive integer, and M may be smaller than or smaller than N, or may be larger than N.

Step S506, the terminal acquires M pixel values corresponding to the M position information in the current display image.

In step S507, the terminal determines display state information of the target display device based on the M pixel values.

Here, step S507 may be implemented by determining whether all of the M pixel values are preset values, determining that the display state of the display apparatus is an abnormal state when all of the M pixel values are preset values, and determining that the display state of the display apparatus is a normal state when all of the M pixel values are not preset values.

In some embodiments, when the step S507 is implemented, it may be to determine whether the M pixel values are all the same, since the M pixel values are randomly obtained, the M pixel values should be different in general, and when the M pixel values are all the same, it is determined that the display state of the target display device is an abnormal state; when the M pixel values are not all the same, the display state of the target display device is determined to be a normal state.

The device identifier, the current timestamp, the target display apparatus identifier, and the normal state identifier may be determined as display state information when the display state of the target display apparatus is the normal state, and the device identifier, the current timestamp, the target display apparatus identifier, the preset value, and the abnormal state identifier may be determined as display state information when the display state of the target display apparatus is the abnormal state.

And step S508, the terminal sends the display state information to a server.

In step S509, the server determines whether the received display state information includes an abnormal state flag.

Here, when the display state information received by the server includes the abnormal state flag, the process proceeds to step S510, and when the display state information received by the server does not include the abnormal state flag, the process returns to step S509 again.

In step S510, the server determines the number of abnormal times of the target display device within a first preset time period.

The first preset time period is a preset interval time period, and may be, for example, 30 minutes, 15 minutes, or the like. When determining that the number of times of abnormality of the display device within the first preset time period is implemented, the number of the abnormal state identifiers included in the display state information of the display device received within the first time period may be determined.

In step S511, the server determines whether the number of abnormal times reaches a first time threshold.

Here, the first-order threshold value is set in advance, and may be, for example, 10 times, 5 times, or the like. When the abnormal times reach the first time threshold, it indicates that the display state is frequently abnormal within a first preset time, and then step S512 is performed; when the number of abnormal times is smaller than the first time threshold, the process returns to step S509 to continue the monitoring.

And step S512, the server sends a restart instruction to the terminal.

Here, when a display abnormality frequently occurs on the display screen of the terminal for a certain time, the server transmits a restart instruction to the terminal to determine whether the problem of the display abnormality can be solved by the restart.

Step S513, the terminal receives the restart instruction sent by the server, and restarts in response to the restart instruction.

Here, after the terminal is restarted, the display device, the system application, the face-brushing payment application, and the like are restarted.

Step S514, the server obtains a second number of times of sending the restart instruction to the terminal within a second preset duration.

Here, the second preset time period is also a preset interval time period, and the second preset time period is generally longer than the first preset time period, for example, the second preset time period may be 12 hours, 8 hours, and the like.

Step S515, when the second time reaches the second time threshold, the server obtains an operation log of the terminal within a second preset time.

In some embodiments, after step S514, the server determines whether the second time reaches a second time threshold, and when the second time reaches the second time threshold, it indicates that the terminal has performed multiple restarts within a second preset time period, at this time, step S515 is entered, and when the second time does not reach the second time threshold, step S509 is returned to continue monitoring.

In step S516, the server determines an abnormal cause based on the operation log, and outputs the abnormal cause.

Here, when step S516 is implemented, the server may analyze the operation log, determine an abnormal keyword in the operation log to determine an abnormal reason, and output the abnormal reason, where the output of the abnormal reason may be sending the abnormal reason to a terminal of an operation and maintenance manager. In some embodiments, when the server cannot determine the abnormal reason based on the operation log, the operation log within a second preset time length is output, so that the operation log is analyzed by an operation and maintenance manager to determine the abnormal reason.

And step S517, the server acquires the exception handling information corresponding to the exception reason.

Here, after the server determines the abnormal cause, the server may further determine the abnormal processing information corresponding to the abnormal cause by itself, and if the server cannot determine the abnormal processing information corresponding to the abnormal cause, the server may send an abnormal resolution request to the operation and maintenance terminal to obtain the abnormal processing information corresponding to the abnormal cause.

Step S518, the server sends the exception cause and the exception handling information to the terminal, so that the terminal solves the display exception problem based on the exception handling.

In step S519, when the terminal receives the abnormality cause and the abnormality processing information sent by the server, the display abnormality is resolved based on the abnormality processing information.

In the display state monitoring method provided in the embodiment of the application, after the terminal is started, when the monitoring reaches the display state monitoring opportunity, size information of a current display image in a target display device is obtained, N random numbers are determined based on the size information, N and each random number are positive integers, M position information is determined based on the N random numbers, and M pixel values corresponding to the M position information in the current display image are further obtained, since the M position information is determined based on the N random numbers, the M position information can be regarded as a random position, after the pixel values of the M random positions are obtained, display state information of the target display device is determined based on the M pixel values, and the display state information is sent to the server, so that the display state of the display device of the terminal can be monitored in time, the method comprises the steps that the capacity of a terminal for monitoring the quality of a black and white screen is improved, a data source which can be referred to is provided for data analysis of a background, when the server obtains display state information sent by the terminal, the abnormal times within a first preset time length are obtained, if the abnormal times reach a first time threshold value, a restart instruction is sent to the terminal, a second time that the restart instruction is sent to the terminal within a second time length is determined, if the second time reaches a second time threshold value, an abnormal reason and abnormal processing information are determined, and the abnormal reason and the abnormal processing information are sent to the terminal, so that the terminal can perform abnormal solution based on the abnormal processing information, and the whole quality of equipment can be improved.

Next, an exemplary application of the embodiment of the present application in a practical application scenario will be described.

In the embodiment of the present application, a screen monitoring method is applied to a dual-screen device shown in fig. 6 as an example for description, and fig. 7 is a schematic diagram of another implementation flow of the screen monitoring method provided in the embodiment of the present application, as shown in fig. 7, the flow includes:

and step S701, starting the IOT double-screen equipment, starting the android Application and starting Application.

In step S702, the Application executes onCreate (), and starts Remote Service in onCreate ().

And step S703, the Remote Service can execute the recyclable Service of the designated task once at an interval of 30S by using the Handler of the android, and execute the IPC cross-process task once at an interval of 30S.

In the embodiment of the application, the task of the IPC cross-process comprises the following steps when in implementation:

step S7031, the process distributes the task.

Here, the front screen process is notified to execute the dotting task, and the back screen process is notified to execute the dotting task.

Step S7032, the front screen process schedules Runable.

And step S7033, scheduling Runable by the back screen process.

Step S7034, a hash point of the current screen is acquired.

Here, the hash point of the current screen may be obtained by obtaining a preset number of coordinate points on the current screen at random. In implementation, the object of the windows manager WindowManager at present may be obtained first, then the object Display of the current screen is obtained through the WindowManager object, the width and height of the current screen are obtained through getWidth () and getHeight () methods of the Display, 100 Random numbers are generated respectively based on the width and height of the screen by using Random classes of android, and then 100 coordinates are synthesized by using the 100 Random numbers.

And step S7035, the hash points are obtained to obtain the corresponding color values.

During implementation, a screen can be projected into the ImageReader by using a projection function provided by an Android system, a Bitmap is obtained through the ImageReader, and a getPixel (x, y) method of the Bitmap is called to obtain the color values corresponding to the 100 coordinates.

And step S7036, comparing the traversal color value with the black/white 16 scale system.

Taking the above example, the 100 coordinate color RGB values are stored in an array, and then the array is traversed, if all the RGB values in the array are all the black/white 16-ary numbers, which indicates that the color of the current screen is most likely to be black/white, at this time, the color of the current screen can be regarded as black/white.

And step S7037, reporting by a buried point.

If the current screen is judged to be completely black/white in the dotting task, the current color value is reported to the background by embedding the current equipment information (equipment number, timestamp, front screen or back screen, current screen color value) together with the current color value, a black-and-white screen monitoring process is completed, and black-and-white screen information is provided for the background IOT double-screen equipment; and if the current screen is determined to be not all black or white in the dotting task, reporting the current color value to the background through the buried points.

In the embodiment of the application, a black-and-white screen monitoring scheme based on the IOT double-screen device is provided by combining multiple possible sources causing the black screen problem with the structural characteristics of the double-screen device, an applicator can be helped to establish a set of black-and-white screen monitoring scheme applicable to the IOT double-screen device, useful information is uploaded through a log uploading system, a data source which can be used for reference is provided for data analysis of a background, the IOT double-screen black-and-white screen quality monitoring capability is improved, and the overall quality and business public praise of the IOT double-screen device are improved.

Continuing with the exemplary structure of the display status monitoring apparatus 455 provided in the embodiments of the present application implemented as software modules, in some embodiments, as shown in fig. 2, the software modules stored in the display status monitoring apparatus 455 of the memory 440 may include:

a first obtaining module 4551, configured to obtain size information of a currently displayed image in a target display apparatus when it is determined that the display state monitoring opportunity is reached;

a first determining module 4552, configured to determine, based on the size information, N random numbers, where N and each random number are positive integers;

a second determining module 4553, configured to determine M pieces of location information based on the N random numbers;

a second obtaining module 4554, configured to obtain M pixel values corresponding to the M position information in the current display image;

a third determining module 4555, configured to determine display state information of the target display apparatus based on the M pixel values, and send the display state information to a server.

In some embodiments, the third determining module is further configured to:

determining whether the M pixel values are all preset values;

In some embodiments, the third determining module is further configured to:

if the M pixel values are not equal to the preset values, determining that the display state is a normal state;

In some embodiments, the first determining module is further configured to:

determining a length and a width of the currently displayed image based on the size information;

In some embodiments, the second determining module is further configured to:

In some embodiments, the apparatus further comprises:

the restarting module is used for responding to a restarting instruction to restart when the restarting instruction sent by the server is received;

Here, it should be noted that: the above description of the embodiment of the condition monitoring device is similar to the above description of the method and has the same advantageous effects as the embodiment of the method. For technical details not disclosed in the embodiments of the state monitoring device presented in the present application, a person skilled in the art shall refer to the description of the embodiments of the method of the present application for understanding.

The embodiment of the present application provides a display status monitoring apparatus, where the display status monitoring apparatus may be stored in a memory in a server, and a software module in the display status monitoring apparatus may include:

the fourth determining module is used for determining the abnormal times within a second preset time length when the display state information comprises an abnormal state identifier;

In some embodiments, the apparatus further comprises:

the fifth obtaining module is used for obtaining the running log of the terminal within a second preset time length when the second time reaches a second time threshold;

In some embodiments, the apparatus further comprises:

Here, it should be noted that: the above description of the embodiment of the condition monitoring device is similar to the above description of the method and has the same advantageous effects as the embodiment of the method. For technical details not disclosed in the embodiments of the present status monitoring device, those skilled in the art should understand that they refer to the description of the embodiments of the method of the present application.

Embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and executes the computer instructions, so that the computer device executes the display state monitoring method according to the embodiment of the present application.

Embodiments of the present application provide a computer-readable storage medium having stored therein executable instructions that, when executed by a processor, cause the processor to perform a method provided by embodiments of the present application, for example, the method as illustrated in fig. 3, 4 and 5.

In some embodiments, the computer-readable storage medium may be memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

In some embodiments, the executable instructions may be in the form of a program, software module, script, or code written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and it may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

By way of example, executable instructions may, but need not, correspond to files in a file system, and may be stored in a portion of a file that holds other programs or data, such as in one or more scripts in a hypertext Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code).

By way of example, executable instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network.

The above description is only an example of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A display status monitoring method, comprising:

determining M pieces of position information based on the N random numbers, wherein M is a positive integer;

2. The method of claim 1, wherein said determining display state information for said target display device based on said M pixel values comprises:

determining whether the M pixel values are all preset values;

3. The method of claim 2, wherein said determining display state information of said target display device based on said M pixel values comprises:

4. The method of claim 1, wherein said determining N random numbers based on said size information comprises:

5. The method of claim 4, wherein determining M location information based on the N random numbers comprises:

6. The method according to any one of claims 1 to 5, wherein the target display device comprises a first display device and a second display device, and a communication connection is established between the first display device and the second display device.

7. The method according to any one of claims 1 to 5, further comprising:

when a restarting instruction sent by a server is received, responding to the restarting instruction to restart;

and when receiving the abnormal reason and the abnormal processing information sent by the server, performing display abnormal resolution based on the abnormal processing information.

8. A display status monitoring method, the method comprising:

receiving display state information sent by a terminal;

when the display state information comprises an abnormal state identifier, determining abnormal times within a first preset time length;

9. The method as claimed in claim 8, further comprising:

acquiring a second time of sending a restart instruction to the terminal within a second preset time length;

when the second time reaches a second time threshold value, acquiring an operation log of the terminal within a second preset time length;

and determining an abnormal reason based on the operation log, and outputting the abnormal reason.

10. The method of claim 9, further comprising:

acquiring exception handling information corresponding to the exception reason;

and sending the abnormal reason and the abnormal processing information to the terminal so that the terminal can solve the problem of display abnormality based on the abnormal processing.

11. A display condition monitoring apparatus, comprising:

12. A display status monitoring apparatus, comprising:

13. A display condition monitoring apparatus, comprising:

a memory for storing executable instructions;

a processor for implementing the method of any one of claims 1 to 7 or any one of claims 8 to 10 when executing executable instructions stored in the memory.

14. A computer-readable storage medium having stored thereon executable instructions for, when executed by a processor, implementing the method of any one of claims 1 to 7 or any one of claims 8 to 10.