CN111400134A - Method and system for determining abnormal playing of target display terminal - Google Patents
Method and system for determining abnormal playing of target display terminal Download PDFInfo
- Publication number
- CN111400134A CN111400134A CN202010165372.5A CN202010165372A CN111400134A CN 111400134 A CN111400134 A CN 111400134A CN 202010165372 A CN202010165372 A CN 202010165372A CN 111400134 A CN111400134 A CN 111400134A
- Authority
- CN
- China
- Prior art keywords
- display terminal
- target display
- screen capture
- screen
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3041—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is an input/output interface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method and a system for determining abnormal playing of a target display terminal, which relate to the technical field of image processing, and the method comprises the following steps: the target display terminal carries out screen capture to obtain a screen capture picture; the target display terminal sends the screen capture picture to a server; and the server identifies the screenshot picture, and if the identification result meets a preset condition, the target display terminal is determined to be abnormally played. The method and the system for determining the abnormal playing of the target display terminal can monitor whether the target display terminal is abnormal in playing.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a method and a system for determining abnormal playing of a target display terminal.
Background
At present, in areas such as a media fusion center, a hall, a corridor, an elevator room, an office and the like, a lot of display terminals are arranged for media fusion data display, enterprise image display, operation data display, enterprise live broadcast and the like.
However, sometimes, a display terminal arranged in the system is abnormal in playing or has a fault, and in such a case, generally, only relevant personnel can make an after-sale call to notify the after-sale personnel to perform maintenance. To a certain extent, inconvenience is brought to enterprises and public institutions for installing the display terminal, and user experience is affected.
Disclosure of Invention
The invention provides a method and a system for determining abnormal playing of a target display terminal, which can monitor whether the target display terminal is abnormal in playing.
In order to solve the above technical problem, an embodiment of the present invention provides the following technical solutions:
in a first aspect, an embodiment of the present invention provides a method for determining abnormal playing of a target display terminal, where the method includes the following steps:
the target display terminal carries out screen capture to obtain a screen capture picture;
the target display terminal sends the screen capture picture to a server;
and the server identifies the screenshot picture, and if the identification result meets a preset condition, the target display terminal is determined to be abnormally played.
Preferably, the server identifies the screenshot picture, and if the identification result meets a preset condition, it is determined that the target display terminal is abnormally played, specifically: and if the identification result is any one of a black screen, a white screen, characters containing 'stop work' and 'no response', determining that the target display terminal is abnormal in playing.
Preferably, if the recognition result is any one of a black screen, a white screen, a text containing "stop work" and a text containing "no response", specifically: and if the number of the black color value pixel blocks in the screen capture picture is the largest, determining the screen capture picture as a black screen, if the number of the white color value pixel blocks in the screen capture picture is the largest, determining the screen capture picture as a white screen, extracting characters in the screen capture picture based on an OCR technology, and determining whether the characters contain 'stop work' or 'no response'.
Preferably, the target display terminal performs screen capture to obtain a screen capture picture, specifically: and the target display terminal automatically performs screen capture at a preset frequency or receives a screen capture instruction sent by the server to perform screen capture, and a screen capture picture is obtained.
Preferably, the target display terminal performs screen capture to obtain a screen capture picture, specifically: the target display terminal executes a screen capture function takescreen shot (), creates a character string of screen capture p, and executes screen capture operation by calling Shell Utilis.
Preferably, the method further comprises the steps of: and the target display terminal creates a local absolute path and stores the acquired screen capture picture under the local absolute path.
Preferably, the method further comprises the steps of: and the target display terminal performs quality compression on the acquired screenshot picture and stores the compressed screenshot picture in the local absolute path.
Preferably, the method further comprises the steps of: and the server receives the encrypted screen capturing instruction sent by the mobile terminal, decrypts the encrypted screen capturing instruction, and sends the decrypted screen capturing instruction to the target display terminal.
In a second aspect, an embodiment of the present invention provides a system for determining abnormal playing of a target display terminal, including: a target display terminal and a server, wherein,
the target display terminal is used for capturing a screen, acquiring a screen capture picture and sending the screen capture picture to the server;
and the server is used for identifying the screenshot picture, and if the identification result meets a preset condition, determining that the target display terminal is abnormal in playing.
Preferably, the server is specifically configured to determine that the target display terminal is abnormally played if the identification result of the screenshot picture is any one of a black screen, a white screen, a text containing "stop work" and a text without response.
By adopting the technical scheme, the screen capture is carried out through the target display terminal, the screen capture picture is obtained and sent to the server, the screen capture picture is identified through the server, and when the identification result meets the preset condition, the abnormal playing of the target display terminal is determined, so that the monitoring of whether the playing of the target display terminal is normal or not can be realized, the manual monitoring is omitted, and the user experience is improved.
Drawings
Fig. 1 is a flowchart of a method for determining abnormal playing of a target display terminal according to an embodiment of the present invention;
fig. 2 is a block diagram of a system for determining abnormal play of a target display terminal according to an embodiment of the present invention.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings. It should be noted that the description of the embodiments is provided to help understanding of the present invention, but the present invention is not limited thereto. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present application, "a plurality" means two or more unless otherwise specified.
In a first aspect, an embodiment of the present invention provides a method for determining that a target display terminal is abnormally played, as shown in fig. 1, including the following steps:
s101, a target display terminal captures a screen to obtain a screen capture picture;
and the target display terminal can perform screen capture in the operation process, and acquires the current screen capture picture through screen capture operation. The screen shot picture can show the current operation condition of the target display terminal.
Wherein, target display terminal includes display screen and intelligent box.
The display screen can be arranged in the areas such as a media fusion center, a hall, a corridor, an elevator room and an office and is used for scenes such as media fusion data display, enterprise image display, operation data display and enterprise live broadcast.
The intelligent box supports mixed carousel and timed broadcasting of various materials of played video (mp4, mov), pictures, H5 webpage, live streaming (multicast UDP, M3u 8). The intelligent box has data processing capability.
In the target display terminal, screen capture is specifically performed through the intelligent box, and a screen capture picture is obtained.
S102, the target display terminal sends the screenshot picture to a server;
the target display terminal is in communication connection with the server, and communication can be achieved in a wireless mode, such as wifi and 4G.
And S103, identifying the screenshot picture by the server, and determining that the target display terminal is abnormal in playing if the identification result meets a preset condition.
And the server performs image recognition on the screenshot picture, and determines that the target display terminal is abnormal in playing when the obtained image recognition result meets a preset condition.
By adopting the technical scheme, the screen capture is carried out through the target display terminal, the screen capture picture is obtained and sent to the server, the screen capture picture is identified through the server, and when the identification result meets the preset condition, the abnormal playing of the target display terminal is determined, so that the monitoring of whether the playing of the target display terminal is normal or not can be realized, the manual monitoring is omitted, and the user experience is improved.
As a preferred embodiment, in step S103: the server identifies the screenshot picture, and if the identification result meets a preset condition, the target display terminal is determined to be abnormal in playing, specifically: and if the identification result is any one of a black screen, a white screen, characters containing 'stop work' and 'no response', determining that the target display terminal is abnormal in playing.
If the server performs image processing on the screen capture picture, and the obtained recognition result is any one of 4 conditions, namely a black screen, a white screen, and characters containing 'stop work' and 'no response', the current playing state of the target display terminal can be determined to be abnormal playing.
Preferably, if the recognition result is any one of a black screen, a white screen, a text containing "stop work" and a text containing "no response", specifically: and if the number of the black color value pixel blocks in the screen capture picture is the largest, determining the screen capture picture as a black screen, and if the number of the white color value pixel blocks in the screen capture picture is the largest, determining the screen capture picture as a white screen, extracting characters in the screen capture picture based on an OCR technology, and determining whether the characters contain 'stop work' or 'no response'.
The ocr (optical character recognition) character recognition technology can acquire characters and layout information by analyzing and processing image files. In the application, the text information in the screenshot picture can be extracted through an OCR technology. Then, whether the information contains characters such as 'stop work' or 'no response' is judged. If yes, the current playing state of the target display terminal is abnormal.
Specifically, by developing the GD graphics of the language itself, the program detects the color values of the picture, calculates the color values of the largest number of pixel blocks in the captured picture, and determines the picture to be a black screen if the number of pixel blocks of the #000000 color number is the largest, and determines the picture to be a white screen if the number of pixel blocks of the # FFFFFF color number is the largest. And extracting the text information in the screenshot picture, and if the text information comprises 'stop work' or 'no response', determining that the playing state of the target display terminal is abnormal.
Preferably, in step S101: the target display terminal performs screen capture to obtain a screen capture picture, and the method specifically comprises the following steps: and the target display terminal automatically performs screen capture at a preset frequency or receives a screen capture instruction sent by the server to perform screen capture, and a screen capture picture is obtained.
Such as: the target display terminal can automatically execute screen capture operation every 10 minutes and upload the screen capture picture to the server.
The frequency of screen capturing may be set according to specific requirements of a user, which is not specifically limited in this application.
In addition, the target display terminal can also receive a screen capturing instruction sent by the server to capture the screen and acquire the screen capturing picture.
As a preferred embodiment, in step S101: the target display terminal performs screen capture to obtain a screen capture picture, and the method specifically comprises the following steps: the target display terminal executes a screen capture function takeScreen shot (), creates a character string of screen capture-p, and executes screen capture operation by calling Shell Utilis.
As a preferred embodiment, the method further comprises the steps of: and the target display terminal creates a local absolute path and stores the acquired screen capture picture in the local absolute path. Thereby realizing the local storage of the screen shot pictures.
As a preferred embodiment, the method further comprises the steps of: and the target display terminal performs quality compression on the acquired screenshot picture and stores the compressed screenshot picture in a local absolute path. Therefore, the occupied space of the screen capture picture can be reduced, and the data transmission is more convenient.
As a preferred embodiment, the method further comprises the steps of: the server receives the encrypted screen capturing instruction sent by the mobile terminal, decrypts the encrypted screen capturing instruction, and sends the decrypted screen capturing instruction to the target display terminal.
The mobile terminal can be a mobile phone, a PAD, and the like.
Specifically, an APP can be installed on the mobile terminal, a screen capture instruction is triggered through the APP, an encrypted screen capture instruction is sent through the websocket, the screen capture instruction is forwarded to an intelligent box of the target display terminal through the server, the screen capture instruction is decrypted through the intelligent box, and then a screen capture method takescreen shot () is executed.
In addition, a screen capturing instruction can be triggered through a remote controller equipped in the target display terminal, so that the intelligent box in the target display terminal executes screen capturing operation.
In addition, after the abnormal playing of the target display terminal is confirmed, the system can automatically send a command to solve the problem. If the system fails to automatically solve the abnormity, the system can push and remind related organization personnel for manual processing.
In a second aspect, an embodiment of the present invention provides a system for determining abnormal playing of a target display terminal, as shown in fig. 2, including: a target display terminal 200, and a server 300, wherein,
the target display terminal 200 is configured to capture a screen, acquire a screen capture picture, and send the screen capture picture to the server 300;
and the server 300 is configured to identify the screenshot picture, and determine that the target display terminal 200 is abnormally played if the identification result meets a preset condition.
As a preferred embodiment, the server is specifically configured to determine that the target display terminal is abnormally played if the identification result of the screenshot is any one of a black screen, a white screen, a text containing "stop work" and a text without response.
The system for determining abnormal playing of the target display terminal in this embodiment may be configured to execute the technical solutions in the corresponding method embodiments, and the implementation principles and technical effects are similar, where the functions of each module may refer to the corresponding descriptions in the method embodiments, and are not described herein again.
The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g., from one website, computer, server, or data center via a wired (e.g., coaxial cable, fiber optic, Digital Subscriber line (Digital Subscriber line L ine, DS L)) or wireless (e.g., infrared, wireless, microwave, etc.) manner to transmit to another website, computer, server, or data center via a wired (e.g., Digital Subscriber line (DVD), DS L)) or wireless (e.g., infrared, wireless, microwave, etc.), may be any available medium such as a Solid State Disk (DVD), or optical Disk (SSD), etc.), or any available medium such as a floppy Disk, a Solid State Disk (DVD), or a Solid State Disk (optical Disk), or optical Disk (optical Disk), which may be a Solid State Disk (DVD), or optical Disk (optical Disk, etc.), may be a Solid State Disk (optical Disk, etc.), or a Solid State Disk (optical Disk, etc.).
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the described embodiments. It will be apparent to those skilled in the art that various changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, and the scope of protection is still within the scope of the invention.
Claims (10)
1. A method for determining abnormal playing of a target display terminal is characterized by comprising the following steps:
the target display terminal carries out screen capture to obtain a screen capture picture;
the target display terminal sends the screen capture picture to a server;
and the server identifies the screenshot picture, and if the identification result meets a preset condition, the target display terminal is determined to be abnormally played.
2. The method for determining abnormal playing of a target display terminal according to claim 1, wherein the server identifies the screenshot picture, and if the identification result meets a preset condition, the target display terminal is determined to be abnormal playing, specifically: and if the identification result is any one of a black screen, a white screen, characters containing 'stop work' and 'no response', determining that the target display terminal is abnormal in playing.
3. The method according to claim 2, wherein if the recognition result is any one of a black screen, a white screen, a text containing "stop work" and a text without response, the method specifically comprises: and if the number of the black color value pixel blocks in the screen capture picture is the largest, determining the screen capture picture as a black screen, if the number of the white color value pixel blocks in the screen capture picture is the largest, determining the screen capture picture as a white screen, extracting characters in the screen capture picture based on an OCR technology, and determining whether the characters contain 'stop work' or 'no response'.
4. The method for determining abnormal playing of a target display terminal according to claim 1, wherein the target display terminal performs screen capture to obtain a screen capture picture, specifically: and the target display terminal automatically performs screen capture at a preset frequency or receives a screen capture instruction sent by the server to perform screen capture, and a screen capture picture is obtained.
5. The method for determining abnormal playing of a target display terminal according to claim 4, wherein the target display terminal performs screen capture to obtain a screen capture picture, specifically: the target display terminal executes a screen capture function takescreen shot (), creates a character string of screen capture p, and executes screen capture operation by calling Shell Utilis.
6. The method for determining abnormal playing of a target display terminal according to claim 5, further comprising the steps of: and the target display terminal creates a local absolute path and stores the acquired screen capture picture under the local absolute path.
7. The method for determining abnormal playing of a target display terminal according to claim 6, further comprising the steps of: and the target display terminal performs quality compression on the acquired screenshot picture and stores the compressed screenshot picture in the local absolute path.
8. The method for determining abnormal playing of a target display terminal according to claim 4, further comprising the steps of: and the server receives the encrypted screen capturing instruction sent by the mobile terminal, decrypts the encrypted screen capturing instruction, and sends the decrypted screen capturing instruction to the target display terminal.
9. A system for determining abnormal play of a target display terminal, comprising: a target display terminal and a server, wherein,
the target display terminal is used for capturing a screen, acquiring a screen capture picture and sending the screen capture picture to the server;
and the server is used for identifying the screenshot picture, and if the identification result meets a preset condition, determining that the target display terminal is abnormal in playing.
10. The system according to claim 9, wherein the server is specifically configured to determine that the target display terminal has an abnormal playing status if the captured picture is identified as any one of a black screen, a white screen, a text containing "stop work" and a text without response.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010165372.5A CN111400134A (en) | 2020-03-11 | 2020-03-11 | Method and system for determining abnormal playing of target display terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010165372.5A CN111400134A (en) | 2020-03-11 | 2020-03-11 | Method and system for determining abnormal playing of target display terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111400134A true CN111400134A (en) | 2020-07-10 |
Family
ID=71430658
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010165372.5A Pending CN111400134A (en) | 2020-03-11 | 2020-03-11 | Method and system for determining abnormal playing of target display terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111400134A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114745558A (en) * | 2021-01-07 | 2022-07-12 | 北京字节跳动网络技术有限公司 | Live broadcast monitoring method, device, system, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104244029A (en) * | 2013-06-19 | 2014-12-24 | 上海信颐电子科技有限公司 | Advertising machine system with long-distance screen capture function and method of advertising machine system |
| CN105979092A (en) * | 2016-05-13 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Abnormity monitoring method and device |
| CN110008110A (en) * | 2019-01-28 | 2019-07-12 | 阿里巴巴集团控股有限公司 | The test method and device of user interface |
| CN110705596A (en) * | 2019-09-04 | 2020-01-17 | 北京三快在线科技有限公司 | White screen detection method and device, electronic equipment and storage medium |
| CN110851350A (en) * | 2019-10-12 | 2020-02-28 | 平安银行股份有限公司 | Method and device for monitoring white screen of web page interface |
-
2020
- 2020-03-11 CN CN202010165372.5A patent/CN111400134A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104244029A (en) * | 2013-06-19 | 2014-12-24 | 上海信颐电子科技有限公司 | Advertising machine system with long-distance screen capture function and method of advertising machine system |
| CN105979092A (en) * | 2016-05-13 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Abnormity monitoring method and device |
| CN110008110A (en) * | 2019-01-28 | 2019-07-12 | 阿里巴巴集团控股有限公司 | The test method and device of user interface |
| CN110705596A (en) * | 2019-09-04 | 2020-01-17 | 北京三快在线科技有限公司 | White screen detection method and device, electronic equipment and storage medium |
| CN110851350A (en) * | 2019-10-12 | 2020-02-28 | 平安银行股份有限公司 | Method and device for monitoring white screen of web page interface |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114745558A (en) * | 2021-01-07 | 2022-07-12 | 北京字节跳动网络技术有限公司 | Live broadcast monitoring method, device, system, equipment and medium |
| CN114745558B (en) * | 2021-01-07 | 2024-04-09 | 北京字节跳动网络技术有限公司 | Live broadcast monitoring method, device, system, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11659220B2 (en) | System and method for surveying broadcasting ratings | |
| US11729459B2 (en) | Systems and methods for operating a set top box | |
| CN107302711B (en) | Processing system of media resource | |
| CN108391089B (en) | Monitoring flow pushing method and device of multi-path camera and monitoring system | |
| CN111080637A (en) | Cloud service-based advertisement remote method, device, system, product and medium | |
| CN107770564B (en) | Method and device for remotely acquiring audio and video data | |
| CN106227492A (en) | Combination and mobile intelligent terminal interconnected method and device | |
| CN110944217A (en) | Live broadcast information processing method and device, server and storage medium | |
| CN111400134A (en) | Method and system for determining abnormal playing of target display terminal | |
| KR101311463B1 (en) | remote video transmission system | |
| CN112543376A (en) | Self-operation media operation and maintenance method, system, storage medium and device based on Internet of things | |
| CN115514989B (en) | Data transmission method, system and storage medium | |
| CN111782876A (en) | Data processing method, device and system and storage medium | |
| CN112422907B (en) | Image processing method, device and system | |
| KR20140146429A (en) | CCTV image aquisition and management system and method using smart devices | |
| CN110381308B (en) | System for testing live video processing effect | |
| US20230156299A1 (en) | Fingerprinting a television signal and displaying information concerning a program that is being transmitted by the television signal | |
| JP7282340B2 (en) | CONTENT PROVIDING DEVICE AND CONTENT PROVIDING SYSTEM | |
| CN115086703B (en) | Auxiliary live broadcast method, background server, system and electronic equipment | |
| CN111885395B (en) | Video monitoring method, device and system | |
| KR20180094367A (en) | Electronic apparatus for playing substitutional advertisement and method for controlling method thereof | |
| US20240058708A1 (en) | Display apparatus, electronic device, and operating methods thereof | |
| CN116800992A (en) | Audio and video transmission method and device based on WebRTC | |
| KR20220021193A (en) | A method and apparatus for integrated control through linkage of video collection device and analysis device | |
| CN112511891A (en) | Recording file processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200710 |