WO2021109786A1

WO2021109786A1 - Terminal desktop content monitoring method, platform, terminal, system and storage medium

Info

Publication number: WO2021109786A1
Application number: PCT/CN2020/126588
Authority: WO
Inventors: 范贤友
Original assignee: 中兴通讯股份有限公司
Priority date: 2019-12-02
Filing date: 2020-11-04
Publication date: 2021-06-10
Also published as: CN112995577A

Abstract

The embodiments of the present application relate to the field of video monitoring, and disclose a terminal desktop content monitoring method, a platform, a terminal, a system and a storage medium. In the present application, a terminal desktop content monitoring method comprises: receiving a video recording policy set for a terminal with regard to terminal desktop content; and sending, to the terminal, the video recording policy and the address of a streaming media server for the terminal to perform real-time video recording on the terminal desktop content according to the video recording policy, and uploading the obtained video recording data of the terminal desktop content onto the streaming media server.

Description

Monitoring method, platform, terminal, system and storage medium of terminal desktop content

Cross-references to related applications

This application is filed based on a Chinese patent application with an application number of 201911214072.5 and an application date of December 2, 2019, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated into this application by way of introduction.

Technical field

The embodiments of the present application relate to the field of video surveillance, and in particular, to a technology for monitoring terminal desktop content.

Background technique

The video surveillance system is mainly composed of video acquisition, video management, video storage and other equipment. In recent years, video surveillance technology has been rapidly developed and widely used.

At present, the collection equipment in the video surveillance system is mainly various cameras, but in real life, it is not only the video collected by the camera, but also other video content that needs to be managed. For example, law enforcement instruments used in urban management generally only store and offline management of the captured content, and lack monitoring of the operation process of the law enforcement instruments. If the operation records of the equipment have full-process video recordings that can be checked, it can be further prevented. Data has been tampered with to enhance credibility. For example, for specific positions such as online car-hailing drivers, if they provide full-process telephone calls, text messages, WeChat, and APP operations for providing driving services, they are more credible than simple screenshots and more difficult to forge.

However, the inventor found that there are at least the following problems in related technologies: Screen recording on smart terminals such as Android phones is a mature technology, but current video surveillance methods mainly rely on manual operation of screen recording actions to generate screen recordings. The video is managed offline, which is not efficient and safe.

Summary of the invention

The embodiments of the present application provide a method, platform, terminal, system, and storage medium for monitoring terminal desktop content.

The embodiment of the present application provides a method for monitoring terminal desktop content, including: receiving a recording strategy set for the terminal for the terminal desktop content; sending the recording strategy and the address of the streaming media server to the terminal for the terminal to check according to the recording strategy The terminal desktop content is recorded in real time, and the obtained recording data of the terminal desktop content is uploaded to the streaming media server.

The embodiment of the present application also provides a method for monitoring terminal desktop content, including: receiving a video recording strategy for terminal desktop content and an address of a streaming media server sent by a network monitoring platform; real-time video recording of terminal desktop content according to the videoing strategy; Upload the video data of the terminal desktop content obtained from the video to the streaming media server for the streaming media server to respond to the client's request for access to the video data.

The embodiment of the present application also provides a network monitoring platform, including: at least one processor; and a memory communicatively connected with the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are The at least one processor executes, so that the at least one processor can execute the method for monitoring terminal desktop content.

The embodiment of the present application also provides a terminal, including: at least one processor; and a memory communicatively connected with the at least one processor; wherein the memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor. The processor executes, so that at least one processor can execute the method for monitoring the desktop content of the terminal.

The embodiment of the present application also provides a terminal desktop content monitoring system, including: a client terminal, a network monitoring platform communicatively connected with the client, at least one terminal communicatively connected with the network monitoring platform, and communication with the client and the terminal Connected streaming media server; among them, the streaming media server is used to store the recording data uploaded by the terminal; the client is used to set the recording strategy for the terminal desktop content in the network monitoring platform for the terminal, and access the recording stored in the streaming media server data.

The embodiment of the present application also provides a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, a method for monitoring terminal desktop content is implemented.

Description of the drawings

One or more embodiments are exemplified by the pictures in the corresponding drawings. These exemplified descriptions do not constitute a limitation on the embodiments. The elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the attached drawings do not constitute a scale limitation.

FIG. 1 is a flowchart of a method for monitoring terminal desktop content in the first embodiment of the present application;

FIG. 2 is a schematic diagram of the terminal and the network monitoring platform in the first embodiment of the present application performing login verification;

FIG. 3 is a flowchart of a method for monitoring terminal desktop content in the second embodiment of the present application;

FIG. 4 is a schematic diagram of the terminal and the network monitoring platform in the second embodiment of the present application performing login verification;

FIG. 5 is a flowchart of a method for monitoring terminal desktop content in the third embodiment of the present application;

FIG. 6 is a schematic structural diagram of a network monitoring platform in the fourth embodiment of the present application;

FIG. 7 is a schematic diagram of the device composition of the terminal desktop content monitoring system in the sixth embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the various embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art can understand that in each embodiment of the present application, many technical details are proposed in order to enable readers to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solution claimed in this application can be realized. The following embodiments are divided for convenience of description, and should not constitute any limitation on the specific implementation of the present application. The various embodiments can be combined with each other without contradiction.

The method for monitoring terminal desktop content can be applied to a network monitoring platform or a terminal device. In this embodiment, application on a network monitoring platform is taken as an example for description.

The first embodiment of the present application relates to a method for monitoring terminal desktop content. In this embodiment, a recording strategy for terminal desktop content set for the terminal is received; the recording strategy and the address of the streaming media server are sent to the terminal for The terminal performs real-time recording of the terminal desktop content according to the recording strategy, and uploads the obtained recording data of the terminal desktop content to the streaming media server. Among them, the recording strategy can be issued to the terminal through the network monitoring platform. The recording specifically refers to the action of the terminal to record according to the recording strategy; the data recorded by the terminal during the recording process is the recording data. The terminal receives the recording strategy for the terminal desktop content set by the client from the network monitoring platform. The terminal uses this recording strategy to record. It is no longer necessary to manually operate the screen recording action to enable the recording function, making recording more convenient and improving users Experience. Uploading the obtained video data to the streaming media server avoids offline management of the data, prevents the video data from being tampered with, enhances the credibility of the video data, and has security.

The implementation details of the method for monitoring terminal desktop content in this embodiment will be specifically described below. The following content is only implementation details for easy understanding, and is not necessary for this embodiment.

A specific flowchart of a method for monitoring terminal desktop content in this embodiment is shown in FIG. 1, and specifically includes the following steps:

Step 101: Receive a video recording strategy set for the terminal.

Specifically, before receiving the recording strategy set for the terminal, the basic information of the terminal has been pre-configured in the network monitoring platform, such as the unique number of the terminal such as IMEI, the mobile phone number that can receive short messages, and the mobile phone number can carry this The mobile phone number, login password, and user id of the terminal's personnel are the client id of the administrator who manages the terminal.

In this step, the recording strategy set for the terminal: including timing recording strategy and application trigger recording strategy. Among them, the timing recording strategy includes: the recording period and its periodicity (one-time or periodic, such as one-time recording from 10 o'clock to 12 o'clock or periodic 2 o'clock to 3 o'clock every Monday), using the law enforcement instrument of urban management as For example, it can be set to automatically start recording during the patrol period; the application trigger recording strategy includes at least the application name, and the corresponding recording action is the attribute such as on or off. Take WeChat as an example. When the terminal opens WeChat, it starts recording, and when it closes WeChat, it stops recording. Similarly, the application name can also be phone call, camera, etc., and the corresponding recording action can also be turned off. I will not list them one by one here. The recording strategy set for the terminal may include one or more timing recording strategies, or one or more application triggering recording strategies.

The timing recording strategy and the application trigger recording strategy can understand the passive mode recording strategy. In actual applications, you can also set the active mode recording strategy, which is controlled by the end user and is similar to the shortcut keys for screenshots, such as button screenshots. Three-finger swipe screen capture, etc., once the active recording event signal is detected, the screen recording is started.

Specifically, the video recording strategy can be configured directly on the network monitoring platform by the management personnel of the terminal, or configured on the network monitoring platform by the management personnel of the terminal through the client.

In practical applications, each recording strategy can also correspond to a priority. For example, the attributes of each application triggering the recording strategy include not only the application name, but also whether the corresponding recording action is on or off, but also the priority. When the recording strategy conflicts in the same time period, the recording strategy corresponding to the higher priority is executed. For example, the recording action corresponding to an application triggering a recording strategy is pause recording. When the application is started, the terminal is currently recording according to a certain timing recording strategy. If the application triggering a recording strategy has a higher priority than the timing recording The priority of the strategy is to pause the recording; if the priority of the application triggering the recording strategy is lower than the priority of the timing recording strategy, the recording will continue.

By setting different recording strategies and prioritizing the corresponding recording strategies, the recording strategies are linked together. The recording strategy with higher priority can cover the recording strategy with lower priority and improve the user experience.

Step 102: Determine whether the terminal has passed the authentication.

The method for judging whether the terminal authentication is passed specifically includes: receiving the login request of the terminal; where the login request includes the unique number and the login password of the terminal; detecting whether the terminal is a registered terminal according to the unique number and the login password of the terminal; After the terminal has been registered, the temporary password is sent to the client; the verification request sent by the terminal is received, and the verification request carries the verification password; according to the matching result of the verification password and the temporary password, it is judged whether the terminal is authenticated.

In this way, it is ensured that the person who uses the terminal for video recording must be approved by the corresponding administrator of the client terminal, which improves the security of the monitoring method of the terminal desktop content.

Specifically, referring to FIG. 2, a schematic diagram of login verification between the terminal 604 and the network monitoring platform 601, including the terminal 604, the network monitoring platform 601 and the client 602.

The terminal in this embodiment takes an Android smart phone as an example. It has a smart operating system, a display screen and screen recording capabilities, an International Mobile Equipment Identity (IMEI, International Mobile Equipment Identity), and an international mobile client SIM card. The user identification code (IMSI for short, International Mobile Subscriber Identification Number) has the ability to receive short messages and access the Internet.

It is assumed that the information of the terminal 604 has been pre-configured on the network monitoring platform 601: including the unique number of the terminal 604 such as IMEI, the user equipment bound to the terminal, the login password, and the client corresponding to the terminal; it is assumed that the terminal 604 has been pre-configured Good access address of the network monitoring platform 601, such as IP address and port.

In step S201, the terminal 604 sends a login request to the network monitoring platform 601. The login request specifically includes the unique number and the login password of the terminal.

Specifically, the terminal 604 sends the unique number login password of the terminal 604 to the network monitoring platform 601 through the pre-configured access address of the network monitoring platform 601. The unique number of the terminal 604 includes the IMEI of the terminal 604, and the login password is the password set when the terminal 604 completes registration on the network monitoring platform 601.

In step S202, the network monitoring platform 601 determines whether the terminal 604 is a registered terminal.

Specifically, after the network monitoring platform 601 receives the login request sent by the terminal 604, it first determines whether the terminal 604 is a user registered in the network monitoring platform 601 according to the unique number of the terminal 604.

If it is a registered user, it is determined whether the unique number of the terminal 604 in the login request corresponds to the password. If the unique number of the terminal 604 corresponds to the password, the terminal 604 will be fed back to the terminal 604 "login is successful, waiting for the next step of verification" information and execute step S203; if If the unique number of the terminal 604 does not correspond to the password, the terminal 604 will be fed back to the terminal 604 that "the login password is incorrect."

If it is not a registered user, the terminal 604 is fed back to the terminal 604 that "the device is not registered".

In step S203, the network monitoring platform 601 sends a temporary password to the client 602.

Specifically, the network monitoring platform 601 sends the temporary password to the client 602 through the information of the client 602 reserved when the terminal 604 registers. In a specific example, the temporary password is a randomly generated 6-digit number.

It should be noted that the way in which the network monitoring platform 601 sends the random password to the client 602 can be done by means of SMS or voice call.

In step S204, the client 602 sends a temporary password to the terminal 604.

Specifically, since the temporary password is sent by the network monitoring platform 601 to the client 602, the temporary password sent by the network monitoring platform 601 is actually sent to the administrator of the terminal 604, and the user using the terminal 604 passes through the terminal 604. The administrator can get a temporary password.

In step S205, the terminal 604 sends a verification request to the network monitoring platform 601, and the verification request includes a verification password.

After the user of the terminal 604 obtains the temporary password by asking the administrator of the terminal 604, the temporary password is used as the verification password, and the verification password is sent to the network monitoring platform 601 through the terminal 604.

Step S206: The network monitoring platform 601 detects whether the received verification password matches the issued temporary password.

Specifically, after the network monitoring platform 601 receives the verification request sent by the terminal 604, it determines whether the verification password matches the temporary password. If the verification password matches the temporary password, it will feed back to the terminal 604 "login successful" information; if the password is verified If it does not match the temporary password, the terminal 604 will be fed back a message "verification failed, please re-verify".

In this way, it is ensured that the person who uses the terminal for video recording must be approved by the corresponding person of the user device bound to the terminal, which prevents the terminal from being forged, and further improves the monitoring method of the terminal desktop content safety.

It should be noted that, in other embodiments, the network monitoring platform 601 may also be preset with a temporary password verification time and verification timeout times. After the network monitoring platform 601 sends the temporary password to the client 602, the network monitoring platform 601 starts to calculate the waiting time. When the network monitoring platform 601 receives the verification request sent by the terminal 604, it first determines whether the waiting time exceeds the preset temporary password verification time. If the waiting time is less than the preset temporary password verification time, step S206 is executed; if the waiting time is greater than The preset temporary password verification time will be fed back to the terminal 604 "Waiting timeout, please re-verify" information and record the number of verification timeouts; if the number of verification timeouts exceeds the preset number of verification timeouts, it will be fed back to the terminal 604 "Login failed" , Please log in again" information.

Using this terminal authentication method, through a temporary password mechanism, it is ensured that only the consent of the client 602 corresponding to the terminal 604 can make the terminal go online successfully, and prevent the recording function from being maliciously turned on and abused.

Step 103: Send the video recording strategy and the streaming media server address to the terminal.

The terminal 604 performs recording according to the recording strategy, and according to the obtained address of the streaming media server. Upload the recording data to the streaming server.

The purpose of sending the recording strategy to the terminal 604 is to enable the terminal 604 to record according to the received recording strategy, and it is no longer necessary to manually operate the screen recording action to enable the recording function, making recording more convenient and improving the user experience; and The received streaming server address uploads the video data, and the client 602 can view the video content through the streaming server, avoiding offline management of video data, preventing video data from being tampered with, enhancing the credibility of video data, and having security .

In a specific example, the recording strategy sent by the network monitoring platform 601 to the terminal 604 may be slightly different from the recording strategy set in step 101. For example, the timing recording strategy sent by the network monitoring platform 601 to the terminal 604 may not include a period. Information, when the recording time is approaching, the timing recording strategy is sent. That is to say, the issuance of the recording strategy can be issued in time after the terminal is authenticated, or it can be sent to the terminal when the difference between the current time and the recording time included in the recording strategy is less than the preset threshold. .

Specifically, when the difference between the current recording time and the recording time included in the recording strategy is less than a preset threshold (for example, a time period such as 10 minutes or 5 minutes), the recording strategy is sent to the terminal. Due to the update of the recording strategy, the network monitoring platform 601 sends the recording strategy to the terminal 604 in advance for the terminal 604 to use the corresponding recording strategy for recording.

The network monitoring platform updates the recording strategy set by the client for the terminal in real time, so that the corresponding terminal can use the updated recording strategy to record; when the difference between the current recording time and the recording time included in the recording strategy is less than the preset threshold, it will be sent to the terminal The recording strategy enables the terminal to obtain the recording strategy in time.

It should be noted that, in other embodiments, when the client updates the recording strategy for the terminal, the updated recording strategy may be sent to the terminal.

In this embodiment, the desktop of the mobile terminal is used as a video source to access the video surveillance platform, and the advantages of the video surveillance technology are used, so that the screen recording data can be managed efficiently and securely. The terminal receives the recording strategy for the terminal desktop content set by the client from the network monitoring platform. The terminal uses this recording strategy to record. It is no longer necessary to manually operate the screen recording action to enable the recording function, making recording more convenient and improving users Experience. Uploading the obtained video data to the streaming media server avoids offline management of the video data, prevents the video data from being tampered with, enhances the credibility of the video data, and has security.

The division of the steps of the various methods above is just for clarity of description. When implemented, it can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications to the process or introducing insignificant designs without changing the core design of the process are within the scope of protection of the patent.

The second embodiment of the present application relates to a method for monitoring terminal desktop content. The second embodiment is roughly the same as the first embodiment. In the second embodiment of this application, after determining that the terminal is a registered terminal, before sending a temporary password to the client, it also includes: sending a random password to the user equipment bound to the terminal. Password: Receive the verification request sent by the terminal, the verification request carries the verification password; if the verification password matches the random password, then the temporary password is sent to the client.

A specific flowchart of a method for monitoring terminal desktop content in this embodiment is shown in FIG. 3, and specifically includes the following steps:

Step 401: Receive a video recording strategy set for the terminal. This step is similar to step 101 of the first embodiment, and will not be repeated here.

Step 402: Determine whether the terminal has passed the authentication.

The method of judging whether the terminal verification is passed specifically includes: receiving the login request of the terminal; where the login request includes the unique number and the login password of the terminal; detecting whether the terminal is a registered terminal according to the unique number and the login password of the terminal; After the terminal is registered, a temporary password is sent to the client; the verification request sent by the terminal is received, and the verification request carries the verification password; according to the matching result of the verification password and the temporary password, it is determined whether the terminal is authenticated.

After determining that the terminal is a registered terminal, before sending the temporary password to the client, it also includes: sending a random password to the user device bound to the terminal; receiving a verification request sent by the terminal, the verification request carrying the verification password; checking and verifying Whether the password matches the random password; if the verification password matches the random password, then send a temporary password to the client.

Specifically, referring to FIG. 4, a schematic diagram of information verification between the terminal 604 and the network monitoring platform 601, including the terminal 604, the network monitoring platform 601, the client 602, and the user equipment 614 bound to the terminal.

It is assumed that the information of the terminal 604 has been pre-configured on the network monitoring platform 601: including the unique number of the terminal 604 such as IMEI, the user equipment bound to the terminal, the login password, and the client information corresponding to the terminal; it is assumed that the terminal 604 has been pre-configured Configure the access address of the network monitoring platform 601, such as IP address and port.

If it is a registered user, determine whether the unique number of the terminal 604 corresponds to the password in the login request. If the unique number of the terminal 604 corresponds to the password, the terminal 604 will be fed back to the terminal 604 "login is successful, waiting for the next step of verification" information and perform step S301; if If the unique number of the terminal 604 does not correspond to the password, the terminal 604 will be fed back to the terminal 604 that "the login password is incorrect."

In step S301, the network monitoring platform 601 sends a random password to the user equipment 614 bound to the terminal.

Specifically, the network monitoring platform 601 sends a random password to the bound user equipment 614 of the terminal according to the information of the user equipment 614 bound to the terminal reserved by the terminal 604 on the platform. In a specific example, the random password is a randomly generated 6-digit number.

It should be noted that the method for the network monitoring platform 601 to send the random password to the user equipment 614 bound to the terminal may be a short message or a voice call.

In step S302, the user equipment 614 bound to the terminal sends a random password to the terminal 604.

Specifically, since the random password is sent by the network monitoring platform 601 to the user equipment 614 bound to the terminal, the random password sent by the network monitoring platform 601 is actually sent to the holder of the terminal 604, and the terminal 204 can pass The user equipment of the holder of the terminal 604 obtains a random password.

In step S303, the terminal 604 sends a verification request to the network monitoring platform 601, and the verification request includes a verification password.

After obtaining the random password through the user equipment of the holder of the terminal 604, the random password is used as the verification password, and the verification password is sent to the network monitoring platform 601 through the terminal 604.

In step S304, the network monitoring platform 601 detects whether the verification password matches the random password.

Specifically, after the network monitoring platform 601 receives the verification request sent by the terminal 604, it determines whether the verification password matches the random password. If the verification password matches the random password, it will feed back to the terminal 604 "verification successful, please proceed to the next step. And execute step S203; if the verification password does not match the random password, the terminal 604 is fed back to the terminal 604 with a message of “verification failed, please re-verify”.

It should be noted that, in other embodiments, the network monitoring platform 601 is also preset with a random password verification time and verification timeout times. After the network monitoring platform 601 sends a random password to the user equipment 614 bound to the terminal, the network monitoring platform 614 starts to calculate the waiting time. When the network monitoring platform 601 receives the verification request sent by the terminal 604, it first determines whether the waiting time exceeds the preset random password verification time. If the waiting time is less than the preset random password verification time, step S304 is executed; if the waiting time is long If the verification time is greater than the preset random password verification time, it will be fed back to the terminal 604 "Waiting timeout, please re-verify" information and record the verification timeout times; if the verification timeout times exceed the preset verification timeout times, it will be fed back to the terminal 604 "Login" Failed, please log in again" message.

Specifically, the network monitoring platform 601 sends the temporary password to the client 602 through the information of the client 602 registered by the terminal 604 that is reserved. In a specific example, the temporary password is a randomly generated 6-digit number.

In step S204, the client 602 sends a temporary password to the terminal 604.

It should be noted that, in other embodiments, the network monitoring platform 601 is also preset with a temporary password verification time and verification timeout times. After the network monitoring platform 601 sends the temporary password to the client 602, the network monitoring platform 601 starts to calculate the waiting time. When the network monitoring platform 601 receives the verification request sent by the terminal 604, it first determines whether the waiting time exceeds the preset temporary password verification time. If the waiting time is less than the preset temporary password verification time, step S206 is executed; if the waiting time is greater than The preset temporary password verification time will be fed back to the terminal 604 "Waiting timeout, please re-verify" information and record the number of verification timeouts; if the number of verification timeouts exceeds the preset number of verification timeouts, it will be fed back to the terminal 604 "Login failed" , Please log in again" information.

Step 403: Deliver the recording strategy and the streaming media server address to the terminal. This step is similar to step 103 of the first embodiment, and will not be repeated here.

This embodiment adopts a double terminal authentication method, through the mechanism of random password, to ensure that even if an attacker learns the unique number and login password of the terminal, he will fail because he cannot receive the random password to avoid the terminal being forged; through the mechanism of temporary password , To ensure that only the consent of the client 602 can make the terminal go online successfully, and prevent the recording function from being maliciously turned on and abused.

The third embodiment of the present application relates to a method for monitoring terminal desktop content. In the third embodiment of the present application, the method for monitoring terminal desktop content is applied to the terminal.

In this embodiment, the recording strategy for the terminal desktop content and the address of the streaming media server sent by the network monitoring platform are received; the terminal desktop content is recorded in real time according to the recording strategy; the recording data of the terminal desktop content obtained by the recording is uploaded to the stream The media server is used for the streaming media server to respond to the client's request for access to video data. The terminal receives the recording strategy for the terminal desktop content set by the client from the network monitoring platform. The terminal uses this recording strategy to record. It is no longer necessary to manually operate the screen recording action to enable the recording function, making recording more convenient and improving users Experience. Uploading the obtained video data to the streaming media server avoids offline management of the video data, prevents the video data from being tampered with, enhances the credibility of the video data, and has security.

The specific flowchart of a method for monitoring terminal desktop content in this embodiment is shown in FIG. 5, which specifically includes the following steps:

Step 501, whether the right verification is passed.

Send a login request to the network monitoring platform; where the login request includes the unique number of the terminal and the login password; send a verification request to the network monitoring platform, the verification request carries a verification password; where the verification password is based on the user equipment bound to the terminal The sent random password is generated; a verification request is sent to the network monitoring platform, and the verification request carries a verification password for the network monitoring platform to authenticate according to the verification password; wherein the verification password is generated based on the temporary password sent by the client.

For the specific verification process, refer to the content of the specific embodiment 2, which has been described in detail in the specific embodiment 2, and will not be repeated here.

Step 502: Receive the recording strategy and the streaming media server address sent by the network monitoring platform.

Specifically, after the verification is passed, the terminal receives the recording strategy and the streaming media server address sent by the network monitoring platform, the terminal uses the received recording strategy to record, and uploads the recording data obtained by the recording to the streaming media server.

Step 503: Perform real-time recording of the desktop content according to the recording strategy.

Step 504: Upload the recording data to the streaming media server.

The terminal uses the recording strategy sent by the streaming server to the terminal to record, and uploads the recorded data obtained from the recording to the streaming server.

The recording strategy includes timing recording strategy and application trigger recording strategy.

It should be noted that uploading the video data obtained by recording to the streaming media server can be done either through scheduled upload or real-time upload; using scheduled upload can effectively save the cost of recording, and the cost of using clear real-time upload is higher, but due to Video data is first-hand data, and its video content is more reliable.

The recording strategy includes: timing recording strategy and application trigger recording strategy; each recording strategy corresponds to a priority; if the current state of the terminal meets multiple recording strategies, the recording strategy with the highest priority is executed.

It should be noted that, in addition to adopting the corresponding recording strategy for recording, the terminal also includes an active mode.

Active mode: If an active recording event signal is detected, the terminal desktop content is recorded in real time, and the obtained recording data is uploaded to the streaming media server. The active video event signal is generated according to the preset operation on the screen.

In addition to recording under the corresponding recording strategy, users can also perform manual operations to perform recording, and perform manual recording when the user needs it, without missing any important information that needs to be recorded.

Specifically, after the terminal 604 is successfully verified to go online, the user of the terminal 604 controls the active recording event signal to start the active mode. The active recording event signal is similar to the shortcut keys for screenshots, such as key-press screenshots, three-finger sliding screenshots, etc. Once the terminal 604 detects the active recording event signal, it starts screen recording, and sends the recording data to the streaming media server allocated by the network monitoring platform 601 when the terminal 604 goes online through the RTSP stream.

After the terminal uploads the video data obtained from the video recording to the streaming media server, the streaming media server splices the video data and the video stream for the client to access. After the streaming media server splices the video data and the video stream sent by the terminal, the client no longer needs the user to search and find each video when viewing and accessing the video, which improves the efficiency of the user to view the corresponding video.

In this embodiment, the desktop of the mobile terminal is used as a video source to access the video surveillance platform, and the advantages of the video surveillance technology are used, so that the screen recording data can be managed efficiently and securely.

In this embodiment, the terminal receives a recording strategy for the terminal’s desktop content set by the client from the network monitoring platform, and the terminal uses the recording strategy to record. It is no longer necessary to manually operate the screen recording action to enable the recording function, so that Video recording is more convenient and improves user experience. Uploading the obtained video data to the streaming media server avoids offline management of the video data, prevents the video data from being tampered with, enhances the credibility of the video data, and has security.

In addition, the dual terminal verification method is adopted, and the password verification mechanism ensures that even if the attacker learns the unique terminal number and login password, he will fail because he cannot receive the verification password, preventing the terminal from being forged; through the verification password mechanism , To ensure that only the client's consent can the terminal be successfully launched, and to avoid malicious activation and abuse of the recording function.

The following will give a specific introduction when using the terminal as a law enforcement instrument or an online car-hailing driver:

When the terminal is specifically a law enforcement instrument:

Ordinary smart law enforcement instruments generally have operating systems such as Android system, display screen, storage, camera, network communication, GPS positioning and other functions. In the law enforcement instrument, this embodiment will exist in the form of an application, which is called a screen recording APP; and the application of law enforcement recording is called a law enforcement APP.

It includes the following steps:

Step 1. Initial setup of the law enforcement device: the administrator of the law enforcement device enters the unique number of the law enforcement device on the network monitoring platform, as well as the phone number of the law enforcement device, and the ID of the administrator of the law enforcement device to approve the law enforcement device Whether to enable the ID of the administrator of the screen recording, and the address of the network monitoring platform.

Step 2. Recording strategy configuration: The administrator of the law enforcement device sets a periodical recording strategy for the law enforcement device on the network monitoring platform. For example, start recording from 10 am to 11 am on weekdays; when it is detected that the law enforcement APP is opened, start recording immediately.

Step 3. Login process: the user of the law enforcement instrument, that is, law enforcement personnel, open the screen recording app before starting to perform the task and log in and go online for verification. After successful verification, the recording strategy and streaming media server address are obtained; the specific login verification process is as shown in specific embodiment 1. That is not repeated here.

Step 4. After the terminal is logged in and online, the network monitoring platform will periodically check whether the law enforcement instrument has periodic recordings to be executed, and send it to the law enforcement instrument in advance; if the configuration in the above 2 is configured, the law enforcement and the law enforcement will receive the recording before 10 o’clock According to the strategy, when the time reaches 10 o'clock, the screen recording APP will record the screen and send it to the streaming server.

Step 5. In other periods, law enforcement officers have temporary tasks to deal with. Open the law enforcement app according to the process, that is, when the law enforcement app is displayed on the law enforcement instrument desktop, the recording app will start to record the screen and send it to the streaming media server.

Step 6. When the law enforcement officer starts to record and collect evidence, there will be two or even multiple video streams. One of them is the video content captured by the camera of the law enforcement instrument. If multiple cameras are turned on, there may be a stream; One way is the content displayed on the screen of the law enforcement instrument. The recording APP will first push the screen recording content to the streaming media server, and optionally push the video stream of the camera to the streaming media server according to the configuration. The video stream generated by the screen recording and the video stream generated by the camera will have the same prefix, that is, the naming rule of the unique number of the law enforcement instrument, so that the streaming server can splice the two or even multiple streams into one screen display. Through this kind of processing, the law enforcement agency can not delete and modify the unfavorable video of one party at will, ensuring the authenticity and integrity of the video taken by the law enforcement instrument.

When the terminal is used by the ride-hailing driver:

In order to more comprehensively manage the service quality of online car-hailing drivers, online car-hailing companies require online car-hailing drivers to use a specific terminal and install the screen recording APP described in this application on the terminal to conduct a comprehensive service throughout the entire service process. recording.

Step 1. The configuration and online procedures are similar to the law enforcement instrument, so I won’t repeat them here;

Step 2. The online car-hailing company uniformly sets application-based recording strategies for the terminal used by the driver. For example, when the taxi application, WeChat, phone, SMS and other applications are activated, they will actively turn on the recording; and when the online banking APP is activated, If you are currently recording, you should stop recording and resume recording after the online banking APP exits.

The specific recording strategy can be described as:

{"APPName":"Taxi Application", "action": "on", "priority": "1"};

{"APPName": "Internet Banking", "action": "off", "priority": "3"};

Among them, priority is meaningful only when the action is the corresponding on or off. The agreement 1 means that the priority of the application is higher than the active recording, the agreement 2 is higher than the periodic recording, and the 3 is higher than the active and periodic recording.

That is to say, in this way, when the driver opens the "Taxi Application", the driver will actively turn on the video; at this time, turn on the "Internet Banking". Since the priority of "Online Banking" is higher than the priority of the "Taxi Application", the "Online" is executed at this time. For the operation corresponding to "Bank", turn off the video, and then reply to the video after closing "Online Banking".

The fourth embodiment of the present application relates to a network monitoring platform, as shown in FIG. 6, including: at least one processor 701; and a memory 702 communicatively connected with the at least one processor 701; wherein the memory 702 stores at least An instruction executed by one processor 701 is executed by at least one processor 701, so that the at least one processor 701 can execute the method for monitoring terminal desktop content of the first or second embodiment.

The memory 702 and the processor 701 are connected in a bus manner. The bus may include any number of interconnected buses and bridges. The bus connects one or more various circuits of the processor 701 and the memory 702 together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are all well-known in the art, and therefore, no further description will be given herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on the transmission medium. The data processed by the processor is transmitted on the wireless medium through the antenna, and further, the antenna also receives the data and transmits the data to the processor 701.

The processor 701 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. The memory can be used to store data used by the processor when performing operations.

The communication component 703 is used to send a temporary password to the terminal or a random password to the user equipment bound to the terminal; it is also used to receive a verification request or a verification request sent by the terminal.

It is not difficult to find that this embodiment is an example of equipment corresponding to the first embodiment or the second embodiment, and this embodiment can be implemented in cooperation with the first embodiment or the second embodiment. The related technical details mentioned in the first embodiment or the second embodiment are still valid in this embodiment, and in order to reduce repetition, they will not be repeated here. Correspondingly, the related technical details mentioned in this embodiment can also be applied to the first embodiment or the second embodiment. In order to highlight the innovative part of this application, this embodiment does not introduce units that are not too closely related to solving the technical problems raised by this application, but this does not mean that there are no other units in this embodiment.

The fifth embodiment of the present application relates to a terminal, including: at least one processor; and, a memory communicatively connected with the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor The instruction is executed by the at least one processor, so that the at least one processor can execute the method for monitoring terminal desktop content of the third embodiment.

Among them, the memory and the processor are connected in a bus mode, and the bus may include any number of interconnected buses and bridges, and the bus connects one or more processors and various circuits of the memory together. The bus can also connect various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are all well-known in the art, and therefore, no further description will be given herein. The bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on the transmission medium. The data processed by the processor is transmitted on the wireless medium through the antenna, and further, the antenna also receives the data and transmits the data to the processor.

The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. The memory can be used to store data used by the processor when performing operations.

In a specific example, the terminal may be a typical or ordinary Android smart phone.

It is not difficult to find that this embodiment is a device example corresponding to the third embodiment, and this embodiment can be implemented in cooperation with the third embodiment. The related technical details mentioned in the third embodiment are still valid in this embodiment, and in order to reduce repetition, they will not be repeated here. Correspondingly, the related technical details mentioned in this embodiment can also be applied in the third embodiment. In order to highlight the innovative part of this application, this embodiment does not introduce units that are not too closely related to solving the technical problems raised by this application, but this does not mean that there are no other units in this embodiment.

The sixth embodiment of the present application relates to a desktop content monitoring system, as shown in FIG. 7, including:

Client 602, a network monitoring platform 601 communicatively connected to the client 602, at least one terminal 604 communicatively connected to the network monitoring platform 601, and a streaming media server 603 communicatively connected to the client 602 and the terminal 604; among them, the streaming media server 603 is used to store the recording data uploaded by the terminal 604; the client 602 is used to set a recording strategy for the terminal desktop content in the network monitoring platform 601 for the terminal 604, and to access the recording data stored in the streaming media server 603.

Specifically, the terminal 604 refers to an intelligent terminal with a display screen, screen recording capabilities, and network communication capabilities. In a specific example, a typical or ordinary Android smart phone can be used. The terminal 604 uses the screen content as a video source to access the network monitoring platform 601.

The client 602 is software used by the user to perform monitoring operations. There are multiple types of clients 602 in the terminal desktop content monitoring system, including C/S mode clients, B/S mode clients, and mobile clients.

Streaming media server 604: receives and stores the video data generated by the terminal, and provides it to the client 602 for access, and responds to the request of the client 602 to play screen recording video.

Network monitoring platform 601: The core of the entire terminal desktop content monitoring system, managing all terminals 604, clients 602, streaming media servers 603, and user information when the terminal 604 is registered.

It is not difficult to find that this embodiment is a system example corresponding to the first embodiment or the third embodiment, and this embodiment can be implemented in cooperation with the first embodiment or the third embodiment. The related technical details mentioned in the first embodiment or the third embodiment are still valid in this embodiment, and in order to reduce repetition, they will not be repeated here. Correspondingly, the related technical details mentioned in this embodiment can also be applied in the first embodiment or the third embodiment. In order to highlight the innovative part of this application, this embodiment does not introduce equipment that is not too closely related to solving the technical problems proposed by this application, but this does not indicate that there are no other equipment in this embodiment.

The seventh embodiment of the present application relates to a computer-readable storage medium storing a computer program. When the computer program is executed by the processor, the above method embodiment is realized.

That is, those skilled in the art can understand that all or part of the steps in the method of the foregoing embodiments can be implemented by instructing relevant hardware through a program. The program is stored in a storage medium and includes several instructions to enable a device ( It may be a single-chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes. .

Those of ordinary skill in the art can understand that the above-mentioned embodiments are specific examples for realizing the present application, and in actual applications, various changes can be made in form and details without departing from the spirit and spirit of the present application. range.

Claims

A method for monitoring terminal desktop content, including:

Receive the video recording strategy for the terminal's desktop content set for the terminal;

The recording strategy and the address of the streaming media server are sent to the terminal, so that the terminal can perform real-time recording of the terminal desktop content according to the recording strategy, and upload the obtained recording data of the terminal desktop content to the terminal flow media services.
The method for monitoring the desktop content of a terminal according to claim 1, wherein before said sending the recording strategy and the address of the streaming media server to the terminal, the method further comprises:

Receiving a login request of the terminal; wherein the login request includes a unique number and a login password of the terminal;

Detecting whether the terminal is a registered terminal according to the unique number and login password of the terminal;

After determining that the terminal is a registered terminal, send a temporary password to the client;

Receiving a verification request sent by the terminal, where the verification request carries a verification password;

According to the matching result of the verification password and the temporary password, it is determined whether the terminal is authenticated.
The method for monitoring terminal desktop content according to claim 2, wherein, after determining that the terminal is a registered terminal, before sending a temporary password to the client terminal, the method further comprises:

Sending a random password to the user equipment bound to the terminal;

Receiving a verification request sent by the terminal, where the verification request carries a verification password;

If the verification password matches the random password, the sending of the temporary password to the client is performed again.
The method for monitoring terminal desktop content according to claim 1, wherein the recording strategy includes: a timing recording strategy and an application-triggered recording strategy; wherein each recording strategy corresponds to a priority.
The method for monitoring terminal desktop content according to any one of claims 1 to 4, further comprising:

When the client updates the recording strategy for the terminal, sending the updated recording strategy to the terminal;

Or, when the difference between the current time and the recording time included in the recording strategy is less than a preset threshold, the recording strategy is sent to the terminal.
A method for monitoring terminal desktop content, including:

Receive the recording strategy for the terminal desktop content and the address of the streaming media server sent by the network monitoring platform;

Perform real-time recording of the terminal desktop content according to the recording strategy;

Uploading the video data of the terminal desktop content obtained by video to the streaming media server for the streaming media server to respond to the client's request for access to the video data.
The method for monitoring terminal desktop content according to claim 6, wherein after receiving the recording strategy for terminal desktop content and the address of the streaming media server sent by the network monitoring platform, the method further comprises:

When an active recording event signal is received, the terminal desktop content is recorded in real time, and the obtained recording data is uploaded to the streaming media server.
8. The method for monitoring terminal desktop content according to claim 7, wherein the active recording event signal is generated according to a preset operation on the screen.
The method for monitoring terminal desktop content according to claim 6, wherein before said receiving the recording strategy for terminal desktop content and the address of the streaming media server sent by the network monitoring platform, the method further comprises:

Sending a login request to the network monitoring platform; wherein the login request includes the unique number and login password of the terminal;

Sending a verification request to the network monitoring platform, the verification request carrying a verification password, for the network monitoring platform to perform authentication according to the verification password; wherein the verification password is generated according to the temporary password notified by the client.
The method for monitoring terminal desktop content according to claim 9, wherein after said sending a login request to the network monitoring platform, before sending a verification request to the network monitoring platform, the method further comprises:

Sending a verification request to the network monitoring platform, the verification request carrying a verification password; wherein the verification password is generated according to a random password notified by the bound user equipment.
The method for monitoring terminal desktop content according to any one of claims 6 to 10, wherein said performing real-time recording of terminal desktop content according to said recording strategy comprises:

If the current state satisfies multiple recording strategies, the recording strategy with the highest priority will be executed according to the priority of each recording strategy;

Wherein, the recording strategy includes: a timing recording strategy and an application triggering recording strategy, and the priority of each recording strategy is preset.
The method for monitoring terminal desktop content according to any one of claims 6 to 10, wherein after uploading the video recording data of the terminal desktop content obtained by recording to the streaming media server, the method further comprises:

The video stream captured by the camera is uploaded to the streaming media server for the streaming media server to splice the video recording data and the video stream for the client to access.
A network monitoring platform, including:

At least one processor; and,

A memory communicatively connected with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute any one of claims 1 to 5 The monitoring method of the terminal desktop content described above.
A terminal, including:

At least one processor; and,

A memory communicatively connected with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute any one of claims 6 to 12 The monitoring method of the terminal desktop content described above.
A monitoring system for terminal desktop content, comprising: a client terminal, a network monitoring platform according to claim 13 that is communicatively connected with the client, and at least one of a communication connection with the network monitoring platform according to claim 14 The terminal, and a streaming media server communicatively connected with the client and the terminal;

Wherein, the streaming media server is used to store the video data uploaded by the terminal;

The client is used to set a video recording strategy for the terminal desktop content in the network monitoring platform for the terminal, and access the video data stored in the streaming media server.
A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the method for monitoring the contents of a terminal desktop according to any one of claims 1 to 5 is implemented, or, claim 6 is implemented. The method for monitoring terminal desktop content described in any one of to 12.