CN113360335A - Method, device and equipment for monitoring terminal and computer readable medium - Google Patents
Method, device and equipment for monitoring terminal and computer readable medium Download PDFInfo
- Publication number
- CN113360335A CN113360335A CN202010152516.3A CN202010152516A CN113360335A CN 113360335 A CN113360335 A CN 113360335A CN 202010152516 A CN202010152516 A CN 202010152516A CN 113360335 A CN113360335 A CN 113360335A
- Authority
- CN
- China
- Prior art keywords
- terminal
- video stream
- websocket connection
- operating system
- terminals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000012544 monitoring process Methods 0.000 title claims abstract description 27
- 238000012360 testing method Methods 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 18
- 238000004891 communication Methods 0.000 description 11
- 230000001360 synchronised effect Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mathematical Physics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a method, a device, equipment and a computer readable medium for monitoring a terminal, and relates to the technical field of computers. One embodiment of the method comprises: creating video stream positions of a plurality of terminals; triggering websocket connection with the terminal based on an operating system of the terminal; and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position. This embodiment enables a plurality of terminal screens to be displayed in a computer screen.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, and a computer-readable medium for monitoring a terminal.
Background
With the technical solution, a wide variety of Applications (APP) can be used on the terminal. In order to ensure the normal use of the APP at the terminal, a test needs to be performed on the terminal in which the APP is installed. In the process of testing the terminal, the content displayed by the APP in the terminal screen can be monitored through the computer.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: because a plurality of terminals need to be tested simultaneously, but a computer screen only displays one terminal screen, the technical problem that a plurality of terminal screens cannot be displayed exists.
Disclosure of Invention
Embodiments of the present invention provide a method, an apparatus, a device, and a computer-readable medium for monitoring a terminal, which are capable of displaying a plurality of terminal screens on a computer screen.
To achieve the above object, according to an aspect of an embodiment of the present invention, there is provided a method of monitoring a terminal, including:
creating video stream positions of a plurality of terminals;
triggering websocket connection with the terminal based on an operating system of the terminal;
and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
The creating of the video stream positions displayed by the plurality of terminals comprises:
and creating the video stream positions displayed by the plurality of terminals according to the number of the connected terminals.
Based on the operating system of the terminal, triggering and websocket connection of the terminal includes:
starting a canvas corresponding to the operating system of the terminal based on the operating system of the terminal;
and calling screen mirror image software of an operating system of the terminal in the canvas, and triggering the websocket connection with the terminal.
Based on the operating system of the terminal, triggering and websocket connection of the terminal includes:
binding the websocket connection of the terminal according to the identifier of the video stream position of the terminal;
and triggering the websocket connection with the terminal based on the operating system of the terminal.
Through the websocket connection of terminal, synchronize the video stream of terminal extremely the video stream position of terminal includes:
and synchronizing the video stream of the terminal to the video stream position of the terminal by adopting image pool through the websocket connection of the terminal.
The synchronizing, through the websocket connection of the terminal, the video stream of the terminal to the video stream position of the terminal, and displaying the video stream of the terminal in the video stream position, includes:
polling the terminal by Tornado to acquire a video stream of the terminal;
and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
The synchronizing, through the websocket connection of the terminal, the video stream of the terminal to the video stream position of the terminal, and after the video stream of the terminal is displayed in the video stream position, the method further includes:
sending a test command to the terminal through the websocket connection;
and displaying the video stream of the terminal in the video stream position.
According to a second aspect of the embodiments of the present invention, there is provided an apparatus for monitoring a terminal, including:
the system comprises an establishing module, a processing module and a display module, wherein the establishing module is used for establishing video stream positions of a plurality of terminals;
the connection module is used for triggering websocket connection with the terminal based on an operating system of the terminal;
and the synchronization module is used for synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
According to a third aspect of the embodiments of the present invention, there is provided an electronic device of a monitoring terminal, including:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method as described above.
According to a fourth aspect of embodiments of the present invention, there is provided a computer readable medium, on which a computer program is stored, which when executed by a processor, implements the method as described above.
One embodiment of the above invention has the following advantages or benefits: creating video stream positions of a plurality of terminals; triggering websocket connection with the terminal based on an operating system of the terminal; and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position. With the websocket connection, the video stream of each terminal is displayed in the video stream position, and thus a plurality of terminal screens can be displayed in the computer screen.
Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
fig. 1 is a schematic diagram of a main flow of a method of monitoring a terminal according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an application scenario of an embodiment of the present invention;
FIG. 3 is a schematic diagram of a video stream location displayed by a terminal according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a video stream location displayed by another terminal according to an embodiment of the present invention;
FIG. 5 is a schematic illustration of a video stream position displayed by yet another terminal according to an embodiment of the present invention;
FIG. 6 is a schematic flow chart illustrating triggering of a websocket connection with a terminal according to an embodiment of the present invention;
FIG. 7 is a schematic flowchart of a websocket connection of a binding terminal according to an embodiment of the present invention;
FIG. 8 is a flow diagram of a synchronized video stream according to an embodiment of the present invention;
FIG. 9 is a flow chart illustrating sending test commands to synchronize video streams according to an embodiment of the invention
Fig. 10 is a schematic diagram of a main structure of an apparatus of a monitoring terminal according to an embodiment of the present invention;
FIG. 11 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;
fig. 12 is a schematic structural diagram of a computer system suitable for implementing a terminal device or a server according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
At present, a computer screen can only display one terminal screen, only one terminal is monitored on one computer screen, and the technical problem that a plurality of terminal screens cannot be displayed exists.
The reasons for the above technical problems are manifold. The mobile terminal device management platform atxserver2 is third-party open source software. In atxserver2, a terminal screen is displayed on a computer screen.
In addition, since a plurality of terminal screens cannot be displayed on one computer screen, comparison and display when a plurality of mobile phones execute the same task cannot be satisfied. This is because it is time-consuming and labor-consuming to test software compatibility, and testers need to pay attention to various operating system versions, various large terminal manufacturers, various screens, and the like. Therefore, the quality cost of ensuring compatibility test through simple manual test is very high.
In order to solve the technical problem that a plurality of terminal screens are difficult to display in one computer screen, the following technical scheme in the embodiment of the invention can be adopted.
Referring to fig. 1, fig. 1 is a schematic diagram of a main flow of a method for monitoring a terminal according to an embodiment of the present invention, and a websocket connection with the terminal is adopted to display a video stream of the terminal in a video stream position of the terminal.
Referring to fig. 2, fig. 2 is a schematic view of an application scenario of the embodiment of the present invention. In fig. 2, the computer a can receive an instruction of a tester, a computer 1 accessed remotely and a computer 2 connected to a terminal. The computer 1 is connected to the terminal 1, and the computer 2 is connected to the terminal 2 and the terminal 3.
The tester needs to remotely test in the terminal 1, the terminal 2 and the terminal 3, and display the screens of the terminal 1, the terminal 2 and the terminal 3 on the screen of the computer a, so that the tester can monitor the test result. It can be understood that the executing body of the technical solution of the embodiment of the present invention may be a computer a. Such as: browser in computer a.
S101, video stream positions of a plurality of terminals are created.
In the embodiment of the invention, the video streams of a plurality of terminals are required to be displayed on the screen of the remote computer. Then, video stream locations for multiple terminals can be created on the remote computer screen. The video stream location refers to the specific location on the remote computer screen where the terminal video is displayed.
In one embodiment of the invention, the video stream positions displayed by the plurality of terminals may be created according to the number of the plurality of terminals connected. As an example, whether a thread to which a terminal is connected is detected, and if the thread to which the terminal is connected is detected, the number of terminals connected to the remote computer is determined. Then, the remote computer screen size is a fixed size, and the video stream positions displayed by the plurality of terminals can be created according to the number of the plurality of terminals connected.
Referring to fig. 3, fig. 3 is a schematic diagram of a video stream position displayed by a terminal according to an embodiment of the present invention. The number of terminals in contact with the remote computer is 3, and the video stream positions of three terminals are included in fig. 3, namely: the video stream position of terminal 1, the video stream position of terminal 2 and the video stream position of terminal 3.
Referring to fig. 4, fig. 4 is a schematic diagram of a video stream position displayed by another terminal according to an embodiment of the present invention. The number of terminals in contact with the remote computer is 6, and the video stream positions of the 6 terminals are included in fig. 4, namely: video stream position of terminal 1, video stream position of terminal 2, video stream position of terminal 3, video stream position of terminal 4, video stream position of terminal 5 and video stream position of terminal 6.
That is, the remote computer screen is divided into a plurality of copies, one for each terminal, each terminal having a corresponding video stream location, based on the number of terminals connected to the remote computer.
It should be noted that, when the number of the terminals connected to the remote computer is too large, the position of the video stream corresponding to each terminal is too small, which may affect the tester to monitor the video stream of the terminal. Then, the video stream of the terminal can be displayed in the current page and the subsequent page. The tester may select a video stream by pulling a page scroll bar.
Referring to fig. 5, fig. 5 is a schematic diagram of a video stream position displayed by yet another terminal according to an embodiment of the present invention. The number of terminals in contact with the remote computer is 9, and fig. 5 includes video stream positions of the 9 terminals, and the tester can select the video stream of the terminal through a page scroll bar.
And S102, triggering the websocket connection with the terminal based on the terminal operating system.
In one embodiment of the invention, the terminal connected to the remote computer has a different operating system. As an example, the operating system of the terminal may be an Android system or an iOS system.
Specifically, during the connection of the terminal with the remote computer, the terminal sends parameters to the remote computer. The operating system of the terminal may be determined based on the above parameters. As an example, the parameter may be based on the parameter field: and a platform field for judging whether the operating system of the terminal is an Android system or an iOS system.
A websocket is a Protocol that performs full duplex communication over a single Transmission Control Protocol (TCP) connection. The websocket communication protocol was defined by the IETF as standard RFC 6455 in 2011 and is supplemented by RFC 7936. The websocket API is also standardized by W3C.
The websocket enables data exchange between the browser and the server to be simpler, and allows the server to actively push data to the browser. In the websocket API, the browser and the server only need to complete one handshake, and persistent connection can be directly established between the browser and the server, and bidirectional data transmission is performed.
In the embodiment of the invention, after the operating system of the terminal is determined, the remote computer can be triggered to be connected with the websocket of the terminal. The terminal communicates with the remote computer through a websocket.
Referring to fig. 6, fig. 6 is a schematic flowchart of triggering a websocket connection with a terminal according to an embodiment of the present invention, which specifically includes:
s601, starting a canvas corresponding to the operating system of the terminal based on the operating system of the terminal.
The canvas (canvas) API is a tag added newly in HTML5 for generating images in real time on a web page and can manipulate the image content, basically it is a bitmap (bitmap) that can be operated on in JavaScript. The canvas object represents an HTML canvas element- < canvas >. It has no behavior of its own, but defines an API to support scripted client drawing operations.
If the operating system of the terminal is Android, starting an Android canvas; if the operating system of the terminal is iOS, an iOS canvas is started.
S602, calling screen image software of an operating system of the terminal in the canvas, and triggering the websocket connection with the terminal.
Preset content may be displayed within the canvas. In the embodiment of the invention, in the canvas, in order to display the video stream of the terminal, screen mirroring software needs to be called, and then the remote computer is triggered to be connected with the websocket of the terminal.
As an example, for a terminal whose operating system is Android, screen mirroring software of the Android may be called to trigger a websocket connection of the terminal. As one example, the Android screen mirroring software may be Android mirror display.
As another example, if the operating system of the terminal is iOS, the screen mirroring software of Android may be called to trigger the websocket connection of the terminal. As one example, the iOS screen mirroring software may be an iOS mirror display method.
In the embodiment in fig. 6, the screen mirroring software is called according to the operating system of the terminal, which triggers the remote computer to connect to the websocket of the terminal, and establishes a channel for displaying the video stream of the terminal in the remote computer.
In the embodiment of the present invention, video stream positions of multiple terminals are created, and the video stream positions need to be set corresponding to the terminals, so that the video streams of the terminals can be conveniently displayed at preset positions.
Referring to fig. 7, fig. 7 is a schematic flowchart of a websocket connection of a binding terminal according to an embodiment of the present invention, which specifically includes:
and S701, binding the websocket connection of the terminal according to the identifier of the video stream position of the terminal.
The video stream position of the terminal can be distinguished by the identification of the video stream position. As one example, the video stream positions include video stream position 1, video stream position 2, and video stream position 3. The identifier of the video stream position 1 can be connected and bound with the websocket of the terminal 1; connecting and binding the identifier of the video stream position 2 with the websocket of the terminal 2; and binding the identification of the video stream position 3 with the websocket connection of the terminal 3.
Thus, after the web communication service between the remote computer and the terminal is triggered, the video stream of the terminal 1 can be displayed at the video stream position 1; displaying the video stream of the terminal 2 at the video stream position 2; the video stream of the terminal 3 is displayed at the video stream position 3.
And S702, triggering the websocket connection with the terminal based on the operating system of the terminal.
After the identifier of the bound video stream is connected with the websocket of the terminal, the websocket connection with the terminal can be triggered based on the operating system of the terminal.
In the embodiment of fig. 7, the identifier of the binding video stream is connected to the websocket of the terminal, and the video stream of each terminal displayed on the remote computer is independent and does not affect each other.
S103, synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
And after the remote computer is triggered to be connected with the websocket of the terminal, the terminal sends the video stream through the websocket connection. And the remote computer is connected through the websocket of the terminal and synchronizes the video streams of the plurality of terminals to the video stream position of each terminal. And the video streams of the plurality of terminals can be displayed in the video stream position.
In an embodiment of the present invention, a video stream of a terminal can be synchronized to a video stream position of the terminal by using an image pool through a websocket connection of the terminal, so as to ensure the flow of the video stream.
The imagepool is a JavaScript tool for managing picture loading, and provides a uniform solution for downloading pictures at a server side. Such as: controlling the usage amount of the picture memory; reducing repeated downloading of pictures; and controlling the number of concurrent image loading.
Referring to fig. 8, fig. 8 is a schematic flowchart of a process for synchronizing video streams according to an embodiment of the present invention, which specifically includes:
and S801, polling the terminal by Tornado to acquire the video stream of the terminal.
After establishing the websocket connection, the remote computer communicates with the terminal to synchronize the video stream of the terminal to the remote computer. Specifically, the terminal is asked at intervals whether there is a video stream that needs to be synchronized. In this way, multiple websocket terminals connected to the computer can send video streams that need to be synchronized to the remote computer.
As the number of synchronized terminals increases, the time spent polling is longer and longer in the case of a larger number of synchronized terminals, while the connected websocket may not have a video stream that needs to be synchronized, and therefore most of the time spent polling is useless.
To improve the polling efficiency, Tornado polling terminals may be used to obtain the video stream of the terminal. The epoll solution is integrated in Tornado, so that only websockets with active data are picked out for polling each time of polling, and a large amount of polling time is saved when a large number of connections exist.
epoll is the poll improved by the Linux kernel for processing large-batch file descriptors, is an enhanced version of the multiplexing IO interface select/poll under Linux, and can significantly improve the utilization rate of a system CPU under the condition that a program is only slightly active in a large number of concurrent connections. Another reason is that when an event is fetched, it does not have to traverse the entire snooped descriptor set, as long as traversing the descriptor sets that were asynchronously awakened by kernel IO events and added to the Ready queue.
Tornado is an open source web server framework. Tornado is clearly distinguished from the mainstream Web server framework: it makes the non-blocking server quite fast. Tornado can handle thousands of connections per second for polling the active terminals of the connection. Tornado is an ideal Web framework for real-time Web services.
S802, synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
After the video stream of the terminal is obtained, the video stream of the terminal is synchronized to the video stream position of the terminal through websocket connection of the terminal, and then the video stream of the terminal is displayed in the video stream position.
The video stream locations of the plurality of terminals are included at the remote computer so that the video streams of the plurality of terminals can be displayed at the remote computer.
In the embodiment of fig. 8, to synchronize video streams of multiple terminals, Tornado polling terminals may be employed to save polling time and improve polling efficiency.
In one embodiment of the present invention, in the case where a remote computer displays video streams of a plurality of terminals, it is considered that the plurality of terminals need to be remotely operated to satisfy the comparison of the plurality of terminals performing tasks.
Referring to fig. 9, fig. 9 is a schematic flowchart of sending a test command to synchronize video streams according to an embodiment of the present invention, which specifically includes:
and S901, sending a test command to the terminal through websocket connection.
In the embodiment of the invention, the remote computer needs to manage and operate the terminal for testing. In case the terminal is connected to the remote computer for the first time, the test tool can be automatically installed in the terminal. As one example, the test tools include, but are not limited to, the following: minicap, miniport or atx-agent.
In order to synchronize the video stream to the remote computer in the terminal, corresponding operations can be performed for different operating systems.
As an example, in the Android operating system, in order to mask the differences of different terminals, a uniform HTTP interface may be opened. The difference of the terminals refers to manufacturer difference and system version difference of Android.
Illustratively, services of an android debug bridge (android debug bridge) are encapsulated into an HTTP interface, and adb commands such as adb forward, install, screen and input keyerve are called conveniently.
As another example, in the iOS operating system, an open source WDA (web Driver agent) is employed, which is a mobile-side test framework. The WDA functions to interconnect and communicate the remote computer and the iOS terminal.
In one embodiment of the invention, a terminal corresponding to an Android operating system sends a test command to the terminal in an ADB communication mode through websocket connection.
In one embodiment of the invention, a terminal corresponding to an iOS operating system adopts a WDA communication mode based on the application package optimization and sends a test command to the terminal through a websocket connection.
And S902, displaying the video stream of the terminal in the video stream position.
And the remote computer remotely controls each terminal through the test command. In the video stream position, the video stream of the terminal can be displayed.
In the embodiment of fig. 9, the remote computer can display the video streams of the plurality of terminals by sending the test command to the terminals, thereby realizing the remote test of the plurality of terminals.
In the above embodiment, video stream positions of a plurality of terminals are created; triggering websocket connection with the terminal based on an operating system of the terminal; and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position. With the websocket connection, the video stream of each terminal is displayed in the video stream position, so that a plurality of terminal screens can be displayed in the remote computer screen.
Specifically, in a remote computer browser page, video streams of multiple terminals can be presented, and the state of each terminal can be monitored.
Furthermore, in the past test, repeated tests are often required on a plurality of terminals, which not only wastes time and labor, but also easily causes omission. By adopting the technical scheme in the embodiment of the invention, the video streams of a plurality of terminals can be displayed, the running condition of each terminal can be observed in real time, the abnormal terminal can be found and positioned quickly, the method and the device are convenient and quick, and the time of testers is greatly saved.
Referring to fig. 10, fig. 10 is a schematic diagram of a main structure of a device of a monitoring terminal according to an embodiment of the present invention, where the device of the monitoring terminal may implement a method of the monitoring terminal, and as shown in fig. 10, the device of the monitoring terminal specifically includes:
a setup module 1001 for creating video stream positions of a plurality of terminals.
The connection module 1002 is configured to trigger a websocket connection with the terminal based on an operating system of the terminal.
The synchronization module 1003 is configured to synchronize a video stream of the terminal to a video stream position of the terminal through the websocket connection of the terminal, and display the video stream of the terminal in the video stream position.
In an embodiment of the present invention, the establishing module 1001 is specifically configured to create video stream positions displayed by a plurality of terminals according to the number of the connected terminals.
In an embodiment of the present invention, the connection module 1002 is specifically configured to start a canvas corresponding to an operating system of a terminal based on the operating system of the terminal;
and calling screen mirror image software of an operating system of the terminal in the canvas, and triggering websocket connection with the terminal.
In an embodiment of the present invention, the connection module 1002 is specifically configured to bind a websocket connection of a terminal according to an identifier of a video stream position of the terminal;
and triggering the websocket connection with the terminal based on the operating system of the terminal.
In an embodiment of the present invention, the synchronization module 1003 is specifically configured to synchronize, through a websocket connection of the terminal, a video stream of the terminal to a video stream position of the terminal by using an image pool.
In an embodiment of the present invention, the synchronization module 1003 is specifically configured to poll the terminal by using Tornado to obtain a video stream of the terminal;
and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
In an embodiment of the present invention, the synchronization module 1003 is further configured to send a test command to the terminal through websocket connection;
in the video stream position, the video stream of the terminal is displayed.
Fig. 11 shows an exemplary system architecture 1100 to which the method of monitoring terminals or the apparatus of monitoring terminals of embodiments of the invention may be applied.
As shown in fig. 11, the system architecture 1100 may include terminal devices 1101, 1102, 1103, a network 1104, and a server 1105. The network 1104 is a medium to provide communication links between the terminal devices 1101, 1102, 1103 and the server 1105. Network 1104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
A user may use terminal devices 1101, 1102, 1103 to interact with a server 1105 over a network 1104 to receive or send messages or the like. Various messaging client applications, such as shopping applications, web browser applications, search applications, instant messaging tools, mailbox clients, social platform software, etc. (examples only) may be installed on the terminal devices 1101, 1102, 1103.
The terminal devices 1101, 1102, 1103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The server 1105 may be a server that provides various services, such as a backend management server (for example only) that provides support for shopping-like websites browsed by users using the terminal devices 1101, 1102, 1103. The backend management server may analyze and perform other processing on the received data such as the product information query request, and feed back a processing result (for example, target push information, product information — just an example) to the terminal device.
It should be noted that the method for monitoring a terminal provided in the embodiment of the present invention is generally executed by the server 1105, and accordingly, the apparatus for monitoring a terminal is generally disposed in the server 1105.
It should be understood that the number of terminal devices, networks, and servers in fig. 11 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 12, shown is a block diagram of a computer system 1200 suitable for use with a terminal device implementing an embodiment of the present invention. The terminal device shown in fig. 12 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 12, the computer system 1200 includes a Central Processing Unit (CPU)1201, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1202 or a program loaded from a storage section 1208 into a Random Access Memory (RAM) 1203. In the RAM 1203, various programs and data necessary for the operation of the system 1200 are also stored. The CPU 1201, ROM 1202, and RAM 1203 are connected to each other by a bus 1204. An input/output (I/O) interface 1205 is also connected to bus 1204.
The following components are connected to the I/O interface 1205: an input section 1206 including a keyboard, a mouse, and the like; an output portion 1207 including a display device such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 1208 including a hard disk and the like; and a communication section 1209 including a network interface card such as a LAN card, a modem, or the like. The communication section 1209 performs communication processing via a network such as the internet. A driver 1210 is also connected to the I/O interface 1205 as needed. A removable medium 1211, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is mounted on the drive 1210 as necessary, so that a computer program read out therefrom is mounted into the storage section 1208 as necessary.
In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 1209, and/or installed from the removable medium 1211. The computer program performs the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 1201.
It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present invention may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor includes a transmitting unit, an obtaining unit, a determining unit, and a first processing unit. The names of these units do not in some cases constitute a limitation to the unit itself, and for example, the sending unit may also be described as a "unit sending a picture acquisition request to a connected server".
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise:
creating video stream positions of a plurality of terminals;
triggering websocket connection with the terminal based on an operating system of the terminal;
and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
According to the technical scheme of the embodiment of the invention, video stream positions of a plurality of terminals are established; triggering websocket connection with the terminal based on an operating system of the terminal; and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position. With the websocket connection, the video stream of each terminal is displayed in the video stream position, and thus a plurality of terminal screens can be displayed in the computer screen.
The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method of monitoring a terminal, comprising:
creating video stream positions of a plurality of terminals;
triggering websocket connection with the terminal based on an operating system of the terminal;
and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
2. The method for monitoring a terminal according to claim 1, wherein the creating of the video stream positions for the plurality of terminal displays comprises:
and creating the video stream positions displayed by the plurality of terminals according to the number of the connected terminals.
3. The method for monitoring the terminal according to claim 1, wherein the triggering the websocket connection with the terminal based on the operating system of the terminal comprises:
starting a canvas corresponding to the operating system of the terminal based on the operating system of the terminal;
and calling screen mirror image software of an operating system of the terminal in the canvas, and triggering the websocket connection with the terminal.
4. The method for monitoring the terminal according to claim 1, wherein the triggering the websocket connection with the terminal based on the operating system of the terminal comprises:
binding the websocket connection of the terminal according to the identifier of the video stream position of the terminal;
and triggering the websocket connection with the terminal based on the operating system of the terminal.
5. The method for monitoring a terminal according to claim 1, wherein the synchronizing the video stream of the terminal to the video stream location of the terminal through the websocket connection of the terminal comprises:
and synchronizing the video stream of the terminal to the video stream position of the terminal by adopting image pool through the websocket connection of the terminal.
6. The method of monitoring a terminal according to claim 1, wherein the synchronizing, via the websocket connection of the terminal, the video stream of the terminal to a video stream location of the terminal in which the video stream of the terminal is displayed comprises:
polling the terminal by Tornado to acquire a video stream of the terminal;
and synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
7. The method of monitoring a terminal according to claim 1, wherein the synchronizing, via the websocket connection of the terminal, the video stream of the terminal to a video stream location of the terminal, further comprises, after displaying the video stream of the terminal in the video stream location:
sending a test command to the terminal through the websocket connection;
and displaying the video stream of the terminal in the video stream position.
8. An apparatus for monitoring a terminal, comprising:
the system comprises an establishing module, a processing module and a display module, wherein the establishing module is used for establishing video stream positions of a plurality of terminals;
the connection module is used for triggering websocket connection with the terminal based on an operating system of the terminal;
and the synchronization module is used for synchronizing the video stream of the terminal to the video stream position of the terminal through the websocket connection of the terminal, and displaying the video stream of the terminal in the video stream position.
9. An electronic device of a monitor terminal, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010152516.3A CN113360335A (en) | 2020-03-06 | 2020-03-06 | Method, device and equipment for monitoring terminal and computer readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010152516.3A CN113360335A (en) | 2020-03-06 | 2020-03-06 | Method, device and equipment for monitoring terminal and computer readable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113360335A true CN113360335A (en) | 2021-09-07 |
Family
ID=77524164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010152516.3A Pending CN113360335A (en) | 2020-03-06 | 2020-03-06 | Method, device and equipment for monitoring terminal and computer readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113360335A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090322784A1 (en) * | 2008-02-27 | 2009-12-31 | Gabriele Sartori | System and method for virtual 3d graphics acceleration and streaming multiple different video streams |
| CN105142011A (en) * | 2015-08-12 | 2015-12-09 | 青岛海信电器股份有限公司 | Web-based television terminal multi-screen interaction method and device |
| WO2017113854A1 (en) * | 2015-12-31 | 2017-07-06 | 乐视控股（北京）有限公司 | Multi-channel video streams playing method and device |
| CN108280020A (en) * | 2018-01-23 | 2018-07-13 | 广州视源电子科技股份有限公司 | Monitoring method, device, terminal and the computer storage media of computer equipment |
| CN109766163A (en) * | 2019-01-17 | 2019-05-17 | 网易（杭州）网络有限公司 | Synchronous display method and device, storage medium and electronic device |
| CN110401820A (en) * | 2019-08-15 | 2019-11-01 | 北京迈格威科技有限公司 | Multipath video processing method, device, medium and electronic equipment |
-
2020
- 2020-03-06 CN CN202010152516.3A patent/CN113360335A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090322784A1 (en) * | 2008-02-27 | 2009-12-31 | Gabriele Sartori | System and method for virtual 3d graphics acceleration and streaming multiple different video streams |
| CN105142011A (en) * | 2015-08-12 | 2015-12-09 | 青岛海信电器股份有限公司 | Web-based television terminal multi-screen interaction method and device |
| WO2017113854A1 (en) * | 2015-12-31 | 2017-07-06 | 乐视控股（北京）有限公司 | Multi-channel video streams playing method and device |
| CN108280020A (en) * | 2018-01-23 | 2018-07-13 | 广州视源电子科技股份有限公司 | Monitoring method, device, terminal and the computer storage media of computer equipment |
| CN109766163A (en) * | 2019-01-17 | 2019-05-17 | 网易（杭州）网络有限公司 | Synchronous display method and device, storage medium and electronic device |
| CN110401820A (en) * | 2019-08-15 | 2019-11-01 | 北京迈格威科技有限公司 | Multipath video processing method, device, medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102158557B1 (en) | Method and device for determining response time | |
| CN108769214B (en) | Method and apparatus for controlling edge computing device, and method and apparatus for updating data | |
| US20190012138A1 (en) | Method and apparatus for providing speech service | |
| CN109218041B (en) | Request processing method and device for server system | |
| CN110275787B (en) | Online platform data transmission method, device, medium and electronic equipment | |
| CN109981546B (en) | Method and device for acquiring remote call relation between application modules | |
| CN115996179A (en) | Service node testing method and device, readable medium and electronic equipment | |
| CN111767176B (en) | Method and device for remotely controlling terminal equipment | |
| CN112685104A (en) | Application program starting control method and device, electronic equipment and storage medium | |
| CN113360335A (en) | Method, device and equipment for monitoring terminal and computer readable medium | |
| CN110019059B (en) | Timing synchronization method and device | |
| CN112579447A (en) | Browser testing method and device | |
| CN113434384B (en) | Pressure testing method and device | |
| CN112131095B (en) | Pressure testing method and device | |
| CN112688982B (en) | User request processing method and device | |
| KR101251099B1 (en) | Method for monitoring a process of remote access and system for monitoring a process of remote access | |
| CN113094131A (en) | Prompt resource display method, device, terminal, server and storage medium | |
| CN110768855B (en) | Method and device for testing linkmzation performance | |
| CN108270803B (en) | Method and system for realizing transmission of network file and desktop application through webpage technology | |
| CN113765960B (en) | Operation and maintenance tangential flow method, system and computer readable medium | |
| CN113900830B (en) | Resource processing method and device, electronic equipment and storage medium | |
| CN113938475B (en) | Data transmission method | |
| CN112953810B (en) | Processing method and device of network request | |
| CN113377603B (en) | Page monitoring method and device | |
| US20240152504A1 (en) | Data interaction method, apparatus, and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |