WO2021174718A1

WO2021174718A1 - Remote monitoring control system and terminal

Info

Publication number: WO2021174718A1
Application number: PCT/CN2020/097603
Authority: WO
Inventors: 罗翀; 彭创
Original assignee: 深圳中兴网信科技有限公司
Priority date: 2020-03-05
Filing date: 2020-06-23
Publication date: 2021-09-10
Also published as: CN111381922A

Abstract

A remote monitoring control system (100) and a terminal (600). The remote monitoring control system (100) is used for the terminal (600), the terminal (600) can perform data instruction interaction with a server, and the remote monitoring control system (100) runs in an IOS system. The remote monitoring control system (100) comprises a service unit (102), an interaction unit (106), and a processing unit (104); the service unit (102) is configured to receive a control instruction, and send the control instruction to the interaction unit (106); the interaction unit (106) is configured to encapsulate the data format of the control instruction sent by the service unit (102) into a first format corresponding to the server, and send an encapsulated control instruction to the processing unit (104); the processing unit (104) is configured to send the encapsulated control instruction to the server, receive returned data sent by the server, and send the returned to the interaction unit (106); the interaction unit (106) is further configured to encapsulate the data format of the returned data into a second format corresponding to the service unit (102), and send encapsulated returned data to the service unit (102); and the service unit (102) is further configured to execute, according to the encapsulated returned data, an operation corresponding to the encapsulated returned data.

Description

Remote monitoring control system and terminal

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office with an application number of 202010146031.3 on March 5, 2020. The entire content of this application is incorporated into this application by reference.

Technical field

This application relates to the technical field of security monitoring, for example, to a remote monitoring control system and a terminal.

Background technique

In related technologies, for some "closed" software systems, such as Apple's IOS system (IOS is a mobile operating system developed by Apple, which is based on the Darwin system and not the original Unix system, so IOS is not only a part of Unix but also a system different from Unix), its system architecture is different from the common "open" system architecture, so it is difficult to implement remote control systems that comply with international unified standards on these closed systems.

Summary of the invention

This application solves at least one of the technical problems existing in the related technology.

The first aspect of this application provides a remote monitoring control system, which is used in a terminal. The terminal can interact with the server for data instructions. The remote monitoring control system runs on the IOS system. The control system includes: a business unit, an interaction unit And processing unit; the business unit is set to receive control instructions and send the control instructions to the interactive unit; the interactive unit is set to encapsulate the data format of the control instructions sent by the business unit into the first format corresponding to the server, and the packaged The control instruction is sent to the processing unit; the processing unit is set to send the encapsulated control instruction to the server, and to receive the return data sent by the server, and send the return data to the interactive unit; the interactive unit is also set to return the data format It is encapsulated into a second format corresponding to the business unit, and the encapsulated return data is sent to the business unit; the business unit is also set to perform operations corresponding to the encapsulated return data according to the encapsulated return data.

The second aspect of the present application provides a terminal, including: a human-computer interaction device, which is used to receive operation behaviors and convert the operation behaviors into control instructions that can be recognized by a computer device; a communication device, which can communicate with The servers carry out data instruction interaction; as in the remote monitoring control system provided in any of the above technical solutions, the remote monitoring control system is connected with the human-computer interaction device and the communication device.

Description of the drawings

Fig. 1 shows a structural block diagram of a remote monitoring control system according to an embodiment of the present application;

Figure 2 shows a schematic diagram of the software design architecture of a remote monitoring control system according to an embodiment of the present application;

Fig. 3 shows a schematic diagram of software operation logic of a remote monitoring control system according to an embodiment of the present application;

FIG. 4 shows a schematic diagram of the interaction of software login, acquisition of a video resource list, heartbeat, and logout of the remote monitoring control system according to an embodiment of the present application;

Figure 5 shows a schematic diagram of the interaction of the software of the remote monitoring control system initiating real-time video, pan-tilt related operations, and closing real-time video according to an embodiment of the present application;

Fig. 6 shows a structural block diagram of a terminal according to an embodiment of the present application.

Detailed ways

The application will be described below with reference to the drawings and embodiments. The following describes the remote monitoring control system and terminal according to some embodiments of the present application with reference to FIGS. 1 to 6.

Example one:

As shown in FIG. 1, in the embodiment of the first aspect of the present application, a remote monitoring control system 100 is provided for use in a terminal. The terminal can interact with the server for data instructions. The remote monitoring control system 100 runs on IOS. The remote monitoring control system 100 includes: a business unit 102, an interactive unit 104, and a processing unit 106; the business unit 102 is set to receive control instructions and send the control instructions to the interactive unit 106; the interactive unit 106 is set to set the business unit 102 The data format of the sent control instruction is encapsulated into the first format corresponding to the server, and the encapsulated control instruction is sent to the processing unit 104; the processing unit 104 is configured to send the encapsulated control instruction to the server, and receive the data sent by the server To return data, send the returned data to the interactive unit 106; the interactive unit 106 is also configured to encapsulate the data format of the returned data into a second format corresponding to the business unit 102, and send the encapsulated return data to the business unit 102 ; The business unit 102 is also configured to perform operations corresponding to the encapsulated return data according to the encapsulated return data.

In this embodiment, the remote monitoring control system 100 includes a business unit 102 and a processing unit 104. The business unit 102 is located at the upper layer of the system and is represented as upper-layer software. The business unit 102 can directly display the User Interface (UI) interface. , And receive the user's direct operation. The processing unit 104 is located at the bottom layer. After the business unit 102 receives the user's operation, the business unit 102 sends the corresponding control instructions to the interaction unit 106. The interaction unit 106 serves as the system middle layer and is responsible for carrying the communication between the top-level system and the bottom-level static library. Data interaction. The business unit 102 first sends the control instruction to the interaction unit 106 in the middle layer. The interaction unit 106 encapsulates the data format of the control instruction, encapsulates it into the first format corresponding to the server, and sends the encapsulated control instruction to the bottom layer for processing. Unit 104. The processing unit 104 forwards the control instruction in the first format to the server, which can be recognized by the server and execute the corresponding data operation. At the same time, the processing unit 104 receives the return data for the control instruction from the server, and calls back the return data to the business unit 102, and the business unit 102 encodes and decodes the return data, and executes corresponding operations.

Because servers under different systems or architectures may have different data formats from the terminal, in order to ensure that the terminal can directly perform corresponding operations when receiving the server's return data, after the underlying processing unit 104 receives the server's return data, The return data is sent to the interaction unit 106 of the middle layer, and the interaction unit 106 encapsulates the format of the return data into a second format corresponding to the business unit 102, and calls back to the business unit 102.

The service unit 102 and the processing unit 104 are isolated from each other by setting the interaction unit 106, so that all messages and stream data can be in the User Datagram Protocol (udp)/Transmission Control Protocol (Transmission Control Protocol, tcp) mode. With support, the interaction unit 106 of the middle layer is used to perform message callback and independent encapsulation of data processing, so that the development of the top-level system does not need to pay attention to the bottom-level protocol, and data docking with a unified standard platform can be easily realized.

Through the embodiments provided in this application, the security monitoring system sends control instructions to the processing unit 104 of the bottom layer by setting the business unit 102 of the top system, and the processing unit 104 executes the unified sending and receiving callbacks. Therefore, regardless of the architecture of the top system, it passes through the bottom layer. The unified standards for data interaction, and then realize the remote monitoring and control system that can send and receive data in real time and comply with the international unified standards.

In an embodiment of the present application, the processing unit 104 includes a public interface, and the processing unit 104 is configured to send the encapsulated control instruction to the server in the following manner: send the encapsulated control instruction to the server through the public interface.

In this embodiment, the processing unit 104 at the bottom layer includes a public interface that can be invoked by different services of the top-level system, and the public interface is exposed in the bottom static library, and data can be sent and received uniformly through this interface. Furthermore, the Session Initiation Protocol (SIP) (SIP is a multimedia communication protocol formulated by the Internet Engineering Task Force (IETF)) client login, user permission acquisition, and video Resource acquisition, heartbeat keep-alive, line status control and processing, video resource playback and control related PTZ, picture capture, local recording, logout, logout, and other functions.

In an embodiment of the present application, the control instruction includes a login instruction, and the return data includes a login result. The processing unit 104 is configured to receive the return data sent by the server in the following manner, and receive the return data corresponding to the login instruction sent by the server, And parse the returned data to obtain the login result; the business unit 102 is set to perform operations corresponding to the encapsulated return data according to the encapsulated return data in the following manner: the business unit 102 receives the login result sent by the processing unit 104 through the interaction unit 106 , Generate the prompt message corresponding to the login result, and display the prompt message.

In this embodiment, the control instruction includes a login instruction, that is, the user sends a login request through the business unit 102 of the top system, and the interaction unit 106 encapsulates the login request and sends it through the processing unit 104 of the bottom layer. The login request includes information such as the target port of the server, the account and key corresponding to the target port and the requested service. After receiving the login request, the server authenticates the login request, and returns a login result of "login successful" after the authentication is passed, and returns a result of "login failed" if the authentication fails. After receiving the encapsulated return data, the processing unit 104 decodes the encapsulated data via the interaction unit 106 to obtain a login result that can be recognized by the service unit 102, and the service unit 102 generates corresponding prompt information according to the login result, such as "login successful" Or "Login failed", and display the corresponding prompt information on the interactive UI.

In an embodiment of the present application, the control instruction includes a monitoring video acquisition instruction, and the return data includes video stream data. The processing unit 104 is also configured to establish a streaming data transmission connection with the server through a public interface, and the processing unit 104 is configured to pass the following Method to receive the return data sent by the server, and send the return data to the interaction unit 106: receive the video stream data through the streaming data transmission connection, and forward the video stream data to the interaction unit 106; the interaction unit 106 is set to send the return data in the following manner Encapsulate the data format of the video stream data into the second format corresponding to the service unit 102, and send the encapsulated return data to the service unit 102: encapsulate the data format of the video stream data into the second format corresponding to the service unit 102, and The encapsulated video stream data is sent to the service unit 102. In this embodiment, the control instruction includes a surveillance video acquisition instruction. After successfully logging in to the remote monitoring server, the processing unit 104 at the bottom layer establishes a streaming data transmission connection with the server through a public interface. In order to achieve real-time acquisition of surveillance video, it is necessary for the service unit 102 to receive and display streaming video data in real time. In order to realize streaming data transmission, the processing unit 104 needs to establish a stable data connection with the server, continuously receive video streaming data through the data connection, and synchronously call back to the interaction unit 106 in the middle layer.

In an embodiment of the present application, the service unit 102 is configured to perform operations corresponding to the encapsulated return data according to the encapsulated return data in the following manner: decode the encapsulated video stream data to obtain video information, and Play video information.

In this embodiment, the stream data may include continuously received multiple independently encapsulated data packets, and the interaction unit 106 decapsulates these data packets, converts them into a data format corresponding to the business unit 102, and sends them to the business unit 102. . The service unit 102 receives the video stream data, decodes the video, and plays the corresponding surveillance video, thereby realizing real-time playback of the remote surveillance video.

In an embodiment of the present application, the control instruction further includes a surveillance video termination instruction, and the processing unit 104 is further configured to: cut off the video stream data according to the surveillance video termination instruction and generate a corresponding callback instruction; the service unit 102 is also set to: The callback instruction stops playing the video information.

In an embodiment of the present application, the processing unit 104 is further configured to: maintain the heartbeat detection for the server based on the successful login information for the login instruction returned by the server; in the case of the heartbeat detection timeout, generate a heartbeat timeout prompt message , And send the heartbeat timeout prompt information to the service unit 102, so that the service unit 102 displays the heartbeat timeout prompt information.

In this embodiment, after successfully logging in to the remote monitoring server, it is necessary to maintain a connection heartbeat with the server. The bottom-level processing unit 104 performs heartbeat detection on the server. If the heartbeat detection times out, it means that the current terminal has been disconnected from the server. At this time, the processing unit 104 generates a heartbeat timeout prompt message and sends it to the business unit 102 for the business unit 102 is displayed through the UI to prompt the user.

In an embodiment of the present application, the remotely monitored control system 100 is used in an IOS system, and the business unit 102 of the remotely monitored control system 100 includes a static library.

In this embodiment, the remote monitoring control system 100 is used in the IOS system, and the client of the remote monitoring control system 100, that is, the business unit 102 is in the open source exosip, tinyXML, boost, log4cpp, live555, Dahua IOS decoding and playback library On the basis of secondary development. The static library is located in the bottom layer, the message protocol interaction between the bottom layer and the server can use exosip, the message uses tinyXML for encoding and decoding, and the bottom system library integrates boost, the log module uses log4cpp encapsulation, the bottom stream media data forwarding process uses live555, and the data stream playback Integrated Dahua open source IOS decoding and playback library, and finally encapsulated into a static library that can be directly called and provided to the upper layer. The business unit 102 of the upper system can release IOS client software after integrating the static library, so as to realize the IOS client under the national standard monitoring platform.

In an embodiment of the present application, the service unit 102 complies with the SIP session initiation protocol and is compiled by Objective-C; the interaction unit 106 is compiled by C language; and the static library is a C++ static library.

In this embodiment, Objective-C is a general-purpose, high-level, object-oriented programming language, and the trademark right of Objective-C belongs to Apple, which is also the main developer of this programming language. Therefore, the client of the top-level IOS system, that is, the business unit 102, can meet the needs of IOS developers through Objective-C compilation.

The interaction unit 106 of the middle layer is implemented in C language, and is mainly used for the interaction processing between the bottom C++ and the Objective-C layer business logic of the upper layer of IOS. The encapsulated bottom message is notified to the middle layer through registration callback, and then notified to the upper layer of IOS through message callback. Objective-C layer.

The function module library that the underlying C++ static library depends on is easy to obtain. The multiple dependent module libraries that the underlying C++ static library depends on need to be compiled under different conditions to achieve the mainstream architecture that can support armv7, arm64, i386, x86_64 and other IOS systems. .

Embodiment two:

In a complete embodiment of this application, this application provides a method based on the national standard GB28181 (from the "Technical Requirements for Information Transmission, Exchange, and Control of Security Video Surveillance Networking System", proposed by the Science and Technology Information Bureau of the Ministry of Public Security, The Security and Alarm System Standardization Technical Committee (SAC/TC100) is under the jurisdiction of a national standard jointly drafted by the First Research Institute of the Ministry of Public Security and other units). The IOS client of the monitoring platform. The secondary development is based on the open source exosip, tinyXML, boost, log4cpp, live555, Dahua IOS decoding and playback library. The bottom layer interacts with the national standard server message protocol using exosip (exosip is a SIP protocol stack that follows the IETF standard and the source code is open), and the message uses tinyXML (tinyXML is an extensible markup language based on the Document Object Model (DOM) Extensible Markup Language (XML) parser) performs encoding and decoding, and the underlying system library integrates Boost (Boost is the general term for some C++ libraries that provide extensions to the C++ language standard library. The Boost library is a portable C++ library that provides source code. As a backup of the standard library, it is one of the development engines of the C++ standardization process), the log module uses log4cpp (Log4cpp is an open source C++ class library, which provides the use of logging and trace debugging functions in C++ programs) encapsulation, the underlying stream Media data forwarding processing uses live555 (live555 is a cross-platform C++ open source project that provides solutions for streaming media. It realizes standard streaming media transmission. It is a cross-platform C++ open source project that provides solutions for streaming media. It implements Supports standard streaming media transmission protocols such as Real-time Transport Protocol (RTP)/Real-time Transport Control Protocol (RTCP), RTSP), SIP, etc.), data stream playback is integrated Dahua open source IOS decoding and playback library is finally encapsulated into a static library that can be directly called and provided to the upper layer. After the upper layer integrates the static library, the IOS client software can be released to realize the IOS client under the national standard monitoring platform.

Specific implementations include:

1. The bottom layer of the IOS system depends on the compilation of open source libraries.

First obtain the open source exosip, tinyXML, boost, log4cpp, live555 source code projects, and then set the compile option conditions on the IOS system to run the compile command, you can compile exosip under the mainstream IOS architectures supporting armv7/arm64/i386/x86_64 , TinyXML, boost, log4cpp and live555 libraries for the underlying data processing module.

2. The realization of the underlying data processing module.

Realize the development and packaging of the bottom-level interactive processing module for the underlying message of the monitoring platform server-side and the streaming data corresponding to the session, and provide public interfaces such as login, logout, real-time playback of video resources, pan-tilt control, and various message registration callback implementations. Data processing can support udp or tcp mode.

3. IOS static library compilation.

Use the Xcode development tool in the IOS system to compile a static library that can be directly used by the upper layer.

4. The realization of the middle layer that interacts between the upper layer of IOS and the C++ layer of the underlying data processing.

Due to different systems and languages, the middle layer (implemented by C language) is mainly used for the interaction processing of the underlying C++ and the Objective-C layer business logic of the IOS upper layer. The encapsulated low-level message is notified to the middle layer through the registration callback, and then notified through the message callback. The Objective-C layer of the IOS upper layer. The schematic diagram of the software design architecture is shown in Figure 2.

In application, as shown in Figure 3, first install the software, and run the client software after the installation is successful. The client software initiates a login, encapsulates the user name, password, server Internet Protocol (IP) address, and port login information instructions and sends it to the server, and receives the login information returned by the server. If the login is successful, it will automatically maintain the heartbeat with the national standard platform server. If the heartbeat times out, a corresponding prompt will be issued.

After the login is successful, obtain a list of video resources corresponding to the user's rights. If the obtaining fails, you need to log in again. After the acquisition is successful, the bottom layer establishes a streaming data connection with the server, and the upper layer client performs real-time playback of the video resource. If the playback fails (video encoding is not supported, etc.), a corresponding prompt is issued. After the video is successfully played, further control instructions can be sent to the server to perform related operations such as PTZ control, screenshots, and local video recording.

After the operation is completed, close the real-time video and perform the logout operation.

The interactive schematic diagram of software login, video resource list acquisition, heartbeat and logout is shown in Figure 4. The interactive parties include the IOS upper layer, the IOS bottom layer processing unit, and the remote national standard platform server.

The IOS upper-level business unit sends a login request to the processing unit, and the processing unit sends the encapsulated login request to the national standard platform server. The processing unit receives the login information and calls back to the IOS upper-layer business unit. If the login fails, the IOS upper-layer business unit will give a corresponding prompt.

If the login is successful, the underlying processing unit maintains the heartbeat keep-alive detection with the server. If the heartbeat times out, the prompt message will be called back, and the IOS upper-layer business unit will prompt to log in again.

After the login is successful, the video resource is obtained through the bottom processing unit, the server sends the video resource to the corresponding user, the bottom processing unit calls back to the IOS upper business unit, and some business units perform video display.

When logout is required, the IOS upper-level business unit issues a logout instruction, and the bottom-level processing unit transmits the encapsulated logout instruction to the server, and the server disconnects the connection according to the logout instruction.

The software initiates real-time video, PTZ related operations, and closes the real-time video interaction schematic diagram as shown in Figure 5. The interactive parties include the IOS upper-level business unit, the IOS bottom-level processing unit, and the remote national standard platform server.

The IOS upper-layer business unit sends a real-time video request, and the IOS lower-layer processing unit sends the encapsulated video request to the national standard platform server. The server returns the success/failure information corresponding to the video request, and the processing unit calls back to the IOS upper-layer business unit. If the request fails , IOS upper business unit displays corresponding prompt information.

After the request is successful, the server forwards and pushes the real-time video data stream, and calls back to the upper IOS business unit via the bottom processing unit, and the IOS upper business unit (IOS client) calls the Dahua IOS decoder for playback.

During the video playback process, the IOS upper-level business unit sends related operation requests for the monitoring pan/tilt, and the IOS bottom-level processing unit sends the encapsulated operation request to the server, and the server forwards it to the corresponding monitoring pan/tilt during the monitoring video playback process. Control the monitoring pan/tilt to change the angle.

When the service ends, the IOS upper-layer business unit sends a request to close the real-time video, and the IOS lower-layer processing unit sends the encapsulated request to the server, and the server cuts off the video data stream.

The dependent library in the embodiment of the present application is an open source library, and the functional module library dependent on the underlying C++ static library is easy to obtain. Compiling the various dependent module libraries that the IOS underlying C++ static library depends on needs to be compiled under different conditions to support mainstream IOS architectures such as armv7/arm64/i386/x86_64. The underlying library can be used freely after the compilation conditions are set in the compilation environment and compiled.

In the embodiment of the present application, the business is isolated from the data processing. Optionally, the business and the underlying data processing are separated through callback processing at different levels, and all messages and stream data can support the udp mode or the tcp mode. Using the middle-layer message callback and the independent encapsulation of the underlying data processing, the IOS upper-layer development does not need to pay attention to the detailed and cumbersome interactions of the underlying protocols. It can enable users to log in to the national standard monitoring platform, obtain video resources under the corresponding user rights of the national standard monitoring platform, and ensure heartbeat with the national standard monitoring platform Live, control, process and play point-by-point videos in an offline state, and control the basic functions of the relevant national standard client such as PTZ, screenshots, local recording, logout, and log records.

At the same time, it can compile a static library directly for IOS upper-level development. The compiled static library can be directly provided to third parties for use by developers who need to implement the SIP client of the national standard GB28181 under IOS. For the national standard GB28181 video playback platform with complex functions and various types of business scenarios, it includes basically all client service processing and module integration. On this basis, the client customization development under the national standard GB28181 monitoring platform can be carried out flexibly.

Embodiment three:

As shown in FIG. 6, in an embodiment of the present application, a terminal 600 is provided, including: a human-computer interaction device 602. The human-computer interaction device 602 is configured to receive an operation behavior and convert the operation behavior into a computer that can be used by a computer. Device identification control instructions; communication device 604, communication device 604 is set to interact with the server for data instructions; such as the remote monitoring control system 606 provided in any of the above embodiments, the remote monitoring control system 606 interacts with man-machine The device 602 and the communication device 604 are connected.

In this embodiment, the human-computer interaction device may be a touch screen, or a combination of an output device such as a display screen and an input device such as a keyboard. Communication equipment includes wireless communication equipment, which can support wireless fidelity (Wi-Fi) (wireless local area network technology based on the IEEE 802.11 standard created by the Wi-Fi Alliance) communication, and third-generation mobile communication technology (3rd Generation mobile communication technology) , 3G) communication, 4th Generation mobile communication technology (4G) communication and 5th Generation Mobile Communication Technology (5G) communication. In the description of this application, the term "plurality" refers to two or more than two. Unless otherwise clearly defined, the orientation or positional relationship indicated by the terms "upper", "lower", etc. is based on the orientation described in the drawings. The or positional relationship is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the pointed device or element must have a specified orientation, be constructed and operated in a specified orientation, and therefore cannot be understood as a limitation of the application; "Connected", "installed", "fixed", etc. should all be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or through an intermediary. Indirectly connected. For those of ordinary skill in the art, the specific meanings of the above-mentioned terms in this application can be understood according to specific circumstances.

Claims

A remote monitoring control system, used in a terminal, the terminal can interact with a server for data instructions, the remote monitoring control system runs on an IOS system, and includes: a business unit, an interaction unit, and a processing unit;

The service unit is configured to receive a control instruction, and send the control instruction to the interaction unit;

The interaction unit is configured to encapsulate the data format of the control instruction sent by the service unit into a first format corresponding to the server, and send the encapsulated control instruction to the processing unit;

The processing unit is configured to send the encapsulated control instruction to the server, receive the return data sent by the server, and send the return data to the interaction unit;

The interaction unit is further configured to encapsulate the data format of the return data into a second format corresponding to the business unit, and send the encapsulated return data to the business unit;

The business unit is further configured to perform operations corresponding to the encapsulated return data according to the encapsulated return data.
The remote monitoring control system according to claim 1, wherein the processing unit includes a public interface, and the processing unit is configured to send the encapsulated control instruction to the server in the following manner:

The encapsulated control instruction is sent to the server through the public interface.
The remote monitoring control system according to claim 2, wherein the control instruction includes a login instruction, the return data includes a login result, and the processing unit is configured to receive the return data sent by the server in the following manner:

The processing unit receives the return data corresponding to the login instruction sent by the server, and parses the return data to obtain the login result;

The business unit is set to perform an operation corresponding to the encapsulated return data according to the encapsulated return data in the following manner:

The business unit receives the login result sent by the processing unit through the interaction unit, generates prompt information corresponding to the login result, and displays the prompt information.
The remote monitoring control system according to claim 2, wherein the control instruction includes a monitoring video acquisition instruction, the return data includes video stream data, and the processing unit is further configured to communicate with the The server establishes a streaming data transmission connection;

The processing unit is configured to receive the return data sent by the server and send the return data to the interaction unit in the following manner: receive the video stream data through the stream data transmission connection, and transfer the video Forwarding the stream data to the interaction unit;

The interaction unit is configured to encapsulate the data format of the return data into a second format corresponding to the business unit by the following method, and send the encapsulated return data to the business unit: send the video stream The data format of the data is encapsulated into a second format corresponding to the service unit, and the encapsulated video stream data is sent to the service unit.
The remote monitoring control system according to claim 4, wherein the service unit is configured to perform an operation corresponding to the encapsulated return data according to the encapsulated return data by: decoding the encapsulated return data After the video stream data, to obtain the video information, and play the video information.
The remote monitoring control system according to claim 5, wherein the control instruction further includes a monitoring video termination instruction, and the processing unit is further configured to:

Cut off the video stream data according to the surveillance video termination instruction, and generate a corresponding callback instruction;

The service unit is further configured to stop playing the video information according to the callback instruction.
The remote monitoring control system according to claim 3, wherein the processing unit is further configured to:

Maintaining the heartbeat detection for the server based on receiving the successful login information for the login instruction returned by the server;

In the case that the heartbeat detection times out, generate heartbeat timeout prompt information, and send the heartbeat timeout prompt information to the service unit, so that the service unit displays the heartbeat timeout prompt information.
The remote monitoring control system according to any one of claims 2 to 7, wherein the service unit includes a static library.
The remote monitoring control system according to claim 8, wherein:

The service unit complies with the session initiation protocol SIP and is compiled by Objective-C;

The interaction unit is compiled by C language;

The static library is a C++ static library.
A terminal, including:

A human-computer interaction device, the human-computer interaction device is configured to receive an operation behavior, and convert the operation behavior into a control instruction that can be recognized by a computer device;

A communication device, where the communication device is configured to exchange data instructions with the server;

The remote monitoring control system according to any one of claims 1 to 9, wherein the remote monitoring control system is connected to the human-computer interaction device and the communication device.