CN111381922A - Remote monitoring control system and terminal - Google Patents
Remote monitoring control system and terminal Download PDFInfo
- Publication number
- CN111381922A CN111381922A CN202010146031.3A CN202010146031A CN111381922A CN 111381922 A CN111381922 A CN 111381922A CN 202010146031 A CN202010146031 A CN 202010146031A CN 111381922 A CN111381922 A CN 111381922A
- Authority
- CN
- China
- Prior art keywords
- server
- data
- unit
- instruction
- control system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/2871—Implementation details of single intermediate entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides a remote monitoring control system and a terminal, wherein the remote monitoring control system is used for the terminal, the terminal can carry out data instruction interaction with a server, the remote monitoring control system runs in an IOS system, and the control system comprises: the service unit is used for receiving the control instruction and sending the control instruction to the interaction unit; the interaction unit is used for packaging the data format of the control instruction sent by the service unit into a first format corresponding to the server and sending the first format to the processing unit so that the processing unit sends the control instruction to the server; the processing unit receives the return data sent by the server, encapsulates the data format of the return data into a second format corresponding to the service unit through the interaction unit, and sends the second format to the service unit so that the service unit executes corresponding operation according to the return data. Data interaction is carried out through the unified standard of the bottom layer, and then the remote monitoring control system which accords with the international unified standard is realized.
Description
Technical Field
The invention relates to the technical field of security monitoring, in particular to a remote monitoring control system and a terminal.
Background
In the related art, for some "closed" software systems, such as an apple IOS system (IOS is a mobile operating system developed by apple, and is based on a Darwin system and is not an original unix system, and therefore IOS is a part of unix and is different from unix system), the system architecture is different from a common "open" system architecture, and therefore it is difficult to implement a remote control system conforming to the international unified standard on these closed systems.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, a first aspect of the invention proposes a remotely monitored control system.
A second aspect of the present invention is directed to a terminal.
In view of the above, a first aspect of the present invention provides a remote monitoring control system for a terminal, where the terminal is capable of performing data instruction interaction with a server, and the remote monitoring control system operates in an IOS system, and the control system includes: the service unit is used for receiving the control instruction and sending the control instruction to the interaction unit; the interaction unit is used for packaging the data format of the control instruction sent by the service unit into a first format corresponding to the server and sending the first format to the processing unit so that the processing unit sends the control instruction to the server; the processing unit receives the return data sent by the server, encapsulates the data format of the return data into a second format corresponding to the service unit through the interaction unit, and sends the second format to the service unit so that the service unit executes corresponding operation according to the return data.
In the technical scheme, the control system for remote monitoring comprises a service unit and a processing unit, wherein the service unit is positioned on the upper layer of the system and is represented as upper-layer software, and the service unit part can directly display a User Interface (UI) Interface and receive direct operation of a User. The processing unit is positioned at the bottom layer, after the service unit receives the operation of the user, the service unit sends the corresponding control instruction to the interaction unit, and the interaction unit is used as a system middle layer and is responsible for bearing data interaction between the top layer system and the bottom layer static library. Specifically, the service unit firstly sends the control instruction to the interaction unit in the middle layer, the interaction unit encapsulates the data of the control instruction, specifically encapsulates the data into data in a first format corresponding to the target server, and sends the encapsulated control instruction to the bottom layer processing unit. The control instruction in the first format is forwarded to the server through the processing unit, and can be recognized by the server and execute corresponding data operation. Meanwhile, the processing unit receives return data aiming at the control instruction from the server and calls back the return data to the service unit, and the service unit encodes and decodes the return data and executes corresponding operation.
Because the data formats of the servers under different systems or architectures may be different from those of the terminal, in order to ensure that the terminal can directly execute corresponding operations when receiving the return data of the server, the bottom processing unit sends the return data to the interaction unit in the middle layer after receiving the return data of the server, and the interaction unit encapsulates the format of the return data into a second format corresponding to the service unit and calls back the second format to the service unit.
The service unit and the processing unit are isolated by setting the interaction unit, so that all messages and streaming data can be supported in a udp/tcp mode, and the interaction unit in the middle layer is utilized to execute message callback and data processing independent encapsulation, so that the top-layer system development does not need to pay attention to a bottom-layer protocol, and the data docking with a unified standard platform can be conveniently realized.
According to the technical scheme provided by the invention, the security monitoring system executes the unified transceiving callback by the processing unit through the interaction unit between the service unit of the top IOS system and the bottom processing unit, so that data interaction is carried out through the unified standard of the bottom no matter what architecture the top system is, and a remote monitoring control system which can receive and transmit data in real time and accords with the international unified standard is further realized.
In addition, the remote monitoring control system in the above technical solution provided by the present invention may further have the following additional technical features:
in any of the above technical solutions, the processing unit includes a common interface, and the processing unit sends the control instruction to the server, which specifically includes: and sending the encapsulated control instruction to a server through a public interface.
In the technical scheme, the processing unit at the bottom layer includes a common interface, the common interface can be used for calling different services of the top layer system, the common interface is in an exposed state in a bottom layer static library, and uniform data transceiving can be realized through the interface, so that functions of logging in, acquiring user rights, acquiring video resources, keeping heartbeat alive, controlling and processing linear states, playing and controlling related cloud deck, capturing images, recording locally, logging out, logging in and the like of an SIP (Session Initiation Protocol, which is a multimedia communication Protocol established by IETF) client side are realized in a closed system.
In any of the above technical solutions, the control instruction includes a login instruction, the return data includes a login result, the service unit receives the return data sent by the server through the processing unit, and executes a corresponding operation according to the return data, which specifically includes: the processing unit receives return data which are sent by the server and correspond to the login instruction, and analyzes the return data to obtain a login result; and the service unit receives the login result sent by the processing unit, generates prompt information corresponding to the login result and displays the prompt information.
In the technical scheme, the control instruction comprises a login instruction, namely, a user sends a login request through a service unit of a top-level system, and the interaction unit packages the login request and then sends the login request through a bottom-level processing unit. The login request comprises information such as a server target port, an account and a key corresponding to the target port and the requested service. And after receiving the login request, the server authenticates the login request, returns a login result of login success after the authentication is passed, and returns a login failure result if the authentication is failed. After receiving the encapsulated return data, the processing unit decodes the encapsulated data through the interaction unit to obtain a login result which can be identified by the service unit, and the service unit generates corresponding prompt information according to the login result, such as 'login success' or 'login failure', and displays the corresponding prompt information on the interaction UI.
In any of the above technical solutions, the control instruction includes a surveillance video acquisition instruction, the return data includes video stream data, and the processing unit is further configured to: establishing a streaming data transmission connection with the server through the common interface, receiving video streaming data through the streaming data transmission connection, and forwarding the video streaming data to the service unit.
In the technical scheme, the control instruction comprises a monitoring video acquisition instruction. After the remote monitoring server is successfully logged in, the underlying processing unit establishes a streaming data transmission connection with the server through the public interface. In order to achieve real-time acquisition of the surveillance video, it is necessary for the service unit to receive and display streaming video data in real time. In order to realize streaming data transmission, the processing unit needs to establish a stable data connection with the server, continuously receive video streaming data through the data connection, and synchronously call back to the interaction unit in the middle layer.
In any of the above technical solutions, the service unit executes the corresponding operation according to the returned data, specifically including: decoding the video stream data to obtain video information, and playing the video information.
In the technical scheme, the stream data may include a plurality of independently encapsulated data packets that are continuously received, and the interaction unit decapsulates the data packets, converts the data packets into a data format corresponding to the service unit, and then sends the data packets to the service unit. And the service unit receives the video stream data, decodes the video, and plays the corresponding monitoring video, thereby realizing the real-time playing of the remote monitoring video.
In any of the above technical solutions, the processing unit is further configured to: based on the condition that successful login information for a login instruction returned by the server is received, heartbeat detection for the server is maintained; and generating heartbeat overtime prompt information based on the condition of heartbeat detection overtime, and sending the heartbeat overtime prompt information to the service unit so that the service unit displays the heartbeat overtime prompt information.
In the technical scheme, after the remote monitoring server is successfully logged in, the heartbeat of the server needs to be kept connected. Specifically, heartbeat detection is carried out on the server through the processing unit at the bottom layer, if the heartbeat detection is overtime, the condition that the current terminal is disconnected with the server is indicated, and at the moment, the processing unit generates heartbeat overtime prompt information and sends the heartbeat overtime prompt information to the service unit so that the service unit can be displayed through the UI to prompt a user.
In any of the above technical solutions, the remote monitoring control system is used in an IOS system, and the remote monitoring control system further includes: and the business unit comprises the static library.
In the technical scheme, the remote monitoring control system is used for an IOS system, and specifically, a client of the remote monitoring control system, namely a service unit, is developed secondarily on the basis of open-source exosip, tinyXML, boost, log4cpp, live555 and Dahua IOS decoding play libraries. The static library is positioned at the bottom layer, the message protocol interaction between the bottom layer and the server can use exosip, the message uses tinyXML to carry out coding and decoding, simultaneously, the bottom layer system library integrates boost, the log module uses log4cpp for packaging, the bottom layer media data forwarding processing uses live555, the data stream playing integrates the Dahua open source IOS decoding playing library, and the static library which can be directly called is finally packaged to be provided for the upper layer. And after the service unit of the upper layer system integrates the static library, IOS client software can be issued, so that the IOS client under the national standard monitoring platform is realized.
In any one of the above technical solutions, the service unit follows an SIP session initiation protocol and is compiled by Objective-C; the interactive unit is compiled through C language; the static library is a C + + static library.
In the technical scheme, Objective-C is a general, high-level and object-oriented programming language, the trademark right of Objective-C belongs to apple Inc., and apple Inc. is also a main developer of the programming language. Therefore, the clients of the top IOS system, namely the business units, can meet the requirements of IOS developers through Objective-C compilation.
The interactive unit of the middle layer is realized through C language and is mainly used for interactive processing of object-C layer service logic of the bottom layer C + + and the upper layer IOS, and the packaged bottom layer message is notified to the middle layer through registration callback and then notified to the IOS layer through message callback.
The acquisition mode of the function module library depended on by the bottom layer C + + static library is convenient, and each dependent module library depended on by compiling the bottom layer C + + static library needs to be compiled under different conditions so as to realize the mainstream architecture capable of supporting the IOS systems such as armv7, arm64, i386, x86_64 and the like.
A second aspect of the present invention provides a terminal, including: the human-computer interaction equipment is used for receiving the operation behaviors and converting the operation behaviors into control instructions which can be recognized by the computer equipment; the communication equipment can perform data instruction interaction with the server; according to the remote monitoring control system provided by any one of the technical schemes, the remote monitoring control system is connected with the human-computer interaction equipment and the communication equipment. Therefore, the terminal includes all the advantages of the remote monitoring control system provided in any one of the above technical solutions.
In the technical scheme, the human-computer interaction equipment can be a touch screen or a combination of an output device such as a display screen and an input device such as a keyboard. The communication device comprises a wireless communication device which can support Wi-Fi (wireless local area network technology based on IEEE802.11 standard created by Wi-Fi alliance) communication, 3G communication, 4G communication and 5G communication.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 shows a block diagram of a remotely monitored control system according to one embodiment of the present invention;
FIG. 2 illustrates a software design architecture diagram of a remotely monitored control system according to one embodiment of the present invention;
FIG. 3 illustrates a software operating logic diagram of a remotely monitored control system according to one embodiment of the present invention;
FIG. 4 illustrates an interactive diagram of software login, video asset list acquisition, heartbeat, and logout for a remotely monitored control system according to one embodiment of the present invention;
FIG. 5 illustrates an interactive diagram of software initiated real-time video, pan-tilt related operations, and closed real-time video of a remotely monitored control system according to one embodiment of the present invention;
fig. 6 shows a block diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
A control system and a terminal for remote monitoring according to some embodiments of the present invention are described below with reference to fig. 1 to 6.
The first embodiment is as follows:
as shown in fig. 1, in an embodiment of the first aspect of the present invention, there is provided a remote monitoring control system 100, which is used for a terminal, where the terminal is capable of performing data instruction interaction with a server, and the remote monitoring control system 100 operates in an IOS system, where the remote monitoring control system 100 includes: the service unit 102, the service unit 102 is configured to receive the control instruction and send the control instruction to the interaction unit 106; the interaction unit 106 is configured to encapsulate a data format of the control instruction sent by the service unit into a first format corresponding to the server, and send the first format to the processing unit 104, so that the processing unit 104 sends the control instruction to the server; the processing unit 104 receives the return data sent by the server, encapsulates the data format of the return data into a second format corresponding to the service unit 102 through the interaction unit 106, and sends the second format to the service unit 102, so that the service unit 102 executes corresponding operations according to the return data.
In this embodiment, the control system 100 for remote monitoring includes a service unit 102 and a processing unit 104, where the service unit 102 is located at an upper layer of the system and is represented as upper layer software, and a part of the service unit 102 can directly display a UI (user interface) interface and receive direct operations of a user. The processing unit 104 is located at the bottom layer, after the service unit 102 receives the operation of the user, the service unit 102 sends the corresponding control instruction to the interaction unit 106, and the interaction unit 106 serves as a system middle layer and is responsible for carrying data interaction between the top-layer system and the bottom-layer static library. Specifically, the service unit 102 first sends the control instruction to the interaction unit 106 in the middle layer, the interaction unit 106 encapsulates the data of the control instruction, specifically encapsulates the data into data in the first format corresponding to the target server, and sends the encapsulated control instruction to the bottom layer processing unit 104. The processing unit 104 forwards the control command in the first format to the server, so that the server can identify and execute the corresponding data operation. Meanwhile, the processing unit 104 receives return data from the server for the control instruction, and calls back the return data to the service unit 102, and the service unit 102 encodes and decodes the return data and executes corresponding operations.
Because the data formats of servers under different systems or architectures may be different from those of the terminal, in order to ensure that the terminal can directly execute corresponding operations when receiving the return data of the server, after receiving the return data of the server, the bottom processing unit 104 sends the return data to the interaction unit 106 in the middle layer, and the interaction unit 106 encapsulates the format of the return data into a second format corresponding to the service unit 102 and calls back the second format to the service unit 102.
The interaction unit 106 is arranged to isolate the service unit 102 from the processing unit 104, so that all messages and streaming data can be supported in a udp/tcp mode, and the interaction unit 106 in the middle layer is used for executing message callback and data processing independent encapsulation, so that the top-layer system development does not need to pay attention to a bottom-layer protocol, and data docking with a unified standard platform can be conveniently realized.
According to the embodiment provided by the invention, the security monitoring system sends the control instruction to the bottom layer processing unit 104 by setting the business unit 102 of the top layer system, and the processing unit 104 executes the unified transceiving call-back, so that no matter what architecture the top layer system is, data interaction is carried out by the unified standard of the bottom layer, and further, the remote monitoring control system which can receive and send data in real time and accords with the international unified standard is realized.
In an embodiment of the present invention, the processing unit 104 includes a common interface, and the processing unit 104 sends the control instruction to the server, specifically including: and sending the encapsulated control instruction to a server through a public interface.
In this embodiment, the processing unit 104 at the bottom layer includes a common interface, the common interface can be used for calling different services of the top layer system, and the common interface is in an exposed state in the bottom layer static library, and can implement uniform data transceiving through the interface, thereby implementing functions of login, user right acquisition, video resource acquisition, heartbeat keep-alive, line state control and processing, video resource playing and control of a related cradle head, grab picture, local video recording, logout, log recording, and the like of an SIP (Session Initiation Protocol, which is a multimedia communication Protocol established by IETF) client in a "closed" system.
In an embodiment of the present invention, the control instruction includes a login instruction, the return data includes a login result, the service unit 102 receives the return data sent by the server through the processing unit 104, and executes a corresponding operation according to the return data, which specifically includes: the processing unit 104 receives return data corresponding to the login instruction sent by the server, and analyzes the return data to obtain a login result; the service unit 102 receives the login result sent by the processing unit 104, generates prompt information corresponding to the login result, and displays the prompt information.
In this embodiment, the control instruction includes a login instruction, that is, a user sends a login request through the business unit 102 of the top-level system, and the interaction unit 106 packages the login request and then sends the login request through the bottom-level processing unit 104. The login request comprises information such as a server target port, an account and a key corresponding to the target port and the requested service. And after receiving the login request, the server authenticates the login request, returns a login result of login success after the authentication is passed, and returns a login failure result if the authentication is failed. After receiving the encapsulated return data, the processing unit 104 decodes the encapsulated data through the interaction unit 106 to obtain a login result that can be recognized by the service unit 102, and the service unit 102 generates corresponding prompt information, such as "login success" or "login failure", according to the login result and displays the corresponding prompt information on the interactive UI.
In an embodiment of the present invention, the control instruction includes a surveillance video acquisition instruction, the return data includes video stream data, and the processing unit 104 is further configured to: a streaming data transmission connection is established with the server over the common interface, video streaming data is received over the streaming data transmission connection, and the video streaming data is forwarded to the service unit 102. In this embodiment, the control instruction includes a surveillance video acquisition instruction. After successful login to the remote monitoring server, the underlying processing unit 104 establishes a streaming data transmission connection with the server through the common interface. In order to obtain the monitoring video in real time, the service unit 102 needs to receive the streaming video data in real time and display the streaming video data. To implement streaming data transmission, the processing unit 104 needs to establish a stable data connection with the server, continuously receive video streaming data through the data connection, and synchronize a call back to the interaction unit 106 of the middle layer.
In an embodiment of the present invention, the service unit 102 executes a corresponding operation according to the returned data, which specifically includes: decoding the video stream data to obtain video information, and playing the video information.
In this embodiment, the stream data may include several independently encapsulated data packets that are continuously received, and the interaction unit 106 decapsulates the data packets, converts the data packets into a data format corresponding to the service unit 102, and then sends the data packets to the service unit 102. The service unit 102 receives the video stream data, performs video decoding, and plays the corresponding monitoring video, thereby implementing real-time playing of the remote monitoring video.
In one embodiment of the invention, the processing unit 104 is further configured to: based on the condition that successful login information for a login instruction returned by the server is received, heartbeat detection for the server is maintained; based on the condition of heartbeat detection timeout, generating heartbeat timeout prompting information, and sending the heartbeat timeout prompting information to the service unit 102, so that the service unit 102 displays the heartbeat timeout prompting information.
In this embodiment, after logging on the remote monitoring server successfully, a heartbeat connection with the server needs to be maintained. Specifically, the heartbeat detection is performed on the server through the processing unit 104 at the bottom layer, and if the heartbeat detection is overtime, it indicates that the current terminal is disconnected from the server, and at this time, the processing unit 104 generates heartbeat overtime prompt information and sends the heartbeat overtime prompt information to the service unit 102, so that the service unit 102 can display the heartbeat overtime prompt information through the UI to prompt the user.
In one embodiment of the present invention, the remotely monitored control system 100 is for an IOS system, the remotely monitored control system 100 further comprising: static library, business unit 102 comprises a static library.
In this embodiment, the remote monitoring control system 100 is used in an IOS system, and specifically, the client of the remote monitoring control system 100, i.e., the service unit 102, performs secondary development on the basis of the open-source exosip, tinyXML, boost, log4cpp, live555, and the dazzlos decoding play library. The static library is positioned at the bottom layer, the message protocol interaction between the bottom layer and the server can use exosip, the message uses tinyXML to carry out coding and decoding, simultaneously, the bottom layer system library integrates boost, the log module uses log4cpp for packaging, the bottom layer media data forwarding processing uses live555, the data stream playing integrates the Dahua open source IOS decoding playing library, and the static library which can be directly called is finally packaged to be provided for the upper layer. The service unit 102 of the upper layer system can issue the IOS client software after integrating the static library, thereby realizing the IOS client under the national standard monitoring platform.
In one embodiment of the invention, the service unit 102 follows the SIP session initiation protocol and is compiled by Objective-C; the interaction unit 106 is compiled through a C language; the static library is a C + + static library.
In this embodiment Objective-C is a general purpose, high-level, object-oriented programming language, which has trade rights of apple Inc., who is also the main developer of this programming language. Thus, clients of the top-level IOS system, i.e., business units 102, can meet IOS developer requirements through Objective-C compilation.
The interaction unit 106 of the middle layer is realized through C language and is mainly used for the interaction processing of object-C layer service logic of the bottom layer C + + and the upper layer IOS, and encapsulated bottom layer messages are notified to the middle layer through registration callback and then notified to the IOS layer through message callback.
The acquisition mode of the function module library depended on by the bottom layer C + + static library is convenient, and each dependent module library depended on by compiling the bottom layer C + + static library needs to be compiled under different conditions so as to realize the mainstream architecture capable of supporting the IOS systems such as armv7, arm64, i386, x86_64 and the like.
Example two:
in a complete embodiment of the invention, the invention provides a method based on the national standard GB28181 (from the technical requirements of information transmission, exchange and control of a security and protection video monitoring networking system, which is a national standard proposed by the Ministry of information technology and technology of the Ministry of public Security, and drafted jointly by multiple units such as the national security and protection alarm system standardization technical committee (SAC/TC100), the Ministry of public Security, and the like). An IOS client of the monitoring platform. And carrying out secondary development on the basis of open-source exosip, tinyXML, boost, log4cpp, live555 and Dahua IOS decoding play libraries. The bottom layer and the national standard server message protocol interact to use exoip (exoip is an SIP protocol stack which follows IETF standard and is open to source codes), the message uses tinyXML (tinyXML is an XML parser based on DOM model) to carry out coding and decoding, the bottom layer system library integrates Boost (Boost is a general name of some C + + program libraries which provide extension for C + + language standard libraries, the Boost library is a portable C + + library which provides source codes and is one of development engines of C + + standardized processes as a backup of the standard libraries), the Log module uses Log4cpp (Log4cpp is an open-source C + + class library which provides functions of logging and trace debugging in C + + programs), the bottom layer stream media data forwarding process uses live555(live555 is a cross-platform C + + open-source project which provides solutions for streaming media, and the cross-platform C + + open-source project which provides solutions for streaming media is realized by standard streaming media transmission, it realizes the support of standard stream media transmission protocol such as RTP/RTCP, RTSP, SIP, etc.), the data stream broadcast integrates the Dahua open source IOS decoding broadcast library, and finally the static library which can be directly called is packaged to be provided to the upper layer, the IOS client software can be issued after the upper layer integrates the static library, thereby realizing the IOS client under the national standard monitoring platform.
The specific implementation comprises the following steps:
1. and compiling each bottom layer of the IOS system by depending on the open source library.
Firstly, acquiring exosip, tinyXML, boost, log4cpp and live555 source code engineering of an open source, then setting a compiling option condition on an IOS system to run a compiling command, and compiling exosip, tinyXML, boost, log4cpp and live555 libraries which simultaneously support armv7/arm64/i386/x86_64 under the current IOS mainstream architecture for use by a bottom layer data processing module.
2. And the bottom layer data processing module is realized.
The method realizes development and encapsulation of a streaming data bottom layer interactive processing module of a server end bottom layer message and a corresponding session of a monitoring platform, provides public interfaces such as login, logout, video resource point location real-time playing, holder control and the like, and realizes registration and callback of various messages, and bottom layer data processing can support a udp or tcp mode.
3. IOS static library compilation.
And compiling a static library which can be directly used by an upper layer by using an Xcode development tool in the IOS system.
4. And the IOS layer and the bottom layer data processing C + + layer are realized by an interaction intermediate layer.
Because the system and the language are different, the middle layer (realized by C language) is mainly used for the interactive processing of the object-C layer business logic of the bottom layer C + + and the upper layer IOS, the encapsulated bottom layer message is notified to the middle layer by the registration callback, and then is notified to the IOS layer by the message callback. A specific software design architecture diagram is shown in fig. 2.
When the application is performed, as shown in fig. 3, the software is installed first, and the client software is run after the installation is successful. The client software initiates login, specifically packages a user name and a password, a server IP and a port login information instruction, sends the packaged instruction to the server, and receives login information returned by the server. If the login is successful, the heartbeat is automatically maintained with the national standard center server, and if the heartbeat is overtime, a corresponding prompt is sent.
And after the login is successful, acquiring a video resource list corresponding to the user authority, and if the acquisition is failed, re-logging in. After the acquisition is successful, the bottom layer establishes stream data connection with the server, the upper layer client plays the video resources in real time, and if the playing fails (video coding is not supported, and the like), a corresponding prompt is sent. After the video is successfully played, a control instruction can be further sent to the server, and relevant operations such as pan-tilt control, screenshot, local video recording and the like can be performed.
And after the operation is finished, closing the real-time video and executing a logout operation.
An interaction diagram of software login, video resource list acquisition, heartbeat and logout is shown in fig. 4, wherein an interaction party comprises an IOS upper layer, an IOS bottom layer processing unit and a remote national standard platform server.
And the IOS upper-layer service unit sends a login request to the processing unit, and the processing unit sends the packaged login request to the central server. And the processing unit receives the login information and calls back to the IOS upper-layer service unit, and if the login fails, the IOS upper-layer service unit carries out corresponding prompt.
If the login result is positive, the bottom layer processing unit maintains heartbeat keep-alive detection with the server. If the heartbeat is overtime, the prompt information is called back, and the IOS upper layer service unit prompts that the login needs to be carried out again.
After login is successful, the video resource is obtained through the bottom layer processing unit, the server sends the video resource to the corresponding user, the bottom layer processing unit calls back to the IOS upper layer service unit, and the service unit displays the video.
When the log-out is needed, the IOS upper layer business unit sends out a log-out instruction, the bottom layer processing unit transmits the packaged log-out instruction to the server, and the server is disconnected according to the log-out instruction.
An interaction diagram of software launching a real-time video, cloud deck related operation and closing the real-time video is shown in fig. 5, wherein an interaction party comprises an IOS upper layer, an IOS bottom layer processing unit and a remote national standard platform server.
The IOS upper layer service unit sends a real-time video request, the IOS bottom layer processing unit sends the packaged video request to the national standard platform server, the server returns success/failure information corresponding to the video request, the processing unit calls back to the service unit, and if the request fails, the service unit displays corresponding prompt information.
After the request is successful, the server forwards and pushes the real-time video data stream, and the real-time video data stream is called back to the IOS upper-layer service unit through the bottom-layer processing unit, and the service unit (IOS client) calls the Datua IOS decoder to play.
In the video playing process, the business unit sends a related operation request aiming at the monitoring cloud deck, the bottom layer processing unit sends the packaged operation request to the server, and the server forwards the operation request to the monitoring cloud deck corresponding to the monitoring video in playing so as to control the cloud deck to change the angle.
When the service is finished, the IOS upper layer service unit sends a request for closing the real-time video, the bottom layer processing unit sends the packaged request to the server, and the server cuts off the video data stream.
The dependency library of the embodiment of the invention is an open source library, wherein the function module library depended by the bottom layer C + + static library is easy to obtain. Compiling each dependent module library depended by the IOS bottom layer C + + static library needs to be compiled under different conditions so as to realize support of IOS mainstream architectures such as armv7/arm64/i386/x86_64 and the like. The bottom library can be freely used after the compiling condition is set in the compiling environment and the compiling is carried out.
In an embodiment of the invention, traffic is isolated from data processing, in particular, traffic is isolated from underlying data processing by different levels of callback processing, and all messages and streaming data can support udp mode or tcp mode. By utilizing the independent packaging of the middle layer message callback and the bottom layer data processing, the IOS layer development does not need to pay attention to the specific and complicated interaction of the bottom layer protocol, the user can log in the national standard monitoring platform, obtain the video resources under the user right corresponding to the platform, keep alive with the heartbeat of the national standard monitoring platform, and control and process the point video and control the basic functions of the national standard client side such as the related cloud deck, the capture, the local video, the logout, the log record and the like in an off-line state.
Meanwhile, a static library can be compiled for the IOS upper layer to develop and use directly. The compiled static library may be provided directly for use by third parties for developers who require SIP clients implementing national standard GB28181 under the IOS. Aiming at the situation that the international GB2818 video playing platform comprises basically all client service processing and module integration under the complex and various service scenes of functions, the client customization development under the international GB28181 monitoring platform can be flexibly carried out directly on the basis.
Example three:
as shown in fig. 6, in one embodiment of the present invention, there is provided a terminal 600 including: the human-computer interaction device 602, the human-computer interaction device 602 is configured to receive an operation behavior, and convert the operation behavior into a control instruction that can be recognized by the computer device; the communication device 604, the communication device 604 can perform data instruction interaction with the server; the remotely monitored control system 606, as provided in any of the above embodiments, is connected to the human machine interface device 602 and the communication device 604. Thus, the terminal includes all the benefits of the remotely monitored control system as provided in any of the embodiments described above.
In this embodiment, the human-computer interaction device may be a touch screen, or a combination of an output device such as a display screen and an input device such as a keyboard. The communication device comprises a wireless communication device which can support Wi-Fi (wireless local area network technology based on IEEE802.11 standard created by Wi-Fi alliance) communication, 3G communication, 4G communication and 5G communication.
In the description of the present invention, the terms "plurality" or "a plurality" refer to two or more, and unless otherwise specifically defined, the terms "upper", "lower", and the like indicate orientations or positional relationships based on the orientations or positional relationships illustrated in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention; the terms "connected," "mounted," "secured," and the like are to be construed broadly and include, for example, fixed connections, removable connections, or integral connections; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the description of the present invention, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In the present invention, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A remote monitoring control system for a terminal, the terminal being capable of performing data instruction interaction with a server, the remote monitoring control system being operated in an IOS system, the control system comprising:
the service unit is used for receiving a control instruction and sending the control instruction to the interaction unit;
the interaction unit is used for packaging the data format of the control instruction sent by the service unit into a first format corresponding to the server and sending the first format to the processing unit so that the processing unit sends the control instruction to the server;
and the processing unit receives the return data sent by the server, encapsulates the data format of the return data into a second format corresponding to the service unit through the interaction unit, and sends the second format to the service unit so that the service unit executes corresponding operation according to the return data.
2. The remote monitoring control system according to claim 1, wherein the processing unit includes a common interface, and the processing unit sends the control instruction to the server, specifically including:
and sending the encapsulated control command to the server through the public interface.
3. The remote monitoring control system according to claim 2, wherein the control instruction includes a login instruction, the return data includes a login result, the service unit receives the return data sent by the server through the processing unit, and executes a corresponding operation according to the return data, specifically including:
the processing unit receives return data which is sent by the server and corresponds to the login instruction, and analyzes the return data to obtain a login result;
and the business unit receives the login result sent by the processing unit, generates prompt information corresponding to the login result and displays the prompt information.
4. The remotely monitored control system according to claim 2, wherein the control instructions comprise a surveillance video acquisition instruction, the return data comprises video stream data, the processing unit is further configured to:
establishing a streaming data transmission connection with the server through the common interface, receiving the video streaming data through the streaming data transmission connection, and forwarding the video streaming data to the service unit.
5. The remotely monitored control system of claim 4,
the business unit executes corresponding operation according to the return data, and specifically includes: and decoding the video stream data to obtain video information, and playing the video information.
6. The remotely monitored control system according to claim 5, wherein the control instructions comprise a surveillance video termination instruction, the processing unit further configured to:
cutting off the video stream data according to the termination instruction, and generating a corresponding callback instruction;
and the service unit stops playing the video information according to the callback instruction.
7. The remotely monitored control system according to claim 3, wherein the processing unit is further configured to:
based on the condition that successful login information for the login instruction returned by the server is received, heartbeat detection for the server is maintained;
and generating heartbeat overtime prompt information based on the condition of the heartbeat detection overtime, and sending the heartbeat overtime prompt information to the service unit so that the service unit displays the heartbeat overtime prompt information.
8. The remotely monitored control system according to any one of claims 2 to 7, further comprising:
a static library, the business unit comprising the static library.
9. The remotely monitored control system of claim 8,
the service unit follows SIP session initiation protocol and is compiled by Objective-C;
the interaction unit is compiled through C language;
the static library is a C + + static library.
10. A terminal, comprising:
the human-computer interaction device is used for receiving an operation behavior and converting the operation behavior into a control instruction which can be recognized by the computer device;
the communication equipment can perform data instruction interaction with the server;
the remotely monitored control system as claimed in any one of claims 1 to 9 being connected to said human interaction device and said communication device.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010146031.3A CN111381922A (en) | 2020-03-05 | 2020-03-05 | Remote monitoring control system and terminal |
| PCT/CN2020/097603 WO2021174718A1 (en) | 2020-03-05 | 2020-06-23 | Remote monitoring control system and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010146031.3A CN111381922A (en) | 2020-03-05 | 2020-03-05 | Remote monitoring control system and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111381922A true CN111381922A (en) | 2020-07-07 |
Family
ID=71219805
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010146031.3A Pending CN111381922A (en) | 2020-03-05 | 2020-03-05 | Remote monitoring control system and terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111381922A (en) |
| WO (1) | WO2021174718A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111988308A (en) * | 2020-08-18 | 2020-11-24 | 深圳中兴网信科技有限公司 | Video monitoring device, implementation method of video monitoring device and readable storage medium |
| CN113282370A (en) * | 2021-05-26 | 2021-08-20 | 深圳市炬力北方微电子有限公司 | Cloud-based software operation state monitoring method and device and related equipment |
| CN113709243A (en) * | 2021-08-27 | 2021-11-26 | 广州博冠信息科技有限公司 | Equipment remote control method and device, electronic equipment and storage medium |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114844963B (en) * | 2022-03-31 | 2023-02-17 | 慧之安信息技术股份有限公司 | Extended header information extraction method based on open source protocol stack eXosip |
| CN115174545A (en) * | 2022-06-29 | 2022-10-11 | 广州鲁邦通物联网科技股份有限公司 | Plug flow web playing method and system based on national standard GB28181 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1913533A (en) * | 2006-09-05 | 2007-02-14 | 北京天地互连信息技术有限公司 | Remote video monitoring system based on session initialize protocol and its implementing method |
| US20070169008A1 (en) * | 2005-07-29 | 2007-07-19 | Varanasi Sankara S | External programmatic interface for IOS CLI compliant routers |
| CN103139541A (en) * | 2011-11-30 | 2013-06-05 | 上海晨兴希姆通电子科技有限公司 | Remote wireless video monitoring system and method thereof |
| CN103581265A (en) * | 2012-08-07 | 2014-02-12 | 深圳市傲冠软件股份有限公司 | Remote access method and system |
| CN104065683A (en) * | 2013-03-21 | 2014-09-24 | 联想(北京)有限公司 | Remote control method and local device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9307009B2 (en) * | 2012-02-15 | 2016-04-05 | Mobilespan Inc. | Presenting execution of a remote application in a mobile device native format |
| CN105142020A (en) * | 2015-08-10 | 2015-12-09 | 合一网络技术(北京)有限公司 | Method and system for converting video in unsupported format in mobile terminal |
| CN107770256A (en) * | 2017-09-29 | 2018-03-06 | 安徽师范大学 | A kind of tele-control system and method for service end and client |
| CN108667902B (en) * | 2018-04-04 | 2021-08-10 | 创新先进技术有限公司 | Remote control system, method, device and equipment of iOS equipment |
-
2020
- 2020-03-05 CN CN202010146031.3A patent/CN111381922A/en active Pending
- 2020-06-23 WO PCT/CN2020/097603 patent/WO2021174718A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070169008A1 (en) * | 2005-07-29 | 2007-07-19 | Varanasi Sankara S | External programmatic interface for IOS CLI compliant routers |
| CN1913533A (en) * | 2006-09-05 | 2007-02-14 | 北京天地互连信息技术有限公司 | Remote video monitoring system based on session initialize protocol and its implementing method |
| CN103139541A (en) * | 2011-11-30 | 2013-06-05 | 上海晨兴希姆通电子科技有限公司 | Remote wireless video monitoring system and method thereof |
| CN103581265A (en) * | 2012-08-07 | 2014-02-12 | 深圳市傲冠软件股份有限公司 | Remote access method and system |
| CN104065683A (en) * | 2013-03-21 | 2014-09-24 | 联想(北京)有限公司 | Remote control method and local device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111988308A (en) * | 2020-08-18 | 2020-11-24 | 深圳中兴网信科技有限公司 | Video monitoring device, implementation method of video monitoring device and readable storage medium |
| CN113282370A (en) * | 2021-05-26 | 2021-08-20 | 深圳市炬力北方微电子有限公司 | Cloud-based software operation state monitoring method and device and related equipment |
| CN113282370B (en) * | 2021-05-26 | 2023-01-31 | 深圳市炬力北方微电子有限公司 | Cloud-based software operation state monitoring method and device and related equipment |
| CN113709243A (en) * | 2021-08-27 | 2021-11-26 | 广州博冠信息科技有限公司 | Equipment remote control method and device, electronic equipment and storage medium |
| CN113709243B (en) * | 2021-08-27 | 2024-04-30 | 广州博冠信息科技有限公司 | Equipment remote control method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021174718A1 (en) | 2021-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111381922A (en) | Remote monitoring control system and terminal | |
| US8799362B2 (en) | Scalable high-performance interactive real-time media architectures for virtual desktop environments | |
| CN101237333B (en) | An universal service platform for supporting multiple services based on multi-network fusion | |
| CN101960822B (en) | SIP-HTTP application correlator | |
| US20070053346A1 (en) | Distributed IP architecture for telecommunications system with video mail | |
| CN108810124B (en) | Remote access control system for large number of multimedia terminals in public network environment | |
| CN102196248B (en) | Mobile video monitoring system and method | |
| CN109120505A (en) | A kind of Android customer service conversational system and method based on MVP mode | |
| CN105429958A (en) | Enterprise application platform system based on Android development | |
| CN111988308A (en) | Video monitoring device, implementation method of video monitoring device and readable storage medium | |
| CN110473129B (en) | Supervision place police special network application management and control system based on Android and cloud platform | |
| CN113037616B (en) | Interactive method and device for cooperatively controlling multiple robots | |
| CN103155530B (en) | Merge including network-telecommunications that script command is downloaded to user terminal | |
| CN114979133B (en) | Deployment method and device for converged communication cloud platform | |
| CN114168460A (en) | Remote debugging method, device and storage medium for front-end code in hybrid development | |
| CN110113558B (en) | Data processing method, device, system and computer readable storage medium | |
| CN113473395B (en) | Message processing method, device, medium and electronic equipment | |
| CN116170610A (en) | SDK for realizing data transmission and data transmission method | |
| CN108712417B (en) | Method, device and system for realizing single-double registration of multi-chip compatibility of RCS client | |
| CN111885223A (en) | Distributed cloud mobile phone and system | |
| Hsu et al. | Improving the efficiency of presence service in IMS by JSON | |
| CN112839243B (en) | Code stream transfer method and device, electronic equipment and storage medium | |
| CN114531740B (en) | VR head display terminal application rendering operation method and system | |
| CN111538932B (en) | Cross-platform, terminal and foreign affair management method for internal and external networks | |
| CN117271270B (en) | Method for monitoring Android music playing on Web operating system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200707 |
|
| RJ01 | Rejection of invention patent application after publication |