CN110557612B

CN110557612B - Control method of monitoring equipment and video networking system

Info

Publication number: CN110557612B
Application number: CN201910817881.9A
Authority: CN
Inventors: 张海旺; 杨乌拉; 叶斌; 杨春晖
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2019-08-30
Filing date: 2019-08-30
Publication date: 2021-12-10
Anticipated expiration: 2039-08-30
Also published as: CN110557612A

Abstract

The embodiment of the invention provides a control method of monitoring equipment and a video networking system, wherein the method is applied to the video networking system and comprises the following steps: responding to a starting instruction aiming at the target task, and generating a starting instruction and an ending instruction of the target task by the mobile terminal; the mobile terminal sends a starting instruction to the streaming media server according to a preset sending rule and sends an ending instruction in a delayed mode; the streaming media server forwards the starting instruction and the ending instruction to a protocol conversion server; and the protocol conversion server controls the monitoring equipment to execute the target task according to the starting instruction and the ending instruction. The data processing pressure of the streaming media server is reduced by setting the special protocol conversion server to be responsible for managing the monitoring equipment, and the preset sending rule is set to send the ending instruction in a delayed mode, so that the sending time between the starting instruction and the ending instruction is guaranteed, and the reliability of monitoring control is improved.

Description

Control method of monitoring equipment and video networking system

Technical Field

The invention relates to the technical field of video networking, in particular to a control method of monitoring equipment and a video networking system.

Background

The video networking is an important milestone for network development, is a higher-level form of the Internet, is a real-time network, can realize the real-time transmission of full-network high-definition videos which cannot be realized by the existing Internet, and pushes a plurality of Internet applications to high-definition video. The video network can support the terminal to acquire high-definition monitoring video data in real time, and fusion convergence and real-time scheduling of monitoring resources in the video network are achieved.

In the existing video networking technology, a user is only supported to perform signaling interaction with a streaming media server through a terminal device, and the streaming media server is responsible for interacting query with a monitoring management platform and controlling monitoring equipment, so that the monitoring equipment is controlled.

For a mobile terminal in the internet, a streaming media server needs to perform protocol conversion on a signaling of the mobile terminal and then interact with a monitoring management platform to control a monitoring device, and the streaming media server needs to repeatedly interact with the monitoring device through the monitoring management server to call monitoring device information and monitoring control, so that the data processing pressure of the streaming media server is increased, the real-time performance of the monitoring device is reduced, and the situation that a start instruction and an end instruction cannot be paired easily occurs because the timing of the start instruction and the end instruction sent by a user cannot be grasped, and the reliability of the monitoring control is affected.

Disclosure of Invention

In view of the above, embodiments of the present invention are proposed to provide a control method of a monitoring device and an internet of view system that overcome or at least partially solve the above problems.

In order to solve the above problem, a first aspect of an embodiment of the present invention discloses a method for controlling a monitoring device, where the method is applied to a video networking system, and the video networking system includes: the method comprises the following steps that the mobile terminal is in communication connection with the streaming media server, the protocol conversion server is in communication connection with the monitoring equipment through the internet, and the streaming media server is in communication connection with the protocol conversion server through the video network, and the method comprises the following steps:

responding to a starting instruction aiming at a target task, and generating a starting instruction and an ending instruction of the target task by the mobile terminal;

the mobile terminal sends the starting instruction to the streaming media server according to a preset sending rule, and sends the ending instruction in a delayed mode;

the streaming media server forwards the starting instruction and the ending instruction to the protocol conversion server;

and the protocol conversion server controls the monitoring equipment to execute the target task according to the starting instruction and the ending instruction.

Optionally, the starting instruction includes: the step of the mobile terminal sending the starting instruction to the streaming media server according to a preset sending rule and sending the ending instruction in a delayed manner after the operation duration comprises the following steps:

if the operation duration is less than a preset duration, the mobile terminal sends the starting instruction to the streaming media server and sends the ending instruction to the streaming media server after a target time interval, wherein the target time interval is the sum of the operation duration and the preset duration;

and if the operation duration is greater than or equal to a preset duration, the mobile terminal sends the starting instruction to the streaming media server, and sends the ending instruction to the streaming media server after the operation duration.

Optionally, before the step of generating, by the mobile terminal, a start instruction and an end instruction of the target task in response to the start instruction for the target task, the method further includes:

responding to a monitoring control request, the mobile terminal acquires a monitoring list from the streaming media server, wherein the monitoring list at least comprises a monitoring identifier and a corresponding control option;

responding to the selection operation of one target control option in the control options, and displaying a monitoring control page corresponding to the target control option by the mobile terminal, wherein the monitoring control page at least comprises a task identifier and a corresponding key;

the step of generating a starting instruction and an ending instruction of the target task by the mobile terminal in response to the starting instruction aiming at the target task comprises the following steps:

in response to a preset operation aiming at one target key in the keys, the mobile terminal determines a task identifier corresponding to the target key as a target task identifier and determines a monitoring identifier corresponding to the target control option as a target monitoring identifier;

and the mobile terminal respectively generates a starting instruction and an ending instruction of the target task according to the target task identifier and the target monitoring identifier.

Optionally, the step of controlling, by the protocol conversion server, the monitoring device to execute the target task according to the start instruction and the end instruction includes:

the protocol conversion server inquires corresponding monitoring equipment according to the monitoring identification;

the protocol conversion server controls the monitoring equipment to execute the target task according to the starting instruction;

and the protocol conversion server controls the monitoring equipment to stop the target task according to the ending instruction.

Optionally, after the step of controlling, by the protocol conversion server, the monitoring device to execute the target task according to the start instruction and the end instruction, the method further includes:

the protocol conversion server receives first monitoring video data in an interconnected grid mode generated by the target monitoring equipment executing the target task;

the protocol conversion server carries out protocol conversion on the first monitoring video data to obtain second monitoring video data in a video networking format, and the second monitoring video data is returned to the streaming media server;

the streaming media server performs protocol conversion on the second monitoring video data to obtain first monitoring video data in an interconnected grid mode, and returns the first monitoring video data to the mobile terminal;

and the mobile terminal displays the first monitoring video data.

The second aspect of the embodiment of the present invention discloses a video networking system, which includes: the system comprises a mobile terminal, a streaming media server, a protocol conversion server and monitoring equipment, wherein the mobile terminal is in communication connection with the streaming media server and the protocol conversion server is in communication connection with the monitoring equipment through the Internet respectively;

the mobile terminal includes: the generating module is used for responding to a starting instruction aiming at a target task and generating a starting instruction and an ending instruction of the target task;

the sending module is used for sending the starting instruction to the streaming media server according to a preset sending rule and sending the ending instruction in a delayed mode;

the streaming media server includes: a forwarding module, configured to forward the start instruction and the end instruction to the protocol conversion server;

the protocol conversion server includes: and the control module is used for controlling the monitoring equipment to execute the target task according to the starting instruction and the ending instruction.

Optionally, the starting instruction includes: the operation duration, the sending module includes:

the first sending submodule is used for sending the starting instruction to the streaming media server and sending the ending instruction to the streaming media server after a target time interval if the operation duration is less than a preset duration, wherein the target time interval is the sum of the operation duration and the preset duration;

and the second sending submodule is used for sending the starting instruction to the streaming media server if the operation duration is greater than or equal to a preset duration, and sending the ending instruction to the streaming media server after the operation duration.

Optionally, the video networking system further includes:

the mobile terminal includes: the acquisition module is used for responding to a monitoring control request and acquiring a monitoring list from the streaming media server, wherein the monitoring list at least comprises a monitoring identifier and a corresponding control option;

the display module is used for responding to the selection operation of one target control option in the control options and displaying a monitoring control page corresponding to the target control option, wherein the monitoring control page at least comprises a task identifier and a corresponding key;

the generation module comprises:

the determining submodule is used for responding to preset operation aiming at one target key in the keys, determining the task identifier corresponding to the target key as a target task identifier, and determining the monitoring identifier corresponding to the target control option as a target monitoring identifier;

and the generation submodule is used for respectively generating a starting instruction and an ending instruction of the target task according to the target task identifier and the target monitoring identifier.

Optionally, the control module includes:

the query submodule is used for querying the corresponding monitoring equipment according to the monitoring identification;

the first control submodule is used for controlling the monitoring equipment to execute the target task according to the starting instruction;

and the second control submodule is used for controlling the monitoring equipment to stop the target task according to the ending instruction.

Optionally, the video networking system further includes:

the protocol conversion server includes: the receiving module is used for receiving first monitoring video data in an interconnected grid mode generated by the target monitoring equipment executing the target task;

the first protocol conversion module is used for carrying out protocol conversion on the first monitoring video data to obtain second monitoring video data in a video networking format and returning the second monitoring video data to the streaming media server;

the streaming media server includes: the second coordination conversion module is used for carrying out protocol conversion on the second monitoring video data to obtain first monitoring video data in an interconnected grid mode and returning the first monitoring video data to the mobile terminal;

the mobile terminal includes: and the display module is used for displaying the first monitoring video data.

The embodiment of the invention has the following advantages:

the embodiment of the invention provides a control method of monitoring equipment and a video networking system, wherein the method is applied to the video networking system, and the video networking system comprises the following steps: the method comprises the following steps that the mobile terminal is in communication connection with the streaming media server, the protocol conversion server is in communication connection with the monitoring equipment through the internet, and the streaming media server is in communication connection with the protocol conversion server through the video network, and the method comprises the following steps: responding to a starting instruction aiming at a target task, and generating a starting instruction and an ending instruction of the target task by the mobile terminal; the mobile terminal sends the starting instruction to the streaming media server according to a preset sending rule, and sends the ending instruction in a delayed mode; the streaming media server forwards the starting instruction and the ending instruction to the protocol conversion server; and the protocol conversion server controls the monitoring equipment to execute the target task according to the starting instruction and the ending instruction. The data processing pressure of the streaming media server is reduced by setting the special protocol conversion server to be responsible for managing the monitoring equipment, and the preset sending rule is set to send the ending instruction in a delayed mode, so that the sending time between the starting instruction and the ending instruction is guaranteed, and the reliability of monitoring control is improved.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

FIG. 5 is a schematic diagram of a data transfer process when controlling a monitoring device of the present invention;

FIG. 6 is a flow chart of the steps of a method of controlling a monitoring device of the present invention;

FIG. 7 is a flow chart of steps of another monitoring device control method of the present invention;

fig. 8 is a block diagram of a video networking system of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the whole network switching type virtual circuit and the seamless connection of data protocols.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any protocol conversion throughout the network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment of the present invention is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The protocol of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the above characteristics of the video network, one of the core concepts of the embodiments of the present invention is proposed, and the video network gateway device is responsible for coordinating establishment of the communication tunnel between the terminal devices, following the protocol of the video network.

In embodiments of the present invention, an video networking system may comprise a video networking gateway device.

Referring to fig. 5, in the embodiment of the present invention, the mobile terminal 501 is responsible for sending a start instruction and an end instruction, the streaming media server 502 forwards the start instruction and the end instruction to the protocol conversion server, and converts the received second monitoring video into the first monitoring video and sends the first monitoring video to the mobile terminal 501, the protocol conversion server 503 sends the start instruction and the end instruction to the monitoring device 504, and converts the first monitoring video sent by the monitoring device 504 into the second monitoring video and sends the second monitoring video to the streaming media server 502.

Example one

Referring to fig. 6, there is shown a control method of a monitoring device of the present invention, the method is applied to a video networking system, the video networking system includes: the method comprises the following steps that the mobile terminal, the streaming media server, the protocol conversion server and the monitoring equipment are respectively in communication connection through the internet, the streaming media server is in communication connection with the protocol conversion server through the video network, and the method can comprise the following steps:

step 601, responding to a starting instruction aiming at a target task, and generating a starting instruction and an ending instruction of the target task by the mobile terminal.

In the embodiment of the present invention, the monitoring device may be an electronic device such as a monitoring camera, a monitor, and an alarm detector, which are disposed in an internet environment. The mobile terminal is in an internet environment and performs data transmission by adopting an internet protocol, such as a mobile phone, a tablet computer and the like. The streaming media server is used as a connecting link between the mobile terminal and the video network, and is provided with an internet interface and a video network interface, so that the protocol conversion function of data between the video network and the mobile terminal in the internet can be realized. The protocol conversion server is used for realizing the protocol conversion function of data between the video network and the monitoring equipment in the Internet.

The user accessible clicks the icon of the video networking monitoring application of installation in its mobile terminal, opens the control page of monitoring, include surveillance video display area, control panel in the video networking control interface, control panel can range upon range of the demonstration and be in surveillance video display area, and the user accessible clicks the control panel of hiding in arbitrary blank position in surveillance video display area, control panel also can set up independent area and show. The monitoring control panel may include one or more keys, a start key, and an end key, for example, if the monitoring device is a monitoring camera, the keys may be keys corresponding to functions of up, down, left, right, focus, and the like. The user can send a corresponding starting instruction to the corresponding monitoring equipment by clicking the starting button and the ending button after clicking the button.

Step 602, the mobile terminal sends the start instruction to the streaming media server according to a preset sending rule, and sends the end instruction in a delayed manner.

In the embodiment of the present invention, since the mobile terminal is in an internet environment, it is not possible to directly transmit data in an internet format to devices in a video network, and the generated start instruction and end instruction need to be sent to the streaming server through an internet interface of the streaming server. In the sending process, because the start instruction and the end instruction belong to intensive instructions, the number of the instructions is huge due to high-frequency operation of a user, so that the reliability of data transmission is difficult to guarantee, if the sent time interval of the start instruction and the end instruction is too short, different degrees of delay can be caused when the internet network fluctuates, and if the delay of data transmission of the end instruction is greater than or equal to the sum of the time interval and the network delay of the start instruction, the start instruction cannot reach the streaming media server before the end instruction, so that the control of the monitoring equipment is abnormal. Therefore, after the mobile terminal sends the start instruction, the corresponding end instruction can be delayed and sent according to the preset sending rule, and the delay is carried out to a certain degree on the original sending time node of the end instruction, so as to adapt to the abnormal sending of the end instruction possibly caused by network delay. In practical application, in order to ensure the reliability of the start instruction and the end instruction in the data transmission process, a preset transmission rule is configured, and the end instruction is transmitted after being delayed on the basis of an original transmission time node, for example, the mobile terminal uses the same character bit to generate the start instruction and the end instruction on the basis of keeping about 42 bytes, specifically, the time length of the delay can be configured according to the data transmission quality of a network environment where the mobile terminal is located, and usually, the time length of the delay needs to be longer than the average delay of the network environment. The small and reasonable byte number of the instruction can meet the expansion requirement and simultaneously improve the reliability of the instruction in the data transmission process, and the same character bit can ensure that the same information transmission protocol is used for the starting instruction and the ending instruction.

Step 603, the streaming media server forwards the start instruction and the end instruction to the protocol conversion server.

In the embodiment of the invention, the protocol conversion server in the video network is also provided with a video network interface and an internet interface and is responsible for connecting and managing a plurality of monitoring devices in the internet environment, so the protocol conversion server can also receive and send data of the video network protocol and data of the internet protocol.

Step 604, the protocol conversion server controls the monitoring device to execute the target task according to the start instruction and the end instruction.

In the embodiment of the present invention, the start instruction and the end instruction include: the system comprises a target task identifier and a monitoring device identifier, wherein the starting instruction further comprises a starting operation field aiming at the associated target task identifier, and the ending instruction further comprises an ending operation field aiming at the associated target task identifier. After receiving the start instruction, the protocol conversion server searches for the corresponding monitoring device through the monitoring device identifier in the start instruction, and sends the start instruction to the monitoring device, and the monitoring device starts to execute the corresponding task according to the target task identifier and the start operation field, for example: and after the protocol conversion server receives a corresponding ending instruction, the ending instruction is forwarded to the same monitoring equipment, and the monitoring equipment stops executing the target task according to the target task identifier and the ending operation field. It is understood that the start instruction is to reach the monitoring device prior to the end instruction, and the monitoring device starts to normally execute the target task.

The embodiment of the invention provides a control method of monitoring equipment, which is applied to a video networking system, wherein the video networking system comprises: the method comprises the following steps that the mobile terminal is in communication connection with the streaming media server, the protocol conversion server is in communication connection with the monitoring equipment through the internet, and the streaming media server is in communication connection with the protocol conversion server through the video network, and the method comprises the following steps: responding to a starting instruction aiming at a target task, and generating a starting instruction and an ending instruction of the target task by the mobile terminal; the mobile terminal sends the starting instruction to the streaming media server according to a preset sending rule, and sends the ending instruction in a delayed mode; the streaming media server forwards the starting instruction and the ending instruction to the protocol conversion server; and the protocol conversion server controls the monitoring equipment to execute the target task according to the starting instruction and the ending instruction. The data processing pressure of the streaming media server is reduced by setting the special protocol conversion server to be responsible for managing the monitoring equipment, and the preset sending rule is set to send the ending instruction in a delayed mode, so that the sending time between the starting instruction and the ending instruction is guaranteed, and the reliability of monitoring control is improved.

Example two

Referring to fig. 7, there is shown another monitoring device control method of the present invention, which is applied to a video networking system including: the method comprises the following steps that the mobile terminal, the streaming media server, the protocol conversion server and the monitoring equipment are respectively in communication connection through the internet, the streaming media server is in communication connection with the protocol conversion server through the video network, and the method can comprise the following steps:

step 701, in response to the monitoring control request, the mobile terminal obtains a monitoring list from the streaming media server, where the monitoring list at least includes a monitoring identifier and a corresponding control option.

In the embodiment of the invention, a user generates a monitoring control request by starting a video networking monitoring application program on a mobile terminal of the user, the mobile terminal forwards the monitoring control request to the streaming media server, and the streaming media server returns a monitoring list containing available viewing to the mobile terminal. The monitoring list at least comprises monitoring identifications of a plurality of monitoring devices, and carries corresponding control options according to whether the monitoring devices support video networking cloud deck remote control. The monitoring list can also only comprise monitoring equipment corresponding to the monitoring equipment supporting the remote control of the video networking cloud deck, and the identification of the monitoring equipment can be directly selected to enter the next step.

Step 702, in response to a selection operation for one of the control options, the mobile terminal displays a monitoring control page corresponding to the target control option, where the monitoring control page at least includes a task identifier and a corresponding key.

In the embodiment of the present invention, the mobile terminal displays the monitoring list through a client display interface of the application program, and a user can open a monitoring control page of the monitoring device corresponding to the monitoring device identifier by clicking a target control option corresponding to a certain monitoring identifier in the monitoring list, where the monitoring control page at least includes a monitoring video display area and a monitoring control panel, and the monitoring control panel at least includes one or more task identifiers and corresponding keys. The keys may include one or more keys, a start key, and an end key, for example, if the monitoring device is a monitoring camera, the keys may be keys corresponding to functions of up, down, left, right, focus, and the like.

Step 703, in response to a preset operation for a target key of the keys, the mobile terminal determines a task identifier corresponding to the target key as a target task identifier, and determines a monitoring identifier corresponding to the target control option as a target monitoring identifier.

In the embodiment of the invention, after the user can trigger the target key by clicking the target key, the user can sequentially click the start key and the end key to trigger the corresponding target tasks. For example, the number 1 key moves upwards correspondingly, the number 2 case moves downwards correspondingly, the number 9 key increases the focal length correspondingly, the number 8 key decreases the focal length correspondingly, the user can click the number 1 key first, then click the start key in the monitoring control panel to trigger the corresponding target task, and then click the end key to end the corresponding target task. Or the monitoring control panel does not comprise a start key and an end key, and a user can directly press or click a target key.

Step 704, the mobile terminal generates a start instruction and an end instruction of the target task according to the target task identifier and the target monitoring identifier.

In this embodiment of the present invention, based on the two target task triggering manners in the monitoring control panel in step 703, when the monitoring control panel includes a start key and an end key, a start instruction corresponding to the target task identifier is generated when the start key is pressed, an end instruction corresponding to the target task identifier is generated when the end instruction is pressed, and a time interval between pressing the start key and pressing the end key is used as a duration. When the monitoring control panel does not comprise a start key and an end key, generating a target instruction corresponding to the target task identifier when the target key is not pressed and released, generating an end instruction corresponding to the target task identifier when the target key is released after being pressed, and recording the duration of the pressing operation aiming at the target key.

Step 705, if the operation duration is less than a preset duration, the mobile terminal sends the start instruction to the streaming media server, and sends the end instruction to the streaming media server after a target time interval, where the target time interval is the sum of the operation duration and the preset duration.

In the embodiment of the present invention, if the duration of the pressing operation is less than a preset duration, it is determined that there is a risk of abnormal instruction transmission due to network delay in the start instruction and the end instruction, and after the start instruction is sent, a delay of a preset duration is added on the basis of an original sending time node of the end instruction, and then the start instruction and the end instruction are sent to the streaming media server. In practical application, the preset duration can be configured according to the delay level of the network environment, and generally can be set to about 100 milliseconds, the preset duration is not suitable to be set to be too long, and the too long preset duration can cause a large delay, so that the experience of the user in practical use can be influenced.

Step 706, if the operation duration is greater than or equal to a preset duration, the mobile terminal sends the start instruction to the streaming media server, and sends the end instruction to the streaming media server after the operation duration.

In the embodiment of the present invention, if the duration of the pressing operation is greater than or equal to a preset duration, it is determined that the start instruction and the end instruction can be stably sent to the streaming media server according to the order of the start instruction being before and the end instruction being after, and after the start instruction is sent, the end instruction is sent to the streaming media server according to the duration of the operation as a time interval.

Step 707, the streaming media server forwards the start instruction and the end instruction to the protocol conversion server.

In the embodiment of the present invention, the streaming media server directly transmits the start instruction to the protocol conversion server after receiving the start instruction, receives a corresponding end instruction after a certain time interval, and directly transmits the end instruction to the protocol conversion server.

Step 708, the protocol conversion server queries the corresponding monitoring device according to the monitoring identifier.

In the embodiment of the present invention, the protocol conversion server stores the corresponding relationship between the monitoring identifier and the physical address of the monitoring device, and determines the physical address corresponding to the target monitoring device according to the target monitoring identifier. And according to the time interval for receiving the starting instruction and the ending instruction, firstly sending the starting instruction to the monitoring equipment, and sending the ending instruction to the monitoring equipment after the time interval.

Step 709, the protocol conversion server controls the monitoring device to execute the target task according to the start instruction.

Step 710, the protocol conversion server controls the monitoring device to stop the target task according to the end instruction.

In the embodiment of the present invention, when the monitoring device is a monitoring camera, and when the start instruction is received, the lens is controlled to start to shift upwards according to a target task identifier in the start instruction, for example, a task identifier a1 corresponding to the upward shift, until a corresponding end instruction is received, the lens is controlled to stop moving upwards, and it is determined that the target task is completed. The ending instruction and the starting instruction comprise the same target task identifier, the ending instruction also comprises an ending operation field associated with the target task identifier, and the starting instruction also comprises a starting operation field associated with the target task identifier.

Step 711, the protocol conversion server receives the first monitoring video data in the internet format generated by the target monitoring device executing the target task.

And 712, the protocol conversion server performs protocol conversion on the first monitoring video data to obtain second monitoring video data in a video networking format, and returns the second monitoring video data to the streaming media server.

Step 713, the streaming media server performs protocol conversion on the second monitoring video data to obtain first monitoring video data in an internet format, and returns the first monitoring video data to the mobile terminal.

And 714, displaying the first monitoring video data by the mobile terminal.

In the embodiment of the present invention, after the target task is completed, the monitoring device sends the first monitoring video data in an interconnected mesh format to the internet interface of the protocol conversion server, the protocol conversion server packages the first monitoring video data by using a video networking protocol, adds a video networking header to obtain second monitoring video data of the video networking protocol, forwards the second monitoring video data to the streaming media server through a video networking two-layer link protocol, and the streaming media server unpacks the second monitoring video data to obtain the first monitoring video data and returns the first monitoring video data to the mobile terminal through the internet interface. And after receiving the first monitoring video data, the mobile terminal displays the first monitoring video data through a monitoring video display area of a monitoring control page.

EXAMPLE III

Referring to fig. 8, a block diagram of an embodiment of a video networking system 80 of the present invention is shown, the video networking system comprising: the system comprises a mobile terminal 81, a streaming media server 82, a protocol conversion server 83 and a monitoring device 84, wherein the mobile terminal 81 and the streaming media server 82, the protocol conversion server 83 and the monitoring device 84 are respectively in communication connection through the internet, and the streaming media server 82 and the protocol conversion server 83 are in communication connection through the video internet;

the mobile terminal 81 includes: the generating module 811 is configured to generate a start instruction and an end instruction of a target task in response to a start instruction for the target task.

A sending module 812, configured to send the start instruction to the streaming media server according to a preset sending rule, and send the end instruction in a delayed manner.

The streaming server 82 includes: a forwarding module 821, configured to forward the start instruction and the end instruction to the protocol conversion server.

The protocol conversion server 83 includes: and a control module 831, configured to control the monitoring device to execute the target task according to the start instruction and the end instruction.

Optionally, the starting instruction includes: duration of operation, the sending module 812 includes:

the first sending submodule 8121 is configured to send the start instruction to the streaming media server and send the end instruction to the streaming media server after a target time interval if the operation duration is less than a preset duration, where the target time interval is a sum of the operation duration and the preset duration.

The second sending submodule 8122 is configured to send the start instruction to the streaming media server if the operation duration is greater than or equal to a preset duration, and send the end instruction to the streaming media server after the operation duration.

Optionally, the video networking system further includes:

the mobile terminal 81 includes: an obtaining module 813, configured to obtain a monitoring list from the streaming media server in response to the monitoring control request, where the monitoring list includes at least a monitoring identifier and a corresponding control option.

A displaying module 814, configured to display, in response to a selection operation for one of the control options, a monitoring control page corresponding to the target control option, where the monitoring control page at least includes a task identifier and a corresponding key.

The generating module 811 includes:

the determining submodule 8111 is configured to, in response to a preset operation for a target key of the keys, determine a task identifier corresponding to the target key as a target task identifier, and determine a monitoring identifier corresponding to the target control option as a target monitoring identifier.

A generating submodule 8112, configured to generate a start instruction and an end instruction of the target task according to the target task identifier and the target monitoring identifier, respectively.

Optionally, the control module 831 includes:

and the query sub-module 8311 is configured to query the corresponding monitoring device according to the monitoring identifier.

A first control sub-module 8312 is configured to control the monitoring device to execute the target task according to the start instruction.

And a second control sub-module 8313, configured to control the monitoring device to stop the target task according to the end instruction.

Optionally, the video networking system further includes:

the protocol conversion server 83 includes: a receiving module 832, configured to receive the first monitoring video data in the form of the interconnected grid generated by the target monitoring device executing the target task.

And the first co-rotation module 833 is configured to perform protocol conversion on the first monitoring video data to obtain second monitoring video data in a video networking format, and return the second monitoring video data to the streaming media server.

The streaming server 82 includes: and a second coordination module 822, configured to perform protocol conversion on the second monitoring video data to obtain first monitoring video data in an internet format, and return the first monitoring video data to the mobile terminal.

The mobile terminal 81 includes: a display module 815 configured to display the first surveillance video data.

The embodiment of the invention provides a control video networking system of monitoring equipment, which comprises: the system comprises a mobile terminal, a streaming media server, a protocol conversion server and a monitoring device, wherein the mobile terminal is in communication connection with the streaming media server and the protocol conversion server are in communication connection with the monitoring device through the Internet, and the streaming media server is in communication connection with the protocol conversion server through the video network, and comprises: the mobile terminal includes: the generating module is used for responding to a starting instruction aiming at a target task and generating a starting instruction and an ending instruction of the target task; the sending module is used for sending the starting instruction to the streaming media server according to a preset sending rule and sending the ending instruction in a delayed mode; the streaming media server includes: a forwarding module, configured to forward the start instruction and the end instruction to the protocol conversion server; the protocol conversion server includes: and the control module is used for controlling the monitoring equipment to execute the target task according to the starting instruction and the ending instruction. The data processing pressure of the streaming media server is reduced by setting the special protocol conversion server to be responsible for managing the monitoring equipment, and the preset sending rule is set to send the ending instruction in a delayed mode, so that the sending time between the starting instruction and the ending instruction is guaranteed, and the reliability of monitoring control is improved.

For the embodiment of the video networking system, since it is basically similar to the embodiment of the method, the description is simple, and for relevant points, reference may be made to part of the description of the embodiment of the method.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, a video networking system, or a computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create a visual networking system for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction video network systems which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The foregoing detailed description of the control method of a monitoring device and a video networking system provided by the present invention, and the specific examples are used herein to explain the principles and embodiments of the present invention, and the descriptions of the foregoing embodiments are only used to help understand the method and its core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A control method of a monitoring device is characterized in that the method is applied to a video networking system, and the video networking system comprises the following steps: the method comprises the following steps that the mobile terminal is in communication connection with the streaming media server, the protocol conversion server is in communication connection with the monitoring equipment through the internet, and the streaming media server is in communication connection with the protocol conversion server through the video network, and the method comprises the following steps:

the mobile terminal sends the starting instruction to the streaming media server according to a preset sending rule, and sends the ending instruction on an original sending time node in a delayed mode;

the protocol conversion server controls the monitoring equipment to execute the target task according to the starting instruction and the ending instruction;

the starting instruction and the ending instruction are generated by using the same character bit, and the time length of the delayed sending is longer than the average delay of the network environment;

the streaming media server does not make any change to the starting instruction and the ending instruction and directly transmits the instructions to the protocol conversion server.

2. The method of claim 1, wherein the initiating instruction comprises: the step of the mobile terminal sending the starting instruction to the streaming media server according to a preset sending rule and sending the ending instruction in a delayed manner after the operation duration comprises the following steps:

3. The method according to claim 1, wherein the step of generating a start instruction and an end instruction of the target task by the mobile terminal in response to the start instruction for the target task is preceded by the step of:

4. The method according to claim 1, wherein the step of controlling the monitoring device to execute the target task by the protocol conversion server according to the start instruction and the end instruction comprises:

5. The method according to claim 1, wherein after the step of controlling the monitoring device to execute the target task according to the start instruction and the end instruction, the protocol conversion server further comprises:

the protocol conversion server receives first monitoring video data in an interconnected grid mode generated by the monitoring equipment executing the target task;

and the mobile terminal displays the first monitoring video data.

6. An internet of view system, comprising: the system comprises a mobile terminal, a streaming media server, a protocol conversion server and monitoring equipment, wherein the mobile terminal is in communication connection with the streaming media server and the protocol conversion server is in communication connection with the monitoring equipment through the Internet respectively;

the sending module is used for sending the starting instruction to the streaming media server according to a preset sending rule and sending the ending instruction on the original sending time node in a delayed mode; the starting instruction and the ending instruction are generated by using the same character bit, and the time length of the delayed sending is longer than the average delay of the network environment;

the streaming media server includes: a forwarding module, configured to forward the start instruction and the end instruction to the protocol conversion server; the streaming media server does not make any change to the starting instruction and the ending instruction and directly transmits the starting instruction and the ending instruction to the protocol conversion server;

7. The video networking system of claim 6, wherein the boot instruction comprises: the operation duration, the sending module includes:

8. The video networking system of claim 7, further comprising:

the generation module comprises:

9. The video networking system of claim 6, wherein the control module comprises:

10. The video networking system of claim 6, further comprising:

the protocol conversion server includes: the receiving module is used for receiving first monitoring video data in an interconnected grid mode generated by the monitoring equipment executing the target task;