CN109714527B

CN109714527B - Method and device for controlling video network camera in internet

Info

Publication number: CN109714527B
Application number: CN201811506781.6A
Authority: CN
Inventors: 王军; 沈军; 王洪超; 白羽
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2018-12-10
Filing date: 2018-12-10
Publication date: 2021-06-11
Anticipated expiration: 2038-12-10
Also published as: CN109714527A

Abstract

The embodiment of the invention provides a method and a device for controlling a camera of a video network in the Internet, wherein the method and the device are applied to the video network, an Internet terminal is accessed to a server with a MServer based on a GB/T28181 protocol, the MServer converts a first control message request aiming at a specified camera, which is sent by the Internet terminal, under an interface created based on a camera cloud deck control protocol of the video network so as to generate a second control message request, and a corotation server sends a cloud deck control code to the camera corresponding to the specified camera address when agreeing to the second control message request; the camera executes corresponding actions according to the holder control codes, after the camera executes the actions, the executed messages are fed back to the internet terminal, and then the internet terminal displays the controlled messages so that a user can know the controlled messages. The embodiment of the application solves the problem that the camera in the video network cannot be controlled in the Internet at present.

Description

Method and device for controlling video network camera in internet

Technical Field

The invention relates to the technical field of video networking, in particular to a method for controlling a video networking camera in the internet and a device for controlling the video networking camera in the internet.

Background

With the rapid development of network technologies, bidirectional communications such as video conferences and video teaching are widely popularized in the aspects of life, work, learning and the like of users.

The video networking is an important milestone for network development, is a higher-level form of the Internet, is a real-time network, can realize the real-time transmission of full-network high-definition videos which cannot be realized by the existing Internet, and pushes a plurality of Internet applications to high-definition video, and high definition faces each other. Finally, world no-distance is realized, and the distance between people in the world is only the distance of one screen.

Video networking technology is currently widely used. In the prior art, video monitoring is performed through monitoring equipment, a plurality of monitoring equipment in the internet are arranged under each cooperative conversion server, and the cooperative conversion server can obtain videos of the monitoring equipment under the cooperative conversion server. However, in the prior art, under the internet environment, it is not feasible to perform pan-tilt control on IPC devices connected to the video network through the internet. However, there are more internet users, so there is an urgent need for a way to enable users to remotely operate IPC devices accessed to video networking in the internet, and to ensure the development range of video networking services.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are provided to provide a method for controlling a video camera in the internet and a corresponding apparatus for controlling a video camera in the internet, which overcome or at least partially solve the above problems.

In order to solve the above problems, an embodiment of the present invention discloses a method for controlling cameras in an internet, where the method is applied to an internet, the internet includes a protocol conversion server accessed with a plurality of cameras, an internet monitoring shared server and an internet scheduling platform MServer sequentially connected to the protocol conversion server based on an internet protocol, and an internet terminal respectively connected to the internet monitoring shared server and the MServer in a communication manner based on a national standard GB/T28181 protocol, and the method includes:

the MServer receives a first control message request sent by an Internet terminal; the first control message request is generated by the Internet terminal when a trigger operation for controlling the action of a video network camera is received, and comprises a specified camera address and a holder control code aiming at the camera;

the MServer generates a second control message request according to the first control message request; wherein the second control message request comprises a video network-based camera pan-tilt control protocol;

the MServer sends the second control message request to a video networking monitoring shared server; the video networking monitoring sharing server is used for transmitting the second control message request to the coordination server; the coordination server is used for sending the pan-tilt control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing corresponding actions according to the holder control codes;

the MServer receives a processing response message transmitted by the video network monitoring sharing server; wherein the processing response message is generated by the coordination server when receiving an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

the MServer generates a control completion message aiming at the processing response message; wherein the control completion message includes execution result data of the camera;

the MServer sends the control completion message to the Internet terminal; the internet terminal is used for displaying the control completion message.

Preferably, the method further comprises:

the MServer generates a first response message when receiving the first control message request;

the MServer sends the first response message to the Internet terminal; the internet terminal is used for displaying the first response message.

Preferably, the method further comprises:

the camera is used for generating a second response message when receiving the holder control code;

the camera is used for sending the second response message to the coordination server.

Preferably, the method further comprises:

the cooperative conversion server is used for generating a third response message when receiving the execution completion message;

and the cooperative conversion server is used for sending the third response message to the camera.

Preferably, the internet terminal comprises a multi-path decoding IE plug-in; the step that the MServer receives the first control message request sent by the Internet terminal comprises the following steps:

the MServer receives a first control message request sent by a multipath decoding IE plugin; wherein the first control message request is generated by the multi-channel decoding IE plugin when receiving a trigger operation for controlling the action of a video network camera, and comprises a specified camera address and a holder control code aiming at the camera.

In order to solve the above problem, an embodiment of the present invention discloses another method for controlling cameras in an internet, where the method is applied to an internet, where the internet includes a protocol conversion server accessed with multiple cameras, an internet monitoring shared server and an internet scheduling platform MServer that are sequentially connected to the protocol conversion server based on an internet protocol, and an internet terminal that is respectively connected to the internet monitoring shared server and the MServer based on a national standard GB/T28181 protocol, and the method includes:

the protocol conversion server receives a second control message request transmitted by the video networking monitoring sharing server; the second control message request is generated by the MServer based on a camera pan-tilt control protocol of the video network when receiving the first control message request sent by the Internet terminal; the first control message request is generated by the Internet terminal when the Internet terminal receives a trigger operation for controlling the action of a video network camera, and comprises a specified camera address and a holder control code aiming at the camera;

when the coordination server agrees to the second control message request, the pan-tilt control code is sent to the camera corresponding to the specified camera address; the camera is used for executing corresponding actions according to the holder control codes;

the cooperative conversion server receives an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

the cooperative conversion server generates a processing response message according to the execution completion message;

the protocol conversion server sends the processing response message to the video networking monitoring sharing server; the video network monitoring sharing server is used for transmitting the processing response message to the MServer; the MServer is used for generating a control completion message comprising the execution result data of the camera aiming at the processing response message and sending the control completion message to the Internet terminal; the internet terminal is used for displaying the control completion message.

In order to solve the above problem, an embodiment of the present invention further discloses a device for controlling cameras in an internet network, where the device is applied to the internet network, the internet network includes a protocol conversion server accessed with a plurality of cameras, a video network monitoring sharing server and a video network scheduling platform MServer sequentially connected to the protocol conversion server based on a video network, and an internet terminal respectively connected to the video network monitoring sharing server and the MServer in a communication manner based on a national standard GB/T28181 protocol, and the MServer includes the following modules:

the first control message request receiving module is used for receiving a first control message request sent by an internet terminal; the first control message request is generated by the Internet terminal when a trigger operation for controlling the action of a video network camera is received, and comprises a specified camera address and a holder control code aiming at the camera;

a second control message request generating module, configured to generate a second control message request according to the first control message request; wherein the second control message request comprises a video network-based camera pan-tilt control protocol;

the second control message request sending module is used for sending the second control message request to a video network monitoring shared server; the video networking monitoring sharing server is used for transmitting the second control message request to the coordination server; the coordination server is used for sending the pan-tilt control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing corresponding actions according to the holder control codes;

the processing response message receiving module is used for receiving the processing response message transmitted by the video network monitoring sharing server; wherein the processing response message is generated by the coordination server when receiving an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

a control completion message generation module, configured to generate a control completion message for the processing response message; wherein the control completion message includes execution result data of the camera;

a control completion message sending module for sending the control completion message to the internet terminal; the internet terminal is used for displaying the control completion message.

In order to solve the above problem, an embodiment of the present invention further discloses another apparatus for controlling cameras in an internet network, where the apparatus is applied to the internet network, the internet network includes a protocol conversion server accessed with a plurality of cameras, a video network monitoring sharing server and a video network scheduling platform MServer sequentially connected to the protocol conversion server based on a video network, and an internet terminal respectively connected to the video network monitoring sharing server and the MServer in a communication manner based on a national standard GB/T28181 protocol, and the protocol conversion server includes the following modules:

the second control message request receiving module is used for receiving a second control message request transmitted by the video networking monitoring sharing server; the second control message request is generated by the MServer based on a camera pan-tilt control protocol of the video network when receiving the first control message request sent by the Internet terminal; the first control message request is generated by the Internet terminal when the Internet terminal receives a trigger operation for controlling the action of a video network camera, and comprises a specified camera address and a holder control code aiming at the camera;

the holder control code sending module is used for sending the holder control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing corresponding actions according to the holder control codes;

the execution completion message receiving module is used for receiving the execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

a processing response message generating module, configured to generate a processing response message according to the execution completion message;

the processing response message sending module is used for sending the processing response message to the video networking monitoring sharing server; the video network monitoring sharing server is used for transmitting the processing response message to the MServer; the MServer is used for generating a control completion message comprising the execution result data of the camera aiming at the processing response message and sending the control completion message to the Internet terminal; the internet terminal is used for displaying the control completion message.

An embodiment of the present application further provides an apparatus, including:

one or more processors; and

one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform one or more methods as described in embodiments of the application.

Embodiments of the present application also provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform one or more methods as described in embodiments of the present application.

The embodiment of the invention has the following advantages:

the embodiment of the invention applies the characteristics of the video network, and creatively provides a method and a product for controlling the camera accessed to the video network to execute corresponding actions in the internet through message signaling data communication conversion among the internet terminal, the MServer, the video network monitoring and sharing server, the protocol conversion server and the camera, so that a user can remotely operate the camera accessed to the video network in the internet, and the service scope of intercommunication between the internet and the video network is increased;

the embodiment of the application applies the characteristics of the video network, the signaling exchange submodule which correspondingly controls the action service of the video network camera is established under the Internet/video network conversion service module of the MServer, and the signaling exchange submodule performs protocol conversion of signaling data, so that each management function of the MServer is more accurate and concise, and the problems of data conversion crosstalk and errors among the signaling exchange submodules of each service are reduced.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

FIG. 5 is a schematic networking diagram of a system for controlling a video network camera in the Internet according to an embodiment of the present application;

FIG. 6 is a flowchart illustrating steps of a method for controlling a video network camera in the Internet according to an embodiment of the present disclosure;

FIG. 7 is a flowchart illustrating steps of another method for controlling a video camera in the Internet according to an embodiment of the present application;

fig. 8 is a block diagram of an apparatus for controlling a video network camera in the internet according to an embodiment of the present application;

fig. 9 is a block diagram of another apparatus for controlling a video network camera in the internet according to an embodiment of the present application.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment of the present invention is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video network, one of the core concepts of the embodiment of the invention is provided, and a method and a product for controlling the video network cameras in the internet are creatively provided according to the protocol of the video network, wherein the internet terminal accesses a platform MServer with a video network unified scheduling management function based on a GB/T28181 protocol, the MServer converts a first control message request aiming at a specified camera and sent by the internet terminal under an interface established based on the video network camera cloud platform control protocol so as to generate a second control message request which can be identified by a video network monitoring sharing server and a protocol conversion server, and then the protocol conversion server sends the cloud platform control code to the camera corresponding to the specified camera address when agreeing to the second control message request; the camera executes corresponding actions according to the holder control codes, after the camera executes the actions, the executed messages are fed back to the internet terminal through the corotation server, the video network monitoring sharing server and the MServer in sequence, and then the internet terminal displays the controlled messages so that a user can know the controlled messages. According to the embodiment of the application, the camera accessed to the video network can be controlled to execute corresponding actions in the Internet, and the service scope of intercommunication between the Internet and the video network is increased.

Meanwhile, in the embodiment of the application, the signaling exchange submodule for correspondingly controlling the action service of the video network camera is established under the Internet/video network conversion service module of the MServer, and the signaling exchange submodule performs protocol conversion of signaling data, so that each management function of the MServer is more accurate and concise, and the problems of data conversion crosstalk and errors among the signaling exchange submodules of each service are reduced.

Example 1:

as shown in fig. 5, a networking schematic diagram of a system for controlling video cameras in the internet according to an embodiment of the present application is shown, where the system may be applied to a video network, where the video network includes a collaboration server 01 having a plurality of cameras 05 connected thereto, a video network monitoring shared server 02 and a video network scheduling platform MServer03 sequentially connected to the collaboration server 01 in communication based on a video network protocol, and an internet terminal 04 respectively connected to the video network monitoring shared server 02 and the MServer03 in communication based on a national standard GB/T28181 protocol.

The collaboration server 01, also known as a monitoring access server, may be understood as a gateway, and is responsible for accessing an external (on-internet) camera 05 (which may also be described as a monitoring resource) to the video network, so as to browse and control a monitoring management device on the internet in the video network.

The video networking monitoring sharing server 02 is also named as a sharing platform, can also be understood as a gateway, and is a device which can be responsible for converting a video code stream of the video networking monitoring device 04 into a video code stream of a real-time transport protocol (RTP) protocol load, and can be used for sharing video networking video to the monitoring platform based on RTP protocol transmission. The video networking monitoring sharing server 02 in the embodiment of the application can communicate with the internet terminal 04 based on the internet protocol, and can convert the multimedia stream data sent by the protocol conversion server 01 based on the video networking protocol and directly send the converted multimedia stream data to the internet terminal 04.

MServer03 belongs to a general management system in the video network, which is called as a video network monitoring network management scheduling platform, and comprises a plurality of service modules, which can be responsible for the unified management of all accessed monitoring devices in the whole video network and the docking service of a national standard (GB/T28181) platform monitoring system. In the embodiment of the application, the MServer03 is mainly used for converting a message request sent by the internet terminal 04 based on the GB/T28181 protocol into a message request based on the camera pan-tilt control protocol of the video network. In specific implementation, the MServer03 establishes a signaling exchange sub-module corresponding to a specific service (e.g., a service for controlling the action of a video camera) in the internet/video conversion service module, and converts the message signaling from the internet data to the video data or vice versa.

The internet terminal 04 refers in particular to a terminal product capable of completing internet services, and is a product composed of customized hardware, an operating system running on the customized hardware, and application software, where the hardware may be a mobile phone, a tablet, a desktop, a notebook, and the like, and the software may be an application client or a web page.

The camera 05 is mainly located in the internet, most of the camera is arranged on a street, in a unit, in a public area such as a market school and the like, and the resources are accessed into the cooperative conversion server 01 in the video internet environment through a system of a snow project and a public security hall.

Example 2:

as shown in fig. 6, a flowchart illustrating steps of a method for controlling a video network camera in the internet according to an embodiment of the present application is shown, where the method may be applied in a video network, and in particular, may be applied in an MServer03 shown in fig. 5, and the method may specifically include the following steps:

step S601: the MServer receives a first control message request sent by an Internet terminal; the first control message request is generated by the Internet terminal when a trigger operation for controlling the action of a video network camera is received, and comprises a specified camera address and a holder control code aiming at the camera;

in the embodiment of the present application, the internet terminal 04 has a display interface, and the display interface may be a client or a web page.

The triggering operation of the camera 05 control of the video network mentioned in the embodiment of the present application may be that a user first selects a camera icon on a display interface, then selects a control function icon (the control function icon may include an icon such as video recording, turning, screenshot, and zooming in a lens) corresponding to an action to be executed by the camera 05 cradle head, and finally clicks a control confirmation button.

The triggering operation for controlling the action of the video network camera in the embodiment of the present application may also be a name or an address number of a certain camera 05 input in the display interface, and then a control function icon that allows the camera 05 to execute a corresponding action is clicked.

The internet terminal 04 generates a first control message request (internet data) corresponding to the trigger operation according to the received trigger operation, where the first control message request includes a specified camera address and pan-tilt control codes for the camera 05, and a code for executing an action in the pan-tilt control codes is generated according to a selected control function icon, and may include one or more actions such as video recording, turning, screenshot, and zooming in a camera.

In order to enable an internet terminal to access a video network, the internet terminal is provided with a multi-channel decoding IE plugin, the multi-channel decoding IE plugin is a plugin applet and is embedded in a running background of a video display and is communicated with the MServer03 based on a GB/T28181 protocol.

Therefore, the step of receiving the first control message request sent by the internet terminal by the MServer03 of the present application may specifically include:

the MServer03 receives a first control message request sent by a multipath decoding IE plug-in; wherein the first control message request is generated by the multi-channel decoding IE plugin when receiving a trigger operation for controlling the action of a video network camera, and comprises a specified camera address and a holder control code aiming at the camera.

In addition, since the internet is at the third layer of the communication protocol and the video network is at the second layer of the communication protocol, the security of the internet is not as high as that of the video network, and the stability of the network is also weak. To address this problem, a preferred embodiment of the present application discloses a method, which may specifically include the following steps:

said MServer03 generates a first response message upon receiving said first control message request;

the MServer03 sends the first response message to the Internet terminal 04; the internet terminal 04 is configured to display the first response message.

Through the above preferred embodiment, it is configured that the MServer03 generates the first response message to notify the internet terminal 04 when receiving the first control message request, so that the user can know in time whether the MServer03 can receive the message in the internet terminal 04, and can notify the user in time to handle the failure.

Step S602: the MServer generates a second control message request according to the first control message request; wherein the second control message request comprises a video network-based camera pan-tilt control protocol;

after receiving a first control message request sent by an internet terminal 04 based on a GB/T28181 protocol, in order to enable the message request to be recognized and executed by a video network monitoring sharing server 02 and a protocol conversion server 01, MServer03 must convert the message request, and when the message request is specifically converted, a video network camera pan-tilt control rule is added to the video network protocol according to the video network protocol communicated with the video network monitoring sharing server 02 and the protocol conversion server 01 to form a video network based camera pan-tilt control protocol, and a signaling exchange sub-module for correspondingly controlling a video network camera action service is established in an internet/video network conversion service module, and the signaling exchange sub-module can convert the first control message request into a second control message request (video network data).

Step S603: the MServer sends the second control message request to a video networking monitoring shared server; the video networking monitoring sharing server is used for transmitting the second control message request to the coordination server; the coordination server is used for sending the pan-tilt control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing corresponding actions according to the holder control codes;

correspondingly, the MServer03 sends the second control message request formed after conversion to the video networking monitoring shared server 02, after the video networking monitoring shared server 02 passes through, the coordination server 01 judges whether to approve the second control message request, if the service protocol of the second control message request is correct or the network communication is normal, and the like, the coordination server 01 usually agrees with the second control message request, and then sends the pan-tilt control code to the camera 05 corresponding to the specified camera address.

The camera 05 executes corresponding actions such as video recording, turning, capturing, zooming in, and the like according to the pan-tilt control code.

In addition, in order to avoid the situation that some cameras are disconnected or fail to receive the pan-tilt control code, the method disclosed in a preferred embodiment of the present application may further include:

the camera 05 is configured to generate a second response message when receiving the pan/tilt control code;

the camera 05 is configured to send the second response message to the coordination server 01.

Through the preferred embodiment, the camera 05 generates the second response message when receiving the pan-tilt control code, so as to inform the cooperative conversion server 01, so that the cooperative conversion server 01 can timely know the networking state of the camera 05 required to be controlled, can timely inform a user of processing, and is beneficial to monitoring, managing and maintaining the camera 05.

Step S604: the MServer receives a processing response message transmitted by the video network monitoring sharing server; wherein the processing response message is generated by the coordination server when receiving an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

after all actions corresponding to the pan-tilt control code are executed, the camera 05 generates an execution completion message and feeds the execution completion message back to the cooperative steering server 01.

Meanwhile, the cooperative conversion server 01 generates a third response message when receiving the execution completion message, and sends the third response message to the camera 05, so that the camera 05 can know the third response message in time.

The cooperative conversion server 01 generates a processing response message according to the received execution completion message, and transmits the processing response message to the MServer03 through the video network monitoring sharing server 02.

Step S605: the MServer generates a control completion message aiming at the processing response message; wherein the control completion message includes execution result data of the camera;

in the embodiment of the present application, the control completion message generated by MServer03 includes execution result data of the camera 05, and the execution result data is generated correspondingly mainly according to the execution action in the pan/tilt/zoom control code.

Step S606: the MServer sends the control completion message to the Internet terminal; the internet terminal is used for displaying the control completion message.

In a preferred embodiment of the present application, when receiving the control completion message, the internet terminal 04 further generates a fourth response message, and sends the fourth response message to the MServer 04. Therefore, a manager managing the MServer04 can know whether the Internet terminal 04 has received the control completion message and record the control completion message, so that data management of each time of camera 05 cradle head control can be enhanced, and the data transmission is clear everywhere.

Through the steps S601 to S606, the mode of controlling the action of the video network camera in the Internet is illustrated from the perspective of MServer03, the embodiment of the application creatively provides a method for controlling the video network camera in the Internet, and the service scope of intercommunication between the Internet and the video network is increased;

in addition, in the embodiment of the application, the signaling exchange submodule for correspondingly controlling the action service of the video network camera 05 is established under the internet/video network conversion service module of the MServer03, and the signaling exchange submodule performs protocol conversion of signaling data, so that each management function of the MServer03 is more accurate and concise, and the problems of data conversion crosstalk and errors among the signaling exchange submodules of each service are reduced.

Example 3:

as shown in fig. 7, a flowchart of steps of another method for controlling a video network camera in the internet according to the embodiment of the present application is shown, where the method may be applied to a video network, and in particular, may be applied to a collaboration server 01 shown in fig. 5, and the method may specifically include the following steps:

step S701: the protocol conversion server receives a second control message request transmitted by the video networking monitoring sharing server; the second control message request is generated by the MServer based on a camera pan-tilt control protocol of the video network when receiving the first control message request sent by the Internet terminal; the first control message request is generated by the Internet terminal when the Internet terminal receives a trigger operation for controlling the action of a video network camera, and comprises a specified camera address and a holder control code aiming at the camera;

step S702: when the coordination server agrees to the second control message request, the pan-tilt control code is sent to the camera corresponding to the specified camera address; the camera is used for executing corresponding actions according to the holder control codes;

step S703: the cooperative conversion server receives an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

step S704: the cooperative conversion server generates a processing response message according to the execution completion message;

step S705: the protocol conversion server sends the processing response message to the video networking monitoring sharing server; the video network monitoring sharing server is used for transmitting the processing response message to the MServer; the MServer is used for generating a control completion message comprising the execution result data of the camera aiming at the processing response message and sending the control completion message to the Internet terminal; the internet terminal is used for displaying the control completion message.

Through the steps S701-S705, the mode of controlling the action of the video network camera in the Internet is explained from the perspective of the cooperative rotation server 01, the embodiment of the application creatively provides a method for controlling the video network camera in the Internet, and the service scope of intercommunication between the Internet and the video network is increased; detailed description of the preferred embodimentsreference is made to example 2 and will not be explained herein for the sake of brevity.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Example 4:

as shown in fig. 8, corresponding to the method in embodiment 2, a block diagram of a device for controlling a video camera in the internet according to an embodiment of the present application is shown, where the device may be applied to the video network, and may specifically be applied to MServer03 shown in fig. 5, where the MServer03 may specifically include the following modules:

a first control message request receiving module 801, configured to receive a first control message request sent by an internet terminal; the first control message request is generated by the Internet terminal when a trigger operation for controlling the action of a video network camera is received, and comprises a specified camera address and a holder control code aiming at the camera;

a second control message request generating module 802, configured to generate a second control message request according to the first control message request; wherein the second control message request comprises a video network-based camera pan-tilt control protocol;

a second control message request sending module 803, configured to send the second control message request to a video networking monitoring sharing server; the video networking monitoring sharing server is used for transmitting the second control message request to the coordination server; the coordination server is used for sending the pan-tilt control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing corresponding actions according to the holder control codes;

a processing response message receiving module 804, configured to receive a processing response message transparently transmitted by the video networking monitoring sharing server; wherein the processing response message is generated by the coordination server when receiving an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

a control completion message generation module 805 configured to generate a control completion message for the processing response message; wherein the control completion message includes execution result data of the camera;

a control completion message sending module 806, configured to send the control completion message to the internet terminal; the internet terminal is used for displaying the control completion message.

Example 5:

as shown in fig. 9, corresponding to the method in embodiment 3, a block diagram of a structure of another apparatus for controlling a video camera in the internet according to the embodiment of the present application is shown, where the apparatus may be applied to the video network, and specifically, may be applied to the cooperative conversion server 01 shown in fig. 5, and the cooperative conversion server 01 may specifically include the following modules:

a second control message request receiving module 901, configured to receive a second control message request transparently transmitted by the video networking monitoring sharing server; the second control message request is generated by the MServer based on a camera pan-tilt control protocol of the video network when receiving the first control message request sent by the Internet terminal; the first control message request is generated by the Internet terminal when the Internet terminal receives a trigger operation for controlling the action of a video network camera, and comprises a specified camera address and a holder control code aiming at the camera;

a cradle head control code sending module 902, configured to send the cradle head control code to the camera corresponding to the specified camera address when the second control message request is granted; the camera is used for executing corresponding actions according to the holder control codes;

an execution completion message receiving module 903, configured to receive an execution completion message sent by the camera; the execution completion message is generated after the camera executes all actions corresponding to the pan-tilt control code;

a processing response message generating module 904, configured to generate a processing response message according to the execution completion message;

a processing response message sending module 905, configured to send the processing response message to the video networking monitoring sharing server; the video network monitoring sharing server is used for transmitting the processing response message to the MServer; the MServer is used for generating a control completion message comprising the execution result data of the camera aiming at the processing response message and sending the control completion message to the Internet terminal; the internet terminal is used for displaying the control completion message.

one or more processors; and

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The method for controlling the video network camera in the internet and the device for controlling the video network camera in the internet provided by the invention are described in detail, specific examples are applied in the text to explain the principle and the implementation mode of the invention, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A method for controlling video network cameras in the Internet is characterized in that the method is applied to the video network, the video network comprises a protocol conversion server accessed with a plurality of cameras, a video network monitoring sharing server and a video network dispatching platform MServer which are sequentially connected with the protocol conversion server in a communication mode based on a video network protocol, and an Internet terminal which is respectively connected with the video network monitoring sharing server and the MServer in a communication mode based on a national standard GB/T28181 protocol, and the method comprises the following steps:

the MServer sends the second control message request to a video networking monitoring shared server; the video networking monitoring sharing server is used for transmitting the second control message request to the coordination server; the coordination server is used for sending the pan-tilt control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing one or more actions of video recording, turning, screenshot and lens pulling of the camera according to the holder control code;

the MServer sends the control completion message to the Internet terminal; the Internet terminal is used for displaying the control completion message;

the video network monitoring sharing server and the internet terminal are communicated based on an internet protocol, multimedia streaming data sent by the protocol conversion server are converted based on the video network protocol and are directly sent to the internet terminal, wherein the multimedia streaming data are generated by the camera executing one or more actions of video recording and screenshot of the camera.

2. The method of claim 1, further comprising:

3. The method of claim 1, further comprising:

4. The method of claim 1, further comprising:

5. The method of claim 1, wherein the internet terminal comprises a multi-decoding IE plugin; the step that the MServer receives the first control message request sent by the Internet terminal comprises the following steps:

6. A method for controlling video network cameras in the Internet is characterized in that the method is applied to the video network, the video network comprises a protocol conversion server accessed with a plurality of cameras, a video network monitoring sharing server and a video network dispatching platform MServer which are sequentially connected with the protocol conversion server in a communication mode based on a video network protocol, and an Internet terminal which is respectively connected with the video network monitoring sharing server and the MServer in a communication mode based on a national standard GB/T28181 protocol, and the method comprises the following steps:

when the coordination server agrees to the second control message request, the pan-tilt control code is sent to the camera corresponding to the specified camera address; the camera is used for executing one or more actions of video recording, turning, screenshot and lens pulling of the camera according to the holder control code;

the protocol conversion server sends the processing response message to the video networking monitoring sharing server; the video network monitoring sharing server is used for transmitting the processing response message to the MServer; the MServer is used for generating a control completion message comprising the execution result data of the camera aiming at the processing response message and sending the control completion message to the Internet terminal; the Internet terminal is used for displaying the control completion message;

7. The utility model provides a control device of video networking camera in internet, its characterized in that, the device is applied to in the video networking, the video networking is including the cooperation commentaries on classics server that inserts a plurality of cameras, with cooperate commentaries on classics server based on video networking protocol in proper order communication connection's video networking control shared server, video networking dispatch platform MServer to and based on national standard GB/T28181 agreement with video networking control shared server, MServer respectively communication connection's internet terminal, MServer includes following module:

the second control message request sending module is used for sending the second control message request to a video network monitoring shared server; the video networking monitoring sharing server is used for transmitting the second control message request to the coordination server; the coordination server is used for sending the pan-tilt control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing one or more actions of video recording, turning, screenshot and lens pulling of the camera according to the holder control code;

a control completion message sending module for sending the control completion message to the internet terminal; the Internet terminal is used for displaying the control completion message;

the video network monitoring sharing server is used for communicating with an Internet terminal based on an Internet protocol, converting multimedia streaming data sent by a protocol conversion server based on the video network protocol and directly sending the multimedia streaming data to the Internet terminal, wherein the multimedia streaming data is generated by one or more actions of video recording and screenshot of a camera executed by the camera.

8. The utility model provides a control device of video networking camera in internet, its characterized in that, the device is applied to in the video networking, the video networking is including the cooperation commentaries on classics server that inserts a plurality of cameras, with cooperate commentaries on classics server based on video networking protocol in proper order communication connection's video networking control shared server, video networking dispatch platform MServer to and based on national standard GB/T28181 agreement with video networking control shared server, MServer respectively communication connection's internet terminal, the cooperation server includes following module:

the holder control code sending module is used for sending the holder control code to the camera corresponding to the specified camera address when the second control message request is agreed; the camera is used for executing one or more actions of video recording, turning, screenshot and lens pulling of the camera according to the holder control code;

the processing response message sending module is used for sending the processing response message to the video networking monitoring sharing server; the video network monitoring sharing server is used for transmitting the processing response message to the MServer; the MServer is used for generating a control completion message comprising the execution result data of the camera aiming at the processing response message and sending the control completion message to the Internet terminal; the Internet terminal is used for displaying the control completion message;

9. An apparatus for controlling a video network camera in the internet, comprising:

one or more processors; and

one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of any of claims 1-6.

10. A machine-readable medium having stored thereon instructions, which when executed by one or more processors, cause the processors to perform the method of any one of claims 1-6.