CN108881814B

CN108881814B - Method and device for communication between video network terminal and network camera and interaction system

Info

Publication number: CN108881814B
Application number: CN201710648172.3A
Authority: CN
Inventors: 秦鹏; 王艳辉; 李云鹏; 杨春晖
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2017-08-01
Filing date: 2017-08-01
Publication date: 2021-06-18
Anticipated expiration: 2037-08-01
Also published as: CN108881814A

Abstract

The embodiment of the invention provides a method, a device and an interactive system for communication between a video network terminal and a network camera, wherein the system comprises the video network terminal, an upper-level server, the network camera and a lower-level server associated with the network camera, and the video network terminal is used for sending an operation request aiming at the network camera to the upper-level server when detecting specified operation; the superior server is used for receiving the operation request, generating a first control instruction according to the operation request and sending the first control instruction to the inferior server; the lower-level server is used for receiving the first control instruction, converting the first control instruction into a second control instruction and sending the second control instruction to the network camera; the network camera is used for receiving the second control instruction and responding to the second control instruction, so that resource integration of the network camera is realized, the video network terminal can acquire resources of the network cameras of different manufacturers through the superior server, and convenience and safety of operation are improved.

Description

Method and device for communication between video network terminal and network camera and interaction system

Technical Field

The invention relates to the field of video networking, in particular to a method for communication between a video networking terminal and a network camera, a device for communication between the video networking terminal and the network camera and an interactive system.

Background

With the rapid development of science and technology, the video networking technology is widely applied to various industries, such as the fields of telemedicine, security, emergency command and the like, and the application of the video networking technology brings great convenience.

At present, the national security and protection alarm system standardization technical committee enters the mouth, and multiple units such as the first place of the ministry of public security have drafted GB/T28181, and the GB/T28181 provides standard requirements for video monitoring information transmission, exchange and control technologies.

However, because GB/T28181 does not provide a unified technical specification, under the principle of following GB/T28181, different manufacturers have different applications to GB/T28181 in a network Camera (IP Camera), and the network Camera can be accessed and managed only by inputting the IP, port, user, password, etc. of each network Camera one by one according to the application of different manufacturers to GB/T28181 by the internet of view terminal, which is too complicated to operate and has low security.

Disclosure of Invention

In view of the above problems, embodiments of the present invention are proposed to provide a method, an apparatus and an interactive system for a video network terminal to communicate with a network camera, which overcome the above problems or at least partially solve the above problems.

In order to solve the above problem, an embodiment of the present invention discloses an interactive system, which includes a video network terminal, a superior server, a network camera, and a subordinate server associated with the network camera,

the video network terminal is used for sending an operation request aiming at the network camera to the superior server when a specified operation is detected;

the superior server is used for receiving the operation request, generating a first control instruction according to the operation request and sending the first control instruction to the subordinate server;

the lower server is used for receiving the first control instruction, converting the first control instruction into a second control instruction and sending the second control instruction to the network camera; the second control instruction is an instruction which can be identified by the network camera;

and the network camera is used for receiving the second control instruction and responding to the second control instruction.

Preferably, the system further comprises one or more intermediate servers associated with the subordinate servers, the superior server comprising:

the first operation request receiving module is used for receiving the operation request;

the first control instruction generation module is used for generating a first control instruction according to the operation request;

and the first control instruction sending module is used for sending the first control instruction to the one or more intermediate servers, and the one or more intermediate servers send the first control instruction to the lower-level server.

Preferably, the second control instruction includes a video stream calling instruction, and the network camera includes:

the first and second control instruction receiving module is used for receiving the video stream calling instruction;

the first and second control instruction response modules are used for calling the video stream according to the video stream calling instruction and sending the video stream to the lower-level server;

the lower level server is also used for receiving the video stream and sending the video stream to the upper level server;

and the superior server is also used for receiving the video stream and sending the video stream to the video networking terminal.

Preferably, the lower server includes:

a first video stream receiving module, configured to receive the video stream;

and the first video stream sending module is used for sending the video stream to the one or more intermediate servers, and the one or more intermediate servers send the video stream to the superior server.

Preferably, the second control instruction includes an operation instruction, and the network camera includes:

the second control instruction receiving module is used for receiving the operation instruction;

and the second control instruction response module is used for executing the operation specified by the operation instruction.

The embodiment of the invention also discloses a method for communication between the video network terminal and the network camera, wherein the network camera is positioned in the Ethernet, and the method comprises the following steps:

receiving an operation request aiming at the network camera, which is sent by the video network terminal;

generating a first control instruction according to the operation request;

determining a subordinate server associated with the network camera;

sending the first control instruction to the subordinate server; the lower server is used for converting the first control instruction into a second control instruction and sending the second control instruction to the network camera, the second control instruction is an instruction which can be identified by the network camera, and the network camera is used for responding to the second control instruction.

Preferably, the step of sending the first control instruction to the subordinate server includes:

determining one or more intermediate servers associated with the subordinate server;

sending, via the one or more intermediate servers, the first control instruction to the subordinate server.

Preferably, the second control instruction comprises a video stream call instruction, the method further comprising:

receiving a video stream sent by the network camera; the video stream is a video stream which is called by the network camera according to the video stream calling instruction and is sent by the lower level server or the lower level server and the one or more intermediate servers;

and sending the video stream to the video networking terminal.

Preferably, the second control instruction comprises an operation instruction, and the responding to the second control instruction comprises executing an operation specified by the operation instruction.

The embodiment of the invention also discloses a device for communication between the video network terminal and the network camera, wherein the network camera is positioned in the Ethernet, and the device comprises:

the second operation request receiving module is used for receiving an operation request which is sent by the video network terminal and aims at the network camera;

the second first control instruction generation module is used for generating a first control instruction according to the operation request;

a lower server determining module for determining a lower server associated with the network camera;

the second first control instruction sending module is used for sending the first control instruction to the subordinate server; the lower server is used for converting the first control instruction into a second control instruction and sending the second control instruction to the network camera, the second control instruction is an instruction which can be identified by the network camera, and the network camera is used for responding to the second control instruction.

The embodiment of the invention also discloses electronic equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the steps of the method are realized when the processor executes the program.

The embodiment of the invention also discloses a computer readable storage medium, which is stored with a computer program, and is characterized in that the program is executed by a processor to realize the steps of the method.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, by constructing the interactive system comprising the video network terminal, the upper-level server, the network camera and the lower-level server associated with the network camera, when the video network terminal sends an operation request aiming at the network camera, the upper-level server generates a first control instruction according to the operation request and sends the first control instruction to the lower-level server associated with the network camera, the lower-level server converts the first control instruction into a second control instruction which can be identified by the network camera, and the network camera receives and responds to the second control instruction, so that the resource integration of the network camera is realized, the video network terminal can obtain the resources of the network cameras of different manufacturers through the upper-level server, and the convenience and the safety of the operation are improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

FIG. 5a is a schematic structural diagram of an interactive system according to an embodiment of the present invention;

FIG. 5b is a schematic structural diagram of another interactive system according to an embodiment of the present invention;

FIG. 6 is a flowchart illustrating steps of a method for a video networking terminal to communicate with a network camera according to an embodiment of the present invention;

fig. 7 is a block diagram of an apparatus for communicating between a video network terminal and a network camera according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

1. Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 204 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment of the present invention is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 208 is configured by the CPU module 204, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video network, the core concept of the embodiment of the invention is provided, by building an interactive system comprising a video network terminal, an upper-level server, a network camera and a lower-level server associated with the network camera, when the video network terminal sends an operation request aiming at the network camera, the upper-level server generates a first control instruction according to the operation request and sends the first control instruction to the lower-level server associated with the network camera, the lower-level server converts the first control instruction into a second control instruction which can be identified by the network camera, and the network camera receives and responds to the second control instruction, so that the resource integration of the network camera is realized, the video network terminal can obtain the resources of the network cameras of different manufacturers through the upper-level server, and the simplicity and the safety of the operation are improved.

In order to meet the requirements of the butt joint of public security and security control monitoring video networking between video networking and different platform manufacturers, realize the unified standardization of media streams, and realize the real-time playing, video calling and cloud deck control of videos nationwide, the embodiment of the invention adopts a mode of cascade connection of multi-stage media servers to realize the step-by-step pushing of the video streams of the network cameras of the basic unit, and the video streams are sequentially transmitted to the unified platform from low to high.

Specifically, referring to fig. 5a, a block diagram of an interactive system according to an embodiment of the present invention is shown, where the system may be applied in a video network, and may include a video network terminal 501, an upper server 502, a webcam 503, and a lower server 504 associated with the webcam 503.

The video network terminal 501 may include a physical terminal such as a set-top box (SetTopBox, STB), which may be called a set-top box or set-top box, and is a device for connecting a television set and an external signal source, and may convert a compressed digital signal into television content and display the television content on the television set. Generally, the set-top box may be connected to a camera and a microphone for collecting multimedia data such as video data and audio data, and may also be connected to a television for playing multimedia data such as video data and audio data.

The terminal 501 may also include a virtual network terminal, which is a terminal accessing the network for implementing a special service, and refers to a special software, and may create an environment between the terminal and the terminal user, and the terminal user operates the software based on the environment created by the software, and the virtual network terminal may be implemented by software of the terminal running a program like a real machine.

The upper level server 502 may provide a uniform interface to the outside to implement a platform access service, which may also be a media server located at the uppermost level in the cascade mode, where the media server provides forwarding of real-time media streams, storage of media, retrieval of historical media information, and a unicast service, and the media server may receive media data from devices such as an SIP (Session Initiation Protocol) device, a gateway, or other media servers, and forward the data to other single or multiple SIP clients and media servers according to instructions.

The webcam 503, which may be located in an ethernet network, is a new generation of webcam created by combining traditional webcams with web technology, and can transmit images to the other end of the earth through the internet, and the remote viewer can monitor the images without any specialized software, as long as a standard web browser is used. The network camera is generally composed of a lens, an image sensor, a sound sensor, an A/D converter, an image sensor, a sound sensor, a controller network server, an external alarm, a control interface and the like.

The lower server 504 may be a media server located at the lowest level in the cascade mode, and directly connected to the network camera 503, and may communicate with the network camera 503 using a command recognizable by the network camera 503, and there is no other media server between the lower server 504 and the network camera 503.

In fact, during the establishment of the interactive system, the following steps may be adopted for docking:

1. confirming platform information of a subordinate server, such as manufacturer brand, model, monitoring resource quantity and GB28181 version of an associated network camera;

2. configuring platform information of a superior server and platform information of a subordinate server on the superior server;

3. and (4) signaling calling and testing, wherein the lower-level server sends registration information to the upper-level server, and the upper-level server verifies the authentication user certificate.

4. And calling and testing the video stream, and checking the video format, the size of the code stream and data transmission.

In the embodiment of the invention, the monitoring resources of different manufacturers are integrated under one platform by establishing the interactive system, the integration of the monitoring resources accessed to the video network is realized, a plurality of access points are changed into one access point, and the data filtering is carried out by arranging a firewall and the like at the access point, so that the safety of the system is improved.

The following illustrates various parts of the interactive system as follows:

the video network terminal 501 may be configured to send an operation request for the network camera 503 to the upper server 502 when a detected specified operation is performed;

as a preferred example, the video network terminal 501 may have directory information of a plurality of network cameras acquired from the upper server 502, and the specifying operation may be a specifying operation for the directory information of the network camera 503.

Specifically, the video network terminal 501 may obtain directory information of a plurality of network cameras from the upper server 502 and display the directory information through the display device, the user may perform a specified operation on the directory information of the plurality of network cameras displayed, for example, a selection operation, and when the specified operation is detected, the video network terminal 501 may send an operation request to the upper server 502 to request to obtain a video stream of the network camera 503 or request to control the network camera 503 to perform the specified operation.

The upper level server 502 may be configured to receive the operation request, generate a first control instruction according to the operation request, and send the first control instruction to the lower level server 504;

after the video network terminal 501 sends the operation request, the upper server 502 may receive the operation request, generate a first control instruction according to the operation request, determine the lower server 504 associated with the network camera 503, and send the first control instruction to the lower server 504.

As an example, the operation request may include an identifier of a webcam, and a request type, such as video stream acquisition and control operation, and the upper level server 502 may generate a corresponding first control instruction according to the request type in the operation request, determine an associated lower level server 504 according to the identifier of the webcam 503 in the operation request, and send the first control instruction to the lower level server 504.

In a preferred example, the first control command may be a command generated by GB/T28181, where GB/T28181 is "transmission, exchange, and control technical requirement of security video monitoring networking system", which is a national standard proposed by the ministry of public security technology informatization, and drafted together by multiple units such as the national security and protection alarm system standardization technical committee (SAC/TC100), the ministry of public security, and the like.

GB/T28181 specifies the interconnection structure and communication protocol structure of information transmission, exchange and control, the basic requirements and safety requirements of transmission, exchange and control, and the technical requirements of control, transmission flow, protocol interface and the like in the urban monitoring alarm networking system.

In practical application, GB28181 is a Protocol based on SIP (Session Initiation Protocol), and it is necessary to complete basic operations such as signaling interaction, registration, directory query, real-time video, and shutdown, to implement video communication based on GB28181, as follows:

registering: the SIP proxy sends a Register request to the SIP server, which sends a response 401 to the SIP proxy, giving the authentication body and parameters appropriate for the SIP proxy in the WWW _ authentication field of the header of the response. The SIP proxy sends a Register request to the SIP server again, and gives a trust book containing authentication information in the Authorization field of the request. The SIP server verifies the request, if the identity of the SIP agent is checked to be legal, a successful response 200OK is sent to the SIP agent, and if the identity is not legal, a despooling service response is sent.

Directory query: the directory retrieval side sends a directory query request Message to the directory owner side, and the Message body comprises video file retrieval conditions. The directory owner sends a 200OK to the directory retriever with no message body. The directory owner sends the query result to the directory retriever, and the message body contains the file directory. The directory retriever sends a 200OK to the directory owner with no message body.

Real-time video: the media stream acceptor sends an Invite message to the SIP server, with the s field "Play" in the SDP message body representing real-time on-demand. The SIP media server analyzes the SDP message, requests to monitor the video of the camera, and sends the video stream to the IP and the port appointed by the media receiver.

Closing: the media stream receiver sends a Bye message to the SIP server. And the SIP server replies a 200OK response after receiving the BYE message, and the session is disconnected.

It should be noted that, because each manufacturer has different understanding about GB/T28181, different manufacturers may have differences in instructions defined by GB/T28181, for example, there are differences in detection strings of the mobile detection function between the manufacturers haikang and dawa, and different manufacturers may have different instructions that can be recognized by the webcam, and the first operation instruction generated by the upper server 502 may be a general standard instruction.

In a preferred embodiment of the present invention, as shown in fig. 5b, the system may further include one or more intermediate servers 505 associated with the lower servers 503, the intermediate servers 505 may be media servers located between the uppermost media server and the lowermost media server in the cascade mode, and the upper server 502, the one or more intermediate servers 505, and the lower servers 504 may be in a relationship of upper and lower levels in the cascade mode, such as media servers at the province, city, district, or county levels.

The upper level server 504 may include the following modules:

a first control instruction sending module, configured to send the first control instruction to the one or more intermediate servers 505, where the one or more intermediate servers 505 send the first control instruction to the lower level server 504.

In the embodiment of the present invention, the upper level server 502 may determine the lower level server 504 associated with the webcam 503, determine one or more intermediate servers 505 associated with the lower level server 504, send the generated first control instruction to the one or more intermediate servers 505, and send the first control instruction to the lower level server 504 by the one or more intermediate servers 505.

The lower server 504 may be configured to receive the first control instruction, convert the first control instruction into a second control instruction, and send the second control instruction to the network camera 503; the second control instruction may be an instruction that can be recognized by the network camera 503;

after the upper server 502 sends the first control instruction, the lower server 504 may receive the first control instruction, may determine an instruction protocol that can be recognized by the network camera 503, convert the first control instruction into a second control instruction that can be recognized by the network camera 503 according to the instruction protocol, and send the second control instruction to the network camera 503.

The webcam 503 may be configured to receive the second control instruction and respond to the second control instruction.

After the lower server 504 sends the second control instruction, the network camera 503 may receive the second control instruction and may respond to the second control instruction.

In one embodiment, the second control instruction may include a video stream fetching instruction for fetching a video stream of the network camera 503, and the network camera 503 may include the following modules:

a first and second control instruction response module, configured to invoke a video stream according to the video stream invoking instruction, and send the video stream to the lower server 504;

after receiving the video retrieval instruction sent by the lower server 504, the webcam 503 retrieves a real-time video stream according to the video stream retrieval instruction, and sends the video stream to the lower server 504.

The lower level server 504 may be further configured to receive the video stream and send the video stream to the upper level server 502;

after the network camera 503 transmits the video stream, the lower server 504 may receive the video stream and then transmit the video stream to the upper server 502.

In a preferred embodiment of the present invention, the lower level server 504 may include:

a first video stream receiving module, configured to receive the video stream;

a first video stream sending module, configured to send the video stream to the one or more intermediate servers 505, where the one or more intermediate servers 505 send the video stream to the upper level server 502.

In the embodiment of the present invention, after receiving the video stream, the lower level server 504 may send the video stream to one or more intermediate servers 505, and then send the video stream to the upper level server 502 by the one or more intermediate servers 505.

As a preferred example, the lower level server 504, one or more intermediate servers 505, and the voucher server 502 can adopt RTP (real time Transport Protocol)/RTCP (real time Transport Control Protocol) to progressively transmit the video stream, where the RTP/RTCP can Control the heartbeat packet and the traffic status packet to provide information of session quality or broadcast performance quality for transmission of the video stream.

The upper level server 502 may also be configured to receive the video stream and send the video stream to the video networking terminal 501.

After the lower-level server 504 or one or more intermediate servers 505 sends the video stream, the upper-level server 502 may receive the video stream, convert the video stream into a video stream that can be identified by the video networking terminal according to the video networking protocol corresponding to the video stream, and send the converted video stream to the video networking terminal 501.

As an example, for a video stream, the corresponding video networking protocol may be determined to be 2000, as shown in table 1:

TABLE 1

In another embodiment, the second control instruction may include an operation instruction for controlling the network camera 503 to perform a specified operation, and the network camera 503 may include the following modules:

In the embodiment of the present invention, after receiving the operation instruction sent by the lower server 504, the network camera 503 may execute the operation specified by the operation instruction.

Referring to fig. 6, a flowchart of steps of a method for a terminal of a video network to communicate with a network camera according to an embodiment of the present invention is shown, where the method may be applied to the video network, and the following description is performed from a higher server side, and specifically may include the following steps:

601, receiving an operation request aiming at the network camera, which is sent by the video network terminal;

as an example, the video network terminal may have directory information of a plurality of network cameras acquired from an upper server, and the specifying operation may be a specifying operation for the directory information of the network cameras.

Specifically, the video network terminal can acquire the directory information of the multiple network cameras from the upper-level server and display the directory information through the display device, a user can perform specified operation on the directory information of the multiple network cameras displayed, if the specified operation is selected, when the specified operation is detected, the video network terminal generates a corresponding operation request and sends the operation request to the upper-level server so as to request to acquire the video stream of the network cameras or request to control the network cameras to perform the specified operation.

Step 602, generating a first control instruction according to the operation request;

in a preferred example, the operation request may include an identifier of the network camera and a request type, and after receiving the operation request, the upper level server obtains the request type in the operation request, and may then generate a first control instruction corresponding to the request type.

Step 603, determining a subordinate server associated with the network camera;

in the embodiment of the present invention, the upper level server may further obtain the identifier of the network camera in the operation request, and then determine the lower level server associated with the identifier of the network camera.

Step 604, sending the first control instruction to the subordinate server; the lower server is used for converting the first control instruction into a second control instruction and sending the second control instruction to the network camera, the second control instruction is an instruction which can be identified by the network camera, and the network camera is used for responding to the second control instruction.

After determining the lower server, the upper server may send the first control instruction to the lower server, and the lower server may convert the first control instruction into a second control instruction that can be recognized by the network camera, and then send the second control instruction to the network camera, and the network camera may recognize the second control instruction and respond to the second control instruction.

In a preferred embodiment of the present invention, step 604 may comprise the following sub-steps:

a substep S11 of determining one or more intermediate servers associated with said lower level server;

in the embodiment of the present invention, one or more intermediate servers may exist between the lower level server and the upper level server, and the upper level server may determine the one or more intermediate servers associated with the lower level server after determining the lower level server.

Sub-step S12, sending the first control instruction to the subordinate server via the one or more intermediate servers.

After determining the one or more intermediate servers, the upper server may send the first control instruction to the one or more intermediate servers, and the one or more intermediate servers send the first control instruction to the lower server, and then the lower server sends the first control instruction to the network camera.

In one embodiment, the second control instruction may comprise a video stream call instruction, and the method further comprises the steps of:

receiving a video stream sent by the network camera; the video stream is a video stream which is called by the network camera according to the video stream calling instruction and is sent by the lower level server or the lower level server and the one or more intermediate servers; and sending the video stream to the video networking terminal.

After the network camera receives a video stream calling instruction sent by the lower-level server, the network server can send the video stream to the lower-level server, the lower-level server can directly send the video stream to the upper-level server, and when one or more intermediate servers exist, the lower-level server can send the video stream to one or more intermediate servers first and then send the video stream to the upper-level server through the one or more intermediate servers.

After the superior server receives the video stream, the embodiment of the invention can convert the video stream into the video stream which can be identified by the video networking terminal according to the video networking protocol, and send the converted video stream to the video networking terminal.

In another embodiment, the second control instruction may include an operation instruction, and the responding to the second control instruction includes executing an operation specified by the operation instruction.

In the embodiment of the invention, after the network camera receives the operation instruction, the operation specified by the operation instruction can be executed so as to realize the response to the operation specification.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 7, a block diagram of a device for communication between a terminal of a video network and a network camera according to an embodiment of the present invention is shown, which may be applied to the video network, and specifically includes the following modules:

a second operation request receiving module 701, configured to receive an operation request for the network camera, where the operation request is sent by the video networking terminal;

a second first control instruction generating module 702, configured to generate a first control instruction according to the operation request;

a lower server determining module 703, configured to determine a lower server associated with the network camera;

a second first control instruction sending module 704, configured to send the first control instruction to the subordinate server; the lower server is used for converting the first control instruction into a second control instruction and sending the second control instruction to the network camera, the second control instruction is an instruction which can be identified by the network camera, and the network camera is used for responding to the second control instruction.

In a preferred embodiment of the present invention, the second first control instruction sending module 704 may include:

an intermediate server determining submodule for determining one or more intermediate servers associated with the lower level server;

the sending submodule is configured to send the first control instruction to the lower level server via the one or more intermediate servers.

In a preferred embodiment of the present invention, the second control instruction may include a video stream fetching instruction, and the apparatus further includes:

the second video stream receiving module is used for receiving the video stream sent by the network camera; the video stream is a video stream which is called by the network camera according to the video stream calling instruction and is sent by the lower level server or the lower level server and the one or more intermediate servers;

and the second video stream sending module is used for sending the video stream to the video networking terminal.

In a preferred embodiment of the present invention, the second control instruction may include an operation instruction, and the responding to the second control instruction may include executing an operation specified by the operation instruction.

The embodiment of the present invention also discloses an electronic device, which may include a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the method shown in fig. 6 when executing the program.

An embodiment of the present invention also discloses a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the method as described in fig. 6.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The method, the device and the interactive system for communication between the video network terminal and the network camera provided by the invention are introduced in detail, and a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An interactive system is characterized in that the system comprises a video network terminal, a superior server, a network camera and a subordinate server associated with the network camera,

the network camera is used for receiving the second control instruction and responding to the second control instruction;

wherein the system further comprises one or more intermediate servers associated with the subordinate servers, the superior server comprising:

a first control instruction sending module, configured to send the first control instruction to the one or more intermediate servers, where the one or more intermediate servers send the first control instruction to the lower level server;

the upper-level server is also used for receiving the video streams sent by the one or more intermediate servers under the condition that the lower-level server sends the video streams to the one or more intermediate servers firstly when the one or more intermediate servers exist;

and converting the video stream into a video stream which can be identified by a video networking terminal according to a video networking protocol corresponding to the video stream.

2. The system of claim 1, wherein the second control instruction comprises a video stream retrieval instruction, and wherein the webcam comprises:

the lower-level server is also used for sending the video stream to one or more intermediate servers and then sending the video stream to the upper-level server by the one or more intermediate servers when one or more intermediate servers exist;

3. The system of claim 2, wherein the subordinate server comprises:

a first video stream receiving module, configured to receive the video stream;

4. The system of claim 1, wherein the second control instruction comprises an operation instruction, and wherein the webcam comprises:

5. A method for a video networking terminal to communicate with a network camera, wherein the network camera is located in an Ethernet, the method comprising:

generating a first control instruction according to the operation request;

determining a subordinate server associated with the network camera;

sending the first control instruction to the subordinate server; the lower server is used for converting the first control instruction into a second control instruction and sending the second control instruction to the network camera, wherein the second control instruction is an instruction which can be identified by the network camera, and the network camera is used for responding to the second control instruction;

wherein the step of sending the first control instruction to the subordinate server comprises:

sending, via the one or more intermediate servers, the first control instruction to the subordinate server;

when one or more intermediate servers exist, receiving the video stream sent by the one or more intermediate servers under the condition that the next-level server sends the video stream to the one or more intermediate servers first;

6. The method of claim 5, wherein the second control instruction comprises a video stream call instruction, the method further comprising:

receiving a video stream sent by the network camera; the video stream is a video stream which is called by the network camera according to the video stream calling instruction and is sent by the lower-level server and the one or more intermediate servers;

and sending the video stream to the video networking terminal.

7. The method of claim 5, wherein the second control instruction comprises an operation instruction, and wherein responding to the second control instruction comprises performing an operation specified by the operation instruction.

8. An apparatus for a video networking terminal to communicate with a web camera, wherein the web camera is located in an ethernet, the apparatus comprising:

the second first control instruction sending module is used for sending the first control instruction to the subordinate server; the lower server is used for converting the first control instruction into a second control instruction and sending the second control instruction to the network camera, wherein the second control instruction is an instruction which can be identified by the network camera, and the network camera is used for responding to the second control instruction;

the second first control instruction sending module further includes:

a sending submodule, configured to send the first control instruction to the lower level server via the one or more intermediate servers;

the second video stream receiving module is used for receiving the video streams sent by the one or more intermediate servers under the condition that the next-level server sends the video streams to the one or more intermediate servers firstly when the one or more intermediate servers exist;

and the second video stream sending module is used for converting the video stream into a video stream which can be identified by the video networking terminal according to the video networking protocol corresponding to the video stream, and sending the video stream to the video networking terminal.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any of claims 5 to 7 are implemented when the program is executed by the processor.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 5 to 7.