CN110418199B

CN110418199B - Information processing method and system based on video network

Info

Publication number: CN110418199B
Application number: CN201810388126.9A
Authority: CN
Inventors: 方小帅; 秦鹏; 李云鹏; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2018-04-26
Filing date: 2018-04-26
Publication date: 2023-03-03
Anticipated expiration: 2038-04-26
Also published as: CN110418199A

Abstract

The embodiment of the invention provides an information processing method and system based on a video network. The video server sends a first monitoring video stream based on an internet protocol to the cooperative conversion server; the protocol conversion method comprises the steps that a protocol conversion server receives a first monitoring video stream, detects the packet loss rate of the first monitoring video stream, converts the first monitoring video stream into a second monitoring video stream based on a video networking protocol, and sends the second monitoring video stream and the packet loss rate to a video networking terminal; and the video network terminal receives the second monitoring video stream and the packet loss rate, plays the second monitoring video stream and displays the packet loss rate. Therefore, when the played monitoring video stream has phenomena of screen splash, frame skip or screen blackness, the monitoring personnel can determine the reasons of the phenomena of screen splash, frame skip or screen blackness according to the displayed packet loss rate, and then timely troubleshoot the faults according to the reasons, so that the phenomena of screen splash, frame skip or screen blackness and the like can be avoided when the monitoring video stream is played later, and the monitoring personnel can see the complete monitoring video stream later.

Description

Information processing method and system based on video network

Technical Field

The invention relates to the technical field of video networking, in particular to an information processing method and system based on video networking.

Background

Nowadays, in order to provide safety prevention and guarantee for work and life of people, a monitoring camera is often required to be arranged at an important position, then a monitoring video stream at the important position is recorded through the monitoring camera, and then a monitoring person is arranged to check whether suspicious people exist in the monitoring video stream recorded by the monitoring camera, for example, whether people are escaping or not.

Wherein, the supervisory personnel can use the terminal to look over the surveillance video stream that the surveillance camera head recorded, for example, the surveillance video stream that the surveillance camera head will record can be collected in advance to the video server, when the surveillance video stream that the surveillance camera head recorded need be looked over to the supervisory personnel, the video server can send the surveillance video stream that the surveillance camera head recorded for the terminal, the terminal receives the surveillance video stream that the video server sent, and broadcast the surveillance video stream on the screen, the supervisory personnel can look over the surveillance video stream that the terminal broadcast on the screen.

However, when the terminal and the video server are not located in the same lan, in the prior art, the video server needs to transmit the surveillance video stream to the terminal through the internet. For example, the video server generates a monitoring video stream based on an IP (Internet Protocol) Protocol, and sends the monitoring video stream based on the IP Protocol to an entry gateway of a local area network in which the terminal is located through at least one router in the Internet, where the entry gateway sends the monitoring video stream based on the IP Protocol to the terminal after receiving the monitoring video stream based on the IP Protocol.

However, the inventor finds that the following defects exist in the prior art in the process of implementing the embodiment of the invention:

sometimes, phenomena such as screen splash, frame skip or screen blacking can occur in the played monitoring video stream, so that a monitoring person cannot see the complete monitoring video, at the moment, the monitoring person cannot determine whether the phenomena such as screen splash, frame skip or screen blacking are caused by the fact that the monitoring video stream recorded by the monitoring camera has problems or the monitoring video stream loses packets in the transmission process between the video server and the terminal, the monitoring person cannot issue medicines according to the reasons causing the phenomena such as screen splash, frame skip or screen blacking, and the monitoring person can still not see the complete monitoring video stream.

Disclosure of Invention

In order to solve the above problems, the embodiment of the invention discloses an information processing method and system based on a video network.

In a first aspect, an embodiment of the present invention shows an information processing method based on a video network, where the video network includes a video server, a protocol conversion server, and a video network terminal, the video server and the protocol conversion server are connected based on internet protocol communication, and the protocol conversion server and the video network terminal are connected based on video network protocol communication, and the method includes:

the video server sends a first monitoring video stream based on an internet protocol to the cooperative conversion server;

the protocol conversion server receives the first monitoring video stream, detects the packet loss rate of the first monitoring video stream, converts the first monitoring video stream into a second monitoring video stream based on a video networking protocol, and sends the second monitoring video stream and the packet loss rate to the video networking terminal;

and the video network terminal receives the second monitoring video stream and the packet loss rate, plays the second monitoring video stream and displays the packet loss rate.

In an alternative implementation, the first surveillance video stream includes a plurality of video data packets; the method further comprises the following steps:

the cooperative switching server judges whether the packet loss rate is greater than a preset packet loss rate threshold value;

if the packet loss rate is greater than a preset packet loss rate threshold value, determining an identifier of a target video data packet lost in the transmission process of the first monitoring video stream, and sending a retransmission request to the video server, wherein the retransmission request carries the identifier of the target video data packet, and the retransmission request is used for requesting the video server to retransmit the target video data packet according to the identifier of the target video data packet;

the video server receives the retransmission request, acquires the target video data packet based on the Internet protocol according to the identification of the target video data packet, and sends the target video data packet based on the Internet protocol to the protocol conversion server;

the protocol conversion server receives the target video data packet based on the Internet protocol, converts the target video data packet based on the Internet protocol into the target video data packet based on the video networking protocol, and sends the target video data packet based on the video networking protocol to the video networking terminal;

and the video networking terminal receives the target video data packet based on the video networking protocol and plays the target video data packet based on the video networking protocol when playing the second monitoring video stream.

In an alternative implementation, the collaboration server and the video server include a plurality of communication links therebetween;

after the detecting the packet loss rate of the first surveillance video stream, the method further includes:

the cooperative conversion server judges whether the packet loss rate is greater than a preset packet loss rate threshold value or not, and if the packet loss rate is greater than the preset packet loss rate threshold value, a communication link replacement notification is sent to the video server;

the video server receives the communication link change notification, selects one of the plurality of communication links other than the currently used communication link, and determines the selected communication link as a communication link for subsequently transmitting a surveillance video stream to the collaboration server.

In an optional implementation manner, the selecting one of the plurality of communication links other than the currently used communication link includes:

the video server acquires the load of each communication link except for the currently used communication link in the plurality of communication links;

selecting a communication link with a lowest load among communication links other than a currently used communication link among the plurality of communication links.

In an optional implementation, the method further includes:

the cooperative switching server judges whether the packet loss rate is greater than a preset packet loss rate threshold value or not, and if the packet loss rate is greater than the preset packet loss rate threshold value, a pause notification is sent to the video server;

and the video server receives the pause notification, pauses the sending of the monitoring video stream to the cooperative conversion server, and resumes sending the monitoring video stream to the cooperative conversion server after a preset time length.

In a second aspect, an embodiment of the present invention shows an information processing system based on a video network, where the video network includes a video server, a protocol conversion server and a video network terminal, the video server and the protocol conversion server are connected based on internet protocol communication, and the protocol conversion server and the video network terminal are connected based on video network protocol communication, and the system includes:

the video server is used for sending a first monitoring video stream based on an internet protocol to the protocol conversion server;

the protocol conversion server is used for receiving the first monitoring video stream, detecting the packet loss rate of the first monitoring video stream, converting the first monitoring video stream into a second monitoring video stream based on a video networking protocol, and sending the second monitoring video stream and the packet loss rate to the video networking terminal;

and the video network terminal is used for receiving the second monitoring video stream and the packet loss rate, playing the second monitoring video stream and displaying the packet loss rate.

In an alternative implementation, the first surveillance video stream includes a plurality of video data packets;

the cooperative switching server is also used for judging whether the packet loss rate is greater than a preset packet loss rate threshold value; if the packet loss rate is greater than a preset packet loss rate threshold value, determining an identifier of a surveillance video data packet lost in the transmission process of the first surveillance video stream, and sending a retransmission request to the video server, wherein the retransmission request carries the identifier of the surveillance video data packet, and is used for requesting the video server to retransmit the surveillance video data packet according to the identifier of the surveillance video data packet;

the video server is further used for receiving the retransmission request, acquiring the monitoring video data packet based on the internet protocol according to the identification of the monitoring video data packet, and sending the monitoring video data packet based on the internet protocol to the protocol conversion server;

the protocol conversion server is also used for receiving the monitoring video data packet based on the Internet protocol, converting the monitoring video data packet based on the Internet protocol into the monitoring video data packet based on the video networking protocol, and sending the monitoring video data packet based on the video networking protocol to the video networking terminal;

the video networking terminal is further used for receiving the monitoring video data packet based on the video networking protocol and playing the monitoring video data packet based on the video networking protocol when the second monitoring video stream is played.

the protocol conversion server is also used for judging whether the packet loss rate is greater than a preset packet loss rate threshold value or not, and if the packet loss rate is greater than the preset packet loss rate threshold value, sending a communication link replacement notification to the video server;

the video server is further configured to receive the communication link change notification, select one of the plurality of communication links other than the currently used communication link, and determine the selected communication link as a communication link for subsequently transmitting the monitoring video stream to the protocol conversion server.

In an optional implementation manner, the video server is specifically configured to: acquiring the load of each communication link except for the currently used communication link in the plurality of communication links; selecting a communication link with the lowest load from among communication links other than a currently used communication link among the plurality of communication links.

In an optional implementation manner, the cooperative conversion server is further configured to determine whether the packet loss rate is greater than a preset packet loss rate threshold, and if the packet loss rate is greater than the preset packet loss rate threshold, send a pause notification to the video server;

and the video server is also used for receiving the pause notification, pausing the sending of the monitoring video stream to the corotation server and resuming the sending of the monitoring video stream to the corotation server after a preset time length.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, a video server sends a first monitoring video stream based on an internet protocol to a protocol conversion server; the method comprises the steps that a corotation server receives a first monitoring video stream, the packet loss rate of the first monitoring video stream is detected by the corotation server, and the first monitoring video stream is converted into a second monitoring video stream based on a video networking protocol by the corotation server; the coordination server sends a second monitoring video stream and the packet loss rate to the video networking terminal; and the video network terminal receives the second monitoring video stream and the packet loss rate, plays the second monitoring video stream and displays the packet loss rate. Therefore, when the played monitoring video stream has phenomena of screen splash, frame skip or screen blackness, the monitoring personnel can determine the reasons of the phenomena of screen splash, frame skip or screen blackness according to the displayed packet loss rate, and then timely troubleshoot the faults according to the reasons, so that the phenomena of screen splash, frame skip or screen blackness and the like can be avoided when the monitoring video stream is played later, and the monitoring personnel can see the complete monitoring video stream later.

If the phenomenon of screen splash, frame skip or screen blackout occurs in the process of playing the second monitoring video stream by the video networking terminal, the monitoring personnel can know whether the phenomenon of screen splash, frame skip or screen blackout occurs due to the fact that the first monitoring video stream recorded by the video recording equipment has problems or the phenomenon that the first monitoring video stream loses packets in the process of transmitting from the video server to the coordination server through the displayed packet loss rate.

For example, if the packet loss rate is greater than or equal to the preset packet loss rate threshold, it is determined that the occurrence of phenomena such as screen splash, frame skip, or screen blackout is caused by packet loss of the first surveillance video stream during transmission from the video server to the coordination server. If the packet loss rate is smaller than a preset packet loss rate threshold value, it is determined that the phenomena of screen splash, frame skip or screen blackout and the like are caused by the fact that the first monitoring video stream acquired by the video recording device has problems.

If the phenomena of screen splash, frame skip or screen blackout and the like are caused by the fact that the first monitoring video stream collected by the video recording equipment has problems, monitoring personnel can timely overhaul the video recording equipment so that the monitoring video stream recorded after the video recording equipment does not have problems, and then the monitoring personnel can see the complete monitoring video stream.

If the phenomena of screen splash, frame skip or screen blackout and the like are caused by the packet loss of the first monitoring video stream in the process of transmitting the first monitoring video stream from the video server to the cooperative conversion server, a monitoring person can timely overhaul a transmission link between the video server and the cooperative conversion server, so that the packet loss rate of the monitoring video stream transmitted to the cooperative conversion server by the video server is lower than a preset threshold value, and the monitoring person can see the complete monitoring video stream.

Drawings

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

FIG. 5 is a block diagram of an embodiment of a video-networking based information handling system of the present invention;

fig. 6 is a flowchart of the steps of an embodiment of the information processing method based on the internet of vision of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The video networking is an important milestone of network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of Internet applications to high-definition video, and high definition is face-to-face.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services such as high-definition video conferences, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mails, personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like into a system platform, and realizes high-definition quality video broadcast through a television or a computer.

To enable those skilled in the art to better understand the embodiments of the present invention, the following description is given of the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved over traditional Ethernet (Ethernet) to face the potentially enormous video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet exchange of the Ethernet, eliminates the Ethernet defect on the premise of full compatibility, and has end-to-end seamless connection of the whole network, direct connection with a user terminal and direct bearing of an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by over one hundred times compared with that of the traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical movement of hard disk magnetic head tracking, the resource consumption only accounts for 20% of the same-grade IP internet, but the concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once, but also connected with a single user, a private network user or the sum of one network. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch and can also be directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may interconnect and interwork via metropolitan and wide area video networks.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: servers, switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 the devices of the access network part can be mainly classified into 3 types: node servers, access switches (including ethernet gateways), terminals (including various set-top boxes, code boards, memories, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the packets coming from the network interface module 201, the cpu module 203 and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) The port send buffer is not full; 2) The queued packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, reading, writing, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, if so, allocates a corresponding stream identifier (stream-id) and enters the switch engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is close to full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which in this embodiment of the present invention is divided into two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) The port send buffer is not full; 2) The queued packet counter is greater than zero; 3) Obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) The port send buffer is not full; 2) The queued packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for the packet buffer queues from all the downstream network interfaces to the upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC DA, MAC SA, length or frame type (2 byte) is subtracted by the MAC deletion module 410 and enters the corresponding receiving buffer, otherwise it is discarded;

the downlink network interface module 401 detects the sending buffer of the port, if there is a packet, the ethernet MAC DA of the corresponding terminal is known according to the destination address DA of the packet in the video network, the ethernet MAC DA of the terminal, the MAC SA of the ethernet protocol gateway, and the ethernet length or frame type are added, and the packet is sent.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), source Address (SA), reserved byte, payload (PDU), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to the types of different datagrams, 64 bytes if various protocol packets, 32+1024=1056 bytes if single-multicast data packets, and certainly not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), source Address (SA), reserved byte (Reserved), tag, payload (PDU), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

Based on the characteristics of the video network, one of the core concepts of the embodiments of the present invention is provided, following the protocol of the video network, the video network terminal can display the packet loss rate of the monitoring video stream when playing the monitoring video stream, and when the played monitoring video stream has phenomena such as screen splash, frame skip or black screen, the monitoring personnel can determine the reasons of the phenomena such as screen splash, frame skip or black screen according to the packet loss rate, and then can timely troubleshoot the fault according to the reasons, so that the monitoring personnel can see the complete monitoring video stream.

Referring to fig. 5, a block diagram of an embodiment of an information processing system based on video networking according to the present invention is shown, the system includes a video server 01, a protocol server 02 and a video networking terminal 03, the video server 01 and the protocol server 02 are connected based on internet protocol communication, and the protocol server 02 and the video networking terminal 03 are connected based on video networking protocol communication.

Referring to fig. 6, a flowchart illustrating steps of an embodiment of an information processing method based on a video network according to the present invention is shown, which may specifically include the following steps:

in step S101, the video server sends a first monitoring video stream based on an internet protocol to the collaboration server;

in the embodiment of the invention, when a user needs to use the video network terminal to check the surveillance video stream recorded by the video recording device, the video network terminal can be controlled to generate a first acquisition request for acquiring the surveillance video stream based on the video network protocol, and then the video network terminal sends the first acquisition request to the protocol conversion server.

The collaboration server receives the first obtaining request, converts the first obtaining request into a second obtaining request which is based on an internet protocol and used for obtaining the monitoring video stream, and sends the second obtaining request to the video server.

And the video server receives the second acquisition request, and the video recording equipment can send the recorded monitoring video stream to the video server for storage in advance, so that the video server can acquire the first monitoring video stream based on the internet protocol and send the first monitoring video stream based on the internet protocol to the protocol conversion server.

The video server can send the first monitoring video stream to the cooperative conversion server through a communication link with the cooperative conversion server.

In step S102, the collaboration server receives a first surveillance video stream;

the protocol conversion server can receive the first monitoring video stream sent by the protocol conversion server through a communication link between the protocol conversion server and the video server.

In step S103, the cooperative conversion server detects a packet loss rate of the first surveillance video stream;

in the embodiment of the present invention, the first surveillance video stream includes a plurality of video data packets with a sequence, each data packet has a data number, and some data packets in the first surveillance video stream may be lost in a process of transmitting the first surveillance video stream from the video server to the coordination server.

After receiving the first surveillance video stream, the collaboration server may detect whether a data packet in the received first surveillance video stream is complete, for example, detect whether a data packet in the received first surveillance video stream is complete according to a data number of the data packet, and further determine a packet loss rate of the first surveillance video stream.

In step S104, the protocol conversion server converts the first surveillance video stream into a second surveillance video stream based on the video networking protocol;

in the embodiment of the present invention, the protocol conversion server has a function of protocol conversion, that is, the protocol conversion server can convert data based on the video networking protocol into data based on the internet protocol, and likewise, can also convert data based on the internet protocol into data based on the video networking protocol.

Since the video networking terminal supports the video networking protocol but not the internet protocol, in order to enable the video networking terminal to analyze the audio stream and the image stream in the first surveillance video stream, the protocol conversion server needs to convert the first surveillance video stream into a second surveillance video stream based on the video networking protocol, and then step S105 is executed.

In step S105, the cooperative server sends the second monitoring video stream and the packet loss rate to the video networking terminal;

in this step, the coordination server may send the second surveillance video stream and the packet loss rate to the video networking terminal through a communication link with the video networking terminal.

In step S106, the video networking terminal receives the second monitoring video stream and the packet loss rate;

in this step, the video networking terminal may receive the second monitoring video stream and the packet loss rate, which are sent by the protocol conversion server, through a communication link with the protocol conversion server.

In step S107, the video network terminal plays the second surveillance video stream, and displays the packet loss rate.

The internet Protocol-based surveillance video stream may be a Real-time Transport Protocol (RTP) -based surveillance video stream, or a H323 Protocol-based surveillance video stream. The surveillance video stream based on the video networking protocol may be a surveillance video stream of a V2V protocol.

In the embodiment of the invention, a video server sends a first monitoring video stream based on an internet protocol to a protocol conversion server; the method comprises the steps that a first monitoring video stream is received by a co-conversion server, the packet loss rate of the first monitoring video stream is detected by the co-conversion server, and the first monitoring video stream is converted into a second monitoring video stream based on a video networking protocol by the co-conversion server; the coordination server sends a second monitoring video stream and the packet loss rate to the video networking terminal; and the video network terminal receives the second monitoring video stream and the packet loss rate, plays the second monitoring video stream and displays the packet loss rate. Therefore, when the played monitoring video stream has the phenomena of screen splash, frame skip or screen blackness and the like, monitoring personnel can determine the reasons of the phenomena of screen splash, frame skip or screen blackness and the like according to the displayed packet loss rate, and then timely troubleshoot faults according to the reasons, so that the phenomena of screen splash, frame skip or screen blackness and the like can be avoided when the monitoring video stream is played later, and the monitoring personnel can see the complete monitoring video stream later.

In another embodiment of the invention, a plurality of communication links are included between the collaboration server and the video server; the collaboration server and the video server may transmit data to each other over any of a plurality of communication links.

In this embodiment of the present invention, after the cooperative server detects a packet loss rate of the first surveillance video stream, the method further includes: the cooperative conversion server judges whether the packet loss rate is greater than a preset packet loss rate threshold value; if the packet loss rate is greater than a preset packet loss rate threshold, sending a communication link replacement notification to a video server; the video server receives the communication link change notification, selects one of the plurality of communication links other than the currently used communication link, and determines the selected communication link as a communication link for subsequently transmitting the monitoring video stream to the corotation server.

In the embodiment of the present invention, a plurality of communication links included between the coordination server and the video server may include a plurality of routers, and any one or more of the routers may be used by other devices to transmit data at the same time, so that a load of a communication link used by the video server to send the first monitoring video stream to the coordination server is high, and thus a packet loss rate of the first monitoring video stream in a transmission process is high. Therefore, in order to reduce the packet loss rate of the surveillance video stream sent by the video server to the collaboration server, a communication link may be replaced.

In another embodiment of the present invention, in order to reduce the packet loss rate during transmission after monitoring the video stream as much as possible, when one of the plurality of communication links other than the currently used communication link is selected, the video server may obtain the load of each of the plurality of communication links other than the currently used communication link; and then selects a communication link with the lowest load among communication links other than the currently used communication link among the plurality of communication links.

In another embodiment of the present invention, after the cooperative conversion server detects a packet loss rate of the first surveillance video stream, the method further includes: the cooperative conversion server judges whether the packet loss rate is greater than a preset packet loss rate threshold value or not, and if the packet loss rate is greater than the preset packet loss rate threshold value, a pause notification is sent to the video server; and the video server receives the pause notification, pauses the sending of the monitoring video stream to the corotation server, and resumes the sending of the monitoring video stream to the corotation server after a preset duration.

In the embodiment of the present invention, if the packet loss rate is greater than the preset packet loss rate threshold, the load of the communication link between the video server and the cooperative conversion server may be higher, so that even if the video server continues to use the communication link to send the monitoring video stream to the cooperative conversion server, the packet loss rate of the monitoring video stream is higher, and thus, a monitoring person cannot view the complete monitoring video stream later, and network resources are wasted.

Therefore, in order to save network resources and enable a monitoring person to view the complete monitoring video stream later, the video server may suspend sending the monitoring video stream to the cooperative conversion server, and after a preset time period, for example, after the load of the communication link is reduced, the monitoring video stream is sent to the cooperative conversion server, so that the packet loss rate of the monitoring video stream can be reduced, and the monitoring person can view the complete monitoring video stream, thereby avoiding wasting network resources.

In another embodiment of the present invention, the first surveillance video stream includes a plurality of video data packets, and in order to enable a monitoring person to view the complete first surveillance video stream, after the coordination server detects a packet loss rate of the first surveillance video stream, the method further includes: the cooperative conversion server judges whether the packet loss rate is greater than a preset packet loss rate threshold value or not; if the packet loss rate is greater than a preset packet loss rate threshold value, determining an identifier of a target video data packet lost in the transmission process of the first monitoring video stream, and sending a retransmission request to the video server, wherein the retransmission request carries the identifier of the target video data packet, and is used for requesting the video server to retransmit the target video data packet according to the identifier of the target video data packet; the video server receives the retransmission request, acquires a target video data packet based on an internet protocol according to the identification of the target video data packet, and sends the target video data packet based on the internet protocol to the protocol conversion server; the protocol conversion server receives a target video data packet based on an internet protocol, converts the target video data packet based on the internet protocol into a target video data packet based on a video networking protocol, and sends the target video data packet based on the video networking protocol to a video networking terminal; and the video networking terminal receives the target video data packet based on the video networking protocol and plays the target video data packet based on the video networking protocol when playing the second monitoring video stream. Thus, the monitoring personnel can see the complete first monitoring video stream.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

The invention also discloses an information processing system based on the video network, the video network comprises a video server, a protocol conversion server and a video network terminal, the video server is in communication connection with the protocol conversion server based on the internet, the protocol conversion server is in communication connection with the video network terminal based on the video network protocol, and the system comprises:

In an alternative implementation manner, a plurality of communication links are included between the corotation server and the video server;

In an optional implementation manner, the video server is specifically configured to: acquiring the load of each communication link except for the currently used communication link in the plurality of communication links; selecting a communication link with a lowest load among communication links other than a currently used communication link among the plurality of communication links.

the video server is further configured to receive the pause notification, pause sending the monitoring video stream to the coordination server, and resume sending the monitoring video stream to the coordination server after a preset duration.

For the system embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or terminal device that comprises the element.

The information processing method and system based on the video network provided by the invention are introduced in detail, and the principle and the implementation mode of the invention are explained by applying specific examples in the text, and the description of the above examples is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An information processing method based on a video network is characterized in that the video network comprises a video server, a protocol conversion server and a video network terminal, the video server is in communication connection with the protocol conversion server based on the internet, the protocol conversion server is in communication connection with the video network terminal based on the video network protocol, and the method comprises the following steps:

the video network terminal receives the second monitoring video stream and the packet loss rate, plays the second monitoring video stream and displays the packet loss rate;

if the packet loss rate is greater than or equal to a preset packet loss rate threshold value, determining that packet loss exists in a transmission link from a video server to a protocol conversion server for a first monitoring video stream based on an internet protocol;

and if the packet loss rate is smaller than a preset packet loss rate threshold value, determining that packet loss exists in the first monitoring video stream acquired by the video recording device.

2. The method of claim 1, wherein the first surveillance video stream comprises a plurality of video data packets; the method further comprises the following steps:

3. The method of claim 1, wherein the collaboration server and the video server comprise a plurality of communication links therebetween;

the cooperative switching server judges whether the packet loss rate is greater than a preset packet loss rate threshold value or not, and if the packet loss rate is greater than the preset packet loss rate threshold value, a communication link replacement notification is sent to the video server;

4. The method of claim 3, wherein selecting one of the plurality of communication links other than the currently used communication link comprises:

5. The method of claim 1, further comprising:

6. An information processing system based on video networking, characterized in that, the video networking includes video server, protocol conversion server and video networking terminal, the video server with on the basis of internet protocol communication connection between the protocol conversion server, the protocol conversion server with on the basis of video networking protocol communication connection between the video networking terminal, the system includes:

the video networking terminal is used for receiving the second monitoring video stream and the packet loss rate, playing the second monitoring video stream, displaying the packet loss rate, and if the packet loss rate is greater than or equal to a preset packet loss rate threshold value, determining that packet loss exists in the process of transmitting the first monitoring video stream based on the internet protocol from the video server to the protocol conversion server; and if the packet loss rate is smaller than a preset packet loss rate threshold value, determining that the first monitoring video stream acquired by the video recording equipment has packet loss.

7. The system of claim 6, wherein the first surveillance video stream comprises a plurality of video data packets;

the cooperative switching server is also used for judging whether the packet loss rate is greater than a preset packet loss rate threshold value; if the packet loss rate is greater than a preset packet loss rate threshold value, determining an identifier of a target video data packet lost in the transmission process of the first monitoring video stream, and sending a retransmission request to the video server, wherein the retransmission request carries the identifier of the target video data packet, and the retransmission request is used for requesting the video server to retransmit the target video data packet according to the identifier of the target video data packet;

the video server is further configured to receive the retransmission request, obtain the target video data packet based on an internet protocol according to the identifier of the target video data packet, and send the target video data packet based on the internet protocol to the protocol conversion server;

the protocol conversion server is also used for receiving the target video data packet based on the Internet protocol, converting the target video data packet based on the Internet protocol into the target video data packet based on the video networking protocol, and sending the target video data packet based on the video networking protocol to the video networking terminal;

and the video networking terminal is also used for receiving the target video data packet based on the video networking protocol and playing the target video data packet based on the video networking protocol when the second monitoring video stream is played.

8. The system of claim 6, wherein the collaboration server and the video server comprise a plurality of communication links therebetween;

the cooperative conversion server is further configured to determine whether the packet loss rate is greater than a preset packet loss rate threshold, and send a communication link change notification to the video server if the packet loss rate is greater than the preset packet loss rate threshold;

9. The system of claim 8, wherein the video server is specifically configured to: acquiring the load of each communication link except for the currently used communication link in the plurality of communication links; selecting a communication link with a lowest load among communication links other than a currently used communication link among the plurality of communication links.

10. The system of claim 6, wherein the coordination server is further configured to determine whether the packet loss rate is greater than a preset packet loss rate threshold, and if the packet loss rate is greater than the preset packet loss rate threshold, send a pause notification to the video server;