CN114679497B

CN114679497B - Video resource integrated scheduling system and method based on traffic private network

Info

Publication number: CN114679497B
Application number: CN202210266160.5A
Authority: CN
Inventors: 方飞; 万千; 李龙跃; 陈思; 赵威; 戚丰远; 李琛; 张洁; 高平
Original assignee: China Transport Telecommunications And Information Center
Current assignee: China Transport Telecommunications And Information Center
Priority date: 2022-03-17
Filing date: 2022-03-17
Publication date: 2024-02-13
Anticipated expiration: 2042-03-17
Also published as: CN114679497A

Abstract

A video resource integrated scheduling system and method based on a traffic private network, wherein the system comprises three stages of platforms from top to bottom: the primary platform is a primary video resource integrated scheduling platform, the secondary platform comprises five department platforms, the tertiary platform is a plurality of subordinate unit platforms in the five departments, each subordinate unit platform is respectively butted with video image acquisition points of a plurality of monitoring sites, and the method comprises the following steps: basic information registration, equipment information pushing, video stream forwarding, real-time streaming, video publishing, cradle head control and video viewing, can realize convergence access of video image data of each platform, and realize interconnection and intercommunication and unified management of video images among national transportation management departments.

Description

Video resource integrated scheduling system and method based on traffic private network

Technical Field

The invention belongs to the technical field of traffic safety emergency, and particularly relates to a video resource integrated scheduling system and method based on a traffic private network.

Background

In terms of traffic safety, any emergency event can be handled as soon as possible in the event sprouting and initial stages and losses can be reduced to a minimum if early warning can be carried out by monitoring means. The video resource plays an important role in monitoring, early warning and auxiliary decision making in emergency treatment of emergencies.

The existing department emergency management units develop emergency treatment of emergency events, and the video resources used are based on independent video resource scheduling systems in various areas and various industries. The video resource integrated scheduling system based on the traffic private network realizes the convergence access of video image data collected by each video monitoring management platform through the butt joint with the video monitoring platform of each department under jurisdiction, and the video resources and the like of the road, waterway, railway, civil aviation, postal service and the like after the convergence access can be based on the traffic private network, realizes comprehensive display and on-demand scheduling through the management interface of the ministry video integrated scheduling platform, and can uniformly manage the display of the video resources on a large screen of the traffic comprehensive emergency command center.

Because the above-mentioned five departments are independent when constructing, the video resources used are based on independent video resource scheduling systems of each area, each trade respectively, the video monitoring platform, camera brand model and data protocol adopted are all different, only can scatter and call each video resource, each sub-platform utilizes own video monitoring management platform to develop the daily operation management work based on video monitoring respectively, can not carry on interconnection and intercommunication and unified management of video image between the national traffic management departments, have inefficiency, unfavorable centralized management and control's shortcoming.

Disclosure of Invention

In order to overcome the problems, the application provides a video resource integrated scheduling system and method based on a traffic private network, so as to realize interconnection and intercommunication and unified management of video images among national traffic and transportation management departments.

In order to achieve the above purpose, the technical scheme of the invention is as follows:

a video resource integrated scheduling system based on a traffic private network, the system comprising a three-stage platform from top to bottom: the primary platform is a primary video resource integrated scheduling platform, the secondary platform comprises five department platforms, the tertiary platform is a plurality of subordinate unit platforms in the five departments, each subordinate unit platform is divided into video image acquisition points for butt joint of a plurality of monitoring sites, and a server arranged on the primary platform comprises: the system comprises a central management server 110, a primary national standard gateway server 120, a streaming media forwarding server 130, a storage proxy server 140, a mobile terminal application server 150, a mobile terminal transcoding server 160, a primary SIP server 170 and a video storage server 180; the server arranged on the secondary platform comprises: a secondary SIP server 210 and a secondary national standard gateway server 220; the central management server 110 is responsible for configuring a database, including distributing a user name and a password to a corresponding lower platform, basic information, service information and user authority required by a video resource integrated scheduling system, and signaling transmission among nodes, wherein all resources and services in the nodes are scheduled by the central management server 110; the first-level national gateway server 120 is an internal private protocol and a gateway converted by the national standard protocol, and can be used as a national standard upper level or a national standard lower level; the streaming media forwarding server 130 is responsible for forwarding and distributing audio and video streaming media and supports private protocols and national standard protocols; the storage proxy server 140 is used as a proxy service stored by the system cloud and is responsible for video on demand, and a security layer is added for interaction between the video storage server 180 and the outside; the video storage server 180 is responsible for storing video resources, and is uniformly managed by the central management server 110; the mobile terminal application server 150 provides services for the mobile client, and the mobile terminal transcoding server 160 converts the video file in the streaming media forwarding server 130 into a format conforming to the mobile terminal playing; the SIP server 170 is configured to dock and convert videos acquired from the streaming media sender by decoding the SIP protocol, which are not national standards of lower platforms; the secondary SIP server 210 is configured to interface and convert those lower platforms that are not national standard in the secondary platforms, and satisfy the video interface and protocol of the secondary national standard gateway server 220 by decoding the SIP protocol; the secondary national standard gateway server 220 is a gateway for private protocol and national standard protocol conversion inside the secondary platform.

The system also comprises the following modules so that a lower-level platform joins the system and pushes monitoring video resources for an upper-level platform:

a basic information registration module:

the lower platform needs to Register with the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server 110, an OK response is returned, a temporary token instruction ring is distributed, and the registration is needed again after the token expires; if the user name and the password do not accord with the information of the lower-level platform, returning a '401 unauthorized' authentication failure response.

(2) The device information pushing module:

after authentication is successful, the upper stage platform can request directory information to the lower stage platform, the upper stage platform sends a query command, and the lower stage platform returns response including queried equipment directory information, wherein the equipment information includes equipment numbers, channel numbers, affiliated organization structures and longitude and latitude.

(3) And a video stream forwarding module:

the client transmits Invite messages first, the Invite messages are forwarded layer by layer through each stage of platform, the Invite messages are transmitted to a final video equipment terminal, after the response is successful, video streams are forwarded layer by layer through each stage of platform, the Invite messages are finally transmitted to the client, and the client plug-in is responsible for decoding and playing.

(4) And the real-time flow opening module is used for:

after the client issues the real-time streaming command, the central management server 110 transmits the streaming command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns streaming receiving address information to the central management server 110; the central management server 110 transmits an open flow instruction with the flow receiving address information of the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the flow sending address information to the central management server 110; the central management server 110 transmits an adding instruction with the streaming address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming address information and then transmits the streaming address information to the client by the central management server 110; after receiving the stream address information sent by the stream media forwarding server 130, the client sends a play instruction to the central management server 110, the stream media forwarding server 130 and the first-level national gateway server 120, and the audio and video stream is sent to the stream media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that real-time stream opening is finally realized.

(5) Video release module:

when multiple services view the same image at the same time, the streaming media forwarding server 130 is responsible for forwarding the real-time image and the history video to the tandem network platform, the client, the mobile client, or the storage proxy server.

(6) The cradle head control module:

after the client issues the control instruction of the cradle head, the central management server 110 transmits the control instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits a control instruction with the address information of the stream media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits an adding instruction with the address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, the streaming media forwarding server 130 returns the address information, and the address information is transmitted to the client by the central management server 110; after receiving the address information of the stream media forwarding server 130, the client sends a control instruction to the central management server 110, the stream media forwarding server 130 and the first-level national gateway server 120, and the control result is sent to the stream media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that the control of the cradle head is finally realized.

(7) Video viewing module:

after the client issues the video inquiry command, the central management server 110 transmits the command to the storage proxy server 140, and the storage proxy server 140 forwards the command to the video storage server 180; the client issues a video streaming command, the streaming command is transmitted to the streaming media forwarding server 130 by the central management server 110, and the streaming media forwarding server 130 returns streaming receiving address information to the central management server 110; the central management server 110 transmits an open stream instruction with stream address information received by the stream media forwarding server 130 to the storage proxy server 140, and the storage proxy server 140 returns the stream address information to the central management server 110; the central management server 110 transmits an adding instruction with the streaming address information of the storage proxy server 140 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming address information and transmits the streaming address information to the client by the central management server 110; after receiving the stream address information sent by the stream media forwarding server 130, the client sends a play instruction to the central management server 110, the stream media forwarding server 130, the storage proxy server 140 and the video storage proxy server, and the audio and video stream is sent to the storage proxy server 140, the stream media forwarding server 130 and the client by the video storage server 180, so that video viewing is finally realized.

The five department platforms of the secondary platform are platforms of a road network center, a local maritime office, a local long aviation office and Beijing city and Shenzhen city. The general video streaming protocol set by the SIP server 170 includes GB/T28181 protocol, or ONVIF.

The invention also provides a video resource integrated scheduling method based on the traffic private network, which is operated in the video resource integrated scheduling system based on the traffic private network, and the method comprises the following steps that a lower platform joins the system and pushes monitoring video resources for an upper platform:

(1) a basic information registration step:

the lower platform needs to Register with the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server 110, an OK response is returned, a temporary token instruction ring is distributed, and the registration is needed again after the token expires; if the user name and the password do not accord with the information of the lower-level platform, returning a '401 Unauthorized' authentication failure response;

(2) a step of pushing equipment information:

(3) A video stream forwarding step:

the client transmits Invite messages first, the Invite messages are forwarded layer by layer through each stage of platform, the Invite messages are transmitted to a final video equipment terminal, after the response is successful, video streams are forwarded layer by layer through a service stage platform, the Invite messages are finally transmitted to the client, and a client plug-in unit is responsible for decoding and playing;

(4) and (3) a real-time flow opening step:

after the client issues the real-time streaming command, the central management server 110 transmits the streaming command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns streaming receiving address information to the central management server 110; the central management server 110 transmits an open flow instruction with the flow receiving address information of the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the flow sending address information to the central management server 110; the central management server 110 transmits an adding instruction with the streaming address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming address information and then transmits the streaming address information to the client by the central management server 110; after receiving the stream address information sent by the stream media forwarding server 130, the client sends a play instruction to the central management server 110, the stream media forwarding server 130 and the first-level national gateway server 120, and the audio and video stream is sent to the stream media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that real-time stream opening is finally realized;

(5) Video publishing step:

(6) The control step of the cradle head:

after the client issues the control instruction of the cradle head, the central management server 110 transmits the control instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits a control instruction with the address information of the stream media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits an adding instruction with the address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, the streaming media forwarding server 130 returns the address information, and the address information is transmitted to the client by the central management server 110; after receiving the address information of the stream media forwarding server 130, the client sends a control instruction to the central management server 110, the stream media forwarding server 130 and the first-level national gateway server 120, and the control result is sent to the stream media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that the control of the cradle head is finally realized;

(7) A video viewing step:

The video resource integrated scheduling system and method based on the traffic private network constructs the ministry video integrated platform, solves the conversion problem among different protocols through the national standard gateway server, and realizes the functions of video scheduling, control and the like of the ministry platform on the second-level platform and the third-level platform. The system can realize signaling control, signaling interaction and video stream pushing among platforms, has the functions of information inquiry, pushing, forwarding and the like, and realizes interconnection and intercommunication and unified management of video images among national traffic and transportation management departments.

Drawings

FIG. 1 is a video resource scheduling system architecture of a traffic private network of the present invention;

FIG. 2 is a functional block diagram of a server according to the present invention;

FIG. 3 shows a basic registration timing diagram;

FIG. 4 illustrates a device information push timing diagram;

FIG. 5 shows a video streaming timing diagram;

FIG. 6 shows a real-time open flow timing diagram;

FIG. 7 illustrates a video distribution timing diagram;

FIG. 8 illustrates a cradle head control timing diagram;

fig. 9 shows a video viewing timing diagram.

Detailed Description

The present invention will be described in detail below by way of examples of specific embodiments with reference to the accompanying drawings. However, it should be understood by those skilled in the art that the present invention is not limited to the specific embodiments listed and should be included within the scope of the present invention as long as the spirit of the present invention is satisfied.

The system and the method for video resource integrated scheduling based on the traffic private network utilize the traffic private network to unify video protocols and standardize external service interfaces, realize the superior platform as an organization, enable the subordinate platform to be accessed into the system without customizing and developing, have the functions of information inquiry, pushing, forwarding and the like, and realize the interconnection and the unified management of video images among national traffic and transportation management departments. The convergence access of video monitoring image resources in Beijing city and Shenzhen city is realized in a local road network center, a local maritime office, a local long-distance aviation office and three local management national offices.

Please refer to fig. 1, which shows a video resource scheduling system architecture of the traffic private network of the present invention, the system divides the nationwide video monitoring into three-level platform architecture, namely, a top-down integrated scheduling platform for the ministry video resource, namely, a first-level platform 100, and a second-level platform 200 comprises five: the system comprises a road network center, a maritime office, a long aviation office, three national offices of department, and platforms of Beijing city and Shenzhen city, wherein three-level platforms are a plurality of subordinate unit platforms 300 in the five departments, each subordinate unit platform 300 is respectively connected with a plurality of monitoring sites, such as a highway, a wharf, an airport and the like, and data of video image acquisition points of the monitoring sites are respectively uploaded to three-level management platforms 300 of the department through video sink nodes, then are collected by the local door platform 300 and are uploaded to a second-level platform 200, and finally are uploaded to the third-level platform 100. Thus realizing the management of national traffic safety. See in detail fig. 1, wherein the arrows indicate the direction of data flow.

The present invention provides a series of servers on the primary platform 100 to implement the various functions of the system. A corresponding server is also provided on the secondary platform 200. FIG. 2 is a functional block diagram of a server according to the present invention; the server of the primary platform 100 shown in fig. 2 includes: a central management server 110, a primary national standard gateway server 120, a streaming media forwarding server 130, a storage proxy server 140, a mobile end application server 150, a mobile end transcoding server 160, a primary SIP server 170, and a video storage server 180. The server of the secondary platform 200 includes: a secondary SIP server 210, and a secondary national standard gateway server 220. The client in fig. 2 may be a computer and the mobile client may be a cell phone.

The central management server 110 is a center for service management of the present invention, and is responsible for configuring a database (not shown in the figure), basic information, service information and user rights required by a video resource integrated scheduling system, and signaling transmission between nodes, all resources and services in the nodes are scheduled by the central management server 110, and when the platform is deployed and configured, an upper platform allocates access user names and passwords for corresponding lower plateau stations, and is configured and managed by the central management server 110. The primary national gateway server 120 is an internal private protocol and a gateway converted by the national standard protocol, and can be used as a national standard upper level or a national standard lower level, and is distinguished by the initialization parameters transmitted by the central management server 110. The streaming media forwarding server 130 is responsible for forwarding and distributing audio and video streaming media, and supports transcoding of video by proprietary protocols and national standard protocol windows versions. The storage proxy server 140, as a proxy service stored by the system cloud, is responsible for video on demand, and adds a security layer for interaction between the video storage server 180 and the outside. The video storage server 180 is responsible for storing video resources, which are uniformly managed by the central management server 110. Mobile-end application server 150 serves mobile clients and mobile-end transcoding server 160 converts video files in streaming media forwarding server 130 into a format that complies with mobile-end playback. The SIP server 170 is configured to interface and convert video streams acquired from a sender (i.e., a client) of streaming media by decoding the SIP protocol, where in one embodiment, the SIP server 170 is configured to use a general video streaming protocol such as GB/T28181 protocol, the ONVIF protocol, and the like, and also provides an SDK interface for secondary development to interface with other non-standard protocols. These protocols support downward access to national standard equipment, interface to lower-level national standard platforms, support upward registration to national standards, and provide applications of national standard functions. In addition, each lower stage platform has certain difference on GB/T28181-2016 technical standard specifications and optional content cognition in the technical standard specifications when the early stage video monitoring system is built, and interfaces of each stage are not completely unified, so that detail adjustment is required when the platforms are in butt joint.

The secondary SIP server 210 is configured to interface and convert those lower platforms that are not national standard in the secondary platforms, and satisfy the video interface and protocol of the secondary national standard gateway server 220 by decoding the SIP protocol; the secondary national standard gateway server 220 is a gateway for private protocol and national standard protocol conversion inside the secondary platform.

In one embodiment of the present invention, the number and configuration of the servers are shown in the following table:

the invention supports the image integration access of the monitoring system of the main stream brand; the platform supporting the GB28181 protocol is in butt joint with the system; the method has the capability of accessing equipment and more than one hundred thousand channels in number; the support device connects to the system via the ONVIF protocol. And providing the SDK, and supporting the mobile application to access the video through secondary development. The method supports the realization of interconnection and intercommunication with all levels of standard platforms (standard platforms conforming to GB/T28181 standards) based on GB/T28181 standards, and for national standard video platforms of other established manufacturers, the signaling interaction and media stream interaction between the platforms can be realized through national standard protocols. Based on GB/T28181 standard, the third party platform is accessed through the national standard access mode, and various networking modes such as cascading, interconnection and the like can be realized.

The video resource integrated scheduling system based on the traffic private network is provided with a plurality of service interfaces (not shown in the figure), and can be connected with mobile terminals with various displays, such as command center screens, desktop terminals or other mobile terminals in fig. 1, and the upper-level platform can select the monitoring video focused on from the lower-level platform according to the needs and distribute the monitoring video to the command center large screen, the desktop terminals or the mobile terminals. The mobile device may also retrieve video image resources within the radical level video resource integration platform through the level service interface. The realization scheduling system can call any one or multiple paths of monitoring images; the monitoring image can be distributed to any one terminal device or other dispatching desk and displayed through a large screen or a television; the mobile device may retrieve video image assets within the video asset integration scheduling system.

The method for video resource integrated scheduling based on the traffic private network comprises the following steps:

(1) basic information registration step

The step can enable the subordinate platform to be added into the video resource integrated scheduling system of the traffic private network very simply and easily without customizing and developing, and realize interconnection and intercommunication and unified management of video images among national traffic and transportation management departments.

The lower platform needs to Register with the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server 110, an OK response is returned, a temporary token instruction ring is allocated, and the registration is needed again after the token expires. If the user name and the password do not accord with the information of the lower-level platform, returning a '401 Unauthorized' authentication failure response. The basic registration timing diagram for one embodiment is shown in fig. 3:

(1) The lower platform sends a registration (Register) message to the upper platform, wherein the registration (Register) message comprises an IP address, a port number, a user name, a password and the like;

(2) The upper stage platform receives the registration information of the lower stage platform, analyzes that the user name or the password in the registration information sent by the lower stage platform is not in accordance with the requirement, and returns an authentication failure response (Unauthorized);

(3) After receiving authentication failure response returned by the upper stage platform, the lower stage platform updates registration information and resends the registration information to the upper stage platform;

(4) The upper platform analyzes the information of the lower platform, confirms that the user name and the password meet the requirements, sends an OK response to the lower platform, indicates that the authentication is successful, and distributes a temporary token instruction ring.

(2) Device information pushing step

After authentication is successful, the upper stage platform can request directory information to the lower stage platform, the upper stage platform sends a query command, the lower stage platform returns response including queried equipment directory information, and the lower stage platform can control which equipment information is returned to the upper stage platform. The returned equipment information comprises basic information such as equipment numbers, channel numbers, affiliated organization structures, longitude and latitude and the like. The catalogue information pushed by the lower level is stored in the upper level platform. FIG. 4 is a device information push timing diagram of one embodiment:

(1) The upper platform sends a Query command to the lower platform for requesting Query information;

(2) After receiving the request of the upper platform, the lower platform returns a response to the upper platform, wherein the query information contained in the response includes information such as equipment numbers, channel numbers, affiliated organizations, longitude and latitude.

After the two steps are completed, the lower-level platform is added with the video resource integrated scheduling system based on the traffic private network, so that the monitoring video resource can be pushed for the upper-level platform.

(3) Video stream forwarding step

The flow of a user broadcasting a certain video stream through a client is as follows: the client side firstly transmits Invite messages, the Invite messages are transmitted to the final video equipment terminal through layer-by-layer forwarding of each level of video platform, after the response is successful, video streams are transmitted layer-by-layer through each level of video platform, and finally the video streams are transmitted to the client side, and the client side plug-in units are negatively v-decoded and played. Fig. 5 shows a timing diagram for forwarding a video stream according to one embodiment:

(1) The client (streaming media receiver) sends an Invite message to the SIP server 170, the Invite message including a request mode (multimedia video), a request address, a SIP version number, etc.;

(2) After receiving the Invite message, the SIP server 170 sends the message to the streaming media forwarding server 130 for verification, where the Invite message does not carry an SDP message body;

(3) After receiving the Invite message from the SIP server 170, the streaming media forwarding server 130 returns a 200 OK response with an SDP message body to the SIP server 170, where the message body describes the content such as IP, port, media format, etc. of the media stream received by the streaming media forwarding server 130;

(4) After receiving the 200 OK response returned by the streaming media forwarding server 130, the SIP server 170 sends an Invite request to the streaming media sender, where the Invite request carries an SDP message body returned by the streaming media forwarding server 130;

(5) After receiving the Invite message sent by the SIP server 170, the streaming media sender replies a 200 OK response carrying the SDP message body;

(6) After receiving the response returned by the streaming media sender, the SIP server 170 sends an ACK acknowledgement message to the streaming media forwarding server 130, so as to complete the Invite session establishment process with the streaming media forwarding server 130;

(7) After sending the ACK acknowledgement message to the streaming media forwarding server 130, the SIP server 170 sends the ACK acknowledgement message to the streaming media sender, completing the Invite session establishment procedure with the streaming media sender;

(8) After receiving the ACK message from the SIP server 170, the streaming media sender transmits the video stream to the streaming media forwarding server 130;

(9) After sending the ACK acknowledgement message to the streaming media sender, the SIP server 170 sends an Invite message carrying the SDP message body to the streaming media forwarding server 130;

(10) After receiving Invite message from SIP server 170, streaming media forwarding server 130 replies 200 OK response carrying SDP message body;

(11) After receiving the 200OK response returned by the streaming media forwarding server 130, the SIP server 170 sends a 200OK response to the streaming media receiver;

(12) After receiving the response from the streaming media forwarding server 130, the SIP server 170 sends an ACK acknowledgement message to the streaming media forwarding server 130;

(13) After receiving the ACK acknowledgement message sent by the SIP server 170, the streaming media forwarding server 130 sends a video stream from the streaming media sender to the streaming media receiver;

(14) The streaming media receiver sends a BYE message to SIP server 170 to disconnect the established Invite session;

(15) After receiving the BYE message sent by the streaming media receiver, the SIP server 170 sends a 200OK message to the streaming media receiver, acknowledges that the BYE message has been received, and simultaneously sends the BYE message to the streaming media forwarding server 130;

(16) After receiving the BYE message sent by the SIP server 170, the streaming media forwarding server 130 sends a 200OK message to the SIP server 170, and determines that the BYE message has been received, and the session is disconnected;

(17) After receiving the 200OK acknowledgement message from the streaming media forwarding server 130, the SIP server 170 sends a BYE message to the streaming media sender requesting to disconnect the video session;

(18) After receiving the BYE message from the SIP server 170, the streaming media sender returns a 200OK message, disconnects the session, and ends the video stream forwarding process.

(4) Real-time flow opening step

After the client issues the real-time streaming command, the central management server 110 transmits the streaming command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns streaming receiving address information to the central management server 110; the central management server 110 transmits an open flow instruction with the flow receiving address information of the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the flow sending address information to the central management server 110; the central management server 110 transmits an adding instruction with the streaming address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming address information and then transmits the streaming address information to the client by the central management server 110; after receiving the stream address information sent by the stream media forwarding server 130, the client sends a play instruction to the central management server 110, the stream media forwarding server 130 and the first-level national gateway server 120, and the audio and video stream is sent to the stream media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that real-time stream opening is finally realized. FIG. 6 is a real-time open flow timing diagram of one embodiment:

(1) The client sends a real-time Open flow (Live Open) message to the central management server 110;

(2) After receiving the Live Open message sent by the client, the central management server 110 sends the message to the streaming media forwarding server 130;

(3) After receiving the Live Open message of the central management server 110, the streaming media forwarding server 130 responds to the Live Open message, and includes information such as an address of the streaming media forwarding server 130;

(4) After receiving the response information of the streaming media forwarding server 130, the central management server 110 sends a Live Open message with the streaming address information received by the streaming media forwarding server 130 to the primary national standard gateway server 120;

(5) After receiving the Live Open message sent by the central management server 110, the primary national gateway server 120 returns a confirmation message to the central management server 110, where the message includes address information of the flow sent by the primary national gateway server 120;

(6) The central management server 110 sends an adding request Live Add with a streaming address of the primary national standard gateway server 120 to the streaming media forwarding server 130;

(7) After receiving the information adding request Live Add from the central management server 110, the streaming media forwarding server 130 returns the streaming address information with the streaming media forwarding server 130 to the central management server 110, and confirms that the adding message Live Add is completed;

(8) After receiving the streaming address information of the streaming forwarding server 130, the central management server 110 returns the streaming address information to the client;

(9) After receiving the streaming address information sent by the central management server 110, the client sends a Play request message Live Play to the central management server 110;

(10) The central management server 110 forwards the received request playing message to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns a request success message;

(11) After receiving the request success message returned by the streaming media forwarding server 130, the central management server 110 sends the request play message LivePlay to the primary national standard gateway server 120 again, and the primary national standard gateway server 120 returns the request success message;

(12) The central management server 110 returns the received request success message to the client;

(13) The audio and video stream is sent to the stream media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client to realize real-time stream opening.

(5) Video publishing step

The streaming media forwarding server 130 is responsible for forwarding real-time images and historical video to tandem network platforms, clients, mobile clients, tv walls, storage proxy servers, etc. The bandwidth can be reasonably used, and when a plurality of users (or services) see the same image at the same time, the network bandwidth resources can be effectively saved by forwarding through the streaming media forwarding server 130. Video streaming forwarding includes forwarding of real-time images and on-demand of historical images. The video image forwarding function is implemented by configuring the streaming media forwarding server 130. A video distribution timing diagram of one embodiment is shown in fig. 7:

The video forwarding is that when a plurality of users (or services) see the same image at the same time, the network bandwidth resource is effectively saved by forwarding through the streaming media forwarding server 130, the release of the real-time image and the on-demand of the historical image are realized, and the timing diagram of video release is consistent with the timing diagram of real-time streaming.

(6) Cradle head control step

After the client issues the control instruction of the cradle head, the central management server 110 transmits the control instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits a control instruction with the address information of the stream media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits an adding instruction with the address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, the streaming media forwarding server 130 returns the address information, and the address information is transmitted to the client by the central management server 110; after receiving the address information of the stream media forwarding server 130, the client sends a control instruction to the central management server 110, the stream media forwarding server 130 and the first-level national gateway server 120, and the control result is sent to the stream media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that the control of the cradle head is finally realized. Fig. 8 is a timing chart of pan/tilt control according to an embodiment:

(1) The client sends a PTZ cradle head control request to the central management server 110;

(2) After receiving the PTZ pan/tilt control request, the central management server 110 sends the PTZ pan/tilt control request to the streaming media forwarding server 130;

(3) After receiving the PTZ pan/tilt control request, the streaming media forwarding server 130 returns a confirmation message for receiving the PTZ request to the central management server 110, where the confirmation message includes address information of the streaming media forwarding server 130;

(4) After receiving the confirmation message of the streaming media forwarding server 130, the central management server 110 sends a PTZ pan-tilt control request to the primary national standard gateway server 120;

(5) After receiving the PTZ pan-tilt control request, the primary national gateway server 120 returns a confirmation message for receiving the PTZ request to the central management server 110, where the confirmation message includes address information of the primary national gateway server 120;

(6) After receiving the acknowledgement message from the primary national gateway server 120, the central management server 110 sends a PTZAdd message with the stream address information sent by the primary national gateway server 120 to the stream media forwarding server 130;

(7) After receiving the PTZAdd message, the streaming media forwarding server 130 adds the streaming address information sent by the primary national standard gateway server 120 to the streaming media forwarding server 130, and returns a confirmation message to the central management server 110, wherein the confirmation message contains the streaming address information sent by the streaming media forwarding server 130;

(8) After receiving the confirmation message returned by the streaming media forwarding server 130, the central gateway server 110 returns the address information of the streaming sent by the streaming media forwarding server 130 to the client;

(9) After receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a PTZ (pan-tilt-zoom) control instruction to the central management server 110;

(10) After receiving the PTZ cradle head control instruction, the central management server 110 distributes the PTZ cradle head control instruction to the streaming media forwarding server 130 and the primary national standard gateway server 120;

(11) After the streaming media forwarding server 130 and the primary national standard gateway server 120 respectively receive the PTZ cradle head control instruction, returning whether the PTZ cradle head control instruction is successfully received or not;

(12) The central management server 110 returns to the client whether the PTZ cradle head control instruction is successfully received by the streaming media forwarding server 130 and the primary national standard gateway server 120;

(13) The primary national gateway server 120 returns a cloud deck control result to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the control result to the client after receiving the control result sent by the primary national gateway server 120, so as to realize remote control of the cloud deck by the client.

(7) Video viewing step

After the client issues the video inquiry command, the central management server 110 transmits the command to the storage proxy server 140, and the storage proxy server 140 forwards the command to the video storage server 180; the client issues a video streaming command, the streaming command is transmitted to the streaming media forwarding server 130 by the central management server 110, and the streaming media forwarding server 130 returns streaming receiving address information to the central management server 110; the central management server 110 transmits an open stream instruction with stream address information received by the stream media forwarding server 130 to the storage proxy server 140, and the storage proxy server 140 returns the stream address information to the central management server 110; the central management server 110 transmits an adding instruction with the streaming address information of the storage proxy server 140 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming address information and transmits the streaming address information to the client by the central management server 110; after receiving the stream address information sent by the stream media forwarding server 130, the client sends a play instruction to the central management server 110, the stream media forwarding server 130, the storage proxy server 140 and the video storage proxy server, and the audio and video stream is sent to the storage proxy server 140, the stream media forwarding server 130 and the client by the video storage server 180, so that video viewing is finally realized. FIG. 9 is a timing diagram of video viewing according to one embodiment:

(1) The client sends a video query request to the central management server 110;

(2) After receiving the client information, the central management server 110 sends a video query request to the storage proxy server 140;

(3) After receiving the query request, the storage proxy server 140 sends a video query request to the video storage server 180;

(4) After the video storage server 180 processes the video query request, the video query result is returned to the storage proxy server 140;

(5) After receiving the query result returned by the video storage server 180, the storage proxy server 140 returns the result to the central management server 110, and the central management server 110 returns the query result to the client;

(6) After receiving the confirmation from the video storage server 180, the client sends a video on stream (Vod Open) request to the central management server 110;

(7) After receiving the Vod Open request from the client, the central management server 110 sends a Live Open request to the streaming media forwarding server 130;

(8) After receiving the Live Open request, the streaming media forwarding server 130 returns a confirmation message to the central management server 110, where the confirmation message contains an address message received by the streaming media forwarding server 130;

(9) After receiving the address information of the stream received by the stream media forwarding server 130, the central management server 110 sends Vod Open message to the storage proxy server 140, where the message contains the stream receiving address information of the stream media forwarding server 130;

(10) After receiving the Vod Open message, the storage proxy server 140 returns a confirmation message to the central management server 110, where the message contains address information of the storage proxy server;

(11) After receiving the address information sent by the storage proxy server 140, the central management server 110 sends the address information sent by the storage proxy server 140 to the streaming media forwarding server 130 through a Live Add message;

(12) After receiving the Live Add message, the streaming media forwarding server 130 returns a confirmation message to the central management server 110, where the message contains address information of the streaming sent by the streaming media forwarding server 130;

(13) After receiving the Live Add confirmation message, the central management server 110 returns the message to the client;

(14) After receiving the streaming address information sent by the streaming media forwarding server 130 returned by the central management server 110, the client sends a video playing request (vod play) to the central management server 110;

(15) After receiving the Vod Play request from the client, the central management server 110 sends a video stream Play (Live Play) request to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns a request acknowledgement message;

(16) After receiving the Live Play request acknowledgement message, the central management server 110 sends a video Play (Vod Play) request to the storage proxy server 140, the storage proxy server 140 returns a request acknowledgement message, and the storage proxy server 140 simultaneously sends an SDK streaming request to the video storage server 180;

(17) After receiving the vodtlay request acknowledgement message, the central management server 110 returns the request acknowledgement message to the client;

(18) The video storage server 180 sends the video stream to the storage proxy server 140, and the storage proxy server 140 sends the video stream to the client through the streaming media forwarding server 130, so as to realize the remote viewing of the video flow by the client.

The video resource integrated scheduling method based on the traffic private network realizes the convergence access of the video image data collected by each video monitoring management platform through the steps, and the monitoring video resources such as roads, waterways, railways, civil aviation, postal and the like after the convergence access can be based on the traffic private network, realize comprehensive display and on-demand scheduling through the management interface of the minister video integrated scheduling platform, and can uniformly manage the display of the video resources on a large screen of a traffic comprehensive emergency command center.

Under the daily condition, each lower stage platform utilizes the video monitoring management platform to carry out daily operation management work based on video monitoring, and the platform can select the monitoring video which focuses on from the lower stage platforms according to the needs and distribute the monitoring video to a command center screen, a desktop terminal or a mobile terminal.

Because the method adopts the technical scheme mainly comprising software, the software products corresponding to the software method, such as the modules corresponding to the steps, are also in the protection scope of the invention, and are not repeated.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.

Claims

1. A video resource integrated scheduling system based on a traffic private network, the system comprising a three-stage platform from top to bottom: the primary platform is a primary video resource integrated scheduling platform, the secondary platform comprises five department platforms, the tertiary platform is a plurality of subordinate unit platforms in the five departments, and each subordinate unit platform is respectively butted with video image acquisition points of a plurality of monitoring sites, and the primary platform is characterized in that:

the server arranged on the primary platform comprises: the system comprises a central management server (110), a primary national standard gateway server (120), a streaming media forwarding server (130), a storage proxy server (140), a mobile terminal application server (150), a mobile terminal transcoding server (160), a primary Session Initiation Protocol (SIP) server (170) and a video storage server (180);

The server arranged on the secondary platform comprises: a secondary SIP server (210) and a secondary national standard gateway server (220);

the central management server (110) is responsible for configuring a database, including distributing the access user name and password, the basic information, service information and user authority required by the video resource integrated scheduling system for the corresponding lower platform, and is responsible for signaling transmission among nodes, and all resources and services in the nodes are scheduled by the central management server (110); the first-level national gateway server (120) is an internal private protocol and a gateway converted by the national standard protocol, and can be used as a national standard upper level or a national standard lower level; the streaming media forwarding server (130) is responsible for forwarding and distributing audio and video streaming media and supports private protocols and national standard protocols; the storage proxy server (140) is used as a proxy service stored by the system cloud and is responsible for video on demand, and a security layer is added for interaction between the video storage server (180) and the outside; the video storage server (180) is responsible for storing video resources and is uniformly managed by the central management server (110); the mobile terminal application server (150) provides service for the mobile client, and the mobile terminal transcoding server (160) converts the video file in the streaming media forwarding server (130) into a format conforming to the playing of the mobile terminal; the SIP server (170) is used for interfacing and converting videos acquired from a streaming media sender through decoding an SIP protocol, wherein the lower-level platforms are not national standards;

The secondary SIP server (210) is used for interfacing and converting lower platforms which are not national standards in the secondary platforms, and meets the video interface and protocol of the secondary national standard gateway server (220) by decoding the SIP protocol; the secondary national standard gateway server (220) is a gateway for private protocol and national standard protocol conversion inside the secondary platform;

①a basic information registration module:the lower platform needs to Register to the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server (110), an OK response is returned, a temporary token instruction ring is distributed, and the registration is needed after the token expires; if the user name and the password do not accord with the information of the lower-level platform, returning to the '401 unauthorized' authenticationA right failure response;

②the device information pushing module:

after authentication is successful, the upper stage platform can request directory information to the lower stage platform, the upper stage platform sends a query command, and the lower stage platform returns response, wherein the response comprises queried equipment directory information, and the equipment information comprises equipment numbers, channel numbers, affiliated organization structures and longitude and latitude;

(3) And a video stream forwarding module:

the client transmits Invite messages first, the Invite messages are forwarded layer by layer through each stage of platform, the Invite messages are transmitted to a final video equipment terminal, after the response is successful, video streams are forwarded layer by layer through each stage of platform, and finally the Invite messages are transmitted to the client, and a client plug-in unit is responsible for decoding and playing;

(4) and the real-time flow opening module is used for:

after the client side issues a real-time streaming command, the central management server (110) transmits the streaming command to the streaming media forwarding server (130), and the streaming media forwarding server (130) returns streaming receiving address information to the central management server (110); the center management server (110) transmits an open flow instruction with the flow receiving address information of the streaming media forwarding server (130) to the first-level national standard gateway server (120), and the first-level national standard gateway server (120) returns the flow sending address information to the center management server (110); the center management server (110) transmits an adding instruction with the primary national standard gateway server (120) sending stream address information to the stream media forwarding server (130), and the stream media forwarding server (130) returns the sending stream address information and then transmits the information to the client by the center management server (110); after receiving the stream address information sent by the stream media forwarding server (130), the client sends a playing instruction to the central management server (110) -the stream media forwarding server (130) -the first-level national standard gateway server (120), and the audio and video stream is sent to the stream media forwarding server (130) by the first-level national standard gateway server (120) and then forwarded to the client, so that real-time stream opening is finally realized;

(5) Video release module:

when a plurality of businesses watch the same path of images at the same time, a streaming media forwarding server (130) is responsible for forwarding real-time images and historical video to an upper cascade network platform, a lower cascade network platform, a client, a mobile client or a storage proxy server;

(6) the cradle head control module:

after the client side issues the control instruction of the cradle head, the central management server (110) transmits the control instruction to the streaming media forwarding server (130), and the streaming media forwarding server (130) returns address information to the central management server (110); the central management server (110) transmits a control instruction with the address information of the streaming media forwarding server (130) to the primary national standard gateway server (120), and the primary national standard gateway server (120) returns the address information to the central management server (110); the center management server (110) transmits an adding instruction with the address information of the first-level national standard gateway server (120) to the streaming media forwarding server (130), the streaming media forwarding server (130) returns the address information, and the address information is transmitted to the client by the center management server (110); after receiving the address information of the streaming media forwarding server (130), the client sends a control instruction to the central management server (110) -the streaming media forwarding server (130) -the first-level national standard gateway server (120), and the control result is sent to the streaming media forwarding server (130) by the first-level national standard gateway server (120) and then forwarded to the client, so that the control of the cloud deck is finally realized;

(7) Video viewing module:

after the client side issues a video inquiry instruction, the central management server (110) transmits the instruction to the storage proxy server (140), and the storage proxy server (140) forwards the instruction to the video storage server (180); the client side issues a video streaming command, the streaming command is transmitted to a streaming media forwarding server (130) by a central management server (110), and the streaming media forwarding server (130) returns streaming receiving address information to the central management server (110); the center management server (110) transmits an open flow instruction with the flow receiving address information of the flow media forwarding server (130) to the storage proxy server (140), and the storage proxy server (140) returns the flow sending address information to the center management server (110); the central management server (110) transmits an adding instruction with the streaming address information of the storage proxy server (140) to the streaming media forwarding server (130), and the streaming media forwarding server (130) returns the streaming address information and transmits the streaming address information to the client by the central management server (110); after receiving the stream address information sent by the stream media forwarding server (130), the client sends a playing instruction to the central management server (110), the stream media forwarding server (130), the storage proxy server (140) and the video storage proxy server, and the audio and video stream is sent to the storage proxy server (140), the stream media forwarding server (130) and the client by the video storage server (180), so that video viewing is finally realized.

2. The traffic private network-based video resource integrated scheduling system according to claim 1, wherein: five department platforms of the secondary platform are platforms of a road network center, a maritime office, a long aviation office and Beijing city and Shenzhen city.

3. The traffic private network-based video resource integrated scheduling system according to claim 1, wherein: the general video streaming protocol set by the SIP server (170) comprises GB/T28181 protocol or ONVIF.

4. The video resource integrated scheduling method based on the traffic private network is operated in a video resource integrated scheduling system based on the traffic private network, and the system comprises three stages of platforms from top to bottom: the primary platform is a primary video resource integrated scheduling platform, the secondary platform comprises five department platforms, the tertiary platform is a plurality of subordinate unit platforms in the five departments, each subordinate unit platform is divided into video image acquisition points for butt joint of a plurality of monitoring sites, and the primary platform is characterized in that:

the method comprises the following steps of enabling a lower stage platform to join the system and pushing monitoring video resources for an upper stage platform:

①a basic information registration step:

the lower platform needs to Register to the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server (110), an OK response is returned, a temporary token instruction ring is distributed, and the registration is needed after the token expires; if the user name and the password do not accord with the information of the lower-level platform, returning a '401 Unauthorized' authentication failure response;

②a step of pushing equipment information:

(3) A video stream forwarding step:

(4) and (3) a real-time flow opening step:

(5) Video publishing step:

when a plurality of businesses simultaneously see the same image, the streaming media forwarding server (130) is responsible for forwarding the real-time image and the historical video to an upper cascade network platform, a lower cascade network platform, a client, a mobile client or a storage proxy server;

(6) the control step of the cradle head:after the client side issues the control instruction of the cradle head, the central management server (110) transmits the control instruction to the streaming media forwarding server (130), and the streaming media forwarding server (130) returns address information to the central management server (110); the central management server (110) transmits a control instruction with the address information of the streaming media forwarding server (130) to the primary national standard gateway server (120), and the primary national standard gateway server (120) returns the address information to the central management server (110); the center management server (110) transmits an adding instruction with the address information of the first-level national standard gateway server (120) to the streaming media forwarding server (130), the streaming media forwarding server (130) returns the address information, and the address information is transmitted to the client by the center management server (110); after receiving the address information of the streaming media forwarding server (130), the client sends a control instruction to the central management server (110) -the streaming media forwarding server (130) -the first-level national standard gateway server (120), and the control result is sent to the streaming media forwarding server (130) by the first-level national standard gateway server (120) and then forwarded to the client, so that the control of the cloud deck is finally realized;

(7) A video viewing step:

5. The video resource integrated scheduling method based on the traffic private network as claimed in claim 4, wherein the method comprises the following steps: five department platforms of the secondary platform are platforms of a road network center, a maritime office, a long aviation office and Beijing city and Shenzhen city.

6. The video resource integrated scheduling method based on the traffic private network as claimed in claim 4, wherein the method comprises the following steps: the general video streaming protocol set by the SIP server (170) comprises GB/T28181 protocol or ONVIF.