CN114679497A

CN114679497A - Video resource integrated scheduling system and method based on special traffic network

Info

Publication number: CN114679497A
Application number: CN202210266160.5A
Authority: CN
Inventors: 方飞; 万千; 李龙跃; 陈思; 赵威; 戚丰远; 李琛; 张洁; 高平
Original assignee: China Transport Telecommunications And Information Center
Current assignee: China Transport Telecommunications And Information Center
Priority date: 2022-03-17
Filing date: 2022-03-17
Publication date: 2022-06-28
Anticipated expiration: 2042-03-17
Also published as: CN114679497B

Abstract

A video resource integrated scheduling system and method based on a private transportation network are provided, the system comprises a top-down three-level platform: the first-level platform is a department-level video resource integrated scheduling platform, the second-level platform comprises five department platforms, the third-level platform is a plurality of subordinate unit platforms in the five departments, and each subordinate unit platform is respectively connected with a plurality of video image acquisition points of a monitoring site in a butt joint mode, and the method comprises the following steps: the method comprises the following steps of basic information registration, equipment information push, video stream forwarding, real-time stream opening, video release, holder control and video viewing, can realize the convergence and access of video image data of each platform, and can realize the interconnection and intercommunication and unified management of video images among national transportation management departments.

Description

Video resource integrated scheduling system and method based on special traffic network

Technical Field

The invention belongs to the technical field of traffic transportation safety emergency, and particularly relates to a video resource integrated scheduling system and method based on a special traffic network.

Background

In terms of traffic safety, any emergency can be treated as soon as possible in the initial stage of the event and the loss can be reduced to the minimum if the monitoring means can early warn. The video resource plays an important role in monitoring, early warning and decision assistance in emergency handling of emergencies.

The existing department-level emergency management unit carries out emergency handling of emergency events, and the used video resources are based on independent video resource scheduling systems in various regions and industries. The video resource integrated dispatching system based on the special traffic network realizes the convergence and access of video image data collected by each video monitoring management platform through the butt joint with the video monitoring platforms of all the departments under jurisdiction, the converged monitoring video resources such as highways, waterways, railways, civil aviation, postal service and the like can be comprehensively displayed and viewed as required through the management interface of the department level video integrated dispatching platform based on the special traffic network, and the unified management can be carried out on the display of the video resources on a large screen of a comprehensive emergency command center for traffic transportation.

The five departments are independent during construction, used video resources are based on independent video resource scheduling systems of all regions and industries, adopted video monitoring platforms, camera brand models and data protocols are different, all the video resources can only be dispersedly called, all the branch platforms utilize the video monitoring management platforms to carry out daily operation management work based on video monitoring, interconnection and unified management of video images among national transportation management departments cannot be carried out, and the defects of low efficiency and inconvenience for centralized management and control exist.

Disclosure of Invention

In order to overcome the problems, the application provides a video resource integrated scheduling system and method based on a private transportation network, so as to realize interconnection and intercommunication and unified management of video images among national transportation management departments.

In order to achieve the purpose, the technical scheme of the invention is as follows:

a video resource integrated scheduling system based on a private transportation network comprises a top-down three-level platform: the first-level platform is the integrated scheduling platform of department level video resource, and the second-level platform includes five departments platforms, and tertiary platform then is a plurality of subordinate unit platform in these five departments, and every subordinate unit platform docks the video image acquisition point on a plurality of control fields respectively, and the server that sets up at the first-level platform includes: the system comprises a central management server 110, a first-level national standard gateway server 120, a streaming media forwarding server 130, a storage proxy server 140, a mobile terminal application server 150, a mobile terminal transcoding server 160, a first-level SIP server 170 and a video storage server 180; the server arranged on the secondary platform comprises: a secondary SIP server 210, and a secondary national standard gateway server 220; the central management server 110 is responsible for configuring a database, distributing access user names and passwords, basic information, service information and user permissions required by the video resource integrated scheduling system for corresponding lower platforms, and signaling transmission among nodes, wherein all resources and services in the nodes are scheduled by the central management server 110; the first-level national gateway server 120 is a gateway for converting an internal private protocol and a national standard protocol, and can be used as a national standard upper level and a national standard lower level; the streaming media forwarding server 130 is responsible for forwarding and distributing audio and video streaming media, and supports a private protocol and a national standard protocol; the storage proxy server 140 is used as a proxy service for system cloud storage, is responsible for video on demand, and simultaneously adds a security layer for interaction between the video storage server 180 and the outside; the video storage server 180 is responsible for storing video resources and is uniformly managed by the central management server 110; the mobile application server 150 provides services for the mobile client, and the mobile transcoding server 160 converts the video file in the streaming media forwarding server 130 into a format that conforms to the mobile playing; the SIP server 170, which is used to interface and convert the lower platforms that are not national standard, and decode the SIP protocol to obtain the video from the streaming media sender; the second-level SIP server 210 is used for docking and converting lower-level platforms which are not national standards in the second-level platform, and meets the video interface and protocol of the second-level national standard gateway server 220 by decoding the SIP protocol; the secondary international gateway server 220 is a gateway for the conversion of the proprietary protocol and the international protocol within the secondary platform.

The system also comprises the following modules to enable the subordinate platforms to join the system and push the monitoring video resources for the superior platforms:

a basic information registration module:

the lower platform needs to Register to the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server 110, an OK response is returned, a temporary token command ring is distributed, and the token needs to be registered again after the token is out of date; and if the user name and the password do not conform to the information of the lower platform, returning a '401 Unauuthorized' authentication failure response.

The equipment information pushing module:

after the authentication is successful, the superior platform can request directory information to the inferior platform, the superior platform sends a query command, and the inferior platform returns a response including queried device directory information, wherein the device information includes a device number, a channel number, an affiliated organization structure and longitude and latitude.

The video stream forwarding module:

the client sends the Invite message firstly, the Invite message is forwarded layer by layer through each stage of platform and sent to a final video equipment terminal, after the response is successful, the video stream is forwarded layer by layer through each stage of platform and finally sent to the client, and the client plug-in is responsible for decoding and playing.

A real-time streaming module:

after the client issues the real-time streaming opening instruction, the central management server 110 transmits the streaming opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information transmitted by the first-level national standard gateway server 120 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a play instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and the audio/video stream is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that real-time streaming is finally realized.

The video publishing module:

when multiple services watch the same image at the same time, the streaming media forwarding server 130 is responsible for forwarding the real-time image and the history video to the upper and lower-level networking platforms, clients, mobile clients, or storage proxy servers.

Sixth, the cradle head control module:

after the client issues the pan/tilt control command, the central management server 110 transmits the control command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits the control instruction with the address information of the streaming media forwarding server 130 to the first-level national gateway server 120, and the first-level national gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits the adding instruction with the address information of the first-level national gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the address information and transmits the address information to the client by the central management server 110; after receiving the address information of the streaming media forwarding server 130, the client sends a control instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and a control result is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that the pan-tilt control is finally realized.

And a video viewing module:

after the client sends a video query instruction, the central management server 110 transmits the instruction to the storage proxy server 140, and the storage proxy server 140 forwards the instruction to the video storage server 180; the client sends a video opening instruction, the central management server 110 sends the opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the stream receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the storage proxy server 140, and the storage proxy server 140 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information sent by the storage proxy server 140 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a playing instruction to the central management server 110, the streaming media forwarding server 130, the storage proxy server 140, the video storage proxy server, and the audio and video stream is sent to the storage proxy server 140, the streaming media forwarding server 130, the client by the video storage server 180, so that the video viewing is finally realized.

The five department platforms of the secondary platform are the platform of the road network center, the maritime bureau, the Changhai bureau, the Beijing market and the Shenzhen market. The general video streaming protocol set by the SIP server 170 includes the GB/T28181 protocol, or ONVIF.

The invention also provides a video resource integrated scheduling method based on the special traffic network, which operates in the video resource integrated scheduling system based on the special traffic network, and enables a lower-level platform to be added into the system and pushes monitoring video resources for an upper-level platform through the following steps:

basic information registration:

the lower platform needs to Register to the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server 110, an OK response is returned, a temporary token command ring is distributed, and the token needs to be registered again after the token is out of date; if the user name and the password do not conform to the information of the lower platform, returning a '401 Unauuthorized' authentication failure response;

and the equipment information pushing step:

Thirdly, video stream forwarding:

the client sends an Invite message firstly, the Invite message is forwarded layer by layer through each stage of platform and sent to a final video equipment terminal, after response is successful, the video stream is forwarded layer by layer through each stage of platform and finally sent to the client, and a client plug-in is responsible for decoding and playing;

fourthly, real-time streaming:

after the client issues the real-time streaming opening instruction, the central management server 110 transmits the streaming opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information transmitted by the first-level national gateway server 120 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a playing instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and the audio and video stream is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that real-time streaming is finally realized;

A video publishing step:

Sixthly, controlling the cradle head:

after the client issues the pan/tilt control command, the central management server 110 transmits the control command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits the control instruction with the address information of the streaming media forwarding server 130 to the first-level national gateway server 120, and the first-level national gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits the adding instruction with the address information of the first-level national gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the address information and transmits the address information to the client by the central management server 110; after receiving the address information of the streaming media forwarding server 130, the client sends a control instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and a control result is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that the control of the holder is finally realized;

And seventhly, recording and viewing:

after the client sends a video query instruction, the central management server 110 sends the instruction to the storage proxy server 140, and the storage proxy server 140 forwards the instruction to the video storage server 180; the client sends a video opening instruction, the central management server 110 sends the opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the stream receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the storage proxy server 140, and the storage proxy server 140 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information sent by the storage proxy server 140 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a play instruction to the central management server 110, the streaming media forwarding server 130, the storage proxy server 140, the video storage proxy server, and the audio and video stream is sent to the storage proxy server 140, the streaming media forwarding server 130, the client by the video storage server 180, so that the video viewing is finally realized.

The video resource integrated scheduling system and method based on the private traffic network construct a department-level video integrated platform, solve the problem of conversion among different protocols through a national standard gateway server, and realize the functions of video scheduling, control and the like of the department platform on a second-level platform and a third-level platform. The system can realize signaling control, signaling interaction and video stream pushing among platforms, has the functions of information inquiry, pushing, forwarding and the like, and realizes interconnection and unified management of video images among national transportation management departments.

Drawings

FIG. 1 is a video resource scheduling system architecture of the private transportation network of the present invention;

FIG. 2 is a functional block diagram of a server according to the present invention;

FIG. 3 shows a basic registration timing diagram;

FIG. 4 shows a device information push timing diagram;

FIG. 5 shows a video stream forwarding timing diagram;

FIG. 6 shows a real-time open flow timing diagram;

FIG. 7 shows a video distribution timing diagram;

fig. 8 shows a pan/tilt control timing chart;

fig. 9 shows a video recording viewing sequence chart.

Detailed Description

The present invention will be described in detail below with reference to the accompanying drawings by way of examples of specific embodiments. However, it should be understood by those skilled in the art that the present invention is not limited to the specific embodiments listed, and should be included within the scope of the present invention as long as the spirit of the present invention is met.

The system and the method for video resource integrated scheduling based on the private transportation network realize that a superior platform as an organization can be accessed to the system without customizing and developing a subordinate platform by utilizing the unification of a video protocol and the standardization of an external service interface by the private transportation network, have the functions of information inquiry, pushing, forwarding and the like, and realize the interconnection, intercommunication and unified management of video images among national transportation management departments. The convergence access of the video monitoring image resources in the local road network center, the local maritime bureau, the local long voyage bureau, the three local administrative national bureaus, the Beijing City and the Shenzhen City is realized.

Referring to fig. 1, a video resource scheduling system architecture of a private transportation network according to the present invention is shown, the system divides national video surveillance into three-level platform architecture, that is, top-down department level video resource integrated scheduling platform, that is, a first-level platform 100, and a second-level platform 200 includes five platforms: the three-level platform is a platform of a road network center, a maritime bureau, a long-voyage bureau, three department management national bureaus, a Beijing city and a Shenzhen city, the three-level platform is a plurality of subordinate unit platforms 300 in the five departments, each subordinate unit platform 300 is respectively connected with a plurality of monitoring sites, and data of video image acquisition points of the monitoring sites such as roads, docks, airports and the like are respectively uploaded to the three-level management platform 300 of the department through video aggregation nodes, then are aggregated by the platform 300 of the department, are uploaded to the two-level platform 200, and are finally uploaded to the department-level platform 100. Thereby realizing the management of national traffic safety. In particular, fig. 1 shows an arrow indicating the direction of data flow.

The present invention provides a series of servers on the primary platform 100 to implement the various functions of the present system. A corresponding server is also provided at the secondary platform 200. FIG. 2 is a functional block diagram of a server according to the present invention; the server of the primary platform 100 shown in fig. 2 includes: the system comprises a central management server 110, a primary national standard gateway server 120, a streaming media forwarding server 130, a storage proxy server 140, a mobile terminal application server 150, a mobile terminal transcoding server 160, a primary SIP server 170 and a video storage server 180. The server of the secondary platform 200 includes: a secondary SIP server 210, and a secondary national standard gateway server 220. The client in fig. 2 may be a computer, and the mobile client may be a mobile phone.

The central management server 110 is a center of service management of the present invention, and is configured with central services in a unified manner, and is responsible for configuring a database (not shown), basic information, service information and user permissions required by a video resource integrated scheduling system, and signaling transmission among nodes, all resources and services in the nodes are scheduled by the central management server 110, and when platforms are deployed and configured, an upper-level platform allocates an access user name and a password to a corresponding lower-level platform, and the central management server 110 configures and manages the access user name and the password. The first-level national gateway server 120 is a gateway for converting an internal private protocol and a national protocol, and can be used as a national upper level or a national lower level, and is distinguished by an initialization parameter transmitted from the central management server 110. The streaming media forwarding server 130 is responsible for forwarding and distributing audio and video streaming media, and supports the private protocol and the national standard protocol, and the windows version supports transcoding of video. The storage proxy server 140 is used as a proxy service for system cloud storage, and is responsible for video on demand, and a security layer is added for interaction between the video storage server 180 and the outside. The video storage server 180 is responsible for storing video resources and is uniformly managed by the central management server 110. The mobile application server 150 serves the mobile client, and the mobile transcoding server 160 converts the video file in the streaming media forwarding server 130 into a format that is suitable for mobile playback. The SIP server 170 is used for interfacing and converting the video stream acquired by the lower platform which is not national standard to the streaming media sender (i.e. client) by decoding the SIP protocol, in one embodiment, the SIP server 170 sets the general video stream protocol such as GB/T28181 protocol, ONVIF protocol, etc., and also provides the SDK interface for secondary development to interface other non-standard protocols. These protocols support downward access to national standard devices, docking of subordinate national standard platforms, upward registration to national standard superior, and application of national standard functions. In addition, each lower-level platform recognizes certain differences in GB/T28181-2016 technical standard specifications and optional contents in the GB/T28181-2016 technical standard specifications during early-stage video monitoring system construction, and interfaces of each platform are not completely unified, so that detailed adjustment is required during platform docking.

The second-level SIP server 210 is used for docking and converting lower-level platforms which are not national standards in the second-level platform, and meets the video interface and protocol of the second-level national standard gateway server 220 by decoding the SIP protocol; the secondary international gateway server 220 is a gateway for the conversion of the proprietary protocol and the international protocol within the secondary platform.

In an embodiment of the present invention, the number and configuration of the servers are as follows:

the invention supports the image integration access of a monitoring system of a mainstream brand; the platform supporting the GB28181 protocol is in butt joint with the system; the capacity of accessing devices and more than one hundred thousand channels is provided; the support equipment is connected with the system through an ONVIF protocol. And providing the SDK to support the mobile application to access the video through secondary development. The method supports the realization of interconnection and intercommunication with standard platforms of all levels (standard platforms conforming to GB/T28181 standards) based on GB/T28181 standards, and can realize the signaling interaction and media stream interaction between the platforms through a national standard protocol for national standard video platforms of other established manufacturers. Based on the GB/T28181 standard, the third-party platform is accessed through a national standard access mode, and various networking modes such as cascade connection, interconnection and the like can be realized.

The video resource integrated scheduling system based on the private transportation network is provided with a plurality of service interfaces (not shown in the figure), can be connected with mobile terminals with various displays, such as a command center screen, a desktop terminal or other mobile terminals in the figure 1, and an upper platform can select a monitoring video focused on from a lower platform according to needs and distribute the monitoring video to a command center large screen, a desktop terminal or a mobile terminal. The mobile device can also call and read the video image resource in the department level video resource integration platform through the service interface. The scheduling system can be used for acquiring any one or more paths of monitoring images; the monitoring image can be distributed to any terminal equipment or other dispatching desks and displayed through a large screen or a television; the mobile device can access the video image resource in the video resource integrated scheduling system.

The invention discloses a video resource integrated scheduling method based on a special traffic network, which comprises the following steps:

(ii) basic information registration step

The step can ensure that the lower-level platform can be simply and conveniently added into the video resource integrated scheduling system of the special transportation network without customizing and developing, and realize the interconnection and intercommunication and unified management of the video images among national transportation management departments.

The lower platform needs to Register to the upper platform, the lower platform sends a Register message, the upper platform analyzes the message, if the user name and the password accord with the information of the lower platform stored in the central management server 110, an OK response is returned, a temporary token command ring is distributed, and the token needs to be registered again after the expiration. And if the user name and the password do not conform to the information of the lower platform, returning a '401 Unauuthorized' authentication failure response. FIG. 3 illustrates a basic registration timing diagram of one embodiment:

(1) the lower platform sends a registration (Register) message to the upper platform, wherein the registration (Register) message comprises an IP address, a port number, a user name, a password and the like;

(2) the superior platform receives the registration information of the subordinate platform, analyzes that the user name or the password in the registration information sent by the subordinate platform does not meet the requirement, and returns an authentication failure response (Unauthorized);

(3) After receiving the authentication failure response returned by the superior platform, the inferior platform updates the registration information and retransmits the registration information to the superior platform;

(4) and the superior platform analyzes the information of the subordinate platform, confirms that the user name and the password meet the requirements, sends an OK response to the subordinate platform to indicate that the authentication is successful, and allocates a temporary token command ring.

Step of pushing equipment information

After authentication is successful, the superior platform can request directory information from the inferior platform, the superior platform sends a query command, the subordinate platform returns a response, including queried equipment directory information, and the subordinate platform can control which equipment information is returned to the superior platform. The returned device information includes basic information such as device number, channel number, affiliated organization structure, longitude and latitude. And the directory information pushed by the lower level is stored in the upper level platform. Fig. 4 shows a timing chart of device information push according to an embodiment:

(1) the upper platform sends a Query command to the lower platform for requesting Query information;

(2) after receiving the request of the superior platform, the subordinate platform returns a Response to the superior platform, and the query message contained in the Response comprises information such as equipment number, channel number, affiliated organization, longitude and latitude and the like.

After the two steps are completed, the lower-level platform is added with the video resource integrated scheduling system based on the private traffic network, and can push monitoring video resources for the upper-level platform.

Step of forwarding video stream

The flow of a user on demand of a certain video stream through a client is as follows: the client sends an Invite message firstly, the Invite message is forwarded layer by layer through each level of video platform and is sent to a final video equipment terminal, after response is successful, the video stream is forwarded layer by layer through each level of video platform and is finally sent to the client, and the client plug-in is responsible for decoding and playing. Fig. 5 shows a timing diagram of video stream forwarding according to an embodiment:

(1) the client (streaming media receiver) sends an Invite message to the SIP server 170, where the Invite message includes a request mode (multimedia video), a request address, an SIP version number, and the like;

(2) after receiving the Invite message, the SIP server 170 sends the message to the streaming media forwarding server 130 for verification, and the Invite message does not carry an SDP body;

(3) after receiving the Invite message of the SIP server 170, the streaming media forwarding server 130 replies a 200OK response with an SDP message body to the SIP server 170, where the message body describes the content of the IP, port, media format, etc. of the media stream received by the streaming media forwarding server 130;

(4) After receiving the 200OK response returned by the streaming media forwarding server 130, the SIP server 170 sends an Invite request to the streaming media sender, where the request carries an SDP body returned by the streaming media forwarding server 130;

(5) after receiving the Invite message sent by the SIP server 170, the streaming media sender replies a 200OK response carrying an SDP body;

(6) after receiving the response returned by the streaming media sender, the SIP server 170 sends an ACK acknowledgement message to the streaming media forwarding server 130, and completes the Invite session establishment process with the streaming media forwarding server 130;

(7) after sending the ACK acknowledgement message to the streaming media forwarding server 130, the SIP server 170 sends the ACK acknowledgement message to the streaming media sender, and completes the Invite session establishment process with the streaming media sender;

(8) after receiving the ACK message from the SIP server 170, the streaming media sender transmits a video stream to the streaming media forwarding server 130;

(9) after sending an ACK confirmation message to the streaming media sender, the SIP server 170 sends an Invite message carrying an SDP body to the streaming media forwarding server 130;

(10) after receiving the Invite message from the SIP server 170, the streaming media forwarding server 130 replies a 200OK response carrying an SDP message body;

(11) after receiving the 200OK response returned by the streaming media forwarding server 130, the SIP server 170 sends the 200OK response to the streaming media receiver;

(12) After receiving the response from the streaming media forwarding server 130, the SIP server 170 sends an ACK acknowledgement message to the streaming media forwarding server 130;

(13) after receiving the ACK acknowledgement message sent by the SIP server 170, the streaming media forwarding server 130 sends a video stream from the streaming media sender to the streaming media receiver;

(14) the streaming media receiver sends a BYE message to the SIP server 170, disconnecting the established Invite session;

(15) after receiving the BYE message sent by the streaming media receiver, the SIP server 170 sends a 200OK message to the streaming media receiver, confirms that the BYE message is received, and sends a BYE message to the streaming media forwarding server 130;

(16) after receiving the BYE message sent by the SIP server 170, the streaming media forwarding server 130 sends a 200OK message to the SIP server 170, and determines that the BYE message is received and the session is disconnected;

(17) after receiving the 200OK confirmation message from the streaming media forwarding server 130, the SIP server 170 sends a BYE message to the streaming media sender to request to disconnect the video session;

(18) after receiving the BYE message from the SIP server 170, the streaming media sender returns a 200OK message, disconnects the session, and ends the video stream forwarding process.

Fourthly, real-time streaming opening step

After the client issues the real-time streaming opening instruction, the central management server 110 transmits the streaming opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information transmitted by the first-level national standard gateway server 120 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a play instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and the audio/video stream is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that real-time streaming is finally realized. FIG. 6 shows a timing diagram of the real-time open flow of one embodiment:

(1) The client sends a real-time Open flow (Live Open) message to the central management server 110;

(2) after receiving the Live Open message sent by the client, the central management server 110 sends the message to the streaming media forwarding server 130;

(3) after receiving the Live Open message from the central management server 110 through 130, the streaming media forwarding server 130 responds to the Live Open message, including information such as the address of the streaming media forwarding server receiver 130;

(4) after receiving the response message of the streaming media forwarding server 130, the central management server 110 sends a Live Open message with streaming address information received by the streaming media forwarding server 130 to the first-level national standard gateway server 120;

(5) after receiving the Live Open message sent by the central management server 110, the primary international gateway server 120 returns a confirmation message to the central management server 110, where the message includes address information sent by the primary international gateway server 120;

(6) the central management server 110 sends an addition request Live Add with a streaming address of the first-level national standard gateway server 120 to the streaming media forwarding server 130;

(7) after receiving the information addition request Live Add from the central management server 110, the streaming media forwarding server 130 returns the information with the streaming media forwarding server 130 sending the streaming address to the central management server 110, and confirms that the addition of the information Live Add is completed;

(8) After receiving the streaming address information of the streaming media forwarding server 130, the central management server 110 returns the streaming address information to the client;

(9) after receiving the streaming address information sent by the central management server 110, the client sends a request Play message Live Play to the central management server 110;

(10) the central management server 110 forwards the received request playing message to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns a request success message;

(11) after receiving the request success message returned by the streaming media forwarding server 130, the central management server 110 sends the request play message LivePlay to the first-level national standard gateway server 120 again, and the first-level national standard gateway server 120 returns the request success message;

(12) the central management server 110 returns the received request success message to the client;

(13) the audio/video stream is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120, and then forwarded to the client, so as to realize real-time streaming.

Fifthly, video publishing step

The streaming media forwarding server 130 is responsible for forwarding the real-time images and the history videos to the upper and lower-level networking platforms, clients, mobile clients, video walls, storage proxy servers, and the like. The bandwidth can be reasonably used, when a plurality of users (or services) watch the same path of image at the same time, the image is forwarded by the streaming media forwarding server 130, and the network bandwidth resource can be effectively saved. The video streaming media forwarding comprises the forwarding of real-time images and the on-demand of historical images. The video image forwarding function is realized by configuring the streaming media forwarding server 130. FIG. 7 shows a timing diagram for video distribution according to one embodiment:

In the video forwarding, when a plurality of users (or services) watch the same image at the same time, the streaming media forwarding server 130 forwards the image to effectively save network bandwidth resources, so as to realize the distribution of real-time images and the on-demand of historical images, and the timing sequence of video distribution is consistent with the timing sequence of real-time streaming opening.

Control step of the pan-tilt

After the client issues the pan/tilt control command, the central management server 110 transmits the control command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits a control instruction with address information of the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits an adding instruction with address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the address information and transmits the address information to the client by the central management server 110; after receiving the address information of the streaming media forwarding server 130, the client sends a control instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and a control result is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that the pan-tilt control is finally realized. Fig. 8 shows a timing chart of the pan/tilt head control according to an embodiment:

(1) The client sends a PTZ pan-tilt control request to the central management server 110;

(2) after receiving the PTZ pan/tilt control request, the central management server 110 sends the PTZ pan/tilt control request to the streaming media forwarding server 130;

(3) after receiving the PTZ pan/tilt control request, the streaming media forwarding server 130 returns a confirmation message of receiving the PTZ request to the central management server 110, where the confirmation message includes address information of receiving streams by the streaming media forwarding server 130;

(4) after receiving the confirmation message from the streaming media forwarding server 130, the central management server 110 sends the PTZ pan/tilt control request to the first-level national standard gateway server 120;

(5) after receiving the PTZ pan-tilt control request, the first-level national standard gateway server 120 returns a confirmation message of receiving the PTZ request to the central management server 110, where the confirmation message includes address information of the stream sent by the first-level national standard gateway server 120;

(6) after receiving the confirmation message from the first-level national gateway server 120, the central management server 110 sends a PTZAdd message with the stream address information sent by the first-level national gateway server 120 to the stream media conversion server 130;

(7) after receiving the PTZAdd message, the streaming media forwarding server 130 adds the streaming address information sent by the first-level national standard gateway server 120 to the streaming media forwarding server 130, and returns a confirmation message to the central management server 110, where the confirmation message includes the streaming address information sent by the streaming media forwarding server 130;

(8) After receiving the confirmation message returned by the streaming media forwarding server 130, the central gateway server 110 returns the address information of the stream to the streaming media forwarding server 130 to the client;

(9) after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a PTZ pan-tilt control instruction to the central management server 110;

(10) after receiving the PTZ pan-tilt control instruction, the central management server 110 respectively sends the PTZ pan-tilt control instruction to the streaming media forwarding server 130 and the first-level national standard gateway server 120;

(11) after receiving the PTZ pan-tilt control instruction, the streaming media forwarding server 130 and the first-level national standard gateway server 120 respectively return whether the PTZ pan-tilt control instruction is successfully received;

(12) the central management server 110 returns to the client whether the streaming media forwarding server 130 and the first-level national standard gateway server 120 successfully receive the PTZ pan-tilt control instruction;

(13) the first-level national standard gateway server 120 returns the pan-tilt control result to the streaming media forwarding server 130, and after receiving the control result sent by the first-level national standard gateway server 120, the streaming media forwarding server 130 returns the control result to the client, so that the client remotely controls the pan-tilt.

Seventhly, recording and viewing step

After the client sends a video query instruction, the central management server 110 transmits the instruction to the storage proxy server 140, and the storage proxy server 140 forwards the instruction to the video storage server 180; the client sends a video opening instruction, the central management server 110 sends the opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the stream receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the storage proxy server 140, and the storage proxy server 140 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information sent by the storage proxy server 140 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a playing instruction to the central management server 110, the streaming media forwarding server 130, the storage proxy server 140, the video storage proxy server, and the audio and video stream is sent to the storage proxy server 140, the streaming media forwarding server 130, the client by the video storage server 180, so that the video viewing is finally realized. FIG. 9 shows a timing diagram for video recording viewing according to an embodiment:

(1) The client sends a video recording query request to the central management server 110;

(2) after receiving the client information, the central management server 110 sends a video recording query request to the storage proxy server 140;

(3) after receiving the query request, the storage proxy server 140 sends the video recording query request to the video storage server 180;

(4) after processing the video recording query request, the video storage server 180 returns the video recording query result to the storage proxy server 140;

(5) after receiving the query result returned by the video storage server 180, the storage proxy server 140 returns the result to the central management server 110, and then the central management server 110 returns the query result to the client;

(6) after receiving the confirmation from the video storage server 180, the client sends a video Open stream (Vod Open) request to the central management server 110;

(7) after receiving the Vod Open request from the client, the central management server 110 sends a Live Open request to the streaming media forwarding server 130;

(8) after receiving the Live Open request, the streaming media forwarding server 130 returns a confirmation message to the central management server 110, where the message includes an address message for receiving a stream by the streaming media forwarding server 130;

(9) after receiving the address information of the streaming media forwarding server 130 for receiving the streaming, the central management server 110 sends a Vod Open message to the storage agent server 140, where the message includes the address information of the streaming media forwarding server 130 for receiving the streaming;

(10) After receiving the Vod Open message, the storage proxy server 140 returns a confirmation message to the central management server 110, where the message includes address information of the storage proxy server stream;

(11) after receiving the address information of the storage proxy server 140, the central management server 110 sends the address information of the storage proxy server 140 to the streaming media forwarding server 130 through the Live Add message;

(12) after receiving the Live Add message, the streaming media forwarding server 130 returns a confirmation message to the central management server 110, where the message includes address information of the stream sent by the streaming media forwarding server 130;

(13) after receiving the Live Add confirmation message, the central management server 110 returns the message to the client;

(14) after receiving the streaming address information sent by the streaming media forwarding server 130 returned by the central management server 110, the client sends a video playing request (Vod Play) to the central management server 110;

(15) after receiving the Vod Play request from the client, the central management server 110 sends a video stream Play (Live Play) request to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns a request confirmation message;

(16) after receiving the Live Play request confirmation message, the central management server 110 sends a video Play (Vod Play) request to the storage proxy server 140, the storage proxy server 140 returns the request confirmation message, and the storage proxy server 140 simultaneously sends an SDK streaming request to the video storage server 180;

(17) After receiving the message of VodPlay request confirmation, the central management server 110 returns the request confirmation message to the client;

(18) video storage server 180 sends the video stream to storage proxy server 140, and storage proxy server 140 sends the video stream to the client through streaming media forwarding server 130, so as to realize the remote video viewing process of the client.

The video resource integrated scheduling method based on the special traffic network realizes the convergence and access of video image data acquired by each video monitoring management platform through the steps, and the converged and accessed monitoring video resources such as roads, waterways, railways, civil aviation, postal service and the like can realize comprehensive display and on-demand watching through a department-level video integrated scheduling platform management interface based on the special traffic network, and can uniformly manage the display of the video resources on a large screen of a comprehensive emergency command center for traffic transportation.

Under the daily condition, each lower platform utilizes the video monitoring management platform of the lower platform to carry out the daily operation management work based on video monitoring, and the platform can select the monitoring video focused on from the lower platforms according to the requirement and distribute the monitoring video to a command center screen, a desktop terminal or a mobile terminal.

Because the method adopts the technical scheme of mainly using software, software products corresponding to the software method, such as modules corresponding to the steps, also belong to the protection scope of the invention, and are not described in detail.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all changes and modifications that fall within the scope of the invention.

Claims

1. A video resource integrated scheduling system based on a private transportation network comprises three stages of platforms from top to bottom: the primary platform is a department-level video resource integrated scheduling platform, the secondary platform comprises five department platforms, the tertiary platform is a plurality of subordinate unit platforms in the five departments, and each subordinate unit platform is respectively connected with a plurality of video image acquisition points of a monitoring site, and the system is characterized in that:

the server arranged on the primary platform comprises: the system comprises a central management server 110, a primary national standard gateway server 120, a streaming media forwarding server 130, a storage proxy server 140, a mobile terminal application server 150, a mobile terminal transcoding server 160, a primary SIP server 170 and a video storage server 180;

The server arranged on the secondary platform comprises: a secondary SIP server 210, and a secondary national standard gateway server 220;

the central management server 110 is responsible for configuring a database, distributing access user names and passwords for corresponding subordinate platforms, basic information, service information and user permissions required by a video resource integrated scheduling system, and signaling transmission among nodes, wherein all resources and services in the nodes are scheduled by the central management server 110; the first-level national gateway server 120 is a gateway for converting an internal private protocol and a national protocol, and can be used as a national upper level and a national lower level; the streaming media forwarding server 130 is responsible for forwarding and distributing audio and video streaming media, and supports a private protocol and a national standard protocol; the storage proxy server 140 is used as a proxy service for system cloud storage, is responsible for video on demand, and simultaneously adds a security layer for interaction between the video storage server 180 and the outside; the video storage server 180 is responsible for storing video resources and is uniformly managed by the central management server 110; the mobile application server 150 provides services for the mobile client, and the mobile transcoding server 160 converts the video file in the streaming media forwarding server 130 into a format that conforms to the mobile playing; the SIP server 170, which is used to interface and convert the lower platforms that are not national standard, and decode the SIP protocol to obtain the video from the streaming media sender;

The second-level SIP server 210 is used for docking and converting lower-level platforms which are not national standards in the second-level platform, and meets the video interface and protocol of the second-level national standard gateway server 220 by decoding the SIP protocol; the second-level national standard gateway server 220 is a gateway for converting a proprietary protocol and a national standard protocol in the second-level platform;

①a basic information registration module:

the subordinate platform needs to Register to the superior platform, the subordinate platform sends Register information, the superior platform analyzes the information, if the user name and the password accord with the information of the subordinate platform stored in the central management server 110, an OK response is returned, a temporary token command ring is distributed, and the token needs to be registered again after the token is over; if the user name and the password do not conform to the information of the subordinate platform, a '401 Unroute' authentication failure response is returned;

the equipment information pushing module:

after the authentication is successful, the superior platform can request directory information to the inferior platform, the superior platform sends a query command, and the inferior platform returns a response, including queried equipment directory information, wherein the equipment information includes an equipment number, a channel number, an affiliated organization structure and longitude and latitude.

2. The integrated scheduling system of video resources based on the private transportation network as claimed in claim 1, wherein: the system further comprises the following modules:

thirdly, the video stream forwarding module:

fourthly, a real-time streaming module:

after the client issues the real-time streaming opening instruction, the central management server 110 transmits the streaming opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information transmitted by the first-level national gateway server 120 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a playing instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national gateway server 120, and the audio and video stream is sent to the streaming media forwarding server 130 by the first-level national gateway server 120 and then forwarded to the client, so that real-time streaming is finally realized;

The video publishing module:

3. The video resource integrated scheduling system based on the private transportation network as claimed in claim 1 or 2, wherein: the system further comprises the following modules:

sixth, the cradle head control module:

And a video viewing module:

after the client sends a video query instruction, the central management server 110 sends the instruction to the storage proxy server 140, and the storage proxy server 140 forwards the instruction to the video storage server 180; the client sends a video recording opening instruction, the central management server 110 sends the opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the storage proxy server 140, and the storage proxy server 140 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information transmitted by the storage proxy server 140 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a play instruction to the central management server 110, the streaming media forwarding server 130, the storage proxy server 140, the video storage proxy server, and the audio and video stream is sent to the storage proxy server 140, the streaming media forwarding server 130, the client by the video storage server 180, so that the video viewing is finally realized.

4. The integrated scheduling system of video resources based on the private transportation network as claimed in claim 1, wherein: and the five department platforms of the secondary platform are a road network center, a maritime office, a long voyage office, a Beijing city platform and a Shenzhen city platform.

5. The video resource integrated scheduling system based on the private transportation network of claim 1, wherein: the general video streaming protocol set by the SIP server 170 includes the GB/T28181 protocol, or ONVIF.

6. A video resource integrated scheduling method based on a special traffic network runs in a video resource integrated scheduling system based on the special traffic network, and the system comprises three stages from top to bottom: the first-level platform is a department-level video resource integrated scheduling platform, the second-level platform comprises five department platforms, the third-level platform is a plurality of subordinate unit platforms in the five departments, and each subordinate unit platform is respectively connected with a plurality of video image acquisition points of a monitoring site in a butt joint mode, and the video image acquisition system is characterized in that:

the server arranged on the primary platform comprises: the system comprises a central management server 110, a first-level national standard gateway server 120, a streaming media forwarding server 130, a storage proxy server 140, a mobile terminal application server 150, a mobile terminal transcoding server 160, a first-level SIP server 170 and a video storage server 180;

the central management server 110 is responsible for configuring a database, distributing access user names and passwords, basic information, service information and user permissions required by the video resource integrated scheduling system for corresponding lower platforms, and signaling transmission among nodes, wherein all resources and services in the nodes are scheduled by the central management server 110; the first-level national gateway server 120 is a gateway for converting an internal private protocol and a national standard protocol, and can be used as a national standard upper level and a national standard lower level; the streaming media forwarding server 130 is responsible for forwarding and distributing audio and video streaming media, and supports a private protocol and a national standard protocol; the storage proxy server 140 is used as a proxy service for system cloud storage, is responsible for video on demand, and simultaneously adds a security layer for interaction between the video storage server 180 and the outside; the video storage server 180 is responsible for storing video resources and is uniformly managed by the central management server 110; the mobile application server 150 provides services for the mobile client, and the mobile transcoding server 160 converts the video file in the streaming media forwarding server 130 into a format that conforms to the mobile playing; the SIP server 170, which is used to interface and convert the lower platforms that are not national standard, and decode the SIP protocol to obtain the video from the streaming media sender;

the method comprises the following steps of enabling a lower-level platform to be added into the system and pushing monitoring video resources for an upper-level platform:

①a basic information registration step:

and the equipment information pushing step:

7. The integrated scheduling method of video resources based on the private transportation network as claimed in claim 6, wherein: the method further comprises the steps of:

thirdly, video stream forwarding:

fourthly, real-time streaming:

after the client issues the real-time streaming opening instruction, the central management server 110 transmits the streaming opening instruction to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the streaming receiving address information to the central management server 110; the central management server 110 transmits the streaming opening instruction with the streaming address information received by the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the streaming address information to the central management server 110; the central management server 110 transmits an adding instruction with the stream address information transmitted by the first-level national standard gateway server 120 to the stream media forwarding server 130, and the stream media forwarding server 130 returns the stream address information, and then the stream address information is transmitted to the client by the central management server 110; after receiving the streaming address information sent by the streaming media forwarding server 130, the client sends a playing instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and the audio and video stream is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that real-time streaming is finally realized;

A video publishing step:

8. The integrated scheduling method of video resources based on the private transportation network according to claim 6 or 7, characterized in that: the method further comprises the steps of:

sixthly, controlling the cradle head:

after the client issues the pan/tilt control command, the central management server 110 transmits the control command to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns address information to the central management server 110; the central management server 110 transmits a control instruction with address information of the streaming media forwarding server 130 to the first-level national standard gateway server 120, and the first-level national standard gateway server 120 returns the address information to the central management server 110; the central management server 110 transmits an adding instruction with address information of the first-level national standard gateway server 120 to the streaming media forwarding server 130, and the streaming media forwarding server 130 returns the address information and transmits the address information to the client by the central management server 110; after receiving the address information of the streaming media forwarding server 130, the client sends a control instruction to the central management server 110, the streaming media forwarding server 130 and the first-level national standard gateway server 120, and a control result is sent to the streaming media forwarding server 130 by the first-level national standard gateway server 120 and then forwarded to the client, so that the control of the holder is finally realized;

Seventhly, video viewing step:

9. The integrated scheduling method of video resources based on the private transportation network as claimed in claim 6, wherein: and the five department platforms of the secondary platform are a road network center, a maritime office, a long voyage office, a Beijing city platform and a Shenzhen city platform.

10. The integrated scheduling method of video resources based on the private transportation network as claimed in claim 6, wherein: the general video streaming protocol set by the SIP server 170 includes the GB/T28181 protocol, or ONVIF.