CN112866303B

CN112866303B - Method and device for managing cascade media transmission link

Info

Publication number: CN112866303B
Application number: CN202110445687.XA
Authority: CN
Inventors: 张凯; 王开学; 刘勋
Original assignee: Wuhan Zhongke Tongda High New Technology Co Ltd
Current assignee: Wuhan Zhongke Tongda High New Technology Co Ltd
Priority date: 2021-04-25
Filing date: 2021-04-25
Publication date: 2021-07-20
Anticipated expiration: 2041-04-25
Also published as: CN112866303A

Abstract

The application relates to the technical field of media transmission, and provides a method and a device for managing a cascade media transmission link, which comprises the following steps: the method comprises the steps that a lower connection platform receives request information which is sent by a third-party upper connection platform and used for requesting a data stream of a camera, and sends the request information to the upper connection platform; if the upper connection platform determines that the request information is the first request of the data stream of the camera, a session module is established, and the session module provides a request cache list; after determining that the session invitation of the camera is successful, the upper connection platform sends a data stream forwarding request to the media server based on each request message in the request cache list and sends a stream pushing message to the target camera; and the media server distributes corresponding ports for the request information according to the data stream forwarding request, determines corresponding third-party media servers, and distributes the data streams to the corresponding third-party media servers through the ports. Therefore, the cross-region transmission of the data stream of the camera is realized, and the problem of network congestion caused by the output of the data stream of the camera is effectively avoided.

Description

Method and device for managing cascade media transmission link

Technical Field

The embodiment of the application relates to the technical field of media transmission, in particular to a method and a device for managing a cascade media transmission link.

Background

The security monitoring industry is generally applied to GB/T28181, for example, devices in the existing security monitoring system communicate by using a Session Initiation Protocol (SIP) in GB/T28181, so that when a third-party media server requests a data stream of a camera in the security monitoring system, the camera can transmit the data stream to the third-party server. But on the one hand, the transmission of a data stream across an area cannot be realized, and on the other hand, if a plurality of third-party media servers request the data stream, the data stream output of the camera is congested in a network.

Disclosure of Invention

The embodiment of the application provides a method and a device for managing a cascade media transmission link, which can realize cross-region transmission of data streams of a camera and effectively avoid the problem of network congestion caused by output of the data streams of the camera.

In a first aspect, an embodiment of the present application provides a method for managing a cascaded media transmission link, where the method is applied to a cascaded media transmission link management system, the cascaded media transmission link management system includes a plurality of third-party upload platforms, a scheduling center, a media server, and a target camera, the scheduling center includes an upload platform and a plurality of download platforms, and the download platforms correspond to the third-party upload platforms one to one, and the method includes:

the method comprises the steps that a lower connection platform receives request information which is sent by a third-party upper connection platform and used for requesting a data stream of a target camera, and sends the request information to the upper connection platform;

the upper connection platform detects whether a session module corresponding to the target camera exists, if not, a target session module is created based on the target camera, the request information is cached in a target request cache list of the target session module, and in the process that the upper connection platform sends session invitation to the target camera until the session is completed, the received request information of all third-party upper connection platforms aiming at the data stream of the target camera is cached in the target request cache list;

the upper connection platform sends the session invitation to the target camera through the target session module, if a normal state code returned by the target camera based on the session invitation is received through the target session module, a data stream forwarding request is sent to a media server based on each request message in the target request cache list, and a first notification message is sent to the target camera, so that the target camera sends the data stream to the media server; the data flow forwarding request comprises information of each third-party media server appointed by each third-party uploading platform corresponding to each request information;

and the media server allocates corresponding media distribution service ports for the request information based on the data stream forwarding request, and distributes the received data streams to the third-party media servers through the media distribution service ports.

In a second aspect, an embodiment of the present application provides a device for managing a cascaded media transmission link, where the device is applied to a cascaded media transmission link management system, the cascaded media transmission link management system includes a plurality of third-party upload platforms, a scheduling center, a media server, and a target camera, the scheduling center includes an upload platform and a plurality of download platforms, the download platforms are in one-to-one correspondence with the third-party upload platforms, and the device for managing a cascaded media transmission link includes:

a lower connection platform, an upper connection platform and a media server;

the lower connection platform is used for receiving request information which is sent by a third-party upper connection platform and used for requesting the data stream of the target camera, and sending the request information to the upper connection platform;

the upper connection platform is used for detecting whether a session module corresponding to the target camera exists or not, if not, a target session module is created based on the target camera, the request information is cached in a target request cache list of the target session module, and in the process that the upper connection platform sends session invitation to the target camera until the session is completed, the received request information of all third-party upper connection platforms aiming at the data stream of the target camera is cached in the target request cache list; the target session module is used for sending the session invitation to the target camera, if a normal state code returned by the target camera based on the session invitation is received by the target session module, a data stream forwarding request is sent to a media server based on each request message in the target request cache list, and a first notification message is sent to the target camera, so that the target camera sends the data stream to the media server; the data flow forwarding request comprises information of each third-party media server appointed by each third-party uploading platform corresponding to each request information;

and the media server is used for allocating corresponding media distribution service ports to the request information based on the data stream forwarding request and distributing the received data stream to the third-party media servers through the media distribution service ports.

In yet another aspect, embodiments of the present application provide a storage medium including instructions that, when executed on a computer, cause the computer to perform the method of the first aspect.

Compared with the prior art, the scheme provided by the embodiment of the application solves the problem of trans-regional transmission of the data stream based on the design of an upper cascade platform and a lower cascade platform; the request cache list provided by the target session module is used for caching all request information aiming at the data stream of the camera, so that only one path of request needs to be reserved, and the uniqueness of a media link of the camera and a scheduling center is ensured; the distribution advantage brought by the high bandwidth of the media server is fully utilized to solve the problem of insufficient distribution capability caused by the small network bandwidth of the camera. Therefore, the cross-region transmission of the data stream of the camera can be realized, and the problem of network congestion caused by the output of the data stream of the camera is effectively avoided.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.

Fig. 1a is a system architecture diagram illustrating operation of a device for managing cascaded media transmission links according to an embodiment of the present application;

fig. 1b is a schematic diagram illustrating a request cache performed by a request cache list of a session module according to an embodiment of the present application;

fig. 2 is a diagram of a system architecture for managing cascaded media transmission links according to an embodiment of the present application;

fig. 3 is a flowchart of a method for managing a concatenation media transmission link according to an embodiment of the present application;

fig. 4a is a schematic diagram of a hierarchical structure of a cascading platform according to an embodiment of the present disclosure;

fig. 4b is an architecture diagram of a cascaded platform of a dispatch center according to an embodiment of the present application;

fig. 5 is a schematic diagram of a session mapping table according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a device for managing cascaded media transmission links according to an embodiment of the present application.

Detailed Description

The terms "first," "second," and the like in the description and in the claims of the embodiments of the application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or modules is not necessarily limited to those steps or modules expressly listed, but may include other steps or modules not expressly listed or inherent to such process, method, article, or apparatus, such that the division of modules presented in the present application is merely a logical division and may be implemented in a practical application in a different manner, such that multiple modules may be combined or integrated into another system or some features may be omitted or not implemented, and such that couplings or direct couplings or communicative connections shown or discussed may be through interfaces, indirect couplings or communicative connections between modules may be electrical or the like, the embodiments of the present application are not limited. Moreover, the modules or sub-modules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed in a plurality of circuit modules, and some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

The embodiment of the application provides a method for managing a cascade media transmission link, which is applied to a device for managing the cascade media transmission link. The camera can be various cameras which are arranged on a monitoring site and used for information acquisition, coding, processing, storage, transmission and safety control, and a user calls the data stream of the camera through a third-party uploading platform.

The method for managing a cascaded media transmission link provided in this embodiment of the present application is executed by a cascaded media transmission link management device, and the cascaded media transmission link management device can operate in the system architecture described in fig. 1a, please refer to fig. 1a, where fig. 1a is a system architecture diagram of the operation of the cascaded media transmission link management device provided in this embodiment of the present application. As shown in fig. 1a, the system includes a plurality of third-party upload platforms (e.g., a third-party upload platform 1 and a third-party upload platform N), a scheduling center (including an upload platform and a plurality of download platforms, e.g., a download platform 1 and a download platform N, where the download platforms correspond to the third-party upload platforms one to one), a camera, a media server, and a third-party media server, where a link between a third-party upload platform and a corresponding download platform is a Session Initiation Protocol (SIP) link, and belongs to a bidirectional transmission link; the link between the lower connection platform and the upper connection platform is a pipeline link and belongs to a bidirectional transmission link; the link between the upper connection platform and the camera is an SIP link and belongs to a bidirectional transmission link; a link between the uplink platform and the media server is a Transmission Control Protocol (TCP) link, and belongs to a bidirectional Transmission link; a link between the camera and the media server is a video transmission link, such as a User Datagram Protocol (UDP) link (UDP command control link), and belongs to a unidirectional transmission link (from the camera to the media server); two links are arranged between the media server and the third-party media server, and are both UDP links, wherein one UDP link is used for transmitting data streams (data packets); the other UDP link is used to transmit statistical information, such as how many data packets are sent in a unit time, for keep-alive and statistical information between the media server and the third-party media server (mainly, considering that the UDP link is a stateless link, if the third-party media server is disconnected, the media server cannot know the disconnection of the third-party media server from the protocol layer, and thus the link is designed); the media transmission link belongs to a unidirectional transmission link (media server to third party media server).

Based on the system architecture shown in fig. 1a, the embodiment of the present application provides the following cascaded media transmission link management scheme: the third-party upper platform sends request information for requesting a data stream of a camera to a lower platform of a dispatching center, the lower platform converts the request information into binary data and then sends the binary data to the upper platform through a pipeline link, the upper platform judges whether a request corresponding to the binary data is a first request of the data stream of the camera (the upper platform of the dispatching center creates a corresponding session module based on the identification of the camera aiming at the requests of the data streams of different cameras, wherein the session module can be understood as a session, if the session module corresponding to the camera does not exist, the first request is indicated), if the upper platform judges that the request corresponding to the binary data is the first request, the session module is created, the session module provides a request cache list, and the request cache list not only caches the request corresponding to the binary data, subsequently received requests for the camera's data stream are buffered. In addition, the request usually carries a request identifier and a camera identifier, so the request cache list also includes the request identifier and the camera identifier, where the request identifier is used to help the third party upload platform to distinguish which request the corresponding response is. As shown in fig. 1b, fig. 1b is a schematic diagram of performing request caching through a request caching list of a session module according to an embodiment of the present application, and as shown in the figure, a first request (video of a requesting device a) and an nth request (video of the requesting device a) are requested to be cached. It can be seen that the session module is created only by the upper connection platform when the first request is made, and when the subsequent upper connection platform receives the request, the upper connection platform directly caches the request into the request cache list without creating the session module again, so that all the requests of multiple paths of data streams requesting for the same camera are uniformly managed, only 1 path of request is reserved, and the uniqueness of the SIP video link of the dispatching center and the camera is ensured. After the upper platform receives the request corresponding to the binary data, the upper platform sends a session invitation to the camera, after the session invitation is determined to be successful (a normal state code returned by the camera is received), the request cache list is traversed, a data stream forwarding request (carrying information of each third-party media server appointed by each third-party upper platform corresponding to each request information) is sent to the media server based on each request information in the request cache list, and a notification message is sent to the camera, so that the camera sends the data stream to the media server. The media server distributes corresponding media distribution service ports for the request information based on the received data stream request, and distributes the received data stream to each third-party media server through each media distribution service port.

Based on the contents of fig. 1a and fig. 1b, as shown in fig. 2, fig. 2 is an architecture diagram of a cascade media transmission link management system provided in an embodiment of the present application, as can be seen in the diagram, each piece of request information corresponds to one media distribution service port (for example, request 1 corresponds to media distribution service port 1, request N corresponds to media distribution service port N), and each media distribution service port corresponds to one third-party media server (for example, media distribution service port 1 corresponds to third-party media server 1 specified by third upper platform 1, for example, media distribution service port N corresponds to third-party media server N specified by third upper platform N). Based on the cascade media transmission link shown in fig. 2, it is possible to implement cross-region transmission of data streams of the camera, and effectively avoid the problem of network congestion of the camera, and in addition, if the third-party media server is disconnected, because the media server may count how many data packets are sent or how many data streams are sent by the media server within a preset time (unit time), if the media server detects that a data packet is 0 or a data stream is 0, the media server may know that the third-party media server is disconnected, and send a notification message to the upper platform, the upper platform may release a corresponding session module and close a link between the upper platform and the target camera based on the notification message, and send the notification message to the corresponding third-party upper platform to notify that the request is ended.

It should be noted that the contents shown in fig. 1a, fig. 1b and fig. 2 are only an example, and are mainly used to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application.

With reference to the above, the following describes a method for managing a cascaded media transmission link in the present application, please refer to fig. 3, where fig. 3 is a flowchart of a method for managing a cascaded media transmission link according to an embodiment of the present application, where the embodiment of the present application at least includes the following steps:

301, a lower connection platform receives request information which is sent by a third party upper connection platform and used for requesting a data stream of a target camera, and sends the request information to the upper connection platform;

in this embodiment, when a user needs to call a data stream of a certain front-end camera, the user may send, to a download platform of a scheduling center, request information for requesting the data stream of a target camera at a client of a third-party upload platform, where the request information may be sent to the download platform through an SIP link, so that the download platform may receive the request information sent by the third-party upload platform, and then send the received request information to the upload platform.

The upper connection platform (upper connection device) can be understood as a SIP server, and is actively connected with the SIP client side for managing the SIP client side, and one upper connection platform corresponds to a plurality of lower connection platforms. The lower connection platform can be understood as an SIP client end and is actively connected with an SIP server, and one lower connection platform can only be connected with one upper connection platform.

As shown in fig. 4a, fig. 4a is a schematic diagram of a hierarchical structure of a cascading platform according to an embodiment of the present disclosure. In fig. 4a, a provincial platform accesses a city-level platform through an SIP link, the city-level platform accesses a county-level platform through an SIP link, the county-level platform accesses a district-level platform through an SIP link, and the district-level platform accesses actual devices (such as target cameras) corresponding to specific device points through the SIP link. For a provincial platform and a city platform, the provincial platform is an SIP upper link of the city platform, and the city platform is an SIP lower link of the provincial platform; for a city-level platform and a county-level platform, the city-level platform is an SIP upper link of the county-level platform, and the county-level platform is an SIP lower link of the city-level platform; the same is true for actual equipment corresponding to county-level platforms, district-level platforms and specific equipment sites. In the figure, the provincial platform is used as a third party upper link, and the actual equipment corresponding to the specific equipment point location corresponds to a third party lower link.

In some possible embodiments, the step of sending, by the drop-off platform, the request message to the upload platform includes:

the downlink platform converts the request information into binary data;

the lower connection platform sends the binary data to the upper connection platform through a pipeline link;

the request information comprises a request identifier and a camera identifier, the request identifier is used for identifying the request information, and the camera identifier is used for identifying the target camera.

Specifically, after receiving the request information, the lower platform encrypts and performs binary conversion processing on the request information to obtain binary encrypted data, and then sends the binary encrypted data to the upper platform through the pipeline link. It should be noted that, the security of link transmission can be improved by encrypting the request information by using an encryption algorithm.

Referring to fig. 4b, fig. 4b is an architecture diagram of a cascaded platform of a scheduling center according to an embodiment of the present disclosure, as shown in fig. 4b, the scheduling center includes an upper platform (a signaling scheduling service main process) and N lower platforms (signaling scheduling service sub-processes), a link between each of the lower platforms and the upper platform is a pipeline link, each of the lower platforms corresponds to a third-party upper platform, a link between each of the third-party upper platforms and each of the lower platforms is an SIP link, each of the upper platforms corresponds to N third-party lower platforms, and a link between each of the third-party lower platforms and each of the upper platforms is an SIP link. The lower connection platform receives the SIP request in the SIP protocol format sent by the third-party upper connection platform through the SIP link and converts the SIP request into the cascade request message in the binary format. And the cascade request message is sent to the upper connection platform through the pipeline link, the upper connection platform converts the cascade request message from a binary format into an SIP request in an SIP protocol format, and the SIP request is sent to the corresponding third party lower connection platform from the upper connection platform through the SIP link. It can be understood that, after the uplink platform receives the SIP response message in the SIP protocol format sent by the third-party downlink platform through the SIP link, the SIP response message is converted into a response message in the binary format, and the response message is sent to the downlink platform through the pipeline link. And in the lower connection platform, the response message in the binary format is converted into an SIP response message in an SIP protocol format and is sent to the third party upper connection platform through an SIP link.

It should be noted that the reason for dividing the scheduling center into the signaling scheduling service main process and the signaling scheduling service sub-process is at least as follows: (1) if the functions realized in the signaling scheduling service main process and the signaling scheduling service subprocess are realized in one process, when one SIP device, such as one SIP uplink device, is damaged/unavailable/attacked, all related functions in the process can be unavailable/unavailable; if the mode of the signaling scheduling service subprocess and the signaling scheduling service main process is adopted, when the function realized by one signaling scheduling service subprocess is unavailable, the function realized by other signaling scheduling service subprocesses is not influenced, and the safety is improved. (2) If the functions realized in the main process and the subprocess of the signaling scheduling service are realized in one process, codes are mixed, the corresponding realized functions are not independent, the coupling is higher, and the codes are not easy to expand. (3) The request information from a non-third-party cascading platform, such as the request information transmitted by a service terminal through a webpage and sent by a transcoding server, is converted into binary data, so that the scheduling center uniformly processes the binary data, namely for a signaling scheduling service main process of the scheduling center, the fact that the request information is from the request information transmitted by a pipeline or transmitted by the webpage does not need to be known, and because for the signaling scheduling service main process, the request information is binary data, the design ensures the independence of the service, and the low-coupling design is realized.

Further, the method further comprises:

and the upper connection platform adds the target session module to a session mapping table, and the session mapping table is used for representing the corresponding relation between the camera identification and the session module.

Specifically, as shown in fig. 5, fig. 5 is a schematic diagram of a session mapping table provided in this embodiment of the present application, where a camera identifier a corresponds to a session module a (session a), a camera identifier B corresponds to a session module B (session B), the session modules in the session mapping table are used to characterize a GB/T28181 link (SIP link) between a camera and an upper-level platform, the GB/T28181 link is a link a and a link B shown in the figure, the GB/T28181 link relies on a status code, if the status code received by the upper platform is not 200 (indicating that the session invitation failed), the GB/T28181 link needs to be removed from the session mapping table, i.e., the session module needs to be removed, the upper platform removes the relevant session module in the session mapping table, and the message of session invitation failure is notified through the request cache list so as to indicate that the session invitation fails. If the status code received by the upper platform is 200, indicating that the session invitation is successful, the GB/T28181 link is not removed from the session mapping table.

Step 302, the upload platform detects whether a session module corresponding to the target camera exists, if not, a target session module is created based on the target camera, the request information is cached in a target request cache list of the target session module, and in the process that the scheduling center sends a session invitation to the target camera until the session is completed, the received request information of all third-party upload platforms for the data stream of the target camera is cached in the target request cache list;

in this embodiment, after the lower platform sends the request information to the upper platform, the upper platform detects whether a session module corresponding to the target camera exists, if the session module corresponding to the target camera does not exist, it indicates that the request information is the request information for requesting the data stream of the target camera for the first time, then the upper platform creates a target session module based on the target camera, caches the request information in a target request cache list of the target session module, and caches the received request information of all third-party upper platforms for the data stream of the target camera in a target request cache list in a process that the upper platform sends a session invitation to the target camera until the session is completed. It should be noted that the purpose of sending the session invitation to the target camera by the upper connection platform is to coordinate resources, ensure that the camera can send data streams to the media server, and if the session invitation is successful, indicate that the camera can send data streams to the media server.

For example, if there is a request 1 from the third party upload platform 1, a request 2 from the third party upload platform 2, and a request 3 from the third party upload platform 3, simultaneously requesting the data stream of the target camera a, the session module is created only when requested for the first time. Assuming that the request 1 is a first request, when the online platform receives the request 1, a session module is created, and at the same time, the request 1 is stored in a request cache list provided by the session module (including a request identifier of the request 1 and a camera identifier of the target camera a), after the online platform receives the request 2 and the request 3, the request 2 and the request 3 are respectively stored in the request cache list (including the request identifier of the request 2 and the request identifier of the request 3), and all the requests stored in the request cache list correspond to the target camera a.

Considering that the upload platform may receive many request information for the data stream of the target camera in a process of sending a session invitation to the target camera until the session is completed (a process of establishing a data stream transmission link of the target camera), the upload platform may cache the request information in the target request cache list, so as to uniformly manage all requests for requesting the data stream of the same target camera.

The upload platform may send only one session invitation to the target camera, that is, for multiple requests for data streams of the same target camera, the upload platform performs deduplication on the multiple requests, only retains 1 request, sends the session invitation to the target camera based on the 1 request, and distributes the data streams to each third-party upload platform after the media server receives the data streams of the target camera. Namely, the uploading platform can control the data stream to be distributed to a plurality of third-party uploading platforms only by maintaining 1 transmission channel, so that the real-time preview of the real-time data stream of the same camera by the plurality of third-party uploading platforms is realized.

The data stream of the target camera can be called by a cascade platform, the cascade platform sends the data stream to the media server, the cascade platform comprises an upper platform and lower platforms, 1 upper platform can be connected with a plurality of lower platforms, the cascade platform can be composed of a province cascade platform, a city cascade platform and a district cascade platform, the province cascade platform can actively call the data of the city cascade platform, the city cascade platform can actively call the data of the district cascade platform, data transmission is carried out between the platforms based on GB/T28181 signaling, the cascade among the platforms realizes the interconnection and intercommunication among different platforms, and effective resource integration is realized.

In a scenario, on an operation interface where a third-party upload platform is located and capable of calling a data stream of a device, there is a device list that can be seen within a permission range of the third-party upload platform, for example, the device list includes a device 1, a device 2, and a device 3, where the device 1, the device 2, and the device 3 correspond to 3 different front-end cameras respectively. When a user triggers any one of the devices, for example, device 1, an acquisition request (request information) of a data stream of the front-end camera is generated according to the information of the front-end camera corresponding to device 1, and the acquisition request is sent to a downlink platform of a scheduling center.

It should be noted that the data stream may be a real-time data stream or a historical data stream, and the request information generally carries front-end identification information (target camera identification) of the target camera. If the data stream is a real-time data stream, the uplink platform of the scheduling center stores the front-end identification information of the target camera corresponding to the data stream, and the transmission of the real-time data stream can be understood as 1-to-N link transmission; if the data stream is a historical data stream, the uplink platform of the scheduling center stores the front-end identification information of the target camera corresponding to the data stream, assigns a static value and stores the static value, and the transmission of the historical data stream can be understood as 1-to-1 link transmission. For example, if there are 4 historical data streams for acquiring the front-end camera 1, the uplink platform of the dispatch center stores four sets of information: (front-end camera 1, static value 1), (front-end camera 1, static value 2), (front-end camera 1, static value 3), (front-end camera 1, static value 4); if 4 real-time data streams of the front-end camera 1 are acquired, the uplink platform of the dispatching center stores the following group of information: (front end camera 1).

In some possible embodiments, the method further comprises:

if the upper connection platform detects that a session module corresponding to the target camera exists, caching the request information into a request cache list of the session module, and sending a registration request of a media distribution service port to the media server based on the request information in the request cache list.

Specifically, if the presence of a session module corresponding to the target camera is detected by the upload platform, which indicates that the current request information is not a first request, the upload platform sends a data stream transcoding request (carrying information of a third-party media server specified by the third-party upload platform corresponding to the request information, such as an address of the third-party media server and a receiving port of the third-party media server for receiving a data stream, of the third-party media server) to the media server based on the request information in the request cache list, so that the media server allocates a corresponding media distribution service port for the request information, and determines the corresponding third-party media server, which is convenient for a subsequent media server to send a data stream to the corresponding third-party media server through the media distribution service port. In addition, the upload platform needs to add request information to the request cache list of the session module (including request identification (handle)) to help the upload platform distinguish which request corresponds to.

Step 303, the upload platform sends the session invitation to the target camera through the target session module, and if a normal status code returned by the target camera based on the session invitation is received through the target session module, sends a data stream forwarding request to a media server based on each request information in the target request cache list, and sends a first notification message to the target camera, so that the target camera sends the data stream to the media server; the data flow forwarding request comprises information of each third-party media server appointed by each third-party uploading platform corresponding to each request information;

in this embodiment, the target session module sends a session invitation to the target camera, and if the target session module receives a normal status code returned by the target camera based on the session invitation (indicating that the session invitation is successful and the target camera can send a data stream), the target platform traverses each request message in the target request cache list, and sends a data stream forwarding request to the media server according to each traversed request message, so that the media server allocates a corresponding media distribution service port to each request message, determines each corresponding third-party media server, and sends an Acknowledgement (ACK) message to the target camera to notify the target camera that the target camera can start sending the data stream.

After receiving the session invitation sent by the upper connection platform, if the target camera determines that the data stream can be sent, the target camera returns a status code of the target camera to the upper connection platform, where the status code is also called an error code and refers to a three-digit code allocated to each request received by the camera, and for example, the status code is 200, which indicates that the device is normal, and the status code is 404, which indicates that the device is not online. The main purpose of the target camera returning the status code to the uplink platform is as follows: 1. informing the upper connection platform whether the session invitation is reasonable and legal; 2. the upload platform is informed whether the target camera can handle the session invitation normally.

It should be noted that, after the upload platform receives the request information, the upload platform may obtain the target camera identifier carried in the request information, and the upload platform may cache the target camera identifier, and may perform caching in a key manner.

In some possible embodiments, the method further comprises:

and if the upper connection platform receives the abnormal state code returned by the target camera based on the session invitation through the target session module, the lower connection platform releases the target session module, generates a request failure message, and sends the request failure message to each lower connection platform corresponding to each request message in the target request cache list, so that the request failure message is sent to each third-party upper connection platform through each lower connection platform.

Specifically, if the target session module receives an abnormal status code (indicating that the session invitation fails) returned by the target camera based on the session invitation, the target session module is released by the upload platform, and a request failure message is generated by the upload platform and sent to each download platform corresponding to each request message in the target request cache list, so that the request failure message is sent to each third-party upload platform through each download platform. Therefore, after the third-party uplink platform receives the status code, the link transmission status of the current data stream is known, if the status code is 404, the link transmission establishment of the current data stream is failed, the third-party uplink platform knows that the current data stream is not required to be continuously acquired, if the status code is 200, the link transmission establishment of the current data stream is successful, and the third-party uplink platform can acquire the current data stream in a waiting manner, so that perfect status notification is realized before the third-party uplink platform receives the data stream, and the third-party uplink platform can conveniently know the link transmission status of the current data stream.

In some possible embodiments, the step of sending, by the upload platform, the first notification message to the target camera includes:

the upper connection platform sends the normal state code to the third party triple platform through the lower connection platform;

the upper connection platform receives confirmation information returned by the third party triple platform through the lower connection platform;

the upload platform sends a first notification message to the target camera based on the confirmation information.

Specifically, after receiving the normal state code, the uplink platform needs to send the normal state code to the third-party uplink platform through the downlink platform, the third-party uplink platform obtains that the link transmission of the current data stream is successfully established after receiving the normal state code, and then returns confirmation information to the downlink platform, the downlink platform returns the confirmation information to the uplink platform, and after receiving the confirmation information, the uplink platform sends a stream pushing message to the target camera, so that the target camera starts sending the data stream. Therefore, before sending the plug-flow message to the target camera, the upload platform needs to acquire the confirmation information of the third-party upload platform.

Step 304, the media server allocates corresponding media distribution service ports to the request information based on the data stream forwarding request, and distributes the received data stream to the third-party media servers through the media distribution service ports.

In this embodiment, after receiving a data stream forwarding request sent by the uplink platform based on each request information, the media server allocates a corresponding media distribution service port to each request information, determines each corresponding third-party media server, and distributes the received data stream to each third-party media server through each media distribution service port.

It should be noted that the media server is adopted to distribute the data stream because the camera bandwidth is small and the media server has a high network bandwidth and thus has an extremely strong distribution capability.

It should be noted that, the media server may provide a plurality of media distribution service controls, each media distribution service control provides a media distribution service port, and the media distribution service controls mainly have the following two functions: 1. and the system is used for transferring the data stream received by the media server to a specified third-party media server, and 2, monitoring whether the data stream transmission link with the third-party media server is disconnected.

In some possible embodiments, after the step of distributing, by the media server, the received data stream to the third-party media server specified by each third-party upload platform corresponding to each request message through each media distribution service port, the method further includes:

and if the media server detects that the target camera stops sending the data stream, sending a second notification message to the upper connection platform, so that the upper connection platform releases the target session module and closes a link between the upper connection platform and the target camera based on the second notification message.

Specifically, if the media server detects that the target camera stops sending the data stream, which indicates that the source of the data stream is cut off, the media server sends a notification message to the upload platform to notify the upload platform to release the target session module and close a link between the upload platform and the target camera.

if the media server detects that the number of the distribution objects of each media distribution service port is 0, sending a third notification message to the upper connection platform, so that the upper connection platform releases the target session module and closes a link between the upper connection platform and the target camera based on the third notification message.

Specifically, if the media server detects that the number of distribution objects of each media distribution service port is 0, which indicates that no third-party upload platform requests the data stream of the target camera currently, the media server sends a notification message to the upload platform to notify the upload platform to release the target session module and close a link between the upload platform and the target camera. It should be noted that the media server provides a plurality of media distribution service controls, each media distribution service control provides one media distribution service port, and each media distribution service port is used to transmit a data stream to a corresponding distribution object (a third-party media server).

the media server counts the transmission quantity of the data stream within a preset time length;

if the media server determines that the transmission quantity is 0, a fourth notification message is sent to the upper connection platform, so that the upper connection platform releases the target session module and closes a link between the upper connection platform and the target camera based on the fourth notification message.

Specifically, the media server may count the transmission amount (or the transmission number of data packets) of the data stream sent by each media distribution service port within a preset time duration (for example, a unit time), and if the transmission amount of the data stream sent by all the media distribution service ports is 0, it indicates that there is no data stream of the target camera requested by the third-party uplink platform, so the media server sends a notification message to the uplink platform to notify that the uplink platform may release the target session module and close the link between the uplink platform and the target camera. It can be understood that the upload platform also sends a notification message to the corresponding third-party upload platform through the download platform to notify that the request is finished.

In the embodiment, the cross-region transmission of the data stream is solved based on the design of the upper and lower cascade platforms; the request cache list provided by the target session module is used for caching all request information aiming at the data stream of the camera, so that only one path of request needs to be reserved, and the uniqueness of a media link of the camera and a scheduling center is ensured; the distribution advantage brought by the high bandwidth of the media server is fully utilized to solve the problem of insufficient distribution capability caused by the small network bandwidth of the camera. Therefore, the cross-region transmission of the data stream of the camera can be realized, and the problem of network congestion caused by the output of the data stream of the camera is effectively avoided.

In order to better implement the above solution of the embodiment of the present application, the following provides a related apparatus for implementing the above solution, which is applied to a cascaded media transmission link management system, where the cascaded media transmission link management system includes a plurality of third-party upload platforms, a scheduling center, a media server, and a target camera, the scheduling center includes an upload platform and a plurality of download platforms, and the download platforms correspond to the third-party upload platforms one to one, please refer to fig. 6, where fig. 6 is a schematic structural diagram of an apparatus for managing a cascaded media transmission link provided in an embodiment of the present application, and the apparatus for managing a cascaded media transmission link includes:

a lower platform 601, an upper platform 602, and a media server 603;

the lower connection platform 601 is configured to receive request information, which is sent by a third-party upper connection platform and used for requesting a data stream of a target camera, and send the request information to the upper connection platform 602;

the upper platform 602 is configured to detect whether a session module corresponding to the target camera exists, if not, create a target session module based on the target camera, cache the request information in a target request cache list of the target session module, and cache the received request information of the data stream of the target camera by all third-party upper platforms in the process that the upper platform 602 sends a session invitation to the target camera until the session is completed in the target request cache list; and is configured to send the session invitation to the target camera through the target session module, and if a normal status code returned by the target camera based on the session invitation is received through the target session module, send a registration request of a media distribution service port to a media server 603 based on each request information in the target request cache list, and send a first notification message to the target camera, so that the target camera sends the data stream to the media server 603;

the media server 603 is configured to allocate, based on the registration request, each corresponding media distribution service port to each piece of request information, and distribute, through each media distribution service port, the received data stream to a third-party media server specified by each third-party upload platform corresponding to each piece of request information.

In this embodiment, the request cache list provided by the target session module is used to cache all request information for the data stream of the camera, so that only one path of request needs to be reserved, and uniqueness of the media link between the scheduling center and the camera is ensured. The distribution advantage brought by the high bandwidth of the media server is fully utilized to solve the problem of insufficient distribution capability caused by the small network bandwidth of the camera. Therefore, the flow of acquiring the data stream of the camera can be simplified on the whole, and the problem of network congestion of the camera is effectively avoided.

Optionally, in some possible embodiments of the present application, the download platform 601 is specifically configured to convert the request information into binary data; sending the binary data to an uplink platform through a pipeline link; the request information comprises a request identifier and a camera identifier, the request identifier is used for identifying the request information, and the camera identifier is used for identifying the target camera.

Optionally, in some possible embodiments of the present application, the download platform 601 is further configured to add the target session module to a session mapping table, where the session mapping table is used to characterize a correspondence between a camera identifier and a session module.

Optionally, in some possible embodiments of the present application, the upload platform 602 is further configured to, if it is detected that a session module corresponding to the target camera exists, cache the request information in a request cache list of the session module, and send a registration request of a media delivery service port to the media server based on the request information in the request cache list.

Optionally, in some possible embodiments of the present application, the upload platform 602 is specifically configured to send the normal status code to the third party upload platform through the download platform; receiving Acknowledgement (ACK) information returned by the third-party triple platform through the downlink platform; sending a first notification message to the target camera based on the ACK information.

Optionally, in some possible embodiments of the present application, the upload platform 602 is further configured to release the target session module, generate a request failure message, and send the request failure message to each download platform 601 corresponding to each request information in the target request cache list if the target session module receives an abnormal status code returned by the target camera based on the session invitation, so that the request failure message is sent to each third-party upload platform through each download platform 601.

Optionally, in some possible embodiments of the present application, the media server 603 is further configured to send a second notification message to the online platform 602 if it is detected that the target camera stops sending the data stream, so that the online platform 602 releases the target session module and closes a link between the online platform 602 and the target camera based on the second notification message.

Optionally, in some possible embodiments of the present application, the media server 603 is further configured to send a third notification message to the upper platform 602 if it is detected that the registration amount of each media distribution service port is 0, so that the upper platform 602 releases the target session module and closes a link between the upper platform 602 and the target camera based on the third notification message.

Optionally, in some possible embodiments of the present application, the media server 603 is specifically configured to receive the data stream through each media distribution service port; performing packet loss detection, rearrangement, packet packing and packaging on the data stream to obtain a media serialization packet; and distributing the media serialization packet to a third-party media server appointed by each third-party uploading platform corresponding to each request message through each media distribution service port.

In another aspect, embodiments of the present application further provide a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented by a processor to perform the method provided by the foregoing embodiments, for example, including: the method comprises the steps that a lower connection platform receives request information which is sent by a third-party upper connection platform and used for requesting a data stream of a target camera, and sends the request information to the upper connection platform; the upper connection platform detects whether a session module corresponding to the target camera exists, if not, a target session module is created based on the target camera, the request information is cached in a target request cache list of the target session module, and in the process that the upper connection platform sends session invitation to the target camera until the session is completed, the received request information of all third-party upper connection platforms aiming at the data stream of the target camera is cached in the target request cache list; the upper connection platform sends the session invitation to the target camera through the target session module, if a normal state code returned by the target camera based on the session invitation is received through the target session module, a data stream forwarding request is sent to a media server based on each request message in the target request cache list, and a first notification message is sent to the target camera, so that the target camera sends the data stream to the media server; the data flow forwarding request comprises information of each third-party media server appointed by each third-party uploading platform corresponding to each request information; and the media server allocates corresponding media distribution service ports for the request information based on the data stream forwarding request, and distributes the received data streams to the third-party media servers through the media distribution service ports.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.

The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may be stored in a computer readable storage medium.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product.

The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the present application are generated in whole or in part when the computer program is loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can store or a data storage device, such as a server, a data center, etc., that is integrated with one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

The technical solutions provided by the embodiments of the present application are introduced in detail, and the principles and implementations of the embodiments of the present application are explained by applying specific examples in the embodiments of the present application, and the descriptions of the embodiments are only used to help understanding the method and core ideas of the embodiments of the present application; meanwhile, for a person skilled in the art, according to the idea of the embodiment of the present application, there may be a change in the specific implementation and application scope, and in summary, the content of the present specification should not be construed as a limitation to the embodiment of the present application.

Claims

1. A method for managing a cascade media transmission link is characterized in that the method is applied to a cascade media transmission link management system which comprises a plurality of third-party upper connection platforms, a scheduling center, a media server and a target camera, wherein the scheduling center comprises an upper connection platform and a plurality of lower connection platforms, the lower connection platforms correspond to the third-party upper connection platforms one by one, a link between the third-party upper connection platform and the corresponding lower connection platform is a session initiation protocol link, a link between the lower connection platform and the upper connection platform is a pipeline link, a link between the upper connection platform and the camera is a session initiation protocol link, a link between the upper connection platform and the media server is a transmission control protocol link, a link between the media server and the camera is a video transmission link, and a user datagram transmission protocol link is arranged between the media server and the third-party media server, the method comprises the following steps:

the method comprises the steps that a lower connection platform receives request information which is sent by a third-party upper connection platform and used for requesting a data stream of a target camera, and sends the request information to the upper connection platform; the downlink platform converts the request information into binary data; the lower connection platform sends the binary data to the upper connection platform through a pipeline link; wherein the request information comprises a request identifier and a camera identifier, the request identifier is used for identifying the request information, and the camera identifier is used for identifying the target camera;

the upper connection platform detects whether a session module corresponding to the target camera exists, if not, a target session module is created based on the target camera, the request information is cached in a target request cache list of the target session module, and in the process that the upper connection platform sends session invitation to the target camera until the session is completed, the received request information of all third-party upper connection platforms aiming at the data stream of the target camera is cached in the target request cache list; if the upper connection platform detects that a session module corresponding to the target camera exists, caching the request information into a request cache list of the session module, and sending a data stream forwarding request to the media server based on the request information in the request cache list;

2. The method of claim 1, wherein the method further comprises:

3. The method for cascade media transmission link management as claimed in claim 1, wherein the step of the upper platform sending the first notification message to the target camera comprises:

the uplink platform sends the normal state code to the third-party uplink platform through the downlink platform;

the third-party upper connection platform receives confirmation information returned by the third-party upper connection platform through the lower connection platform;

4. The method for cascaded media transmission link management according to any of claims 1-3, wherein the method further comprises:

and if the upper connection platform receives the abnormal state code returned by the target camera based on the session invitation through the target session module, the upper connection platform releases the target session module, generates a request failure message, and sends the request failure message to each lower connection platform corresponding to each request message in the target request cache list, so that the request failure message is sent to each third-party upper connection platform through each lower connection platform.

5. The method for managing cascaded media transmission links according to any one of claims 1 to 3, wherein after the step of distributing, by the media server, the received data stream to the third-party media server specified by each third-party upload platform corresponding to each request message through each media distribution service port, the method further comprises:

6. The method for managing cascaded media transmission links according to any one of claims 1 to 3, wherein after the step of distributing, by the media server, the received data stream to the third-party media server specified by each third-party upload platform corresponding to each request message through each media distribution service port, the method further comprises:

7. The method for managing cascaded media transmission links according to any one of claims 1 to 3, wherein after the step of distributing, by the media server, the received data stream to the third-party media server specified by each third-party upload platform corresponding to each request message through each media distribution service port, the method further comprises:

8. A cascade media transmission link management device is characterized in that the device is applied to a cascade media transmission link management system which comprises a plurality of third-party upper connection platforms, a scheduling center, a media server and a target camera, wherein the scheduling center comprises an upper connection platform and a plurality of lower connection platforms, the lower connection platforms correspond to the third-party upper connection platforms one by one, a link between the third-party upper connection platform and the corresponding lower connection platform is a session initiation protocol link, a link between the lower connection platform and the upper connection platform is a pipeline link, a link between the upper connection platform and the camera is a session initiation protocol link, a link between the upper connection platform and the media server is a transmission control protocol link, a link between the media server and the camera is a video transmission link, and a user datagram transmission protocol link is arranged between the media server and the third-party media server, the cascade media transmission link management device comprises:

a lower connection platform, an upper connection platform and a media server;

the lower connection platform is used for receiving request information which is sent by a third-party upper connection platform and used for requesting the data stream of the target camera, and sending the request information to the upper connection platform; the downlink platform converts the request information into binary data; the lower connection platform sends the binary data to the upper connection platform through a pipeline link; wherein the request information comprises a request identifier and a camera identifier, the request identifier is used for identifying the request information, and the camera identifier is used for identifying the target camera;

the upper connection platform is used for detecting whether a session module corresponding to the target camera exists or not, if not, a target session module is created based on the target camera, the request information is cached in a target request cache list of the target session module, and in the process that the upper connection platform sends session invitation to the target camera until the session is completed, the received request information of all third-party upper connection platforms aiming at the data stream of the target camera is cached in the target request cache list; if the upper connection platform detects that a session module corresponding to the target camera exists, caching the request information into a request cache list of the session module, and sending a data stream forwarding request to the media server based on the request information in the request cache list; the target session module is used for sending the session invitation to the target camera, if a normal state code returned by the target camera based on the session invitation is received by the target session module, a data stream forwarding request is sent to a media server based on each request message in the target request cache list, and a first notification message is sent to the target camera, so that the target camera sends the data stream to the media server; the data flow forwarding request comprises information of each third-party media server appointed by each third-party uploading platform corresponding to each request information;