CN111836020B

CN111836020B - Code stream transmission method and device in monitoring system and storage medium

Info

Publication number: CN111836020B
Application number: CN202010706880.XA
Authority: CN
Inventors: 孔备; 张磊磊; 丁文雅; 张宝卿
Original assignee: Suzhou Keda Special Video Co ltd; Suzhou Keda Technology Co Ltd
Current assignee: Suzhou Keda Special Video Co ltd; Suzhou Keda Technology Co Ltd
Priority date: 2020-07-21
Filing date: 2020-07-21
Publication date: 2022-03-18
Anticipated expiration: 2040-07-21
Also published as: CN111836020A

Abstract

The application relates to a code stream transmission method, a device and a storage medium in a monitoring system, belonging to the technical field of communication, wherein the method comprises the following steps: setting control components in the multi-stage monitoring subsystem, wherein each stage of control component acquires the packet loss rate sent by each client at a corresponding stage and sends the packet loss rate to the control component at the uppermost stage step by step; determining whether the cross-level transmission path has network congestion or not by the uppermost-level control assembly according to the packet loss rate, and generating a code stream adjusting instruction to adjust and monitor the code stream when the network congestion exists; the problems that the bandwidth between the upper and lower monitoring platforms has an upper limit, and code stream transmission delay, monitoring picture blocking or mosaic occurrence possibly exist can be solved; the control component can adaptively adjust the monitoring code stream to adjust the bandwidth resource occupied by the monitoring code stream, so that the problems of code stream transmission delay, blockage of a monitoring picture or mosaic occurrence caused by limited bandwidth between an upper monitoring platform and a lower monitoring platform can be avoided, and the transmission effect of the monitoring code stream is ensured.

Description

Code stream transmission method and device in monitoring system and storage medium

Technical Field

The application relates to a code stream transmission method, a code stream transmission device and a storage medium in a monitoring system, and belongs to the technical field of communication.

Background

Video surveillance systems generally include: monitoring equipment (such as an analog camera or a network camera), a monitoring platform, a client and the like. After the monitoring device is connected to the monitoring platform through a standard protocol, the monitoring device can compress (also called code stream) the acquired audio and video signals and send the compressed (also called code stream) to the monitoring platform through a network, and the monitoring platform can forward the code stream to the client.

The monitoring platforms can be deployed in a multi-stage cascade mode. When a client directly connected with an upper monitoring platform monitors the image of a lower monitoring device connected with a lower monitoring platform, the monitoring device sends a monitoring code stream to the lower monitoring platform, the lower monitoring platform forwards the monitoring code stream to a higher monitoring platform, and the higher monitoring platform forwards the monitoring code stream to a higher client.

Because the bandwidth between the upper and lower monitoring platforms has an upper limit, at this time, the problems of code stream transmission delay, blockage of a monitoring picture or mosaic may exist.

Disclosure of Invention

The application provides a code stream transmission method, a device and a storage medium in a monitoring system; the problem that the bandwidth between upper and lower monitoring platforms has an upper limit, and the problems of code stream transmission delay, blockage of a monitoring picture or mosaic occurrence can be solved. The application provides the following technical scheme:

in a first aspect, a code stream transmission method in a monitoring system is provided, the monitoring system comprises a plurality of stages of monitoring subsystems, and each stage of monitoring subsystem is in communication connection with a control component; the method is used in an ith-level control assembly which is in communication connection with an ith-level monitoring subsystem, wherein the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1; the method comprises the following steps:

acquiring a packet loss rate reported by an i-1 level control component, wherein the packet loss rate comprises the packet loss rate of at least one level subordinate monitoring subsystem of the i level monitoring subsystem;

determining whether a cross-level transmission path in the monitoring system has network congestion according to the packet loss rate, wherein the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and the client belong to different levels of monitoring subsystems; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path;

and sending the code stream adjustment signaling to the i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path.

Optionally, when the cross-level transmission path includes at least one segment of target sub-transmission path and network congestion exists, the generating a code stream adjustment signaling when the cross-level transmission path has network congestion includes:

for each cross-level transmission path comprising the target sub-transmission path, determining a client with the lowest level corresponding to each cross-level transmission path, wherein the level of the client is determined according to the level of a monitoring subsystem where the client is located;

acquiring a first expected resolution of the client with the lowest level;

and generating the code stream adjusting signaling based on the first expected resolution, wherein the code stream adjusting signaling is used for controlling a control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitoring code stream of the client with the lowest level based on the first expected resolution.

Optionally, when the levels of the clients corresponding to the respective cross-level transmission paths are the same, generating a code stream adjustment signaling when there is network congestion in the cross-level transmission paths includes:

acquiring a second expected resolution and a user permission level of the client with the same level;

generating the code stream adjustment signaling for at least two clients with different user permission levels and the same level based on the user permission levels and the second expected resolution; and the code stream adjustment signaling is used for controlling the control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitoring code stream of the client with the same level based on the second expected resolution in sequence according to the sequence from the low level to the high level of the user authority level.

Optionally, when the user permission levels of the clients having the same levels are the same, generating a code stream adjustment signaling when network congestion exists in the cross-level transmission path includes:

acquiring the code stream request sequence of the clients with the same level; generating the code stream adjustment signaling based on the code stream request sequence and the second expected resolution; the code stream adjusting signaling is used for controlling a control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitoring code stream of the client with the same level according to the sequence of the first-to-last code stream requests and based on the second expected resolution in sequence;

alternatively, the first and second electrodes may be,

generating a random adjustment sequence of the clients with the same level; generating the code stream adjustment signaling based on the random adjustment sequence and the second expected resolution; and the code stream adjustment signaling is used for controlling the control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitoring code stream of the client with the same level sequentially based on the second expected resolution according to the sequence indicated by the random adjustment sequence from first to last.

Optionally, before obtaining the packet loss rate reported by the i-1 th-level control component, the method further includes:

receiving a resolution indicating signaling sent by the i-1 level control component, wherein the resolution indicating signaling is used for indicating the expected resolution when the i-1 level client requests to monitor the code stream and/or indicating the expected resolution when a lower-level client of the i-1 level client requests to monitor the code stream;

and/or the presence of a gas in the gas,

receiving resolution indicating information sent by an ith-level client when the ith-level client requests to monitor a code stream, wherein the resolution indicating information is used for indicating the expected resolution of the ith-level client.

Optionally, when the code stream adjustment signaling is used for adjusting the monitoring code stream transmitted by the i-1 th level monitoring subsystem; the ith monitoring subsystem comprises an ith client for requesting a lower-level monitoring code stream and an ith monitoring platform which is respectively in communication connection with the ith client and an ith-1 monitoring platform in the ith-1 monitoring subsystem; after the sending the code stream adjustment signaling to the i-1 th level control component, the method further includes:

receiving an adjustment feedback signaling and an adjusted monitoring code stream sent by the i-1 level control component, wherein the adjustment feedback signaling is generated after the i-1 level control component adjusts the code stream in the i-1 level monitoring subsystem according to the code stream adjustment signaling;

sending the adjustment feedback signaling and the adjusted monitoring code stream to an i-th-level client indicated by the code stream adjustment signaling, so that the i-th-level client outputs a code stream adjustment prompt according to the adjustment feedback signaling and outputs the adjusted monitoring code stream; the code stream adjustment prompt is used for indicating that the resolution of the monitoring code stream currently displayed by the i-th-level client is lower than the expected resolution;

and calling a forwarding stopping interface of the i-th level monitoring platform to enable the i-th level monitoring platform to stop sending the monitoring code stream to the i-th level client indicated by the code stream adjusting signaling.

receiving login information sent by an ith-level client so that the ith-level client logs in the ith-level control component; and/or the presence of a gas in the gas,

receiving login information reported by an i-1 level control component;

and the login information comprises the user authority level of the corresponding client.

In the embodiment, the control assemblies are arranged in the multi-stage monitoring subsystem, and each stage of control assembly acquires the packet loss rate sent by the client at the corresponding stage and sends the packet loss rate to the control assembly at the highest stage by stage; determining whether network congestion exists in a cross-level transmission path or not by the control assembly at the uppermost level according to the packet loss rate, and adjusting the monitoring code stream when the network congestion exists; the problems that the bandwidth between the upper and lower monitoring platforms has an upper limit, and code stream transmission delay, monitoring picture blocking or mosaic occurrence possibly exist can be solved; the control component can adaptively adjust the monitoring code stream to adjust the bandwidth resource occupied by the monitoring code stream, so that the problems of code stream transmission delay, blockage of a monitoring picture or mosaic occurrence caused by limited bandwidth between an upper monitoring platform and a lower monitoring platform can be avoided, and the transmission effect of the monitoring code stream is ensured.

In addition, the code stream transmission method provided by the application mainly depends on the control SDK and the universal transcoding server provided by the monitoring platform manufacturer, the service of the monitoring platform is not required to be modified, theoretically, the code stream transmission method can be simply modified and then expanded to support more levels of cascading, and is suitable for most monitoring equipment manufacturers.

In addition, the resolution of the monitoring code stream is adjusted according to the level relation of the client, the user authority level relation when the level relation of the client is the same and the request sequence when the user authority level is the same, so that the high-authority user can be guaranteed to occupy bandwidth resources preferentially, and the actual monitoring requirement is met.

In a second aspect, a code stream transmission method in a monitoring system is provided, where the monitoring system includes multiple stages of monitoring subsystems, and each stage of monitoring subsystem is in communication connection with a control component; the method is used in a kth-level control assembly in communication connection with a kth-level monitoring subsystem, wherein the ith-level control assembly is the control assembly at the current uppermost level, k is more than or equal to 1 and is less than i, and i is an integer more than 1; the method comprises the following steps:

receiving a first packet loss rate sent by a kth-level client in the kth-level monitoring subsystem, and/or receiving a second packet loss rate sent by a next-level control assembly of the kth-level control assembly; the second packet loss rate sent by the lower monitoring device is sent by a client connected with the lower control component in a communication manner;

sending the first packet loss rate and/or the second packet loss rate to a (k + 1) th-level control assembly, so that the (k + 1) th-level control assembly sends the first packet loss rate and/or the second packet loss rate to the i-level control assembly step by step, and the i-level control assembly determines whether network congestion exists in a cross-level transmission path in the monitoring system according to the packet loss rate; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; sending the code stream adjustment signaling to the i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

when a target sub-transmission path with network congestion on the cross-level transmission path comprises the kth level monitoring subsystem, receiving a code stream adjustment signaling sent by a kth +1 level control component; the code stream adjustment signaling comprises a client identifier;

when the kth-level monitoring subsystem is the lowest-level monitoring subsystem on the target sub-transmission path, adjusting a monitoring code stream corresponding to the client identifier in the kth-level monitoring subsystem according to the code stream adjustment signaling to obtain an adjusted monitoring code stream; generating an adjustment feedback signaling; sending the adjustment feedback signaling and the adjusted monitoring code stream to the (k + 1) th level control component;

when the kth-level monitoring subsystem is the highest-level monitoring subsystem on the target sub-transmission path, receiving an adjustment feedback signaling and an adjusted monitoring code stream sent by the kth-1-level monitoring subsystem; and sending the adjustment feedback signaling and the adjusted monitoring code stream to a client corresponding to the client identifier.

Optionally, the sending the adjustment feedback signaling and the adjusted monitoring code stream to the client corresponding to the client identifier includes:

when the client corresponding to the client identifier is a kth-level client, sending the adjustment feedback signaling and the adjusted monitoring code stream to the kth-level client corresponding to the client identifier;

and when the client corresponding to the client identification is not the kth-level client, sending the adjustment feedback signaling and the adjusted monitoring code stream to a kth + 1-level control component, so as to send the adjustment feedback signaling and the adjusted monitoring code stream to the client corresponding to the client identification through the kth + 1-level control component.

Optionally, the kth-level monitoring subsystem includes a kth-level monitoring platform for receiving and forwarding a monitoring code stream; when the client corresponding to the client identifier is the kth-level client, the method further includes:

sending the adjustment feedback signaling and the adjusted monitoring code stream to a (k + 1) th level control component;

and calling a forwarding stopping interface of the kth-level monitoring platform to enable the kth-level monitoring platform to stop sending the monitoring code stream to the kth-level client corresponding to the client identification.

Optionally, the kth-level monitoring subsystem includes a kth-level transcoding device and a kth-level monitoring platform for receiving and forwarding a monitoring code stream; adjusting the monitoring code stream corresponding to the client identifier in the kth level monitoring subsystem according to the code stream adjustment signaling to obtain an adjusted monitoring code stream, including:

calling a code stream forwarding interface of the kth-level monitoring platform, wherein the code stream forwarding interface is used for forwarding the monitoring code stream received by the kth-level monitoring platform to the kth-level transcoding equipment;

calling a transcoding starting interface of the kth level transcoding equipment, wherein the transcoding starting interface is used for transcoding the monitoring code stream received by the kth level transcoding equipment so as to adjust the transcoded monitoring code stream to the resolution ratio indicated by the code stream adjustment signaling;

and receiving the adjusted monitoring code stream sent by the kth level transcoding equipment.

Optionally, the method further comprises:

determining whether the (k + 1) th level control component is in a normal working state;

and when the (k + 1) th level control component is in a normal working state, triggering and executing the step of receiving a code stream adjustment signaling sent by the (k + 1) th level control component when the target sub-transmission path with network congestion on the cross-level transmission path comprises the (k) th level monitoring subsystem.

Optionally, before receiving the first packet loss rate sent by the kth-level client in the kth-level monitoring subsystem, and/or receiving the second packet loss rate sent by the lower-level monitoring device of the kth-level control component, the method further includes:

acquiring resolution indicating information sent by the kth-level client when the kth-level client requests to monitor a code stream, wherein the resolution indicating information is used for indicating the expected resolution of the client;

when the monitoring code stream requested by the kth-level client is called by other clients and the expected resolution of the other clients is different from the expected resolution of the kth-level client, calling a code stream forwarding interface of a kth-level monitoring platform to forward the monitoring code stream to kth-level transcoding equipment;

calling a transcoding starting interface of the kth-level transcoding equipment to enable the kth-level transcoding equipment to transcode the received monitoring code stream, and adjusting the transcoded monitoring code stream to the expected resolution of the kth-level client;

receiving the adjusted monitoring code stream sent by the kth level transcoding equipment;

and sending the adjusted monitoring code stream to the kth-level client.

In the embodiment, the control assemblies are arranged in the multi-stage monitoring subsystem, and each stage of control assembly acquires the packet loss rate sent by the client at the corresponding stage and sends the packet loss rate to the control assembly at the highest stage by stage; adjusting the code stream according to the code stream adjusting signaling generated by the control component at the uppermost level; the problems that the bandwidth between the upper and lower monitoring platforms has an upper limit, and code stream transmission delay, monitoring picture blocking or mosaic occurrence possibly exist can be solved; the control component can adaptively adjust the monitoring code stream to adjust the bandwidth resource occupied by the monitoring code stream, so that the problems of code stream transmission delay, blockage of a monitoring picture or mosaic occurrence caused by limited bandwidth between an upper monitoring platform and a lower monitoring platform can be avoided, and the transmission effect of the monitoring code stream is ensured.

In addition, when the monitoring code stream requested by the kth-level client is called by other clients and the expected resolution of the other clients is different from the expected resolution of the kth-level client, the monitoring code stream received by the kth-level monitoring platform is transcoded by calling the kth-level transcoding device to obtain the monitoring code stream meeting the expected resolution of the kth-level client, so that the adaptivity of code stream forwarding can be improved.

In a third aspect, a code stream transmission method in a monitoring system is provided, where the monitoring system includes multiple stages of monitoring subsystems, and at least one stage of monitoring subsystem includes a client and a monitoring platform providing a monitoring code stream for the client; the method is used in the client, and comprises the following steps:

after establishing communication connection with a monitoring platform at a corresponding level, acquiring the packet loss rate of a currently received monitoring code stream;

sending the packet loss rate to a control component at a corresponding level, so that the control component at the corresponding level sends the packet loss rate to an ith level control component layer by layer, and the ith level control component determines whether a cross-level transmission path in the monitoring system has network congestion according to the packet loss rate; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; sending the code stream adjustment signaling to an i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems; the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1.

Optionally, the method further comprises:

when a monitoring code stream is requested to the monitoring platform of the corresponding level, acquiring resolution indicating information of the client, wherein the resolution indicating information is used for indicating the expected resolution of the client;

and sending the resolution indication information to the control component of the corresponding level, so that the control component of the corresponding level sends the resolution indication information to the ith level control component step by step, and the ith level control component generates the code stream adjustment signaling according to the resolution indication information.

Optionally, after the sending the resolution indication information to the control component of the corresponding level, the method further includes:

when the monitoring code stream requested by the client is called by other clients and the expected resolution of the other clients is different from the expected resolution of the client, receiving the adjusted monitoring code stream sent by the control component at the corresponding level; the adjusted monitoring code stream is transmitted to the transcoding equipment of the corresponding level by the control component of the corresponding level calling the code stream forwarding interface of the monitoring platform of the corresponding level; calling a transcoding starting interface of the transcoding equipment of the corresponding level to enable the transcoding equipment of the corresponding level to transcode the received monitoring code stream, and adjusting the transcoded monitoring code stream to the expected resolution of the client; receiving the adjusted monitoring code stream sent by the transcoding equipment of the corresponding level;

and outputting the adjusted monitoring code stream.

Optionally, after the sending the packet loss rate to the control component of the corresponding level, the method further includes:

when the code stream adjustment signaling is used for indicating to adjust the monitoring code stream requested by the client, receiving an adjustment feedback signaling and an adjusted monitoring code stream sent by the monitoring platform at the corresponding level;

outputting the adjusted monitoring code stream;

and outputting a code stream adjustment prompt according to the adjustment feedback signaling, wherein the code stream adjustment prompt is used for indicating that the resolution of the monitoring code stream currently displayed by the client is lower than the expected resolution.

In this embodiment, by setting the control components in the multi-stage monitoring subsystem, each stage of client sends the packet loss rate to the control component of the corresponding stage, so that each stage of control component sends the packet loss rate to the control component of the highest stage step by step; the problems that the bandwidth between the upper and lower monitoring platforms has an upper limit, and code stream transmission delay, monitoring picture blocking or mosaic occurrence possibly exist can be solved; the control component can adaptively adjust the monitoring code stream to adjust the bandwidth resource occupied by the monitoring code stream, so that the problems of code stream transmission delay, blockage of a monitoring picture or mosaic occurrence caused by limited bandwidth between an upper monitoring platform and a lower monitoring platform can be avoided, and the transmission effect of the monitoring code stream is ensured.

In addition, by outputting a code stream adjustment prompt when the code stream of the current client is adjusted, the user can be prompted that the code stream of the client is adjusted and timely notified to the user.

In a fourth aspect, a code stream transmission apparatus in a monitoring system is provided, where the monitoring system includes multiple stages of monitoring subsystems, and each stage of monitoring subsystem is in communication connection with a control component; the device is used in an ith-level control assembly in communication connection with an ith-level monitoring subsystem, wherein the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1; the device comprises:

the data acquisition module is used for acquiring the packet loss rate reported by the i-1 th-level control component, wherein the packet loss rate comprises the packet loss rate of at least one lower-level monitoring subsystem of the i-level monitoring subsystem;

a congestion determining module, configured to determine whether a cross-level transmission path in the monitoring system has network congestion according to the packet loss rate, where the cross-level transmission path is used to transmit a monitoring code stream requested by a client, and a monitoring device that collects the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

the signaling generation module is used for generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path;

and the signaling sending module is used for sending the code stream adjusting signaling to the i-1 level control component so as to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path.

In a fifth aspect, a code stream transmission apparatus in a monitoring system is provided, where the monitoring system includes multiple stages of monitoring subsystems, and each stage of monitoring subsystem is in communication connection with a control component; the device is used in a kth-level control assembly in communication connection with a kth-level monitoring subsystem, wherein the ith-level control assembly is the current uppermost-level control assembly, k is more than or equal to 1 and is less than i, and i is an integer more than 1; the device comprises:

the data acquisition module is used for receiving a first packet loss rate sent by a kth-level client in the kth-level monitoring subsystem and/or receiving a second packet loss rate sent by a next-level control assembly of the kth-level control assembly; the second packet loss rate sent by the lower monitoring device is sent by a client connected with the lower control component in a communication manner;

the data sending module is configured to send the first packet loss rate and/or the second packet loss rate to a (k + 1) th-level control component, so that the (k + 1) th-level control component sends the first packet loss rate and/or the second packet loss rate to the i-th-level control component step by step, and the i-th-level control component determines whether a network congestion exists in a cross-level transmission path in the monitoring system according to the packet loss rate; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; sending the code stream adjustment signaling to the i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

a signaling receiving module, configured to receive a code stream adjustment signaling sent by a (k + 1) th level control component when a target sub-transmission path with network congestion on the cross-level transmission path includes the kth level monitoring subsystem; the code stream adjustment signaling comprises a client identifier;

a code stream adjusting module, configured to adjust, when the kth-level monitoring subsystem is the lowest-level monitoring subsystem on the target sub-transmission path, a monitoring code stream corresponding to the client identifier in the kth-level monitoring subsystem according to the code stream adjustment signaling, so as to obtain an adjusted monitoring code stream; generating an adjustment feedback signaling; sending the adjustment feedback signaling and the adjusted monitoring code stream to the (k + 1) th level control component;

a code stream receiving module, configured to receive an adjustment feedback signaling and an adjusted monitoring code stream sent by a kth-1-level monitoring subsystem when the kth-level monitoring subsystem is a highest-level monitoring subsystem on the target sub-transmission path; and sending the adjustment feedback signaling and the adjusted monitoring code stream to a client corresponding to the client identifier.

The sixth aspect provides a code stream transmission device in a monitoring system, where the monitoring system includes multiple stages of monitoring subsystems, and at least one stage of monitoring subsystem includes a client and a monitoring platform providing a monitoring code stream for the client; the device is used in the client, and comprises:

the packet loss rate acquisition module is used for acquiring the packet loss rate of the currently received monitoring code stream after establishing communication connection with the monitoring platform at the corresponding level;

the data sending module is used for sending the packet loss rate to the control component at the corresponding level, so that the control component at the corresponding level sends the packet loss rate to the ith level control component layer by layer, and the ith level control component determines whether a cross-level transmission path in the monitoring system has network congestion according to the packet loss rate; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; sending the code stream adjustment signaling to an i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems; the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1.

In a seventh aspect, a code stream transmission apparatus in a monitoring system is provided, where the apparatus includes a processor and a memory; the memory stores a program, and the program is loaded and executed by the processor to realize the code stream transmission method in the monitoring system of the first aspect; or, implementing the code stream transmission method in the monitoring system of the second aspect; or, implementing the code stream transmission method in the monitoring system according to the third aspect.

An eighth aspect provides a computer-readable storage medium, where the storage medium stores a program, and the program is loaded and executed by the processor to implement the code stream transmission method in the monitoring system according to the first aspect; or, implementing the code stream transmission method in the monitoring system of the second aspect; or, implementing the code stream transmission method in the monitoring system according to the third aspect.

The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical solutions of the present application more clear and clear, and to implement the technical solutions according to the content of the description, the following detailed description is made with reference to the preferred embodiments of the present application and the accompanying drawings.

Drawings

Fig. 1 is a schematic structural diagram of a code stream transmission system in a monitoring system according to an embodiment of the present application;

FIG. 2 is a schematic structural diagram of a primary monitoring subsystem according to an embodiment of the present application;

fig. 3 is a schematic diagram of monitoring code stream transmission of a peer monitoring subsystem according to an embodiment of the present application;

fig. 4 is a schematic diagram of monitoring code stream transmission of a cross-level monitoring subsystem according to an embodiment of the present application;

fig. 5 is a flowchart of a code stream transmission method in a monitoring system according to an embodiment of the present application;

fig. 6 is a flowchart illustrating a client establishing a communication connection with a monitoring platform according to an embodiment of the present application;

fig. 7 is a flowchart illustrating a client acquiring a monitored code stream meeting a desired resolution according to an embodiment of the present application;

fig. 8 is a schematic diagram illustrating a client acquiring a monitored code stream meeting a desired resolution according to an embodiment of the present application;

fig. 9 is a schematic diagram illustrating a code stream transmission flow in a monitoring system according to an embodiment of the present application;

fig. 10 is a schematic diagram of signaling transmission of a peer monitoring subsystem according to an embodiment of the present application;

fig. 11 is a schematic diagram illustrating code stream transmission of a peer monitoring subsystem according to an embodiment of the present application;

fig. 12 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application;

fig. 13 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application;

fig. 14 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application;

fig. 15 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application.

Detailed Description

The following detailed description of embodiments of the present application will be described in conjunction with the accompanying drawings and examples. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application.

First, a number of terms referred to in this application are introduced:

monitoring camera: including analog cameras and web cameras (IP cameras, IPC). The analog camera is a camera for transmitting images through a video line; the network camera refers to a camera that transmits sound and images through a network cable.

Software Development Kit (SDK) is a collection of Development tools that build application Software for a particular Software package, Software framework, hardware platform, operating system, etc. In other words, the SDK refers to a toolkit provided by a third party service provider to implement a certain function of the software product. Typically, an SDK is a collection of professional services provided by companies of a professional nature, such as providing android development tools, or services developed based on hardware, etc.; alternatively, there is also an SDK for a certain software function, such as a push technology, an image recognition technology, a mobile payment technology, a voice recognition analysis technology, and the like. Based on the SDK, a developer does not need to develop each function of the product, selects a suitable stable SDK service, and can integrate a certain function in the product with little experience.

Fig. 1 and fig. 2 are schematic structural diagrams of a code stream transmission system in a monitoring system according to an embodiment of the present application, where the system at least includes: the n-level monitoring subsystems 11 and the control components 12 corresponding to at least one level of monitoring subsystems 11 (in fig. 1, each level of monitoring subsystem corresponds to a control component 12 for example). n is an integer greater than 1.

For the m-th monitoring subsystem in the n-th monitoring subsystem 11, the m-th monitoring subsystem at least includes the m-th monitoring platform 111 and the m-th transcoding device 112. M is more than or equal to 1 and less than or equal to n.

The m-th level monitoring platform 111 is used for forwarding the monitoring code stream. Certainly, the m-th level monitoring platform 111 also supports a storage function of the monitoring code stream, and the functions provided by the m-th level monitoring platform 111 are not listed in this embodiment. Illustratively, the m-th monitoring platform 111 implements forwarding of the monitoring code stream by running the SDK. In addition, the number of the m-th level monitoring platforms 111 may be one or more, and the number of the m-th level monitoring platforms 111 is not limited in this embodiment.

In this embodiment, the mth monitoring platform 111 at least includes: a code stream receiving interface, a code stream forwarding interface and a forwarding stopping interface. Certainly, the mth monitoring platform 111 may also have an original sending interface, where the original sending interface is used for the mth monitoring platform 111 to send the obtained monitoring code stream to the mth client. At this time, the mth level monitoring subsystem further includes at least one mth level client. And the code stream receiving interface is used for receiving the monitoring code stream when being called. And when the forwarding stopping interface is called, the monitoring code stream is stopped from being sent to the mth level client. And when the code stream forwarding interface is called, the code stream forwarding interface is used for forwarding the monitoring code stream to the mth level transcoding device 112.

The m-th level transcoding device 112 is configured to transcode the input monitored code stream to adjust a resolution of the monitored code stream. The number of the mth stage transcoding devices 112 may be one or more, and the number of the mth stage transcoding devices 112 is not limited in this embodiment.

In this embodiment, the mth level transcoding device 112 at least includes: the transcoding interface is started. And when the transcoding starting interface is called, the transcoding starting interface is used for transcoding the received monitoring code stream. Of course, the mth level transcoding device 112 may also include a stop transcoding interface for stopping transcoding the received monitored code stream when called.

Optionally, the mth level monitoring subsystem 11 further includes an mth level monitoring device. And the m-level monitoring equipment is used for acquiring multimedia data to obtain a monitoring code stream. The m-th level monitoring device may be a monitoring camera. The number of m-th level monitoring devices may be one or more, and the number of m-th level monitoring devices is not limited in this embodiment.

In one example, referring to the mth level monitoring subsystem shown in fig. 2, the mth level monitoring subsystem includes the mth level monitoring platform 111, the mth level transcoding device 112, the mth level client 21, and the mth level monitoring device 22.

When m is smaller than n, the m-th level monitoring platform 111 supports communication connection with the m + 1-th level monitoring platform 111; when m is greater than 1, the m-th level monitoring platform 111 supports a communication connection with the m-1 th level monitoring platform 111.

The scenes of monitoring code stream transmission by the m-th level monitoring subsystem include, but are not limited to, the following:

the first method comprises the following steps: the monitoring subsystem at the same level transmits the monitoring code stream, and the transmission process at least comprises the following steps:

1. after logging in to the mth level monitoring platform 111, the mth level client sends a monitoring request to the mth level monitoring platform 111, wherein the code stream monitoring request carries an equipment identifier and an expected resolution of the mth level monitoring equipment;

2. after receiving the monitoring request, the m-th level monitoring platform 111 acquires a monitoring code stream with a desired resolution, which is acquired by the m-th level monitoring equipment, based on the equipment identifier; sending the monitoring code stream to an m-level client;

3. and the m-level client receives the monitoring code stream with the expected resolution.

The transmission process of the monitoring code stream is shown in fig. 3.

In the application, all the devices in the peer monitoring subsystem communicate with each other based on the local area network, the bandwidth of the local area network is sufficient, and at the moment, network congestion cannot occur in code stream transmission.

And the second method comprises the following steps: the cross-level monitoring subsystem carries out monitoring code stream transmission, and the transmission process at least comprises the following steps:

1. after logging in to the mth level monitoring platform 111, the mth level client sends a monitoring request to the mth level monitoring platform 111, wherein the code stream monitoring request carries the equipment identifier and the expected resolution of the mth-a level monitoring equipment; a is more than or equal to 1 and less than m;

2. after receiving the monitoring request, the m-level monitoring platform 111 establishes communication connection with the m-1 level monitoring platform 111; sending the equipment identification of the m-a level monitoring equipment to the m-1 level monitoring platform 111 based on the communication connection, so that the equipment identification of the m-a level monitoring equipment is issued to the m-a level monitoring platform 111 layer by layer;

3. the m-a level monitoring platform 111 receives the equipment identification of the m-a level monitoring equipment, and acquires a monitoring code stream with expected resolution, which is acquired by the m-a level monitoring equipment, based on the equipment identification;

4. the m-a level monitoring platform 111 sends the monitoring code stream to the m-a +1 level monitoring platform 111, so that the monitoring code stream is reported to the m level monitoring platform 111 layer by layer;

5. the m-level monitoring platform 111 receives the monitoring code stream and sends the monitoring code stream to the m-level client;

6. and the m-level client receives the monitoring code stream with the expected resolution.

Fig. 4 is referred to for a transmission process of the monitoring code stream, and fig. 4 illustrates an example where a is 2.

In this application, the communication connection between the monitoring platforms 111 of two adjacent stages is established based on a public network, the used signaling communication Protocol may be a Transmission Control Protocol (TCP), the code stream Transmission communication Protocol is generally a User Datagram Protocol (UDP), and of course, other protocols may also be used, and the present embodiment does not limit the communication protocols used between the monitoring platforms 111 of different stages. At this time, there may be congestion in the transmission process of the monitoring code stream because the bandwidth resources of the public network may be insufficient.

Based on the above technical problem, the present application provides a control component 12 in a stream transmission system to perform bandwidth adaptive control. The control component 12 is software or hardware or a combination of software and hardware independent of the monitoring platform 111. In the present application, the control unit 12 includes a control unit 121 at the uppermost stage and a lower control unit 122 at the lower stage of the control unit at the uppermost stage. In one example, the ith level control component is the current uppermost level control component 121, and i is an integer greater than 1. The control component 121 at the uppermost stage is not in a normal operating state, such as: and when the controller is in a shutdown state or a fault state, updating the control component at the next level of the ith control component, namely the ith-1 level control component, into the control component at the current uppermost level, and sequentially circulating.

In this application, each monitoring subsystem is described as corresponding to at least one control component 12. The control component needs to add at least the following configuration information before use:

1. the level information, the level of the control component 12 is determined according to the level of the monitoring subsystem corresponding to the control component 12.

2. The communication bandwidth with the superior control component 12.

3. The communication address of the upper level control component 12. The communication address includes an IP address and port information.

4. And the communication address of the monitoring platform in the monitoring subsystem of the level.

5. And login information of the client in the monitoring subsystem of the level.

After each level of control component is started, logging in a superior control component 12 (the control component is not the superior control component) and a current level monitoring platform according to configuration information; the control device receives subordinate information (the control device is not the lowest control device) transmitted when the next control device 12 registers the current control device, and transmits the subordinate information to the previous control device 12 (the control device is not the highest control device). Therefore, after the subordinate information is reported step by step, each control assembly can store the connection condition of all the subordinate control assemblies with relevance.

The clients in each level of monitoring subsystem also synchronously log into the control component 12 of that level of monitoring subsystem when logging into the monitoring platform 111 of that level of monitoring subsystem. Optionally, the client also sends the user permission level when logging into the control component 12.

The following introduces a working process of the code stream transmission system provided by the present application, where the process at least includes the following steps:

1. after establishing communication connection with a monitoring platform (mth level monitoring platform) of a corresponding level, the mth level client acquires the packet loss rate of the currently received monitoring code stream; sending the packet loss rate to a control component (mth level control component) of a corresponding level, so that the control component of the corresponding level sends the packet loss rate to an ith level control component layer by layer;

the process of establishing communication connection between the mth level client and the mth level monitoring platform comprises the following steps: after the mth-level client logs in the mth-level monitoring platform and the mth-level control assembly, acquiring the expected resolution of the monitored code stream; generating resolution indicating information based on the desired resolution; sending the resolution indication information to an m-th level control component; the m-level control component acquires resolution indicating information and sends the resolution indicating information to the m + 1-level control component; sending feedback information to the mth level client; after receiving the feedback information, the mth-level client calls a code stream receiving interface and an original sending interface of the mth-level monitoring platform based on the equipment identification of the mth-b-level monitoring equipment to obtain a monitoring code stream with the expected resolution provided by the mth-b-level monitoring equipment; b is more than or equal to 1 and less than m.

The resolution indication information may be a bandwidth occupation value corresponding to the desired resolution; alternatively, the desired resolution.

2. The kth-level control component receives a first packet loss rate sent by a kth-level client in the kth-level monitoring subsystem, and/or receives a second packet loss rate sent by a lower-level monitoring device of the kth-level control component; the second packet loss rate sent by the lower monitoring equipment is sent by a client connected with the lower monitoring equipment in a communication way, and k is more than or equal to 1 and less than i; sending the first packet loss rate and/or the second packet loss rate to a (k + 1) th-level control component, and executing the step 3 until k is equal to i-1;

3. the ith-level control component acquires the packet loss rate reported by the (i-1) th-level control component; the packet loss rate comprises the packet loss rate of at least one lower-level monitoring subsystem of the i-level monitoring subsystem; determining whether a cross-level transmission path in the monitoring system has network congestion according to the packet loss rate; generating a code stream adjustment signaling when network congestion exists in a cross-level transmission path; and sending the code stream adjusting signaling to the i-1 level control component to adjust the bandwidth resource occupied by the monitoring code stream transmitted by the cross-level transmission path.

The code stream adjustment signaling comprises a client identifier. The client identifier may be login information or device information; or an IP address, etc., and the implementation manner of the client identifier is not limited in this embodiment.

The cross-level transmission path is used for transmitting a monitoring code stream requested by the client, and monitoring equipment for collecting the monitoring code stream and the client belong to different levels of monitoring subsystems; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems.

4. When a target sub-transmission path with network congestion on a cross-level transmission path comprises a k-level monitoring subsystem, a k-level control component receives a code stream adjustment signaling sent by a k + 1-level control component; when the kth-level monitoring subsystem is the lowest-level monitoring subsystem on the target sub-transmission path, adjusting a monitoring code stream corresponding to the client identifier in the kth-level monitoring subsystem according to the code stream adjustment signaling to obtain an adjusted monitoring code stream; generating an adjustment feedback signaling; sending the adjustment feedback signaling and the adjusted monitoring code stream to a (k + 1) th level control component; when the kth-level monitoring subsystem is the highest-level monitoring subsystem on the target sub-transmission path, receiving an adjustment feedback signaling and an adjusted monitoring code stream sent by the kth-1-level monitoring subsystem; and sending the adjustment feedback signaling and the adjusted monitoring code stream to the client corresponding to the client identifier.

In this application, the monitoring authority of the upper monitoring subsystem 11 is higher than the monitoring authority of the lower monitoring subsystem 11. The client in the upper monitoring subsystem 11 only supports the monitoring code stream generated by the current monitoring device and the monitoring code stream generated by the lower monitoring device.

According to the above, the control component supports bandwidth adaptive adjustment, so that the problem of network congestion during cross-level code stream transmission can be solved.

The following describes a code stream transmission method in the monitoring system provided by the present application in detail.

Fig. 5 is a flowchart of a code stream transmission method in a monitoring system according to an embodiment of the present application, and this embodiment takes the application of the method to the code stream transmission system in the monitoring system shown in fig. 1 as an example for description. The method at least comprises the following steps:

step 501, after establishing communication connection with a monitoring platform at a corresponding level, a client acquires a packet loss rate of a currently received monitoring code stream.

In this embodiment, a client that needs to acquire a monitoring code stream establishes a communication connection with a monitoring platform in advance, and acquires the monitoring code stream based on the communication connection. The monitoring code stream acquired by the client can be provided by the monitoring equipment in the current-level monitoring subsystem; or, the monitoring device provided by the monitoring device in the lower monitoring subsystem determines the monitoring device providing the monitoring code stream according to the monitoring requirement of the client, and the level of the monitoring device providing the monitoring code stream is not limited in this embodiment.

In one example, referring to fig. 6, the process of establishing a communication connection between a client and a monitoring platform includes at least the following steps:

and 61, when the client requests the monitoring code stream to the monitoring platform at the corresponding level, acquiring resolution indicating information of the client.

The resolution indication information is used for indicating the expected resolution of the client when outputting the monitoring code stream. The resolution indication information can be a bandwidth occupation value corresponding to the expected resolution; alternatively, the desired resolution.

And when the resolution indicating information is the bandwidth occupation value, the client inputs the expected resolution into a preset bandwidth calculation formula to obtain the bandwidth occupation value corresponding to the expected resolution.

Optionally, the desired resolution is user-selected; or transmitted by other devices.

And step 62, the client sends the resolution indication information to the control component of the corresponding level, sends the monitoring request to the monitoring platform of the corresponding level, and executes steps 63 and 64.

The method comprises the steps that a client logs in a control assembly at a corresponding level and a monitoring platform at a corresponding level in advance, and after the control assembly at the corresponding level is logged in, resolution indicating information is sent to the control assembly at the corresponding level; and after logging in the corresponding monitoring platform, sending the monitoring request to the monitoring platform at the corresponding level.

The client may send the monitoring request after sending the resolution indication information; or sending a monitoring request before sending the resolution indication information; or, the resolution indication information and the monitoring request are transmitted simultaneously, and the transmission order of the resolution indication information and the monitoring request is not limited in this embodiment.

The control component of the corresponding level is used for sending the resolution indicating information to the ith control component step by step so that the ith control component generates a code stream adjusting signaling according to the resolution indicating information. The ith-level control component is the control component at the current uppermost level, and i is an integer greater than 1.

In this application, sending to the ith control module step by step means that for the adjacent upper and lower control modules, the lower control module sends information, data and/or signaling to the adjacent upper control module, and the process is circulated in sequence until the ith-1 control module sends the information, data and/or signaling to the ith control module.

Taking the client as the kth-level client in the kth-level monitoring subsystem as an example, at this time, the control component at the corresponding level is the kth-level control component, and k is greater than or equal to 1 and is less than i. In the embodiment shown in fig. 6, the value of k may also be equal to i.

The monitoring request and the content carried by the resolution indication information are the same or different. The monitoring request includes a client identification, a monitoring device identification, and a desired resolution. The client identifier includes a level identifier of a level where the client is located, and of course, the client identifier may also include a device identifier, an IP address, and/or a number of the client, and the setting manner of the client identifier is not limited in this embodiment. The monitoring device identifier includes a level identifier of a level where the monitoring device is located, and of course, may also include a device identifier, an IP address, and/or a number of the monitoring device, and the setting manner of the monitoring device identifier is not limited in this embodiment.

And 63, receiving the monitoring request by the level monitoring platform at the corresponding level, and sending the monitoring code stream acquired by the monitoring equipment indicated by the monitoring equipment identifier to the client according to the monitoring request.

In one scenario, the monitoring device is located in the same level of monitoring subsystem as the client and the monitoring platform. At this time, the monitoring platform is in direct communication connection with the monitoring device, so that the monitoring code stream collected by the monitoring device can be directly received, and the monitoring code stream method is sent to the client.

In one scenario, the monitoring device is located in a lower monitoring subsystem of the monitoring subsystems where the client and the monitoring platform are located. At the moment, the monitoring platform is in communication connection with the monitoring platform in the next-stage monitoring subsystem, the monitoring equipment in the next-stage monitoring subsystem is in communication connection with the monitoring platform in the corresponding stage and sends the collected monitoring code stream to the monitoring platform in the corresponding stage, the monitoring platform in the corresponding stage sends the monitoring code stream to the monitoring platform in the monitoring subsystem in the stage where the client is located step by step, and the monitoring code stream is sent to the client by the monitoring platform.

Step 64, the control component at the corresponding level acquires resolution indicating information sent when the client requests to monitor the code stream; when the control component of the corresponding level is not the control component of the uppermost level, the control component of the corresponding level is also used for sending the resolution indication information to the control component of the upper level.

Optionally, after the kth-level control component acquires the resolution indication information, the kth-level control component may further send feedback information to the kth-level client, where the feedback information is used to indicate that the kth-level control component has received the resolution indication information.

Because the monitoring device can only provide a monitoring code stream with one resolution at the same time, when the expected resolution of the monitoring code stream requested by the upper-level client is different from the expected resolution of the monitoring code stream requested by the lower-level client, the monitoring system cannot provide the monitoring code stream which simultaneously meets the expected resolution of the two-level client. Such as: when a lower level is browsing 1080P code stream of a monitoring device, and a higher level requests to browse 720P code stream of the monitoring device, the code stream being browsed by the lower level is also changed into 720P. Because the monitoring code stream requested by the client may have been called by other clients, when the desired resolution of other clients is different from the desired resolution of the current client, the current client may acquire the monitoring code stream that does not conform to the desired resolution. Based on this, referring to fig. 7, in this embodiment, after the kth stage control component receives the resolution indication information, that is, after step 64, the following steps may also be performed:

step 71, when the monitoring code stream requested by the kth-level client is called by other clients and the expected resolution of the other clients is different from the expected resolution of the kth-level client, the kth-level control component calls a code stream forwarding interface of the kth-level monitoring platform so that the monitoring code stream is forwarded to the kth-level transcoding equipment.

In one example, the resolution indicating information includes a client identifier, a monitoring device identifier, and an expected resolution, at this time, the kth-level control component may receive resolution indicating information sent by the kth-1-level control component when a lower-level client applies for acquiring a monitoring code stream, and may determine whether the monitoring code stream requested by the kth-level client is called by other clients according to the monitoring device identifier in the resolution indicating information, and whether the expected resolution of the other clients is the same as the expected resolution of the kth-level client. Specifically, when the monitoring device identifier in the resolution indication information received by the kth-level control component from the kth-1-level control component is the same as the monitoring device identifier in the resolution indication information sent by the kth-level client, it is determined that the monitoring code stream requested by the kth-level client is called by other clients. And when the desired resolution in the resolution indication information received by the k-level control component from the k-1 level control component is different from the desired resolution in the resolution indication information sent by the k-level client, determining that the desired resolution of the other client is different from the desired resolution of the k-level client.

Optionally, when the monitored code stream requested by the kth-level client is not called by other clients, or the desired resolution of other clients is the same as the desired resolution of the kth-level client, the step 63 is continuously executed.

The kth-level monitoring subsystem further comprises a kth-level transcoding device, and since the monitoring code stream requested by the kth-level client is called by other clients and the expected resolution of the other clients is different from the expected resolution of the kth-level client, the resolution of the monitoring code stream received by the kth-level monitoring platform is the same as the expected resolution of the other clients. In order to ensure that the monitoring code stream meeting the expected resolution of the kth-level client is provided for the kth-level client, in this embodiment, a kth-level transcoding device may be called to transcode the monitoring code stream received by the kth-level monitoring platform, so as to obtain the monitoring code stream meeting the expected resolution of the kth-level client.

And 72, calling a transcoding starting interface of the kth-level transcoding equipment by the kth-level control component to enable the kth-level transcoding equipment to transcode the received monitoring code stream, and adjusting the transcoded monitoring code stream to the expected resolution of the kth-level client.

And 73, the kth level control component receives the adjusted monitoring code stream sent by the kth level transcoding equipment.

And step 74, the kth-level control component sends the adjusted monitoring code stream to the kth-level client.

And 75, when the monitoring code stream requested by the client is called by other clients and the expected resolution of the other clients is different from the expected resolution of the client, the client receives the adjusted monitoring code stream sent by the control component of the corresponding level.

The adjusted monitoring code stream is transmitted to the transcoding equipment of the corresponding level by calling a code stream forwarding interface of the monitoring platform of the corresponding level through the control component of the corresponding level; calling a transcoding starting interface of the transcoding equipment of the corresponding level to enable the transcoding equipment of the corresponding level to transcode the received monitoring code stream, and adjusting the transcoded monitoring code stream to the expected resolution of the client; and receiving the adjusted monitoring code stream sent by the transcoding equipment of the corresponding level.

And step 76, outputting the adjusted monitoring code stream by the client.

Such as: referring to the monitoring code stream transmission process shown in fig. 8, when the upper client 81 requests the monitoring code stream of the lower monitoring device 82, since the lower client 83 has called the monitoring code stream of the lower monitoring device 82, and the desired resolution is 1080P; therefore, the upper monitoring platform 84 can obtain the monitoring code stream with the resolution of 1080P provided by the lower monitoring device 82 from the lower monitoring platform 85. The desired resolution at the upper level client 81 is not 1080P, such as: when the number of the monitored code streams is 720P, the upper control device 86 forwards the monitored code streams acquired by the upper monitoring platform 84 to the upper transcoding device 87, and controls the upper transcoding device 87 to transcode the monitored code streams to obtain the adjusted monitored code streams with the resolution of 720P; the upper control device 86 sends the acquired adjusted monitoring code stream to the upper client 81, so that the upper client 81 outputs the adjusted monitoring code stream with the desired resolution.

After the client establishes communication connection with the monitoring platform, the client can acquire a monitoring code stream sent by the monitoring platform through the SDK. And then, the client acquires the packet loss rate of the currently received monitoring code stream. The packet loss rate is used for indicating the packet loss condition of the monitoring code stream on the transmission path. Because the packet loss rate of the monitoring code stream during transmission in the same-level monitoring subsystem is close to 0, the packet loss rate obtained by the client is approximate to the packet loss rate of the monitoring code stream during cross-level transmission.

The method for acquiring the packet loss rate of the monitoring code stream by the client comprises the following steps: and acquiring the frame count of each frame of data packet in the monitoring code stream, and determining the packet loss rate of the monitoring code stream according to the frame count.

Generally, after the line bandwidth threshold is exceeded, the bandwidth occupation value of the public network used by the monitoring platform is in a positive correlation with the packet loss rate of the client.

Step 502, the client sends the packet loss rate to the control component of the corresponding level.

The control component at the corresponding level is used for sending the packet loss rate to the ith level control component layer by layer, and determining whether the cross-level transmission path in the monitoring system has network congestion according to the packet loss rate by the ith level control component; generating a code stream adjustment signaling when network congestion exists in a cross-level transmission path; sending a code stream adjusting signaling to an i-1 level control component to adjust bandwidth resources occupied by monitoring code streams transmitted by a cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by the client, and monitoring equipment for collecting the monitoring code stream and the client belong to different levels of monitoring subsystems; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems.

In step 503, the kth-level control component receives a first packet loss rate sent by a kth-level client in the kth-level monitoring subsystem, and/or receives a second packet loss rate sent by a next-level control component of the kth-level control component.

And step 504, the kth-level control component sends the first packet loss rate and/or the second packet loss rate to the (k + 1) th-level control component so as to send the first packet loss rate and/or the second packet loss rate to the ith-level control component step by step.

The (k + 1) th-level control component is used for sending the first packet loss rate and/or the second packet loss rate to the ith-level control component step by step, and determining whether the cross-level transmission path in the monitoring system has network congestion or not by the ith-level control component according to the packet loss rate; generating a code stream adjustment signaling when network congestion exists in a cross-level transmission path; sending a code stream adjusting signaling to an i-1 level control component to adjust bandwidth resources occupied by monitoring code streams transmitted by a cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by the client, and monitoring equipment for collecting the monitoring code stream and the client belong to different levels of monitoring subsystems; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems.

And 505, the ith control component acquires the packet loss rate reported by the (i-1) th control component, wherein the packet loss rate comprises the packet loss rate of at least one lower-level monitoring subsystem of the ith monitoring subsystem.

At least one lower-level monitoring subsystem of the ith-level monitoring subsystem comprises any one or more monitoring subsystems from the 1 st-level monitoring subsystem.

The packet loss rate of the at least one level of subordinate monitoring subsystem comprises a first packet loss rate and/or a second packet loss rate received by the subordinate monitoring subsystem.

Step 506, the ith control component determines whether a network congestion exists in a cross-level transmission path in the monitoring system according to the packet loss rate; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and the client belong to different levels of monitoring subsystems; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems.

The packet loss rate obtained by the ith-level control component includes: and generating a client identifier of the client with the packet loss rate and a value of the packet loss rate.

After receiving the packet loss rate, the ith-level control component determines that network congestion exists in a cross-level transmission path where the client indicated by the client identifier is located in the packet loss rate, wherein the value of the packet loss rate is greater than a packet loss rate threshold value.

Optionally, step 506 is performed when there is network congestion across the hierarchical transmission path; and when no network congestion exists in the cross-level transmission path, transmitting the monitoring code stream according to the original cross-level transmission path. Namely, the monitoring code stream is transmitted according to the cross-level transmission path of the monitoring equipment- > at least two-level monitoring platform- > client.

In step 507, the ith control component generates a code stream adjustment signaling when network congestion exists in the cross-level transmission path.

The monitoring requirements of a monitoring system typically include the following scenarios:

1. if client a is requesting subordinate monitoring device 1, peer client B wishes to request subordinate monitoring device 2 at a desired resolution (which may be the same as monitoring device 1 requested by a), and the bandwidth of the section between the department in which B is located and the department in which IPC2 is located is insufficient: if the authority A is larger than the authority B, providing a code stream with a resolution lower than the expected resolution for the authority B so as to avoid influencing the authority A; if the authority is the same, providing a code stream with a resolution lower than the expected resolution for the post-operation client B according to the principle of 'first come first get' and 'second get'; if the authority A is smaller than the authority B, a code stream with an expected resolution ratio is provided for the authority B, the resolution ratio of the code stream received by the authority A is reduced, and the authority A is prompted.

2. If client a is requesting subordinate monitoring device 1, subordinate client B wishes to request subordinate monitoring device 2 of B (which may be the same as monitoring device 1 requested by a) at the desired resolution, and the bandwidth of the section between the department of B and the department of IPC2 is insufficient: and providing a low-resolution code stream for B so as not to influence A.

3. If the client a is requesting the subordinate monitoring device 1, the client B of the superior level wishes to request the subordinate monitoring device 2 of B (which may be the same as the IPC requested by a) according to the desired resolution, and the bandwidth of the section between the department where B is located and the department where the monitoring device 2 is located is insufficient: and providing the code stream with the expected resolution for the B, reducing the resolution of the code stream received by the A, and prompting the A.

4. When the daily office needs to preempt the bandwidth for data transmission, the receiving resolution is tried to be reduced from low to high according to the client authority, and the adjusted client is prompted.

Based on the monitoring requirement, in an example, generating a code stream adjustment signaling when there is network congestion in a cross-level transmission path includes: when network congestion exists in a cross-level transmission path including at least one section of target sub-transmission path, determining a client with the lowest level corresponding to each cross-level transmission path for each cross-level transmission path including the target sub-transmission path; acquiring a first expected resolution of a client with the lowest level; and generating a code stream adjusting signaling based on the first expected resolution, wherein the code stream adjusting signaling is used for controlling a control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitoring code stream of the client with the lowest level based on the first expected resolution.

The level of the client is determined according to the level of the monitoring subsystem where the client is located.

And the ith-level control component acquires the expected resolution of the client side of each level before generating the code stream adjustment signaling. At the moment, before generating a code stream adjustment signaling, the ith-level control component receives a resolution indication signaling sent by the ith-1-level control component, wherein the resolution indication signaling is used for indicating the expected resolution when the ith-1-level client requests to monitor the code stream and/or indicating the expected resolution when a lower-level client of the ith-1-level client requests to monitor the code stream; and/or receiving resolution indication information sent by the ith-level client when the ith-level client requests to monitor the code stream, wherein the resolution indication information is used for indicating the expected resolution of the ith-level client.

Such as: referring to the transmission process of the monitored code stream shown in fig. 9, the monitoring system includes two trans-level transmission paths, where the first trans-level transmission path is monitoring device 91- > monitoring platform 92- > monitoring platform 93- > client 94; the second cross-stage transmission path is monitoring equipment 91- > monitoring platform 92- > monitoring platform 93- > monitoring platform 95- > client 96. Assuming that the packet loss rate obtained by the control component 97 on the uppermost layer indicates that the value of the packet loss rate corresponding to the monitoring platform 92 is greater than the packet loss rate threshold, it is determined that network congestion exists in the sub-transmission paths of the monitoring platform 92- > the monitoring platform 93. The control component 97 determines the lowest-level client, i.e., the client 94, corresponding to the first cross-level transmission path and the second cross-level transmission path of the monitoring platform 92- > of the monitoring platform 93; and generating a code stream adjustment signaling based on the first desired resolution of the client 94, wherein the code stream adjustment signaling is used for controlling a control component connected with the monitoring platform 92 to downwards adjust the resolution of the monitoring code stream of the client 94 with the lowest level based on the first desired resolution.

Illustratively, the code stream adjustment signaling includes a client identifier, a first desired resolution, and a component identifier and an adjustment mode of the control component with the lowest level.

The client identification is used for indicating a client (namely the client with the lowest level) requesting the monitoring code stream to be adjusted; the first desired resolution is a desired resolution of the client; the component identification is used for indicating a control component for executing adjustment and monitoring of the code stream; the adjustment mode is used for indicating a downward adjustment value of the resolution of the monitoring code stream.

The component identifier includes a level identifier of a level where the control component is located, and of course, may also include a device identifier, an IP address, and/or a device number of the control component, and the setting manner of the component identifier is not limited in this embodiment.

Optionally, when the levels of the clients corresponding to the cross-level transmission paths are the same, the ith control component acquires a second expected resolution and a user permission level of the client with the same level; and generating a code stream adjusting signaling for at least two clients with different user permission levels and the same level based on the user permission levels and a second expected resolution, wherein the code stream adjusting signaling is used for controlling a control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitoring code stream of the client with the same level based on the second expected resolution in sequence from low to high according to the user permission levels.

And the ith-level control component acquires the user permission levels of the clients at all levels before generating the code stream adjustment signaling. At this time, before generating the code stream adjustment signaling, the ith level control component further includes: receiving login information sent by an ith-level client so that the ith-level client logs in to an ith-level control component; and/or receiving login information reported by the i-1 level control component. The login information comprises the user authority level of the corresponding client.

In this embodiment, the user permission level of the client in the upper monitoring subsystem is higher than the user permission level of the client in the lower monitoring subsystem. And the user permission levels of different clients in the same level monitoring subsystem are the same or different.

Optionally, when the user permission levels of the clients of the same level are the same, generating a code stream adjustment signaling when there is network congestion in the cross-level transmission path, including: acquiring a code stream request sequence of clients with the same level; generating a code stream adjustment signaling based on the code stream request sequence and the second desired resolution; the code stream adjustment signaling is used for controlling a control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitored code stream of the client with the same level according to the sequence of the code stream requests from first to last and based on a second expected resolution in sequence; or generating a random adjustment sequence of the clients with the same level; generating a code stream adjusting signaling based on the random adjusting sequence and the second expected resolution; the code stream adjustment signaling is used for controlling the control component with the lowest level on the target sub-transmission path to downwards adjust the resolution of the monitored code stream of the client with the same level in sequence based on the second expected resolution according to the sequence from first to last indicated by the random adjustment sequence.

Of course, the generation manner of the code stream adjustment signaling is only schematic, and in actual implementation, the generation manner of the code stream adjustment signaling may also be adaptively adjusted according to monitoring requirements, and the generation manner of the code stream adjustment signaling is not limited in this embodiment.

And step 508, the ith control component sends the code stream adjustment signaling to the (i-1) th control component so as to send the code stream adjustment signaling to the control component indicated by the code stream adjustment signaling layer by layer.

The code stream adjusting signaling is used for adjusting bandwidth resources occupied by monitoring code streams transmitted by the cross-level transmission path.

And the i-1 level control assembly sends the code stream adjusting instruction to the control assembly indicated by the code stream adjusting instruction step by step so that the control assembly adjusts the monitoring code stream of the client indicated by the code stream adjusting instruction.

Optionally, after step 508, the ith-level control component performs step 506 every detection time, and transmits the monitoring code stream according to the original cross-level transmission path when the network congestion on the cross-level transmission path corresponding to the code stream adjustment signaling disappears, so that the corresponding client receives the monitoring code stream meeting the desired resolution.

Step 509, when the target sub-transmission path with network congestion on the cross-level transmission path includes the kth level monitoring subsystem, the kth level control component receives a code stream adjustment signaling sent by the kth +1 level control component; step 510 or 511 is performed.

The code stream adjustment signaling comprises a client identifier. Such as: the kth stage control assembly includes

control assemblies

98, 99, and 910 of fig. 9.

Step 510, when the kth-level monitoring subsystem is the lowest-level monitoring subsystem on the target sub-transmission path, the kth-level control component adjusts the monitoring code stream corresponding to the client identifier in the kth-level monitoring subsystem according to the code stream adjustment signaling to obtain an adjusted monitoring code stream; generating an adjustment feedback signaling; and sending the adjustment feedback signaling and the adjusted monitoring code stream to a (k + 1) th level control component.

When the kth-level monitoring subsystem is the lowest-level monitoring subsystem on the target sub-transmission path, that is, the value of the packet loss rate of the kth-level client in the kth-level monitoring subsystem is greater than the threshold value of the packet loss rate, the kth-level monitoring platform sends network congestion to the sub-transmission path of the monitoring code stream to the (k + 1) th-level monitoring platform. At this time, the code stream adjustment signaling is used for controlling the kth-level control component to downwards adjust the resolution of the monitoring code stream requested by the client based on the desired resolution of the client indicated by the client identifier.

In one example, the kth-level monitoring subsystem comprises a kth-level transcoding device and a kth-level monitoring platform for receiving and forwarding monitoring code streams. The kth level control component adjusts the monitoring code stream corresponding to the client identifier in the kth level monitoring subsystem according to the code stream adjustment signaling to obtain the adjusted monitoring code stream, and the method comprises the following steps: the kth level control component calls a code stream forwarding interface of the kth level monitoring platform, and the code stream forwarding interface is used for forwarding the monitoring code stream received by the kth level monitoring platform to the kth level transcoding equipment; calling a transcoding starting interface of the kth level transcoding equipment, wherein the transcoding starting interface is used for transcoding the monitoring code stream received by the kth level transcoding equipment so as to adjust the transcoded monitoring code stream to the resolution indicated by the code stream adjustment signaling (namely the expected resolution of the client indicated by the client identifier); and receiving the adjusted monitoring code stream sent by the kth level transcoding equipment.

And the adjustment feedback signaling is used for indicating that the kth-level control component finishes the adjustment of the resolution of the monitoring code stream.

Such as: referring to fig. 9, after receiving the code stream adjustment instruction, the control component 98 forwards the monitored code stream acquired by the monitoring platform 92 to the transcoding device 911, and the transcoding device 911 adjusts the monitored code stream according to the code stream adjustment instruction to obtain an adjusted monitored code stream; sending the adjusted monitoring code stream to the control component 98; the control component 98 sends the adjusted monitoring code stream to the control component 99; the control component 99 sends the adjusted monitoring code stream to the client 94 and the control component 910 at the previous stage respectively; the control component 910 sends the adjusted monitoring codestream to the client 96. It should be added that after the code stream is adjusted, the monitoring platform 93 stops sending the monitoring code stream to the client 94; wherein, the dotted line in fig. 9 is the code stream transmission path before the code stream adjustment instruction is received.

Step 511, when the kth-level monitoring subsystem is the highest-level monitoring subsystem on the target sub-transmission path, the kth-level control component receives the adjustment feedback signaling and the adjusted monitoring code stream sent by the kth-1-level monitoring subsystem; and sending the adjustment feedback signaling and the adjusted monitoring code stream to the client corresponding to the client identifier.

In one scenario, when the client corresponding to the client identifier is a kth-level client, the kth-level control component sends the adjustment feedback signaling and the adjusted monitoring code stream to the kth-level client corresponding to the client identifier.

The kth-level monitoring subsystem comprises a kth-level monitoring platform for receiving and forwarding monitoring code streams; when the client corresponding to the client identification is a kth-level client, the kth-level control component sends an adjustment feedback signaling and an adjusted monitoring code stream to a kth + 1-level control component; and calling a forwarding stopping interface of the kth-level monitoring platform to enable the kth-level monitoring platform to stop sending the monitoring code stream to the kth-level client corresponding to the client identifier.

In another scenario, when the client corresponding to the client identifier is not the kth-level client, the adjustment feedback signaling and the adjusted monitoring code stream are sent to the kth + 1-level control component, so that the adjustment feedback signaling and the adjusted monitoring code stream are sent to the client corresponding to the client identifier through the kth + 1-level control component.

Optionally, when the value of k is i and the code stream adjustment signaling indicates to adjust the monitoring code stream requested by the i-th level client, the i-th level monitoring subsystem includes an i-th level client for requesting a lower-level monitoring code stream and an i-th level monitoring platform in communication connection with the i-th level client and the i-1-th level monitoring platform in the i-1-th level monitoring subsystem, respectively; at the moment, the ith level control component receives an adjustment feedback signaling and an adjusted monitoring code stream which are sent by the ith-1 level control component, wherein the adjustment feedback signaling is generated after the ith-1 level control component adjusts the code stream in the ith-1 level monitoring subsystem according to the code stream adjustment signaling; sending the adjustment feedback signaling and the adjusted monitoring code stream to an i-th-level client indicated by the code stream adjustment signaling, so that the i-th-level client outputs a code stream adjustment prompt according to the adjustment feedback signaling and outputs the adjusted monitoring code stream; the code stream adjustment prompt is used for indicating that the resolution of the monitored code stream currently displayed by the ith-level client is lower than the expected resolution; and calling a forwarding stopping interface of the i-th level monitoring platform to enable the i-th level monitoring platform to stop sending the monitoring code stream to the i-th level client indicated by the code stream adjusting signaling.

And step 512, when the code stream adjustment signaling is used for indicating to adjust the monitoring code stream requested by the client, the client receives an adjustment feedback signaling and an adjusted monitoring code stream sent by the monitoring platform at the corresponding level.

And 513, outputting the adjusted monitoring code stream by the client.

And 514, the client outputs a code stream adjustment prompt according to the adjustment feedback signaling, wherein the code stream adjustment prompt is used for indicating that the resolution of the monitoring code stream currently displayed by the client is lower than the expected resolution.

As can be seen from the above code stream transmission process, the signaling transmission process among the control component 101, the monitoring device 102, the monitoring platform 103, the transcoding device 104 and the client 105 at the same level is shown in fig. 10, and the transmission process of the monitoring code stream among the control component 111, the monitoring device 112, the monitoring platform 113, the transcoding device 114 and the client 115 at the same level is shown in fig. 11.

In summary, in the code stream transmission method in the monitoring system provided by this embodiment, the control components are arranged in the multi-stage monitoring subsystem, and each stage of the control components obtains the packet loss rate sent by the client at the corresponding stage and sends the packet loss rate to the control component at the highest stage step by step; determining whether network congestion exists in a cross-level transmission path or not by the control assembly at the uppermost level according to the packet loss rate, and adjusting the monitoring code stream when the network congestion exists; the problems that the bandwidth between the upper and lower monitoring platforms has an upper limit, and code stream transmission delay, monitoring picture blocking or mosaic occurrence possibly exist can be solved; the control component can adaptively adjust the monitoring code stream to adjust the bandwidth resource occupied by the monitoring code stream, so that the problems of code stream transmission delay, blockage of a monitoring picture or mosaic occurrence caused by limited bandwidth between an upper monitoring platform and a lower monitoring platform can be avoided, and the transmission effect of the monitoring code stream is ensured.

Alternatively, steps 501, 502, 512, 514, 61, 62, 75 and 76 may be implemented separately as a client-side embodiment; steps 503, 504, 509, 511, 64, 71-74 can be implemented separately as embodiments on the kth level control component side; steps 505 and 508, 71-74 may be implemented separately as an embodiment on the i-th level control component side.

Optionally, based on the foregoing embodiments, the code stream transmission method provided in this embodiment further includes: the kth level control component determines whether the kth +1 level control component is in a normal working state; and when the (k + 1) th level control component is in a normal working state, triggering and executing the step of receiving a code stream adjustment signaling sent by the (k + 1) th level control component when a target sub-transmission path with network congestion on the cross-level transmission path comprises a k-th level monitoring subsystem.

And when the value of k +1 is i and the k +1 th level control assembly is not in a normal working state, updating the k level control assembly to be the current uppermost level control assembly, namely updating the value of i-1 to be i.

And when the value of k +1 is less than i and the (k + 1) th level control assembly is not in a normal working state, updating the (k + 2) th level control assembly into a (k + 1) th level control assembly, and establishing communication connection between the (k + 2) th level control assembly and the (k + 2) th level control assembly.

Optionally, the determining, by the kth level control component, whether the (k + 1) th level control component is in a normal operating state includes: sending detection data packets to a (k + 1) th level control component every detection time; when response information sent by the (k + 1) th level control component is received, determining that the (k + 1) th level control component is in a normal working state; and when the response information sent by the (k + 1) th level control component is not received, determining that the (k + 1) th level control component is not in a normal working state.

In this embodiment, whether the control component of the previous stage is in a normal working state or not is detected, so that the control component of the previous stage can be ensured to be processed in time when being abnormal, and the normal operation of the code stream transmission process is ensured.

Fig. 12 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application, and this embodiment takes an ith-level control component 121 of the code stream transmission system, which is applied to the monitoring system shown in fig. 1, as an example for explanation. The device at least comprises the following modules: a data acquisition module 1210, a congestion determination module 1220, a signaling generation module 1230, and a signaling transmission module 1240.

A data obtaining module 1210, configured to obtain a packet loss rate reported by an i-1 th-level control component, where the packet loss rate includes a packet loss rate of at least one lower-level monitoring subsystem of the i-level monitoring subsystem;

a congestion determining module 1220, configured to determine, according to the packet loss rate, whether a network congestion exists in a cross-level transmission path in the monitoring system, where the cross-level transmission path is used to transmit a monitoring code stream requested by a client, and a monitoring device that collects the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

a signaling generating module 1230, configured to generate a code stream adjustment signaling when there is network congestion in the cross-level transmission path;

a signaling sending module 1240, configured to send the code stream adjustment signaling to the i-1 th level control component, so as to adjust bandwidth resources occupied by the monitored code stream transmitted by the cross-level transmission path.

For relevant details reference is made to the above-described method embodiments.

Fig. 13 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application, and this embodiment takes as an example that the apparatus is applied to the kth-level control component 122 in the code stream transmission system in the monitoring system shown in fig. 1. The device at least comprises the following modules: a data obtaining module 1310, a data sending module 1320, a signaling receiving module 1330, a code stream adjusting module 1340, and a code stream receiving module 1350.

A data obtaining module 1310, configured to receive a first packet loss rate sent by a kth client in the kth-level monitoring subsystem, and/or receive a second packet loss rate sent by a next-level control component of the kth-level control component; the second packet loss rate sent by the lower monitoring device is sent by a client connected with the lower control component in a communication manner;

a data sending module 1320, configured to send the first packet loss rate and/or the second packet loss rate to a (k + 1) -th level control component, so that the (k + 1) -th level control component sends the first packet loss rate and/or the second packet loss rate to the i-th level control component step by step, and the i-th level control component determines, according to the packet loss rate, whether a network congestion exists in a cross-level transmission path in the monitoring system; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; sending the code stream adjustment signaling to the i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

a signaling receiving module 1330, configured to receive a code stream adjustment signaling sent by the (k + 1) th level control component when a target sub-transmission path with network congestion on the cross-level transmission path includes the kth level monitoring subsystem; the code stream adjustment signaling comprises a client identifier;

a code stream adjusting module 1340, configured to adjust, when the kth-level monitoring subsystem is the lowest-level monitoring subsystem on the target sub-transmission path, a monitoring code stream corresponding to the client identifier in the kth-level monitoring subsystem according to the code stream adjustment signaling, so as to obtain an adjusted monitoring code stream; generating an adjustment feedback signaling; sending the adjustment feedback signaling and the adjusted monitoring code stream to the (k + 1) th level control component;

a code stream receiving module 1350, configured to receive an adjustment feedback signaling and an adjusted monitoring code stream sent by the kth-1-level monitoring subsystem when the kth-level monitoring subsystem is the highest-level monitoring subsystem on the target sub-transmission path; and sending the adjustment feedback signaling and the adjusted monitoring code stream to a client corresponding to the client identifier.

Fig. 14 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application, and this embodiment takes an example in which the apparatus is applied to a client in the code stream transmission system in the monitoring system shown in fig. 1. The device at least comprises the following modules: a packet loss rate obtaining module 1410 and a data sending module 1420.

A packet loss rate obtaining module 1410, configured to obtain a packet loss rate after establishing a communication connection with a monitoring platform at a corresponding level;

a data sending module 1420, configured to send the packet loss rate to a control component at a corresponding level, so that the control component at the corresponding level sends the packet loss rate to an i-th level control component layer by layer, and the i-th level control component determines, according to the packet loss rate, whether a network congestion exists in a cross-level transmission path in the monitoring system; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; sending the code stream adjustment signaling to an i-1 level control component to adjust bandwidth resources occupied by the monitoring code stream transmitted by the cross-level transmission path; the cross-level transmission path is used for transmitting a monitoring code stream requested by a client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems; the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1.

It should be noted that: in the above embodiment, when the code stream transmission device in the monitoring system transmits the code stream in the monitoring system, only the division of the functional modules is used for illustration, and in practical application, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the code stream transmission device in the monitoring system is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the code stream transmission apparatus in the monitoring system and the code stream transmission method in the monitoring system provided in the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Fig. 15 is a block diagram of a code stream transmission apparatus in a monitoring system according to an embodiment of the present application, where the apparatus may be an apparatus including the control component 110 in the code stream transmission system in the monitoring system shown in fig. 1 or an apparatus including a client. The apparatus comprises at least a processor 1501 and a memory 1502.

Processor 1501 may include one or more processing cores such as: 4 core processors, 8 core processors, etc. The processor 1501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). Processor 1501 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also referred to as a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 1501 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

The memory 1502 may include one or more computer-readable storage media, which may be non-transitory. The memory 1502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer readable storage medium in the memory 1502 is configured to store at least one signaling for execution by the processor 1501 to implement the codestream transmission method in the monitoring system provided by the method embodiments of the present application.

In some embodiments, the code stream transmission device in the monitoring system may further include: a peripheral interface and at least one peripheral. The processor 1501, memory 1502, and peripheral interface may be connected by a bus or signal line. Each peripheral may be connected to the peripheral interface via a bus, signal line, or circuit board. Illustratively, peripheral devices include, but are not limited to: radio frequency circuit, touch display screen, audio circuit, power supply, etc.

Of course, the code stream transmission apparatus in the monitoring system may also include fewer or more components, which is not limited in this embodiment.

Optionally, the present application further provides a computer-readable storage medium, where a program is stored in the computer-readable storage medium, and the program is loaded and executed by a processor to implement the code stream transmission method in the monitoring system according to the above method embodiment.

Optionally, the present application further provides a computer product, where the computer product includes a computer-readable storage medium, where a program is stored in the computer-readable storage medium, and the program is loaded and executed by a processor to implement the code stream transmission method in the monitoring system according to the foregoing method embodiment.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A code stream transmission method in a monitoring system is characterized in that the monitoring system comprises a plurality of stages of monitoring subsystems, and each stage of monitoring subsystem is in communication connection with a control component; the method is used in an ith-level control assembly which is in communication connection with an ith-level monitoring subsystem, wherein the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1; the method comprises the following steps:

the code stream adjustment signaling comprises a client identifier; and sending the code stream adjustment signaling to the i-1 level control component, and sending the code stream adjustment signaling to the control component indicated by the code stream adjustment signaling step by the i-1 level control component, so that the control component adjusts the monitoring code stream of the client indicated by the code stream adjustment signaling.

2. The method according to claim 1, wherein when there is network congestion in the cross-level transmission path including at least one segment of target sub-transmission path, the generating a code stream adjustment signaling when there is network congestion in the cross-level transmission path comprises:

acquiring a first expected resolution of the client with the lowest level;

3. The method according to claim 2, wherein generating a code stream adjustment signaling when there is network congestion in the cross-level transmission path when the levels of the clients corresponding to the respective cross-level transmission paths are the same comprises:

4. The method according to claim 1, wherein when the stream adjustment signaling is used for adjusting the monitoring stream transmitted by the i-1 th level monitoring subsystem; the ith monitoring subsystem comprises an ith client for requesting a lower-level monitoring code stream and an ith monitoring platform which is respectively in communication connection with the ith client and an ith-1 monitoring platform in the ith-1 monitoring subsystem; after the sending the code stream adjustment signaling to the i-1 th level control component, the method further includes:

5. A code stream transmission method in a monitoring system is characterized in that the monitoring system comprises a plurality of stages of monitoring subsystems, and each stage of monitoring subsystem is in communication connection with a control component; the method is used in a kth-level control assembly in communication connection with a kth-level monitoring subsystem, wherein the ith-level control assembly is the control assembly at the current uppermost level, k is more than or equal to 1 and is less than i, and i is an integer more than 1; the method comprises the following steps:

receiving a first packet loss rate sent by a kth-level client in the kth-level monitoring subsystem, and/or receiving a second packet loss rate sent by a next-level control assembly of the kth-level control assembly; the second packet loss rate sent by the next-level control component is sent by a client connected with the next-level control component in a communication manner;

sending the first packet loss rate and/or the second packet loss rate to a (k + 1) th-level control assembly, so that the (k + 1) th-level control assembly sends the first packet loss rate and/or the second packet loss rate to the i-level control assembly step by step, and the i-level control assembly determines whether network congestion exists in a cross-level transmission path in the monitoring system according to the packet loss rate; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; the code stream adjusting signaling comprises a client terminal identification and is sent to an i-1 level control component, and the i-1 level control component sends the code stream adjusting signaling to a control component indicated by the code stream adjusting signaling step by step so that the control component adjusts the monitoring code stream of the client terminal indicated by the code stream adjusting signaling; the cross-level transmission path is used for transmitting the monitoring code stream requested by the client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems;

when a target sub-transmission path with network congestion on the cross-level transmission path comprises the kth level monitoring subsystem, receiving a code stream adjustment signaling sent by a kth +1 level control component;

6. The method of claim 5, wherein the kth-level monitoring subsystem comprises a kth-level monitoring platform for receiving and forwarding monitoring code streams; when the client corresponding to the client identifier is the kth-level client, the method further includes:

7. The method according to claim 5, wherein before receiving the first packet loss rate sent by the kth-level client in the kth-level monitoring subsystem and/or receiving the second packet loss rate sent by the lower monitoring device of the kth-level control component, the method further includes:

and sending the adjusted monitoring code stream to the kth-level client.

8. A code stream transmission method in a monitoring system is characterized in that the monitoring system comprises a plurality of stages of monitoring subsystems, at least one stage of monitoring subsystem comprises a client and a monitoring platform for providing a monitoring code stream for the client; the method is used in the client, and comprises the following steps:

sending the packet loss rate to a control component at a corresponding level, so that the control component at the corresponding level sends the packet loss rate to an ith level control component layer by layer, and the ith level control component determines whether a cross-level transmission path in the monitoring system has network congestion according to the packet loss rate; generating a code stream adjustment signaling when the network congestion exists in the cross-level transmission path; the code stream adjustment signaling comprises a client identifier; sending the code stream adjustment signaling to an i-1 level control component, and sending the code stream adjustment signaling to a control component indicated by the code stream adjustment signaling step by the i-1 level control component so that the control component adjusts the monitoring code stream of the client indicated by the code stream adjustment signaling; the cross-level transmission path is used for transmitting the monitoring code stream requested by the client, and monitoring equipment for collecting the monitoring code stream and a monitoring subsystem of which the client belongs to different levels; the cross-stage transmission path comprises at least one section of sub-transmission path between different stages of monitoring subsystems; the ith-level control assembly is the control assembly at the current uppermost level, and i is an integer greater than 1.

9. The code stream transmission device in the monitoring system is characterized by comprising a processor and a memory; the memory is stored with a program which is loaded and executed by the processor to realize the code stream transmission method in the monitoring system according to any one of claims 1 to 4; or, implementing a code stream transmission method in the monitoring system according to any one of claims 5 to 7; or, implementing the code stream transmission method in the monitoring system according to claim 8.

10. A computer-readable storage medium, characterized in that the storage medium stores a program, which when executed by a processor, is used for implementing a codestream transmission method in the monitoring system according to any one of claims 1 to 4; or, implementing a code stream transmission method in the monitoring system according to any one of claims 5 to 7; or, implementing the code stream transmission method in the monitoring system according to claim 8.