CN113114978A - Multi-device video negotiation transmission method, system and related device - Google Patents
Multi-device video negotiation transmission method, system and related device Download PDFInfo
- Publication number
- CN113114978A CN113114978A CN202110198860.0A CN202110198860A CN113114978A CN 113114978 A CN113114978 A CN 113114978A CN 202110198860 A CN202110198860 A CN 202110198860A CN 113114978 A CN113114978 A CN 113114978A
- Authority
- CN
- China
- Prior art keywords
- equipment
- video
- transmission
- time
- video frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
Abstract
The application discloses a multi-device video negotiation transmission method, a system and a related device, comprising the following steps: the method comprises the steps that a first device obtains an uplink bandwidth value between the first device and a video monitoring platform, a transmission code stream of the first device and a transmission code stream of at least one second device connected with the first device; responding to the uplink bandwidth value being larger than or equal to the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted upwards according to the difference value; responding to the fact that the uplink bandwidth value is smaller than the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted downwards according to the difference value, or enabling the at least one second device to stop sending the video streams according to the difference value; wherein, the video frame transmission level is positively correlated with the transmission code stream. The video transmission strategy can be adaptively adjusted, and the robustness of the system and the network transmission resources of the key monitoring area are guaranteed.
Description
Technical Field
The present application relates to the field of communications application technologies, and in particular, to a method, a system, and a related apparatus for multi-device video negotiation transmission.
Background
Video monitoring technology has been one of the application technology hotspots concerned by people, and is widely applied to many occasions due to the characteristics of intuition, convenience, rich information content and the like. Based on the characteristics of the 5G network, a single 5G network CAMERA (IP CAMERA, abbreviated as IPC) often cannot fully utilize the uplink bandwidth of the whole link, so that redundant bandwidth is inevitably available for other non-5G IPCs, and the other non-5G IPCs are cascaded to the 5G IPCs for high-speed communication. However, in the cascade IPC sharing the 5G link, the problems of poor video transmission coordination among multiple cameras, low uplink network bandwidth utilization rate and the like exist.
When the access base station uses network resources at the peak of crowd accumulation and the like, the base station is easy to have the condition of insufficient bandwidth. Most of the prior art only carries out self-adaptive adjustment on a video transmission strategy for a single IPC according to network bandwidth, and for multi-IPC video transmission under the cascade environment, no better solution is available at present. Therefore, there is a need to provide a multi-device video adaptive negotiation transmission method to solve the above problems.
Disclosure of Invention
The technical problem mainly solved by the application is to provide a multi-device video negotiation transmission method, a multi-device video negotiation transmission system and a related device, which can adaptively adjust a video transmission strategy.
In order to solve the technical problem, the application adopts a technical scheme that: a multi-device video negotiation transmission method is provided, which comprises the following steps: the method comprises the steps that a first device obtains an uplink bandwidth value between the first device and a video monitoring platform, a transmission code stream of the first device and a transmission code stream of at least one second device connected with the first device; responding to the uplink bandwidth value being larger than or equal to the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the sum of all the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted upwards according to the difference value; responding to the fact that the uplink bandwidth value is smaller than the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the sum of all the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted downwards according to the difference value, or enabling at least one second device to stop sending video streams according to the difference value; wherein the video frame transmission level is positively correlated with the transmission code stream.
Wherein the step of adjusting up the video frame transmission level of at least one of the second devices according to the difference value comprises: judging whether second equipment with the video frame transmission level adjusted downwards before the current moment exists or not according to configuration information, wherein the configuration information comprises the video frame transmission levels and the monitoring area levels of all the second equipment; if the video frame transmission level exists, determining second equipment with the video frame transmission level capable of being adjusted upwards and the video frame transmission level capable of being adjusted upwards according to the sequence of the monitoring area levels from high to low; sending an up-regulation configuration request to the selected second equipment which can be up-regulated, and updating the configuration information; and if the uplink bandwidth value does not exist, returning to the first equipment to obtain the uplink bandwidth value between the first equipment and the video monitoring platform, the transmission code stream of the first equipment and the transmission code stream of at least one second equipment connected with the first equipment.
Wherein the step of adjusting the video frame transmission level of at least one of the second devices downward according to the difference, or stopping the at least one of the second devices from transmitting the video stream according to the difference comprises: judging whether second equipment with the video frame transmission level capable of being adjusted downwards exists or not according to configuration information, wherein the configuration information comprises the video frame transmission levels and the monitoring area levels of all the second equipment; if the video frame transmission level exists, determining second equipment capable of adjusting the video frame transmission level downwards and the video frame transmission level capable of adjusting the video frame transmission level downwards according to the sequence of the levels of the monitoring areas from low to high; sending a down-regulation configuration request to the selected second equipment which can be regulated down, and updating the configuration information; and if the current video stream does not exist, sending a request for stopping sending the video stream to at least one second device according to the sequence of the levels of the monitoring areas from low to high, and updating the configuration information.
Wherein, still include: in response to the first device receiving a connection request from at least one second device; judging whether a second device is connected with the first device or not at present; if so, obtaining the receiving time of the I frame which is received by the first equipment from the connected second equipment for the last time from the current configuration information, and adjusting the I frame generating time of the second equipment to be connected according to the receiving time; if not, obtaining the sending time of the I frame which is sent by the first equipment for the last time from the current configuration information, and adjusting the I frame generating time of the second equipment to be connected according to the sending time; forming an adjusting instruction according to the I frame generation time and updating the configuration information; and sending the adjusting instruction to the corresponding second equipment.
Wherein the step of adjusting the I-frame generation time of the second device to be connected according to the reception time/the transmission time includes: setting a consecutive group of pictures time GOP of the second device to be connected to be identical to the first device; and obtaining the I frame generation time of the second equipment to be connected in the subsequent continuous picture group time GOP according to the obtained receiving time/sending time and the total number of the second equipment which is connected with the first equipment currently according to a binary insertion method.
Wherein the step of forming an adjustment instruction according to the I-frame generation time comprises: acquiring the issuing time of the issuing adjustment instruction according to the I frame generating time; the step of issuing the adjustment instruction to the corresponding second device includes: and responding to the time of the issuing, and issuing the adjusting instruction.
Before the step of determining whether a second device has established a connection with the first device, the method further includes: judging whether the second equipment corresponding to the current connection request is appointed to start sending the video stream; if yes, entering a step of judging whether a second device is connected with the first device or not; otherwise, judging whether the second equipment corresponding to the current connection request is appointed to stop sending the video stream; if yes, further judging whether the second equipment corresponding to the current connection request exists in the configuration information; and if so, deleting the second equipment corresponding to the current connection request in the configuration information.
In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided a multi-video device negotiation transmission system, comprising: the system comprises a video monitoring platform, first equipment in communication connection with the video monitoring platform, and a plurality of second equipment in communication connection with the first equipment; the first device, the video monitoring platform and the plurality of second devices cooperate with each other to implement the negotiation transmission method according to any of the embodiments.
The first equipment is a 5G network camera, and the second equipment is a non-5G network camera.
In order to solve the above technical problem, the present application adopts another technical solution: there is provided a multi-device video negotiation transmission apparatus, comprising a memory and a processor coupled to each other, wherein the processor is configured to execute program instructions stored in the memory to implement the negotiation transmission method according to any of the above embodiments.
In order to solve the above technical problem, the present application adopts another technical solution: there is provided an apparatus having a storage function, which stores program data that can be read by a computer, the program data being executable by a processor to implement the negotiation transmission method according to any one of the above embodiments.
Different from the prior art, the beneficial effects of the application are that: in the application, a first device acquires an uplink bandwidth value between the first device and a video monitoring platform, a transmission code stream of the first device and a transmission code stream of at least one second device connected with the first device; responding to the uplink bandwidth value being larger than or equal to the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted upwards according to the difference value; responding to the fact that the uplink bandwidth value is smaller than the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted downwards according to the difference value, or enabling the at least one second device to stop sending the video streams according to the difference value; wherein, the video frame transmission level is positively correlated with the transmission code stream. By the method, the video transmission strategy can be adaptively adjusted, the robustness of the video monitoring system and the network transmission resources of the key monitoring area are guaranteed, and the flexibility and the robustness of the system are improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein:
FIG. 1 is a schematic diagram of an embodiment of a multi-device video negotiation transmission system according to the present application;
fig. 2 is a schematic flowchart illustrating an embodiment of a multi-device video negotiation transmission method according to the present application;
FIG. 3 is a schematic flow chart of one embodiment of step S12 in FIG. 2;
FIG. 4 is a schematic flow chart illustrating an embodiment of step S13 in FIG. 2;
FIG. 5 is a schematic diagram of a 3-way superposition of I-frame traffic peaks;
FIG. 6 is a flowchart illustrating one embodiment of the steps of a first device receiving a connection request from at least one second device;
FIG. 7 is a schematic flow chart diagram illustrating one embodiment of a step prior to step S20 in FIG. 6;
FIG. 8 is a schematic flow chart illustrating one embodiment of step S21 or step S22 shown in FIG. 6;
FIG. 9 is a schematic diagram of 3 way I-frame generation time staggered according to binary insertion;
FIG. 10 is a block diagram of an embodiment of a multi-device video negotiation transmission apparatus according to the present application;
fig. 11 is a schematic structural diagram of an embodiment of a multi-device video negotiation transmission apparatus according to the present application;
fig. 12 is a schematic diagram of a framework of an embodiment of the device with a storage function according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating a structure of an embodiment of a multi-video device negotiation transmission system according to the present invention. The above-mentioned system includes: a video surveillance platform 10, a first device 12 communicatively coupled to the video surveillance platform 10, and a plurality of second devices 13 communicatively coupled to the first device 12. Wherein the first device 12 is interoperable with the video surveillance platform 10 and the plurality of second devices 13. Wherein, the connection process omits other relay front-end equipment.
Specifically, in this embodiment, the system may further include a base station 11, which is in communication connection with the video monitoring platform 10 and the first device 12, respectively. The first device 12 and the plurality of second devices 13 may be connected through wifi, and the plurality of second devices 13 may be connected through wired or wifi, which is not limited herein.
In one embodiment, the first device 12 may be a 5G webcam and the second device 13 may be a non-5G webcam. Of course, in other embodiments, the first device 12 and the plurality of second devices 13 may be other types of monitoring devices, and are not limited herein.
Since the network resources of the base station 11 are relatively fixed, it is necessary to provide the accessed first device 12, the plurality of second devices 13, and the common user at the same time. When the number of the common users accessing the same base station 11 is small, the base station 11 has enough residual bandwidth to provide the first device 12 and the plurality of second devices 13 for network transmission, and at this time, the first device 11 and the plurality of second devices 12 can perform network transmission as normal. Under a normal network environment, the first device 12 and the second devices 13 which are in communication connection respectively monitor the flow rate conditions of respective areas, the risk level of the current monitoring area is evaluated through the density of the flow rate, monitoring pictures are layered according to the risk level, and the layered monitoring pictures are selectively transmitted to the video monitoring platform 11. When the people flow density is higher and the level of a monitored area is higher, a complete video picture needs to be transmitted, and network resources of the monitored video need to be guaranteed preferentially. When the density of the human flow is smaller and the level of the monitoring area is lower, the video pictures of the low-level code streams can be transmitted, and partial network resources are made available for other key monitoring area devices.
When the crowd aggregates occur to the common users accessing the same base station 11, and the remaining bandwidth of the base station 11 is not enough to supply the first device 12 and the plurality of second devices 13 for network transmission, in order to ensure the preferential transmission of the key area, the monitoring video pictures sent by the first device 12 and the plurality of second devices 13 are adjusted by the multi-device video negotiation transmission method, so that the effect of effectively allocating the network resources is achieved, and the robustness of the system and the network transmission resources of the key monitoring area are ensured.
The monitoring area grade distribution of the application is exemplified by the people flow density parameter, but is not limited to the reference, and also comprises the traffic flow density, the accident scene occurrence situation, the natural disaster occurrence situation and the like.
Referring to fig. 2 in detail, fig. 2 is a flowchart illustrating a multi-device video negotiation transmission method according to an embodiment of the present application. The method comprises the following steps:
s10: the method comprises the steps that a first device obtains an uplink bandwidth value between the first device and a video monitoring platform, a transmission code stream of the first device and a transmission code stream of at least one second device connected with the first device.
S11: judging whether the uplink bandwidth value is larger than or equal to the sum of all transmission code streams;
s12: and if the uplink bandwidth value is greater than or equal to the sum of all the transmission code streams, obtaining the difference between the uplink bandwidth value and the sum of all the transmission code streams, and increasing the video frame transmission level of at least one second device according to the difference.
Specifically, in this embodiment, the second device, which can adjust the video frame transmission level up, may be determined according to the difference between the uplink bandwidth value and the sum of all the transmission code streams, and the sequence from the high level to the low level of the monitored area level. Of course, in other embodiments, the video frame transmission levels of the plurality of second devices may also be adjusted according to the difference between the uplink bandwidth value and the sum of all the transmission code streams, and the order from high to low of the levels of the monitoring area, so as to ensure the video picture quality of the important monitoring area, which is not limited in this application.
Specifically, in this embodiment, the configuration information of the first device and all the second devices is stored in a configuration information parameter table, where the configuration information parameter table includes MAC addresses of all the monitoring devices, a video frame transmission level, a monitoring area level, a sending video frame discarding ratio, and the like, as shown in table 1 below:
table 1: configuration information parameter table
| Device MAC address | For example, 50-65-F3-4D-3B-79 |
| Monitoring zone rank | High, medium, low, normal |
| Video frame transmission level | High, medium, low, extremely low |
| Sending video frame discard |
10％、20％、40％、60％ |
| Statistical size of code stream transmitted last time | E.g., 8Mbps |
| I-frame reception/arrival time | Using ISO standard time |
As shown in table 1 above, the MAC addresses of the first device and all the second devices are stored in a configuration new parameter table, e.g., 50-65-F3-4D-3B-79; the initial stage of the video frame transmission level of the first device and all the second devices is defaulted to a high level; the I frame receiving time/arrival time adopts ISO standard time, and is accurate to milliseconds, for example, 2020-03-02T16:11:41.000+08: 00; the configuration information parameter table also contains the last transmitted codestream statistical size, e.g., 8 Mbps.
Specifically, please refer to fig. 3, wherein fig. 3 is a flowchart illustrating an embodiment of step S12 in fig. 2. The step S12 specifically includes:
s120: and judging whether a second device with the video frame transmission level adjusted downwards before the current moment exists or not according to the configuration information.
S121: and if so, determining the second equipment with the video frame transmission level capable of being adjusted upwards and the video frame transmission level capable of being adjusted upwards according to the sequence from high to low of the monitoring area level.
Specifically, in this embodiment, the classification and the corresponding relationship of the monitoring area level corresponding to the monitoring area and the video frame transmission level are specifically shown in the following table 2:
table 2: the relation table of the monitoring area grade and the video frame transmission grade comprises the following steps:
as can be seen from table 2 above, the higher the level of the monitored area is, the higher the transmission level of the video frame is, the lower the discarding ratio of the transmitted video frame is, the better the picture quality is, and the larger the bandwidth needs to be occupied. Specifically, the video frame dropping here may be dropping P frames, or dropping part of the enhancement layer in SVC coding, as long as the dropping proportion of the video frame is guaranteed, and the specific implementation is not limited herein. Of course, in other embodiments, other ranking rules may be adopted, and are not limited herein.
S122: and sending an up configuration request to the selected second device which can be up-regulated, and updating the configuration information.
Specifically, after step S122, determining whether the first device and all the second devices stop transmitting the video stream may be further included; if yes, ending; otherwise, returning to the step S10, the first device obtains the current uplink bandwidth value between the first device and the video monitoring platform, the transmission code stream of the first device, and the transmission code stream of at least one second device connected to the first device.
S123: if not, the process returns to step S10.
Specifically, if there is no second device with the video frame transmission level adjusted downward before the current time in the configuration information, returning to the step of acquiring, by the first device, the uplink bandwidth value between the first device and the video monitoring platform, the transmission code stream of the first device, and the transmission code stream of at least one second device connected to the first device.
S13: if the uplink bandwidth value is smaller than the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the sum of all the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted downwards according to the difference value, or enabling at least one second device to stop sending the video stream according to the difference value; wherein, the video frame transmission level is positively correlated with the transmission code stream.
Specifically, in the present embodiment, please refer to fig. 4, and fig. 4 is a flowchart illustrating an embodiment of step S13 in fig. 2. The step S13 specifically includes:
s130: and judging whether a second device with the video frame transmission level capable of being adjusted downwards exists according to the configuration information.
S131: and if the video frame transmission level exists, determining the second equipment with the video frame transmission level capable of being adjusted downwards and the video frame transmission level capable of being adjusted downwards according to the sequence of the levels of the monitoring areas from low to high.
S132: and sending a down-regulation configuration request to the selected second equipment which can be regulated down, and updating the configuration information.
Specifically, after step S132, determining whether the first device and all the second devices stop transmitting the video stream may be further included; if yes, ending; otherwise, returning to step S10, the first device obtains the current uplink bandwidth value between the first device and the video monitoring platform, the transmission code stream of the first device, and the transmission code stream of at least one second device connected to the first device.
S133: and if the current video stream does not exist, sending a request for stopping sending the video stream to at least one second device according to the sequence of the levels of the monitoring areas from low to high, and updating the configuration information.
Specifically, after step S133, determining whether the first device and all the second devices stop transmitting the video stream may be further included; if yes, ending; otherwise, returning to step S10, the first device obtains the current uplink bandwidth value between the first device and the video monitoring platform, the transmission code stream of the first device, and the transmission code stream of at least one second device connected to the first device.
By the method, the robustness of the multi-device video negotiation transmission system and the network transmission resources of the key monitoring area can be guaranteed, the network resources can be effectively allocated, and the flexibility and the robustness of the multi-device video negotiation transmission system can be improved.
When the first device receives a connection request from at least one second device, because there is randomness in the time when the user requests the first device and all the second devices, when the first device has access to a large number of second devices, the problem of I-frame traffic peak superposition is likely to occur, specifically referring to fig. 5, where fig. 5 is a schematic diagram of 3-way I-frame traffic peak superposition. As shown in fig. 5, the I frames of the first device, the second device a and the second device B are overlapped in time, and the flow peaks of the I frames are superposed. The larger the ratio of I frame/P frame is, the higher the peak traffic is at the time of superimposition.
Specifically, referring to fig. 6, fig. 6 is a flowchart illustrating an embodiment of a step when a first device receives a connection request from at least one second device. The steps specifically include:
s20: and judging whether a second device is connected with the first device at present.
S21: if so, obtaining the receiving time of the I frame which is received by the first equipment from the connected second equipment for the last time from the current configuration information, and adjusting the I frame generating time of the second equipment to be connected according to the receiving time.
S22: if not, obtaining the sending time of the I frame which is sent by the first equipment for the last time from the current configuration information, and adjusting the I frame generating time of the second equipment to be connected according to the sending time.
S23: and forming an adjusting instruction according to the I frame generation time and updating the configuration information.
S24: and sending the adjusting instruction to the corresponding second equipment.
Specifically, in this embodiment, the step S23 specifically includes: acquiring the issuing time of the issued adjusting instruction according to the I frame generating time, and updating the configuration information; the step S24 specifically includes: and when the issuing time is up, the first equipment issues the adjusting instruction.
Of course, in other embodiments, the step S23 may also specifically include: obtaining the sending time for delaying sending the I frame according to the I frame generating time, forming the sending time into an adjusting instruction, and updating the configuration information; the step S24 may also specifically include: and issuing the adjustment instruction to the corresponding second device, so that the second device automatically sends the video stream when the sending time is reached after receiving the adjustment instruction, where the embodiments of step S23 and step S24 are not limited in this application.
Through the mode, the first device can effectively solve the problem of overlapping of the flow peak values of the I frames of the multi-device video negotiation transmission system by controlling the I frame generation time of the second device.
In one embodiment, referring to fig. 7, fig. 7 is a flowchart illustrating an embodiment of a step before step S20 in fig. 6. Before step S20, the method specifically includes:
s30: and judging whether a second device corresponding to the current connection request is appointed to start sending the video stream.
Specifically, in this embodiment, it is determined whether the first device designates the second device corresponding to the current connection request to start transmitting the video stream, so as to perform the subsequent steps.
S31: if yes, the step of judging whether a second device is connected with the first device or not is carried out.
Specifically, if the first device designates the second device corresponding to the current connection request to start transmitting the video stream, the process proceeds to step S20, and the subsequent steps are executed.
S32: otherwise, judging whether the second equipment corresponding to the current connection request is appointed to stop sending the video stream.
Specifically, if the first device does not specify that the second device corresponding to the current connection request starts to send the video stream, it is determined whether the first device specifies that the second device corresponding to the current connection request stops sending the video stream.
S33: if so, further judging whether the second equipment corresponding to the current connection request exists in the configuration information.
Specifically, if the first device designates the second device corresponding to the current connection request to stop transmitting the video stream, it is further determined whether the information of the second device corresponding to the current connection request is present in the configuration information.
And if the first equipment does not specify that the second equipment corresponding to the current connection request stops sending the video stream, directly entering a step of judging whether the first equipment and all the second equipment stop sending the video stream.
S34: and if so, deleting the second equipment corresponding to the current connection request in the configuration information.
Specifically, if the second device corresponding to the current connection request exists in the configuration information, the second device corresponding to the current connection request is deleted from the configuration information.
In this embodiment, if the second device corresponding to the current connection request does not exist in the configuration information, or after step S34, the method may further include: judging whether the first equipment and all the second equipment stop sending the video stream or not; if yes, ending; if not, returning to the step that the first equipment acquires the uplink bandwidth value between the first equipment and the video monitoring platform, the transmission code stream of the first equipment and the transmission code stream of at least one second equipment connected with the first equipment.
Specifically, in the present embodiment, please refer to fig. 8, and fig. 8 is a flowchart illustrating an implementation manner of step S21 or step S22 in fig. 6. The step S21 or the step S22 specifically includes:
s210: the consecutive group of pictures temporal GOP of the second device to be connected is set to coincide with the first device.
Specifically, before the first device and the plurality of second devices transmit the video streams to the video monitoring platform, the continuous picture time GOP of the second device to be connected is set to coincide with that of the first device, for example, the continuous picture time GOP of the first device and the second device to be connected is set to 2 seconds, 3 seconds, 4 seconds, or the like, which is not limited herein.
S211: and obtaining the I frame generation time of the second equipment to be connected in the subsequent continuous picture group time GOP according to the obtained receiving time/sending time and the total number of the second equipment which is connected with the first equipment currently.
Specifically, in the present embodiment, the reception time/transmission time, the total number of second devices that have currently been connected to the first device, and the continuous group of pictures time GOP update are saved in the configuration information parameter table.
Specifically, the I-frame generation times of the first device and the second device to be connected are obtained according to the receiving time/sending time and the total number of the second devices which are currently connected with the first device, and the I-frame generation time of the second device to be connected in the subsequent continuous group of pictures time GOP according to a binary insertion method.
Referring to FIG. 9, FIG. 9 is a schematic diagram of 3-way I-frame generation time staggered according to binary insertion. For example, the reception/transmission instant of the first device is at a point in time T within one successive group of pictures time GOP1The I frame generation time of the second device A to be connected is adjusted to T2，T2The time point of the middle time in the subsequent continuous picture group time GOP is; the I frame generation time of the second device B to be connected is adjusted to T3，T3For a subsequent successive group of pictures time within GOP T1And T2The point in time at which the intermediate time is located. Wherein, T3May be at T2Before, it can also be at T2Hereinafter, the present application does not limit this. The I frame generation time of all following second devices to be connected can be analogized.
In this way, the I frames of the first device and the plurality of second devices can be effectively generated at different time, and the problem of superposition of the flow peak values of the I frames is solved.
Referring to fig. 10, fig. 10 is a schematic diagram of a framework of an embodiment of a multi-device video negotiation transmission apparatus according to the present application. The apparatus includes an obtaining module 100, a determining module 102, and a processing module 104. The obtaining module 100 is configured to obtain, by a first device, an uplink bandwidth value between the first device and a video monitoring platform, a transmission code stream of the first device, and a transmission code stream of at least one second device connected to the first device. The judging module 102 is configured to judge whether the uplink bandwidth value is greater than or equal to the sum of all the transmission code streams. The processing module 104 is configured to, in response to that the uplink bandwidth value is greater than or equal to the sum of all the transmission code streams, obtain a difference between the uplink bandwidth value and the sum of all the transmission code streams, and adjust up the video frame transmission level of the at least one second device according to the difference. The processing module 104 is further configured to, in response to that the uplink bandwidth value is smaller than the sum of all the transmission code streams, obtain a difference between the uplink bandwidth value and the sum of all the transmission code streams, and lower the video frame transmission level of the at least one second device according to the difference, or stop sending the video stream by the at least one second device according to the difference, where the video frame transmission level is positively correlated with the transmission code stream. By the method, the robustness of the multi-device video negotiation transmission system and network transmission resources of a key monitoring area can be guaranteed, and the flexibility and the robustness of the system are improved.
Referring to fig. 11, fig. 11 is a schematic structural diagram of an embodiment of a multi-device video negotiation transmission apparatus according to the present application, where the apparatus includes a memory 200 and a processor 202 coupled to each other, the memory 200 stores program instructions, and the processor 202 is configured to execute the program instructions to implement the multi-device video negotiation transmission method mentioned in any of the embodiments.
Specifically, the processor 202 may also be referred to as a CPU (Central Processing Unit). The processor 202 may be an integrated circuit chip having signal processing capabilities. The Processor 202 may also be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, processor 202 may be implemented collectively by a plurality of integrated circuit chips.
Referring to fig. 12, fig. 12 is a schematic diagram of a framework of an embodiment of a device with a storage function according to the present application. The apparatus 40 stores program data 400, which can be read by a computer, and the program data 400 can be executed by a processor to implement the multi-device video negotiation transmission method mentioned in any of the above embodiments. The program data 400 may be stored in the apparatus 40 with a storage function in the form of a software product, and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. The aforementioned storage device includes: various media capable of storing program codes, such as a usb disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or terminal devices, such as a computer, a server, a mobile phone, and a tablet.
In summary, different from the situation in the prior art, the method and the device for adjusting the video transmission strategy in the video negotiation transmission system can adjust the video transmission strategy in a self-adaptive manner, can ensure the robustness of the multi-device video negotiation transmission system and network transmission resources in a key monitoring area, improve the flexibility and the robustness of the system, and effectively solve the problem of the superposition of the flow peak values of the I frames in the system.
The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
Claims (11)
1. A multi-device video negotiation transmission method is characterized by comprising the following steps:
the method comprises the steps that a first device obtains an uplink bandwidth value between the first device and a video monitoring platform, a transmission code stream of the first device and a transmission code stream of at least one second device connected with the first device;
responding to the uplink bandwidth value being larger than or equal to the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the sum of all the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted upwards according to the difference value;
responding to the fact that the uplink bandwidth value is smaller than the sum of all the transmission code streams, obtaining a difference value between the uplink bandwidth value and the sum of all the transmission code streams, and enabling the video frame transmission level of at least one second device to be adjusted downwards according to the difference value, or enabling at least one second device to stop sending video streams according to the difference value; wherein the video frame transmission level is positively correlated with the transmission code stream.
2. The negotiated transmission method according to claim 1, wherein the step of adjusting up the video frame transmission level of at least one of the second devices according to the difference comprises:
judging whether second equipment with the video frame transmission level adjusted downwards before the current moment exists or not according to configuration information, wherein the configuration information comprises the video frame transmission levels and the monitoring area levels of all the second equipment;
if the video frame transmission level exists, determining second equipment with the video frame transmission level capable of being adjusted upwards and the video frame transmission level capable of being adjusted upwards according to the sequence of the monitoring area levels from high to low; sending an up-regulation configuration request to the selected second equipment which can be up-regulated, and updating the configuration information;
and if the uplink bandwidth value does not exist, returning to the first equipment to obtain the uplink bandwidth value between the first equipment and the video monitoring platform, the transmission code stream of the first equipment and the transmission code stream of at least one second equipment connected with the first equipment.
3. The method of claim 1, wherein the step of adjusting the video frame transmission level of at least one of the second devices downward according to the difference value or stopping the at least one of the second devices from sending the video stream according to the difference value comprises:
judging whether second equipment with the video frame transmission level capable of being adjusted downwards exists or not according to configuration information, wherein the configuration information comprises the video frame transmission levels and the monitoring area levels of all the second equipment;
if the video frame transmission level exists, determining second equipment capable of adjusting the video frame transmission level downwards and the video frame transmission level capable of adjusting the video frame transmission level downwards according to the sequence of the levels of the monitoring areas from low to high; sending a down-regulation configuration request to the selected second equipment which can be regulated down, and updating the configuration information;
and if the current video stream does not exist, sending a request for stopping sending the video stream to at least one second device according to the sequence of the levels of the monitoring areas from low to high, and updating the configuration information.
4. The negotiation transmission method of claim 1, further comprising:
in response to the first device receiving a connection request from at least one second device;
judging whether a second device is connected with the first device or not at present;
if so, obtaining the receiving time of the I frame which is received by the first equipment from the connected second equipment for the last time from the current configuration information, and adjusting the I frame generating time of the second equipment to be connected according to the receiving time;
if not, obtaining the sending time of the I frame which is sent by the first equipment for the last time from the current configuration information, and adjusting the I frame generating time of the second equipment to be connected according to the sending time;
forming an adjusting instruction according to the I frame generation time and updating the configuration information;
and sending the adjusting instruction to the corresponding second equipment.
5. The negotiation transmission method according to claim 4, wherein the step of adjusting the I-frame generation time of the second device to be connected according to the receiving time/the transmitting time comprises:
setting a consecutive group of pictures time GOP of the second device to be connected to be identical to the first device;
and obtaining the I frame generation time of the second equipment to be connected in the subsequent continuous picture group time GOP according to the obtained receiving time/sending time and the total number of the second equipment which is connected with the first equipment currently according to a binary insertion method.
6. The negotiation transmission method of claim 4,
the step of forming an adjustment instruction according to the I frame generation time comprises: acquiring the issuing time of the issuing adjustment instruction according to the I frame generating time;
the step of issuing the adjustment instruction to the corresponding second device includes: and responding to the time of the issuing, and issuing the adjusting instruction.
7. The negotiation transmission method of claim 4, wherein before the step of determining whether a second device is currently connected to the first device, the method further comprises:
judging whether the second equipment corresponding to the current connection request is appointed to start sending the video stream;
if yes, entering a step of judging whether a second device is connected with the first device or not;
otherwise, judging whether the second equipment corresponding to the current connection request is appointed to stop sending the video stream; if yes, further judging whether the second equipment corresponding to the current connection request exists in the configuration information; and if so, deleting the second equipment corresponding to the current connection request in the configuration information.
8. A multi-video device negotiation transmission system, comprising:
the system comprises a video monitoring platform, first equipment in communication connection with the video monitoring platform, and a plurality of second equipment in communication connection with the first equipment; wherein the first device cooperates with the video surveillance platform and the plurality of second devices to implement the negotiation transmission method of any one of claims 1-8.
9. The negotiation transmission system of claim 8,
the first equipment is a 5G network camera, and the second equipment is a non-5G network camera.
10. A multi-device video negotiation transmission apparatus, comprising a memory and a processor coupled to each other, wherein the processor is configured to execute program instructions stored in the memory to implement the negotiation transmission method according to any one of claims 1 to 7.
11. An apparatus having a storage function, wherein program data is stored and can be read by a computer, and the program data can be executed by a processor to implement the negotiation transmission method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110198860.0A CN113114978B (en) | 2021-02-22 | 2021-02-22 | Multi-device video negotiation transmission method, system and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110198860.0A CN113114978B (en) | 2021-02-22 | 2021-02-22 | Multi-device video negotiation transmission method, system and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113114978A true CN113114978A (en) | 2021-07-13 |
| CN113114978B CN113114978B (en) | 2022-11-22 |
Family
ID=76710107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110198860.0A Active CN113114978B (en) | 2021-02-22 | 2021-02-22 | Multi-device video negotiation transmission method, system and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113114978B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114390291A (en) * | 2022-01-17 | 2022-04-22 | 广州市奥威亚电子科技有限公司 | Video coding stream transmission method and device |
| CN115037965A (en) * | 2022-06-10 | 2022-09-09 | 苏州华兴源创科技股份有限公司 | Multi-channel data transmission method and device based on occupation coordination mechanism |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104125429A (en) * | 2013-04-27 | 2014-10-29 | 杭州海康威视数字技术股份有限公司 | Video data transmission adjusting method and device |
| CN104918133A (en) * | 2014-03-12 | 2015-09-16 | 北京视联动力国际信息技术有限公司 | Method and device for playing video streams in articulated naturality web |
| CN105049783A (en) * | 2014-04-28 | 2015-11-11 | 霍尼韦尔国际公司 | System and method of optimized network traffic in video surveillance system |
| CN107623851A (en) * | 2017-09-01 | 2018-01-23 | 苏州科达科技股份有限公司 | Video code flow transmission control unit and control method |
| WO2018076293A1 (en) * | 2016-10-28 | 2018-05-03 | 海能达通信股份有限公司 | Method and apparatus for adjusting parameter of multimedia communication, and mobile terminal |
| CN110290402A (en) * | 2019-07-31 | 2019-09-27 | 腾讯科技（深圳）有限公司 | A kind of video code rate method of adjustment, device, server and storage medium |
| CN111787292A (en) * | 2020-09-04 | 2020-10-16 | 浙江大华技术股份有限公司 | Data transmission method based on multiple network cameras and related device |
| CN112055176A (en) * | 2020-08-28 | 2020-12-08 | 浙江大华技术股份有限公司 | Video code stream-based negotiation transmission method, electronic equipment and recording storage medium |
| CN112203043A (en) * | 2020-09-14 | 2021-01-08 | 中标慧安信息技术股份有限公司 | Video transmission method and system |
-
2021
- 2021-02-22 CN CN202110198860.0A patent/CN113114978B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104125429A (en) * | 2013-04-27 | 2014-10-29 | 杭州海康威视数字技术股份有限公司 | Video data transmission adjusting method and device |
| CN104918133A (en) * | 2014-03-12 | 2015-09-16 | 北京视联动力国际信息技术有限公司 | Method and device for playing video streams in articulated naturality web |
| CN105049783A (en) * | 2014-04-28 | 2015-11-11 | 霍尼韦尔国际公司 | System and method of optimized network traffic in video surveillance system |
| WO2018076293A1 (en) * | 2016-10-28 | 2018-05-03 | 海能达通信股份有限公司 | Method and apparatus for adjusting parameter of multimedia communication, and mobile terminal |
| CN107623851A (en) * | 2017-09-01 | 2018-01-23 | 苏州科达科技股份有限公司 | Video code flow transmission control unit and control method |
| CN110290402A (en) * | 2019-07-31 | 2019-09-27 | 腾讯科技（深圳）有限公司 | A kind of video code rate method of adjustment, device, server and storage medium |
| CN112055176A (en) * | 2020-08-28 | 2020-12-08 | 浙江大华技术股份有限公司 | Video code stream-based negotiation transmission method, electronic equipment and recording storage medium |
| CN111787292A (en) * | 2020-09-04 | 2020-10-16 | 浙江大华技术股份有限公司 | Data transmission method based on multiple network cameras and related device |
| CN112203043A (en) * | 2020-09-14 | 2021-01-08 | 中标慧安信息技术股份有限公司 | Video transmission method and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114390291A (en) * | 2022-01-17 | 2022-04-22 | 广州市奥威亚电子科技有限公司 | Video coding stream transmission method and device |
| CN114390291B (en) * | 2022-01-17 | 2023-12-22 | 广州市奥威亚电子科技有限公司 | Video coding stream transmission method and device |
| CN115037965A (en) * | 2022-06-10 | 2022-09-09 | 苏州华兴源创科技股份有限公司 | Multi-channel data transmission method and device based on occupation coordination mechanism |
| CN115037965B (en) * | 2022-06-10 | 2024-01-19 | 苏州华兴源创科技股份有限公司 | Multichannel data transmission method and device based on occupation coordination mechanism |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113114978B (en) | 2022-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110536179B (en) | Content distribution system and method | |
| CN103595655B (en) | The RSVP of data flows in interconnection networks | |
| CN102484748B (en) | Managing video adaptive algorithm | |
| CN113114978B (en) | Multi-device video negotiation transmission method, system and related device | |
| RU2491751C2 (en) | Method of controlling temporary access in digital video network | |
| TWI680662B (en) | Method for distributing available bandwidth of a network amongst ongoing traffic sessions run by devices of the network, corresponding device | |
| WO2019119837A1 (en) | Service identification method and device, and network device | |
| CN101707551B (en) | Data transmission method and device | |
| US8448213B2 (en) | Contents distribution system, contents distribution server, contents reproduction terminal, and contents distribution method | |
| CN111083536B (en) | Method and device for adjusting video code rate | |
| CN113194134B (en) | Node determination method and device | |
| WO2022193890A1 (en) | Resource scheduling method and apparatus | |
| CN112055176A (en) | Video code stream-based negotiation transmission method, electronic equipment and recording storage medium | |
| CN108881931A (en) | A kind of data buffering method and the network equipment | |
| CN113301299A (en) | Multi-channel video transmission method, system, terminal and storage medium | |
| CN112055177A (en) | Video layering-based negotiation transmission method, electronic device and recording medium | |
| CN114245196B (en) | Screen recording and stream pushing method and device, electronic equipment and storage medium | |
| CN107251487B (en) | Bandwidth distribution method and device in network and computer readable storage medium | |
| US20140099040A1 (en) | Image processing device and image processing method | |
| CN112055175B (en) | Video partition-based negotiation transmission method, electronic device and recording medium | |
| CN112511848B (en) | Live broadcast method, server side and computer readable storage medium | |
| Nguyen et al. | An adaptive streaming method of 360 videos over HTTP/2 protocol | |
| CN113038543A (en) | QoE value adjusting method and device | |
| JP2018505632A (en) | Computer-readable recording medium storing a program for providing network adaptive content and network adaptive content providing apparatus | |
| CN112261354B (en) | Data transmission method based on multiple network cameras and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |