WO2023185292A1 - 视频数据的处理方法、装置、边缘计算网关及存储介质 - Google Patents
视频数据的处理方法、装置、边缘计算网关及存储介质 Download PDFInfo
- Publication number
- WO2023185292A1 WO2023185292A1 PCT/CN2023/076021 CN2023076021W WO2023185292A1 WO 2023185292 A1 WO2023185292 A1 WO 2023185292A1 CN 2023076021 W CN2023076021 W CN 2023076021W WO 2023185292 A1 WO2023185292 A1 WO 2023185292A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- collision
- frame
- frames
- combination
- adjusted
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 32
- 230000005540 biological transmission Effects 0.000 claims abstract description 63
- 238000001514 detection method Methods 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 claims abstract description 13
- 238000000034 method Methods 0.000 claims abstract description 10
- 238000011156 evaluation Methods 0.000 claims description 70
- 230000007423 decrease Effects 0.000 claims description 14
- 230000000737 periodic effect Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 5
- 238000005070 sampling Methods 0.000 description 5
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- This application relates to the field of video processing technology, and in particular to a video data processing method, device, edge computing gateway and storage medium.
- Video data packets are transmitted in frame units.
- Common frame types include I frames and P frames.
- the I frame contains complete picture information and has a low compression rate, which is the basis for P frame decoding.
- P frames rely on I frames for inter-frame prediction, difference transmission, and higher compression rates. Since the amount of data in an I frame is much larger than that of a P frame, after passing through a bandwidth-limited transmission channel, the I frame will take up more transmission time, which may cause reception delays at the receiving end. If the transmission time of the I frame exceeds a certain threshold, it will cause video playback freeze at the receiving end. Therefore, the transmission of I frames needs to control its transmission time, which imposes requirements on the bandwidth of the transmission channel.
- the bandwidth of video data transmission is not measured by the second-level "average rate”, but is calculated by the I-frame data volume and the limited transmission time. Assume that the converted bandwidth requirement is the "peak rate”, and the peak value is Rates typically exceed the average rate by an order of magnitude. Compared with the I frame, the data volume of the P frame is much smaller. Under the same channel bandwidth, the possibility of affecting the data transmission of the P frame will be much smaller, which is ignored here.
- Embodiments of the present application provide a video data processing method, device, edge computing gateway, and storage medium.
- embodiments of the present application provide a video data processing method, which includes: performing collision detection on multiple video streams in a transmission channel to determine an I-frame collision combination; the I-frame collision combination includes at least two in the same Overlapping I frames during the transmission period; select the combination with the largest number of I frames from the I frame collision combination as the combination to be adjusted; perform I frame period adjustment on the I frames in the combination to be adjusted, so that the adjusted The collision situation of the multiple video streams is improved.
- embodiments of the present application provide an evaluation method for video stream adjustment, which includes: performing collision detection on multiple video streams before and after adjustment to obtain an I-frame collision combination; when the I-frame collision combination satisfies the evaluation condition - , and any one of evaluation condition 2, evaluation condition 3, and evaluation condition 4 is met, it is determined that the collision situation of the multiple video streams after adjustment is improved; wherein: evaluation condition 1: the adjusted maximum number of collision frames is less than or Equal to the maximum number of collision frames before adjustment, the maximum number of collision frames is the number of I frames included in the combination with the largest number of I frames among the I frame collision combinations; evaluation Evaluation condition two: The maximum collision flow is less than or equal to the preset flow threshold, and the maximum collision flow is the sum of the flows of each I frame in the collision time period of the combination with the largest number of I frames in the I frame collision combination; Evaluation condition three : The number of occurrences of the maximum number of collision frames decreases; Evaluation condition four: The maximum collision time duty cycle decreases, and the maximum collision time duty cycle is
- embodiments of the present application provide a video data processing device, including at least one control processor and a memory configured to be communicatively connected to the at least one control processor; the memory stores information that can be processed by the at least one control processor. Instructions executed by the control processor, the instructions are executed by the at least one control processor, so that the at least one control processor can execute the video data processing method described in the above embodiment of the first aspect.
- an embodiment of the present application provides an edge computing gateway, including the video data processing device described in the above embodiment of the third aspect.
- embodiments of the present application provide a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute as described in the first embodiment. video data processing methods.
- Figure 1 is a schematic transmission diagram of a certain I frame of six video streams provided by the embodiment of the present application;
- Figure 2 is a flow chart of a video data processing method provided in Embodiment 1 of the present application.
- Figure 3 is a flow chart of a video data processing method provided in Embodiment 2 of the present application.
- Figure 4 is a flow chart of a video data processing method provided in Embodiment 3 of the present application.
- Figure 5 is an original sample flow diagram provided in Embodiment 4 of the present application.
- Figure 6 is a sample flow diagram after the third iteration provided in Embodiment 4 of the present application.
- Figure 7 is an original sample flow diagram provided in Embodiment 5 of the present application.
- Figure 8 is a sample flow diagram after the second iteration provided in Embodiment 5 of the present application.
- Figure 9 is a flow chart of a video stream adjustment evaluation method provided by an embodiment of the present application.
- Figure 10 is a schematic structural diagram of a video data processing device provided by an embodiment of the present application.
- Video data packets are transmitted in frame units.
- Common frame types include I frames and P frames.
- the I frame contains complete picture information and has a low compression rate, which is the basis for P frame decoding.
- P frames rely on I frames for inter-frame prediction, difference transmission, and higher compression rates. Since the amount of data in an I frame is much larger than that of a P frame, after passing through a bandwidth-limited transmission channel, the I frame will take up more transmission time, which may cause reception delays at the receiving end. If the transmission time of the I frame exceeds a certain threshold, it will cause video playback freeze at the receiving end. Therefore, the transmission of I frames needs to control its transmission time, which imposes requirements on the bandwidth of the transmission channel.
- the bandwidth of video data transmission is not measured by the second-level "average rate”, but is calculated by the I-frame data volume and the limited transmission time. Assume that the converted bandwidth requirement is the "peak rate”, and the peak value is Rates typically exceed the average rate by an order of magnitude. Compared with the I frame, the data volume of the P frame is much smaller. Under the same channel bandwidth, the possibility of affecting the data transmission of the P frame will be much smaller, which is ignored here.
- Figure 1 shows an I-frame of six video streams, and the I-frame collision combination is as follows:
- I-frame collision combinations with an I-frame number of 2 video stream (1,2) combination, video stream (2,3) combination, video (4,5) combination;
- I-frame collision combinations with an I-frame number of 3 video stream (2,3,4) combination, video stream (3,4,5) combination.
- Embodiments of the present application provide a video data processing method, device, edge computing gateway and storage medium, which can improve the collision of video streams in the transmission channel and avoid I-frame collisions between video streams by adjusting the I-frame period. Collision will cause a sudden increase in the cell air interface bandwidth or transmission network bandwidth to avoid impact on the network and avoid video freezes.
- the first embodiment of the present application provides a video data processing method, including but not limited to step S210, step S220, and step S230.
- Step S210 Perform collision detection on multiple video streams in the transmission channel to determine an I-frame collision combination; the I-frame collision combination includes at least two overlapping I frames in the same transmission period.
- two overlapping I frames in the same transmission period may be partially overlapping or completely overlapping.
- Step S220 Select the combination with the largest number of I frames from the I frame collision combinations as the combination to be adjusted.
- Step S230 Adjust the I frame period for the I frames in the combination to be adjusted, so that the collision situation of the adjusted multiple video streams is improved.
- i 2,...,K
- K is the number of I frames in the I frame set to be adjusted
- Ti is the period of the i-th I frame in the I frame set to be adjusted
- IframeDelta is the period adjustment step.
- the I frame collision combination is not only the combination with the largest number of I frames, but also the combination with the most occurrences.
- the period is adjusted from the second I frame of the I frame collision combination.
- the period of the second I frame is increased by 1 period adjustment step IframeDelta than the original one.
- the period of the third I frame is increased by 2 period adjustment steps than the original one.
- IframeDelta the period of the K-th I frame is increased by K-1 period adjustment step IframeDelta, which can make the period of the I frame in the I frame collision combination wider to reduce the collision probability of the I frame collision combination.
- the I frame with the most occurrences is selected from the combination to be adjusted as the I frame set to be adjusted; when the I frames in the I frame set to be adjusted belong to different I frame collision combinations, the I frame period Adjustments include:
- T1 T1+IframeDelta
- T1 is the period of the first I frame in the I frame set to be adjusted
- IframeDelta is the period adjustment step.
- the first I frame in the I frame set to be adjusted is selected for periodic adjustment, and then the adjustment effect can be further evaluated and the next step can be continued.
- step S310 the above video data processing method also includes step S310 and step S320, wherein:
- Step S310 Perform collision detection on the adjusted multiple video streams to obtain an adjusted I-frame collision combination
- Step S320 When the adjusted I-frame collision combination satisfies evaluation condition one and any one of evaluation condition two, evaluation condition three, and evaluation condition four, determine that the collision conditions of the adjusted multiple video streams have been improved and perform the adjustment. ;
- Evaluation condition 1 The maximum number of collision frames after adjustment is less than or equal to the maximum number of collision frames before adjustment.
- the maximum number of collision frames is the number of I frames included in the combination with the largest number of I frames in the I-frame collision combination;
- Evaluation condition 2 The maximum collision traffic is less than or equal to the preset traffic threshold, and the maximum collision traffic is the sum of the traffic of each I frame in the collision time period of the combination with the largest number of I frames in the I frame collision combination;
- Evaluation condition three The number of occurrences of the maximum number of collision frames decreases
- Evaluation condition four The maximum collision time duty cycle decreases.
- the maximum collision time duty cycle is the ratio of the I frame collision duration to the total transmission duration of all I frames in the I frame collision combination with the largest number of I frames.
- the maximum number of collision frames in the evaluation condition 1 is the first important consideration to determine whether the collision situation has been improved before and after adjustment.
- the maximum collision flow rate in evaluation condition two, the number of occurrences of the maximum collision frame number in evaluation condition three, and the maximum collision time duty cycle in evaluation condition four are used to determine the collision situation before and after adjustment.
- the preset traffic threshold is set according to the transmission channel bandwidth, and the maximum collision flow is greater than the preset flow
- the threshold value indicates that frame freeze may occur; when the evaluation condition 2, evaluation condition 3 and evaluation condition 4 are not met, even if the evaluation condition 1 is met, it is judged that the adjusted collision situation has worsened.
- the first step is to conduct testing. Obtain multiple video streams in the transmission channel and record them as sample 1; then perform collision detection. In the detection results, at most N frames of collision are encountered, and the adjustment starts from N frame collisions. It should be noted that there may be multiple combinations of N-frame collisions, so all combinations of N-frame collisions need to be screened out.
- the second step is to make adjustments. If there are multiple N-frame collision combinations, then:
- Step 2.1 take the union of all combinations of N frame collisions
- Step 2.2 sort all the I frames in the union set from most to least occurrences
- Step 2.3 select the I frame that appears the most. If there are multiple I frames that appear the most, select them all;
- the third step is to evaluate. Evaluate whether the collision situation will improve after the new I frame cycle of each I frame takes effect.
- Step 3.1 if the maximum number of collision frames after adjustment is greater than the maximum number of collision frames before adjustment, that is, the maximum number of collision frames after adjustment is greater than before adjustment, the adjustment result of the second step will not be implemented and the process ends;
- Step 3.2 if the adjusted maximum number of collision frames is less than or equal to the maximum number of collision frames before adjustment, compare the maximum collision traffic with the preset traffic threshold;
- Step 3.2.1 if the maximum collision flow rate during the collision period is less than the preset flow threshold, the adjustment result of the second step is implemented and the process ends;
- Step 3.2.2 if the maximum collision flow rate during the collision period is greater than or equal to the preset flow threshold, then:
- Step 3.2.2.1 if the number of occurrences of the adjusted maximum collision frame number is less than before adjustment, or the adjusted maximum collision time duty cycle is less than the maximum collision time duty cycle before adjustment, then the second step of adjustment is implemented The result; and based on the current output, repeat the second and third steps, that is, each output is the input of the next iteration (ie, sample 2 is used as sample 1);
- Step 3.2.2.2 otherwise, the adjustment result of the second step will not be implemented and the process ends.
- the evaluation in the third step is a prediction of the future, so new data can only be generated according to the average period of the I frame period of the current data;
- the maximum collision time duty cycle is the length of the I frame collision in the combination of N frame collisions.
- the maximum collision traffic is the total traffic of the N-frame collision combination in the collision period.
- the I frame period (unit: ms) of the camera is modified based on the above output.
- What is actually adjusted in the protocol is GovLength, which is the I frame interval. , so it is also necessary to convert the output I frame period combined with the frame rate into an I frame interval.
- the conversion method is:
- Scene settings 20 video streams are randomly initiated within 3 seconds, with random starting times; the periods of all video streams are randomly selected within [1s, 1.5s, 2s]; the continuous transmission time of all I frames is set to the same (it can also be different, In this embodiment, it is set to be the same); the sampling duration is 30s.
- Step1 Detect collision results, as follows:
- 6-frame collisions [4,3,7,11,18,13], [4,3,7,11,18,13], [4,3,7,11,18,13], [4 ,3,7,11,18,13], [4,3,7,11,18,13]; 6-frame collision duty cycle: 0.0007; 5-frame collision duty cycle: 0.023; It is actually a 6-frame collision, Recurring periodically.
- the original sample duty cycle is as follows:
- Step2 Since there is actually only one collision combination, and these streams are all in one collision combination, the I frame period of this combination will be adjusted starting from the second stream, then the new I frame period of the following streams is:
- IframeDelta is the adjustment step size, assumed to be 100ms.
- Step3 Evaluate whether the collision situation will improve after the new I frame period takes effect for each stream.
- starttime(j) current I frame starttime of stream 13+j ⁇ T6;
- new data with a sampling duration of 30 seconds is generated, recorded as sample 2, and then collision detection is performed.
- Step 2 If the number of occurrences of maximum collision frame 6 decreases, the adjustment results of step 2 will be implemented. And based on the current output, repeat Step2 to Step3. That is, each output is the input for the next iteration (i.e. sample 2 serves as sample 1).
- Scene settings 20 video streams are randomly initiated within 1s, with random starting times; the periods of all video streams are randomly selected within [1s, 1.5s, 2s]; the continuous transmission time of all I frames is set to the same (it can also be different, In this embodiment, it is set to be the same); the sampling duration is 30s.
- Step1 The collision detection results are as follows:
- Step2 Because the maximum 5-frame collision has multiple combinations: [1,13,17,8,2], [5,15,16,6,3], [15,16,6,3,13], [ 12,1,17,8,2];
- Step3 Evaluate whether the collision situation will improve after the new I frame period takes effect.
- the best result is the output of the second iteration, and the final result of the second iteration is output.
- the video data processing method provided by the above embodiments of this application solves the problem of limited air interface bandwidth in the community. For example: in the network operation stage, the air interface capacity of the community has been determined. According to the number of cameras deployed in the community and the camera parameters, the I frame size can be calculated; Detect the collision of I frames. If the probability of collision is very small, no further processing is required; if the probability of collision is very high, adjust the I frame period of the collision I frame as mentioned above to reduce the demand for air interface bandwidth for current video transmission; at the same time, if The bandwidth requirement has been significantly improved, and it is possible to further increase the number of cameras; through the embodiment of the present application, the I-frame cycle adjustment of the colliding I-frames reduces video freezes and improves the video transmission speed.
- a second embodiment of the present application provides an evaluation method for video stream adjustment, including but not limited to step S910 and step S920.
- Step S910 Perform collision detection on multiple video streams before and after adjustment to obtain an I-frame collision combination.
- Step S920 When the I-frame collision combination satisfies the first evaluation condition and any one of the second evaluation condition, the third evaluation condition, and the fourth evaluation condition, it is determined that the collision situation of the adjusted multiple video streams has been improved.
- Evaluation condition 1 The maximum number of collision frames after adjustment is less than or equal to the maximum number of collision frames before adjustment, and the maximum number of collision frames is the number of I frames included in the combination with the largest number of I frames among the I frame collision combinations;
- Evaluation condition two the maximum collision traffic is less than or equal to the preset traffic threshold, and the maximum collision traffic is the sum of the traffic of each I frame in the collision time period of the combination with the largest number of I frames in the I frame collision combination;
- Evaluation condition three the number of occurrences of the maximum number of collision frames decreases
- Evaluation condition four The maximum collision time duty cycle decreases.
- the maximum collision time duty cycle is the combination of the I frame collision combination with the largest number of I frames, the duration of the I frame collision and the total transmission duration of all I frames. ratio.
- a third embodiment of the present application provides a video data processing device 1000, including at least one control processor 1010 and a memory 1020 configured to be communicatively connected with the at least one control processor 1010;
- the memory 1020 stores instructions that can be executed by the at least one control processor 1010, and the instructions are executed by the at least one control processor 1010, so that the at least one control processor 1010 can perform the above first aspect implementation.
- a fourth embodiment of the present application provides an edge computing gateway, including the video data processing device 1000 described in the above third embodiment.
- a fifth embodiment of the present application provides a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute the above embodiment of the first aspect.
- the described video data processing method is a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute the above embodiment of the first aspect.
- the I-frame collision combinations that collide are detected, and the combination with the largest number of I frames is selected as the combination to be adjusted and the I-frame week Periodic adjustment, thereby improving the collision situation of multiple video streams; giving priority to the I frame collision combination with the largest number of I frames for period adjustment, which can prevent the colliding I frames from colliding from the next period, effectively reducing the number of I frames in the transmission channel
- the number of collisions reduces the demand for air interface bandwidth for current video transmission, reduces video freezes, and improves the transmission speed of video streams.
- Embodiments of the present application include a video data processing method, a video stream adjustment evaluation method, a video data processing device, an edge computing gateway, and a computer-readable storage medium.
- the I-frame collision combinations that collide are detected, and the combination with the largest number of I frames is selected as the combination to be adjusted and the I-frame Periodic adjustment, thereby improving the collision situation of multiple video streams; giving priority to the I-frame collision combination with the largest number of I-frames for period adjustment, which can prevent the colliding I-frames from colliding from the next period, effectively reducing the number of I-frames in the transmission channel
- the number of collisions reduces the demand for air interface bandwidth for current video transmission, reduces video freezes, and improves the transmission speed of video streams.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disk, DVD or other optical disk storage, magnetic cassettes, magnetic tape, disk storage or other magnetic storage devices, or may be used Any other medium that stores the desired information and can be accessed by a computer. Additionally, it is known to those of ordinary skill in the art that communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
本申请公开了一种视频数据的处理方法、视频流调整的评估方法、视频数据的处理装置、边缘计算网关及计算机可读存储介质。视频数据的处理方法包括：对传输通道中的多个视频流进行碰撞检测，确定I帧碰撞组合（S210）；从所述I帧碰撞组合中选取I帧数量最大的组合，作为待调整组合（S220）；对所述待调整组合中的I帧进行I帧周期调整，以使调整后的所述多个视频流的碰撞情况得到改善（S230）。
Description
相关申请的交叉引用
本申请基于申请号为202210332030.7、申请日为2022年03月31日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
本申请涉及视频处理技术领域，尤其涉及一种视频数据的处理方法、装置、边缘计算网关及存储介质。
视频数据报文是以帧为单位传输的，常见帧类型包括I帧和P帧。其中I帧包含完整画面信息，压缩率较低，是P帧解码基础。P帧依靠I帧进行帧间预测，差值传送，压缩率较高。由于I帧数据量比P帧大很多，在经过带宽受限的传输通道后，I帧会占用更多的传输时间，可能导致接收端出现接收延迟的问题。如果I帧的传输时间超过了某个门限，那么就会导致接收端出现视频播放卡顿的现象。因此I帧的传输是需要控制其传输时间的，这就对传输通道带宽提出要求。即视频数据传输的带宽并不是按秒级的“平均速率”来衡量的，而是按I帧数据量以及限定的传输时间来计算的，假设这个折算后的带宽要求为“峰值速率”，峰值速率通常会超出平均速率一个数量级。相对于I帧，P帧的数据量小很多，在相同通道带宽的情况下，P帧数据传输受影响的可能性会小很多，此处忽略。
当多路摄像头同时传输数据时，受I帧/P帧业务模型的影响，n个I帧数据在传输通道内“同时”传输时，对传输通道的带宽要求会急剧抬升(n*峰值速率)。“同时”指的是若干个I帧数据在传输时段内会有时间上的重叠(从部分重叠到完全重叠)，也即“I帧碰撞”场景。传输通道中视频流的碰撞若不解决，会造成小区空口带宽或传输网络带宽突然增大、视频出现卡顿的情况，对网络造成冲击。
发明内容
本申请实施例提供一种视频数据的处理方法、装置、边缘计算网关及存储介质。
第一方面，本申请实施例提供一种视频数据的处理方法，包括：对传输通道中的多个视频流进行碰撞检测，确定I帧碰撞组合；所述I帧碰撞组合包括至少两个在同一传输时段上重叠的I帧；从所述I帧碰撞组合中选取I帧数量最大的组合，作为待调整组合；对所述待调整组合中的I帧进行I帧周期调整，以使调整后的所述多个视频流的碰撞情况得到改善。
第二方面，本申请实施例提供一种视频流调整的评估方法，包括：对调整前后的多个视频流分别进行碰撞检测，得到I帧碰撞组合；当所述I帧碰撞组合满足评估条件一，且满足评估条件二、评估条件三、评估条件四中的任意一个，确定调整后的所述多个视频流的碰撞情况得到改善；其中：评估条件一：调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，所述最大碰撞帧数为所述I帧碰撞组合中I帧数量最大的组合所包含的I帧数量；评
估条件二：最大碰撞流量小于或者等于预设流量阈值，所述最大碰撞流量为所述I帧碰撞组合中I帧数量最大的组合的各个I帧在碰撞时间段的流量之和；评估条件三：所述最大碰撞帧数的出现次数下降；评估条件四：最大碰撞时间占空比下降，所述最大碰撞时间占空比为所述I帧碰撞组合中I帧数量最大的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值。
第三方面，本申请实施例提供一种视频数据处理装置，包括至少一个控制处理器和被设置为与所述至少一个控制处理器通信连接的存储器；所述存储器存储有可被所述至少一个控制处理器执行的指令，所述指令被所述至少一个控制处理器执行，以使所述至少一个控制处理器能够执行如上第一方面实施例所述的视频数据的处理方法。
第四方面，本申请实施例提供一种边缘计算网关，包括如上第三方面实施例所述的视频数据的处理装置。
第五方面，本申请实施例提供一种计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使计算机执行如上第一方面实施例所述的视频数据的处理方法。
本申请的其它特征和优点将在随后的说明书中阐述，并且，部分地从说明书中变得显而易见，或者通过实施本申请而了解。本申请的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。
附图用来提供对本申请技术方案的进一步理解，并且构成说明书的一部分，与本申请的实施例一起用于解释本申请的技术方案，并不构成对本申请技术方案的限制。
下面结合附图和实施例对本申请进一步地说明；
图1是本申请实施例提供的6个视频流的某个I帧的传输示意图；
图2是本申请实施例一提供的一种视频数据的处理方法的流程图；
图3是本申请实施例二提供的一种视频数据的处理方法的流程图；
图4是本申请实施例三提供的一种视频数据的处理方法的流程图；
图5是本申请实施例四提供的原始样本流量图；
图6是本申请实施例四提供的第3次迭代后的样本流量图；
图7是本申请实施例五提供的原始样本流量图；
图8是本申请实施例五提供的第2次迭代后的样本流量图；
图9是本申请实施例提供的一种视频流调整的评估方法的流程图；
图10是本申请实施例提供的一种视频数据处理装置的结构示意图。
本部分将详细描述本申请的具体实施例，本申请的部分实施例在附图中示出，附图的作用在于用图形补充说明书文字部分的描述，使人能够直观地、形象地理解本申请的每个技术特征和整体技术方案，但其不能理解为对本申请保护范围的限制。
在本申请的描述中，如果有描述到第一、第二只是用于区分技术特征为目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量或者隐含指明所指示的技
术特征的先后关系。
本申请的描述中，除非另有明确的限定，设置、安装、连接等词语应做广义理解，所属技术领域技术人员可以结合技术方案的具体内容合理确定上述词语在本申请中的具体含义。
视频数据报文是以帧为单位传输的，常见帧类型包括I帧和P帧。其中I帧包含完整画面信息，压缩率较低，是P帧解码基础。P帧依靠I帧进行帧间预测，差值传送，压缩率较高。由于I帧数据量比P帧大很多，在经过带宽受限的传输通道后，I帧会占用更多的传输时间，可能导致接收端出现接收延迟的问题。如果I帧的传输时间超过了某个门限，那么就会导致接收端出现视频播放卡顿的现象。因此I帧的传输是需要控制其传输时间的，这就对传输通道带宽提出要求。即视频数据传输的带宽并不是按秒级的“平均速率”来衡量的，而是按I帧数据量以及限定的传输时间来计算的，假设这个折算后的带宽要求为“峰值速率”，峰值速率通常会超出平均速率一个数量级。相对于I帧，P帧的数据量小很多，在相同通道带宽的情况下，P帧数据传输受影响的可能性会小很多，此处忽略。
当多路摄像头同时传输数据时，受I帧/P帧业务模型的影响，n个I帧数据在传输通道内“同时”传输时，对传输通道的带宽要求会急剧抬升(n*峰值速率)。“同时”指的是若干个I帧数据在传输时段内会有时间上的重叠(从部分重叠到完全重叠)，也即“I帧碰撞”场景。传输通道中视频流的碰撞若不解决，会造成小区空口带宽或传输网络带宽突然增大、视频出现卡顿的情况，对网络造成冲击。
参照图1所示，图1为6个视频流的某个I帧，其I帧碰撞组合如下：
I帧数量为2的I帧碰撞组合：视频流(1,2)组合，视频流(2,3)组合，视频(4,5)组合；
I帧数量为3的I帧碰撞组合：视频流(2,3,4)组合，视频流(3,4,5)组合。
本申请实施例提供一种视频数据的处理方法、装置、边缘计算网关及存储介质，能够改善传输通道中视频流的碰撞情况，通过对I帧的周期进行调整，从而避免视频流间I帧进行碰撞，造成小区空口带宽或传输网络带宽突然增大的情况，避免对网络造成冲击，以及避免视频出现卡顿。
下面结合附图，对本申请实施例作进一步阐述。
参照图2，本申请的第一方面实施例提供一种视频数据的处理方法，包括但不限于步骤S210、步骤S220和步骤S230。
步骤S210：对传输通道中的多个视频流进行碰撞检测，确定I帧碰撞组合；I帧碰撞组合包括至少两个在同一传输时段上重叠的I帧。
需要说明的是，本申请方案没有提供具体的碰撞检测技术，本申请可以采用任意一种视频I帧碰撞检测技术，只要能够检测出发生碰撞的视频流组合即可。
还需要说明的是，两个在同一传输时段上重叠的I帧，既可以是部分重叠，也可以是完全重叠。
步骤S220：从I帧碰撞组合中选取I帧数量最大的组合，作为待调整组合。
需要说明的是，若I帧数量最大的组合有多个，则所有I帧数量最大的组合均被选取出来作为待调整组合。
可以理解的是，选取I帧数量最大的组合，进行周期调整，可以使碰撞的I帧从下一周期开始避免碰撞，有效减少传输通道中的I帧碰撞数目。例如参照图1，先对I帧数量为3
的I帧碰撞组合进行调整。
步骤S230：对待调整组合中的I帧进行I帧周期调整，以使调整后的多个视频流的碰撞情况得到改善。
在上述的视频数据的处理方法中，从待调整组合中选取出现次数最多的I帧，作为待调整I帧集；当待调整I帧集中的I帧属于同一I帧碰撞组合，I帧周期调整包括：
Ti＝Ti+(i-1)*IframeDelta；
Ti＝Ti+(i-1)*IframeDelta；
其中：i＝2,...,K；K为待调整I帧集中的I帧的数量；Ti为待调整I帧集中第i个I帧的周期；IframeDelta为周期调整步长。
可以理解的是，当待调整I帧集中的I帧属于同一I帧碰撞组合，说明该I帧碰撞组合既是I帧数量最大的组合，也是出现次数最多的组合。从该I帧碰撞组合的第2个I帧进行周期调整，第2个I帧的周期比原来增加1个周期调整步长IframeDelta，第3个I帧的周期比原来增加2个周期调整步长IframeDelta，第K个I帧的周期比原来增加K-1个周期调整步长IframeDelta，从而可以使得该I帧碰撞组合中的I帧的周期拉开，以降低该I帧碰撞组合的碰撞几率。
在上述的视频数据的处理方法中，从待调整组合中选取出现次数最多的I帧，作为待调整I帧集；当待调整I帧集中的I帧属于不同的I帧碰撞组合，I帧周期调整包括：
选取待调整I帧集的第一个I帧进行周期调整：T1＝T1+IframeDelta；
其中：T1为待调整I帧集的第一个I帧的周期；IframeDelta为周期调整步长。
可以理解的是，当待调整I帧集中的I帧属于不同的I帧碰撞组合，选取调整I帧集的第一个I帧进行周期调整，然后可以通过进一步评估调整后的效果，继续进行下一步的调整。
参照图3，在上述的视频数据的处理方法中，还包括步骤S310和步骤S320，其中：
步骤S310：对调整后的多个视频流进行碰撞检测，得到调整后的I帧碰撞组合；
步骤S320：当调整后的I帧碰撞组合满足评估条件一，且满足评估条件二、评估条件三、评估条件四中的任意一个，确定调整后的多个视频流的碰撞情况得到改善并执行调整；
其中：
评估条件一：调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，最大碰撞帧数为I帧碰撞组合中I帧数量最大的组合所包含的I帧数量；
评估条件二：最大碰撞流量小于或者等于预设流量阈值，最大碰撞流量为I帧碰撞组合中I帧数量最大的组合的各个I帧在碰撞时间段的流量之和；
评估条件三：最大碰撞帧数的出现次数下降；
评估条件四：最大碰撞时间占空比下降，最大碰撞时间占空比为I帧碰撞组合中I帧数量最大的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值。
在上述的视频数据的处理方法中，当不满足评估条件一，或者评估条件二、评估条件三和评估条件四均不满足，确定调整后的多个视频流的碰撞情况出现恶化并停止执行调整。
可以理解的是，评估条件一中的最大碰撞帧数，作为判断调整前后的碰撞情况是否得到改善的第一重要考量因素，当调整后的I帧碰撞组合的最大碰撞帧数增大，即可直接判断调整后的碰撞情况出现恶化；评估条件二中的最大碰撞流量、评估条件三中的最大碰撞帧数的出现次数和评估条件四中的最大碰撞时间占空比作为判断调整前后的碰撞情况是否得到改善的次要考量因素，其中预设流量阈值根据传输通道带宽而设置，最大碰撞流量大于预设流量
阈值，说明可能会导致卡帧；当评估条件二、评估条件三和评估条件四均不满足，即使满足评估条件一，也判断调整后的碰撞情况出现恶化。
在上述的视频数据的处理方法中，确定调整后的多个视频流的碰撞情况得到改善并执行调整之后，还包括：
再次选取待调整组合，并进行I帧周期调整，直至调整后的多个视频流的碰撞情况出现恶化。
可以理解的是，一次调整后的碰撞情况得到改善，并不意味着已经调整至最优情况，因此可以继续进行调整，直到碰撞情况出现恶化才停止调整。
下面，结合图4对本申请实施例的视频数据的处理方法作出全面完整的介绍。
第一步，进行检测。获取传输通道中的多个视频流，记为样本1；然后进行碰撞检测，检测结果中，最多为N帧碰撞，则从N帧碰撞开始调整。需要说明的是，N帧碰撞的组合可能存在多个，因此需要筛选出N帧碰撞的所有组合。
第二步，进行调整。若有多个N帧碰撞的组合，则：
步骤2.1，将N帧碰撞的所有组合取并集；
步骤2.2，将并集中的所有I帧按照出现次数从多到少进行排序；
步骤2.3，选择出现次数最多的I帧，若出现次数最多的I帧有多个，则都选取；
步骤2.3.1，若选取出来的I帧都在同一个N帧碰撞的组合中，则将该组合从第2个I帧进行I帧周期调整。假设该组合中共有K个I帧，则第2个至第K个I帧的周期依次调整为：Ti＝Ti+(i-1)*IframeDelta；i＝2,...,K；Ti为第i个I帧的周期；IframeDelta为周期调整步长；
步骤2.3.2，若选取出来的I帧分散于不同的组合中，则选取并集的第一个I帧进行I帧周期调整，即T1＝T1+IframeDelta，T1为第一个I帧的周期；IframeDelta为周期调整步长。
第三步，进行评估。评估各个I帧新的I帧周期生效后，碰撞情况是否会改善。
首先，根据上面第二步所做的调整生成所有I帧的起始时间点，并且采用与样本1相同采样时长的样本量，记为样本2，然后进行检测，并输出评估指标：最大碰撞帧数、最大碰撞流量、最大碰撞帧数的出现次数、最大碰撞时间占空比。
步骤3.1，若调整后的最大碰撞帧数大于调整前的最大碰撞帧数,即调整后最大碰撞帧数比调整前变大，则不实施第二步的调整结果，流程结束；
步骤3.2，若调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，则将最大碰撞流量与预设流量阈值进行比较；
步骤3.2.1，若碰撞时间段的最大碰撞流量小于预设流量阈值，则实施第二步的调整结果，流程结束；
步骤3.2.2，若碰撞时间段的最大碰撞流量大于或者等于预设流量阈值，则：
步骤3.2.2.1，若调整后的最大碰撞帧数的出现次数比调整前少，或者，调整后的最大碰撞时间占空比小于调整前的最大碰撞时间占空比，则实施第二步的调整结果；并且根据当前输出，重复第二步和第三部，即每次输出是下一次迭代的输入(即样本2作为样本1)；
步骤3.2.2.2，否则，不实施第二步的调整结果，流程结束。
其中：第三步中的评估是对未来的预测，因此只能按照当前数据的I帧周期均值周期生成新数据；最大碰撞时间占空比为该N帧碰撞的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值；最大碰撞流量为该N帧碰撞的组合在碰撞时间段的总流量。
可以理解的是，本申请实施例提供的视频数据的处理方法，应用于摄像头时，根据上述输出，修改摄像头的I帧周期(单位：ms)，协议中实际调的是GovLength，即I帧间隔，所以还需要将输出的I帧周期结合帧率转化为I帧间隔，转化方法为：
根据已有数据包计算相邻帧之间的平均间隔，即I帧与P帧之间、P帧与P帧之间、P帧与I帧之间的平均间隔interval_avg；然后根据新得到的I帧周期Ti和平均间隔interval_avg得到新的I帧间隔＝I帧周期Ti/平均间隔interval_avg，最后执行新的I帧间隔。
下面，结合在实际场景中的具体的实施例，对本申请实施例提供的视频数据的处理方法作进一步介绍。
实施例1：稀疏场景；
场景设置：在3s内随机发起20个视频流，起始时间随机；所有视频流的周期在[1s,1.5s,2s]内随机选取；所有I帧持续传输时间设置为相同(也可以不同，该实施例中设为相同)；采样时长30s。
Step1:检测碰撞结果，如下：
5次6帧碰撞：[4,3,7,11,18,13]、[4,3,7,11,18,13]、[4,3,7,11,18,13]、[4,3,7,11,18,13]、[4,3,7,11,18,13]；6帧碰撞占空比0.0007；5帧碰撞占空比：0.023；实际是一次6帧碰撞，周期性重复出现。
原始样本占空比如下表：
原始样本流量图如图5所示。
第1次迭代：
Step2:因实际只有一种碰撞组合，并且都在这些流都在一个碰撞组合中，则将该组合从第2个流开始进行I帧周期调整,则下述流的新I帧周期依次为：
流3:T2＝T_3+(2-1)×IframeDelta；
流7:T3＝T_7+(3-1)×IframeDelta；
流11:T4＝T_11+(4-1)×IframeDelta；
流18:T5＝T_18+(5-1)×IframeDelta；
流13:T6＝T_13+(6-1)×IframeDelta；
其中，IframeDelta为调整步长,假设为100ms。
Step3:评估各流生效新的I帧周期后，碰撞情况是否会改善。
则上述被调整流后续新的I帧起始时间点为：
流3:starttime(j)＝流3的当前I帧starttime+j×T2；
流7:starttime(j)＝流7的当前I帧starttime+j×T3；
流11:starttime(j)＝流11的当前I帧starttime+j×T4；
流18:starttime(j)＝流18的当前I帧starttime+j×T5；
流13:starttime(j)＝流13的当前I帧starttime+j×T6；
按照上述方法生成采样时长30s的新数据，记为样本2，然后进行碰撞检测。
输出：碰撞时间占空比和冲突时间段的流量，这两个值作为评估指标。
1>调整后最大碰撞帧6≤调整前最大碰撞帧数N＝6；
2>碰撞时间段的流量(6个I帧碰撞产生的流量)≥目标流量throughput_tartget(假设为5个I帧碰撞产生的流量)；
3>最大碰撞帧6出现次数减少，则实施step2的调整结果。并且根据当前输出，重复Step2至Step3。即每次输出是下一次迭代的输入(即样本2作为样本1)。
经过上述4迭代，最好结果是第3次迭代输出，最终输出第3次结果。
说明：上述每次迭代都基于前一次的输出结果。
第3次迭代占空比如下表所示：
第3次迭代的流量图如图6所示。
实施例2：密集场景；
场景设置：在1s内随机发起20个视频流，起始时间随机；所有视频流的周期在[1s,1.5s,2s]内随机选取；所有I帧持续传输时间设置为相同(也可以不同，该实施例中设为相同)；采样时长30s。
Step1:检测碰撞结果如下：
20次5帧碰撞：[1,13,17,8,2]、[5,15,16,6,3]、[15,16,6,3,13]、[12,1,17,8,2]、[1,13,17,8,2]、[5,15,16,6,3]、[15,16,6,3,13]、[12,1,17,8,2]、[1,13,17,8,2]、[5,15,16,6,3]、[15,16,6,3,13]、[12,1,17,8,2]、[1,13,17,8,2]、[5,15,16,6,3]、[15,16,6,3,13]、[12,1,17,8,2]、[1,13,17,8,2]、[5,15,16,6,3]、[15,16,6,3,13]、[12,1,17,8,2]，5帧碰撞占比0.0130。
说明：上述20次5帧碰撞为同一组4个数据重复出现5次。该样本文件中，1/13/17/8/2/15/16/6/3这些数据流均出现10次。
原始数据占空比如下表所示：
原始数据流量图如图7所示。
第1次迭代：
Step2:因最大的5帧碰撞有多个组合：[1,13,17,8,2]、[5,15,16,6,3]、[15,16,6,3,13]、[12,1,17,8,2]；
取上述组合并集并按出现次数从大到小排序，为{1,13,17,8,2,15,16,6,3,5,12}；
出现次数最多的流分在多个碰撞组合中，则选择并集的第一个流(流1)进行I帧周期调整，即T’＝T_1+IframeTransmitTime,其中，IframeDelta为调整步长,假设为100ms。
Step3:评估生效新的I帧周期后，碰撞情况是否会改善。
则上述被调整流后续新的I帧起始时间点为：
流1:starttime(j)＝流1的当前I帧starttime+j×T’；
生成采样时长30s的新数据，记为样本2，然后进行碰撞检测。
输出：碰撞时间占空比和冲突时间段的流量，这两个值作为评估指标。
1>最大碰撞帧5≤初始最大碰撞帧数N＝5；
2>碰撞时间段的流量(5个I帧碰撞产生的流量)≥目标流量throughput_tartget(假设为5个I帧碰撞产生的流量)；
3>最大碰撞帧5出现次数减少，或者调整后的最大I帧碰撞的碰撞时间占空比0.009<调整前的最大I帧碰撞的碰撞时间占空比0.013，则实施step2的调整结果。并且根据当前输出，重复Step2至Step3。即每次输出是下一次迭代的输入(即样本2作为样本1)。
经过上述3迭代，最好结果是第2次迭代输出，最终输出第2次结果。
第2次迭代之后的占空比如下表所示：
第2次迭代之后的流量图参照图8所示。
本申请上述实施例提供的视频数据的处理方法，解决小区空口带宽受限，如：网络运营阶段，小区空口容量已定，根据小区部署的摄像头个数和摄像头参数，可计算出I帧大小；检测I帧碰撞情况，若碰撞概率很小，不需要再做处理；若碰撞概率很大，进行上述的碰撞I帧的I帧周期调整，降低当前视频传输对空口带宽的需求；同时，若对带宽需求改善显著，还可能进一步增加摄像头数目；通过本申请实施例对碰撞的I帧进行I帧周期调整，减少了视频卡顿，提高了视频传输速度。
另外，参照图9，本申请的第二方面实施例提供一种视频流调整的评估方法，包括但不限于步骤S910和步骤S920。
步骤S910：对调整前后的多个视频流分别进行碰撞检测，得到I帧碰撞组合。
步骤S920：当I帧碰撞组合满足评估条件一，且满足评估条件二、评估条件三、评估条件四中的任意一个，确定调整后的多个视频流的碰撞情况得到改善。
其中：
评估条件一：调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，所述最大碰撞帧数为所述I帧碰撞组合中I帧数量最大的组合所包含的I帧数量；
评估条件二：最大碰撞流量小于或者等于预设流量阈值，所述最大碰撞流量为所述I帧碰撞组合中I帧数量最大的组合的各个I帧在碰撞时间段的流量之和；
评估条件三：所述最大碰撞帧数的出现次数下降；
评估条件四：最大碰撞时间占空比下降，所述最大碰撞时间占空比为所述I帧碰撞组合中I帧数量最大的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值。
另外，参照图10，本申请的第三方面实施例提供一种视频数据处理装置1000，包括至少一个控制处理器1010和被设置为与所述至少一个控制处理器1010通信连接的存储器1020；所述存储器1020存储有可被所述至少一个控制处理器1010执行的指令，所述指令被所述至少一个控制处理器1010执行，以使所述至少一个控制处理器1010能够执行如上第一方面实施例所述的视频数据的处理方法。
另外，本申请的第四方面实施例提供一种边缘计算网关，包括如上第三方面实施例所述的视频数据的处理装置1000。
另外，本申请的第五方面实施例提供一种计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使计算机执行如上第一方面实施例所述的视频数据的处理方法。
根据本申请实施例提供的方案，通过先对传输通道中的视频流进行碰撞检测，从而检测出发生碰撞的I帧碰撞组合，并从中选取I帧数量最大的组合作为待调整组合并进行I帧周
期调整，进而改善多个视频流的碰撞情况；优先对I帧数量最大的I帧碰撞组合进行周期调整，可以使碰撞的I帧从下一周期开始避免碰撞，有效减少传输通道中的I帧碰撞数目，降低当前视频传输对空口带宽的需求，减少视频卡顿，提高视频流的传输速度。
本申请实施例包括视频数据的处理方法、视频流调整的评估方法、视频数据的处理装置、边缘计算网关及计算机可读存储介质。根据本申请实施例提供的方案，通过先对传输通道中的视频流进行碰撞检测，从而检测出发生碰撞的I帧碰撞组合，并从中选取I帧数量最大的组合作为待调整组合并进行I帧周期调整，进而改善多个视频流的碰撞情况；优先对I帧数量最大的I帧碰撞组合进行周期调整，可以使碰撞的I帧从下一周期开始避免碰撞，有效减少传输通道中的I帧碰撞数目，降低当前视频传输对空口带宽的需求，减少视频卡顿，提高视频流的传输速度。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统可以被实施为软件、固件、硬件及其适当的组合。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质或非暂时性介质和通信介质或暂时性介质。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息诸如计算机可读指令、数据结构、程序模块或其他数据的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘DVD或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
上面结合附图对本申请实施例作了详细说明，但是本申请不限于上述实施例，在所述技术领域普通技术人员所具备的知识范围内，还可以在不脱离本申请宗旨的前提下作出各种变化。
Claims (10)
- 一种视频数据的处理方法，包括：对传输通道中的多个视频流进行碰撞检测，确定I帧碰撞组合；所述I帧碰撞组合包括至少两个在同一传输时段上重叠的I帧；从所述I帧碰撞组合中选取I帧数量最大的组合，作为待调整组合；对所述待调整组合中的I帧进行I帧周期调整，以使调整后的所述多个视频流的碰撞情况得到改善。
- 根据权利要求1所述的视频数据的处理方法，其中，从所述待调整组合中选取出现次数最多的I帧，作为待调整I帧集；当所述待调整I帧集中的I帧属于同一所述I帧碰撞组合，所述I帧周期调整包括：
Ti＝Ti+(i-1)*IframeDelta；其中：i＝2,...,K；K为所述待调整I帧集中的I帧的数量；Ti为所述待调整I帧集中第i个I帧的周期；IframeDelta为周期调整步长。 - 根据权利要求1所述的视频数据的处理方法，其中，从所述待调整组合中选取出现次数最多的I帧，作为待调整I帧集；当所述待调整I帧集中的I帧属于不同的所述I帧碰撞组合，所述I帧周期调整包括：选取所述待调整I帧集的第一个I帧进行周期调整：T1＝T1+IframeDelta；其中：T1为所述待调整I帧集的第一个I帧的周期；IframeDelta为周期调整步长。
- 根据权利要求1所述的视频数据的处理方法，还包括以下步骤：对调整后的所述多个视频流进行碰撞检测，得到调整后的I帧碰撞组合；当所述调整后的I帧碰撞组合满足评估条件一，且满足评估条件二、评估条件三、评估条件四中的任意一个，确定调整后的所述多个视频流的碰撞情况得到改善并执行所述调整；其中：评估条件一：调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，所述最大碰撞帧数为所述I帧碰撞组合中I帧数量最大的组合所包含的I帧数量；评估条件二：最大碰撞流量小于或者等于预设流量阈值，所述最大碰撞流量为所述I帧碰撞组合中I帧数量最大的组合的各个I帧在碰撞时间段的流量之和；评估条件三：所述最大碰撞帧数的出现次数下降；评估条件四：最大碰撞时间占空比下降，所述最大碰撞时间占空比为所述I帧碰撞组合中I帧数量最大的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值。
- 根据权利要求1所述的视频数据的处理方法，其中，当不满足评估条件一，或者评估条件二、评估条件三和评估条件四均不满足，确定调整后的所述多个视频流的碰撞情况出现恶化并停止执行所述调整；其中：评估条件一：调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，所述最大碰撞帧数为所述I帧碰撞组合中I帧数量最大的组合所包含的I帧数量；评估条件二：最大碰撞流量小于或者等于预设流量阈值，所述最大碰撞流量为所述I帧碰撞组合中I帧数量最大的组合的各个I帧在碰撞时间段的流量之和；评估条件三：所述最大碰撞帧数的出现次数下降；评估条件四：最大碰撞时间占空比下降，所述最大碰撞时间占空比为所述I帧碰撞组合中I帧数量最大的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值。
- 根据权利要求4所述的视频数据的处理方法，其中，确定调整后的所述多个视频流的碰撞情况得到改善并执行所述调整之后，还包括：再次选取待调整组合，并进行I帧周期调整，直至调整后的所述多个视频流的碰撞情况出现恶化。
- 一种视频流调整的评估方法，包括：对调整前后的多个视频流分别进行碰撞检测，得到I帧碰撞组合；当所述调整后的I帧碰撞组合满足评估条件一，且满足评估条件二、评估条件三、评估条件四中的任意一个，确定调整后的所述多个视频流的碰撞情况得到改善；其中：评估条件一：调整后的最大碰撞帧数小于或者等于调整前的最大碰撞帧数，所述最大碰撞帧数为所述I帧碰撞组合中I帧数量最大的组合所包含的I帧数量；评估条件二：最大碰撞流量小于或者等于预设流量阈值，所述最大碰撞流量为所述I帧碰撞组合中I帧数量最大的组合的各个I帧在碰撞时间段的流量之和；评估条件三：所述最大碰撞帧数的出现次数下降；评估条件四：最大碰撞时间占空比下降，所述最大碰撞时间占空比为所述I帧碰撞组合中I帧数量最大的组合中，I帧碰撞的时长与所有I帧的传输总时长的比值。
- 一种视频数据处理装置，包括至少一个控制处理器和被设置为与所述至少一个控制处理器通信连接的存储器；所述存储器存储有可被所述至少一个控制处理器执行的指令，所述指令被所述至少一个控制处理器执行，以使所述至少一个控制处理器能够执行如权利要求1至6任一项所述的视频数据的处理方法。
- 一种边缘计算网关，包括权利要求8所述的视频数据处理装置。
- 一种计算机可读存储介质，所述计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使计算机执行如权利要求1至6任一项所述的视频数据的处理方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210332030.7A CN116939286A (zh) | 2022-03-31 | 2022-03-31 | 视频数据的处理方法、装置、边缘计算网关及存储介质 |
| CN202210332030.7 | 2022-03-31 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023185292A1 true WO2023185292A1 (zh) | 2023-10-05 |
Family
ID=88199126
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/076021 WO2023185292A1 (zh) | 2022-03-31 | 2023-02-14 | 视频数据的处理方法、装置、边缘计算网关及存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116939286A (zh) |
| WO (1) | WO2023185292A1 (zh) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102209237A (zh) * | 2011-05-26 | 2011-10-05 | 杭州华三通信技术有限公司 | 降低点播实况媒体流时i帧重叠的方法及视频管理服务器 |
| US20160105684A1 (en) * | 2014-10-14 | 2016-04-14 | Huawei Technologies Co., Ltd. | System and Method for Video Communication |
| CN111787292A (zh) * | 2020-09-04 | 2020-10-16 | 浙江大华技术股份有限公司 | 基于多个网络摄像机的数据传输方法及相关装置 |
| CN112203100A (zh) * | 2020-09-03 | 2021-01-08 | 中国移动通信集团广东有限公司 | 降低上下行带宽需求的传输方法及系统 |
| CN113259717A (zh) * | 2021-07-15 | 2021-08-13 | 腾讯科技（深圳）有限公司 | 视频流的处理方法、装置、设备及计算机可读存储介质 |
| CN113923506A (zh) * | 2020-07-10 | 2022-01-11 | 成都鼎桥通信技术有限公司 | 视频数据处理的方法、装置、边缘计算网关及存储介质 |
-
2022
- 2022-03-31 CN CN202210332030.7A patent/CN116939286A/zh active Pending
-
2023
- 2023-02-14 WO PCT/CN2023/076021 patent/WO2023185292A1/zh unknown
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102209237A (zh) * | 2011-05-26 | 2011-10-05 | 杭州华三通信技术有限公司 | 降低点播实况媒体流时i帧重叠的方法及视频管理服务器 |
| US20160105684A1 (en) * | 2014-10-14 | 2016-04-14 | Huawei Technologies Co., Ltd. | System and Method for Video Communication |
| CN113923506A (zh) * | 2020-07-10 | 2022-01-11 | 成都鼎桥通信技术有限公司 | 视频数据处理的方法、装置、边缘计算网关及存储介质 |
| CN112203100A (zh) * | 2020-09-03 | 2021-01-08 | 中国移动通信集团广东有限公司 | 降低上下行带宽需求的传输方法及系统 |
| CN111787292A (zh) * | 2020-09-04 | 2020-10-16 | 浙江大华技术股份有限公司 | 基于多个网络摄像机的数据传输方法及相关装置 |
| CN113259717A (zh) * | 2021-07-15 | 2021-08-13 | 腾讯科技（深圳）有限公司 | 视频流的处理方法、装置、设备及计算机可读存储介质 |
Non-Patent Citations (1)
| Title |
|---|
| BABA YUKI; MATSUMOTO AKIRA; SHAO PENG; DAVIS PETER: "Wireless LAN frame collision control using collision type information", IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES (ICECCT), 2015, 5-7 MARCH 2015, COIMBATORE, IEEE, 5 March 2015 (2015-03-05), pages 1 - 6, XP033210323, ISBN: 978-1-4799-6084-2, DOI: 10.1109/ICECCT.2015.7226166 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116939286A (zh) | 2023-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2450468C2 (ru) | Система и способ адаптации к перегрузке сети | |
| CN111836079A (zh) | 一种视频码流的传输方法及装置 | |
| CN104394484A (zh) | 一种无线实时流媒体传输方法 | |
| CN106954101B (zh) | 一种低延迟实时视频流媒体无线传输的丢帧控制方法 | |
| CN104618195A (zh) | 带宽估测方法和装置 | |
| JP6575529B2 (ja) | 可用帯域推定システム、可用帯域推定方法、受信装置及び受信装置の制御プログラム | |
| CN113301392B (zh) | 码率确定方法、装置、设备及存储介质 | |
| CN114520891B (zh) | 一种基于多个前端视频设备的数据传输方法及相关装置 | |
| CN111064954A (zh) | 一种可供旁路视频播放质量评价使用的方法和装置 | |
| CN112019873A (zh) | 视频码率调整方法、装置和电子设备 | |
| WO2023185292A1 (zh) | 视频数据的处理方法、装置、边缘计算网关及存储介质 | |
| CN114501066A (zh) | 视频流处理方法、系统、计算机设备和存储介质 | |
| CN106888376A (zh) | 基于丢包分析的多级联网监控视频质量实时评价方法 | |
| CN107566795B (zh) | 一种提高实时画面流畅度的方法、装置及系统 | |
| JP6468193B2 (ja) | 通信装置及び通信装置におけるネットワーク利用可能帯域推定方法、並びにネットワーク利用可能帯域推定プログラム | |
| CN105828112A (zh) | 基于竞争的网络中的带宽获取 | |
| CN105227894B (zh) | 一种视频会议的实现方法及多点控制单元 | |
| CN111741319B (zh) | 直播数据处理方法、装置及电子设备 | |
| US8234683B2 (en) | Method and apparatus for controlling channel for providing internet protocol television service | |
| JP2015050591A (ja) | 情報処理装置、情報処理方法およびプログラム | |
| CN112688824B (zh) | Rtp丢包检测方法、装置、设备及计算机可读存储介质 | |
| CN111953612A (zh) | 数据传输控制方法及装置 | |
| US10772010B2 (en) | Transmission apparatus, method for controlling transmission, and recording medium | |
| CN111510703B (zh) | 一种视频播放方法、装置及系统 | |
| WO2023174346A1 (zh) | 碰撞检测方法、电子设备、计算机可读介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23777671 Country of ref document: EP Kind code of ref document: A1 |