CN114900698A - Forward error correction-based video transmission method, apparatus and computer storage medium - Google Patents

Forward error correction-based video transmission method, apparatus and computer storage medium Download PDF

Info

Publication number
CN114900698A
CN114900698A CN202210216682.4A CN202210216682A CN114900698A CN 114900698 A CN114900698 A CN 114900698A CN 202210216682 A CN202210216682 A CN 202210216682A CN 114900698 A CN114900698 A CN 114900698A
Authority
CN
China
Prior art keywords
video
level
frames
redundancy
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210216682.4A
Other languages
Chinese (zh)
Inventor
黄信杰
王飞
叶奇
邓志吉
刘明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Dahua Technology Co Ltd
Original Assignee
Zhejiang Dahua Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Dahua Technology Co Ltd filed Critical Zhejiang Dahua Technology Co Ltd
Priority to CN202210216682.4A priority Critical patent/CN114900698A/en
Publication of CN114900698A publication Critical patent/CN114900698A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385—Channel allocation; Bandwidth allocation

Abstract

The invention discloses a video transmission method, a device and a computer storage medium based on forward error correction, wherein the video transmission method based on forward error correction comprises the following steps: carrying out level configuration on video frames of video data; respectively calculating the redundancy corresponding to the video frames of each level; and carrying out data coding and redundancy coding on the video frames of all levels to obtain a data packet and a redundancy packet for transmission. Through the mode, the video blocking problem under the scene with large network fluctuation can be solved.

Description

Forward error correction-based video transmission method, apparatus and computer storage medium
Technical Field
The present invention relates to the field of communications, and in particular, to a method, apparatus, and computer storage medium for video transmission based on forward error correction.
Background
In a video communication system based on an IP network, network packet loss has a very serious influence on the real-time video communication quality. Such as mosaic, katoon, skip seconds, etc. problems with the video, resulting in a very poor user experience. Especially in the case of a bad network environment, packet loss is a problem that often occurs.
An Automatic Repeat-reQuest (ARQ) method is a common method, in which a receiver finds a packet loss and then requests a sender to retransmit the packet. And under the environment of large network delay, the real-time video browsing is easy to be blocked.
Disclosure of Invention
The invention mainly solves the technical problem of providing a video transmission method, a device and a computer storage medium based on forward error correction, which can overcome the video blocking problem under the scene of larger network fluctuation.
In order to solve the technical problems, the invention adopts a technical scheme that: there is provided a forward error correction-based video transmission method including: carrying out level configuration on video frames of video data; respectively calculating the redundancy corresponding to the video frames of each level; and carrying out data coding and redundancy coding on the video frames of each level to obtain a data packet and a redundancy packet for transmission.
The video data comprises one or more image groups, each image group comprises a key frame and a plurality of forward frames, and the grade configuration of the video frames of the video data comprises the following steps: detecting whether the image group contains a target event; if the image group contains the target event, the key frames in the image group are configured to be at a first level, at least part of the forward frames in the image group are configured to be at a second level, and the first level is higher than/equal to the second level.
Wherein, detecting whether the image group contains the target event further comprises: and if the image group does not contain the target event, configuring the key frames in the image group into a first grade, and configuring the forward frames in the image group into a third grade, wherein the third grade is lower than the second grade.
The method comprises the following steps of detecting that an image group contains a target event, and after carrying out level configuration on video frames of the image group, the method comprises the following steps: judging whether the network bandwidth W is larger than the transmission quantity D or not, wherein the transmission quantity
Figure BDA0003535150010000021
Figure BDA0003535150010000022
L is the network packet loss rate, Qn is the redundancy adjustment parameter of each level of video frame, and B is the video code stream size; if the network bandwidth W is larger than or equal to the transmission quantity D, the grade of the video frame is not adjusted; and if the network bandwidth W is less than the transmission quantity D, adjusting the level of part of the forward frames in the image group to a third level, wherein the third level is lower than the second level.
If the network bandwidth W is less than the transmission quantity D, configuring the key frames in the image group into a first level, configuring the levels of the first N forward frames into a second level, and configuring the rest forward frames into a third level; wherein N is a formula
Figure BDA0003535150010000023
The smallest integer of (a); wherein, W is network bandwidth, B is video code stream size, L is network packet loss rate, Q1 is high-level video redundancy adjustment factor, Q2 is low-level video redundancy adjustment factor, Bm represents high-level video code stream size, F is video frame rate size, K is the ratio of I frame size to P frame size, the first level and the second level belong to high level, and the third level belongs to low level.
Wherein, respectively calculating the redundancy corresponding to the video frames of each level comprises: calculating the basic redundancy S, S is a satisfying formula
Figure BDA0003535150010000024
The smallest integer of (a); the redundancy of each grade video frame is Qn S, and Qn is the redundancy adjustment parameter of each grade video frame.
Wherein, the higher the level of the video frame is, the larger the redundancy adjustment parameter Qn of the video frame is, and 1< Qn < 2.
The method comprises the following steps of carrying out data coding and redundancy coding on video frames of all levels to obtain a data packet and a redundancy packet so as to carry out transmission, wherein the method comprises the following steps: and receiving packet loss feedback information and acquiring the packet loss rate.
In order to solve the technical problem, the invention adopts another technical scheme that: there is provided a forward error correction based video transmission apparatus comprising a processor for executing instructions to implement a forward error correction based video transmission method as described above.
In order to solve the technical problem, the invention adopts another technical scheme that: there is provided a computer readable storage medium for storing instructions/program data executable to implement a forward error correction based video transmission method as described above.
The invention has the beneficial effects that: different from the situation of the prior art, the invention firstly carries out the level division of the importance degree on the video frames before carrying out the video transmission, carries out the differential redundancy on the video data under different levels, provides more redundant data for the video frames with high levels, and utilizes the FEC encoder to encode and transmit the original data and the redundant data, thereby overcoming the defect that the video data has no differential redundancy in the video transmission process of the prior art and solving the video blockage problem under the scene with larger network fluctuation.
Drawings
FIG. 1 is a schematic diagram of a forward error correction method;
FIG. 2 is a flowchart illustrating an embodiment of a forward error correction based video transmission method according to the present application;
FIG. 3 is a schematic flow chart of another embodiment of a forward error correction based video transmission method according to the present application;
FIG. 4 is a schematic structural diagram of a video transmission method based on forward error correction according to the present application;
FIG. 5 is a flowchart illustrating an embodiment of a forward error correction based video transmission method according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a video frame level configuration according to the present application;
FIG. 7 is a schematic diagram of another video frame level configuration of the present application;
FIG. 8 is a schematic flow chart of a backend real-time streaming device according to the present application;
fig. 9 is a schematic structural diagram of a forward error correction-based video transmission apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a forward error correction-based video transmission apparatus according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of a computer-readable storage medium in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples.
Referring to fig. 1, fig. 1 is a schematic diagram of a forward error correction method. A Forward Error Correction (FEC) method is that when a sending party sends data, some redundant packets are added according to the sending data by an FEC algorithm; and the receiver receives the effective data packet and the redundant packet, and can recover complete effective data through the limited data packet and the redundant packet received by the FEC algorithm even if a certain data packet is lost. The method can recover the complete data without retransmission after packet loss occurs, and ensures the transmission effect of real-time video. However, the added part of redundant packets increases the network load, and the FEC method is more suitable than the packet loss retransmission method in the real-time video communication system. However, under the condition of a certain network bandwidth, if the video data is subjected to undifferentiated EC redundancy, the effective utilization rate of the network bandwidth is low; thereby resulting in poor user image quality experience. Therefore, the application provides a video transmission method based on forward error correction, according to the network condition, the video frame is firstly subjected to level division of importance degree before video transmission is carried out, a differential redundancy method is carried out on video data of each level by adopting forward error correction suitable for redundancy, more redundant data are provided for the video frame with high level, and an FEC encoder is utilized to encode and transmit original data and redundant data, so that the problem that video data is not subjected to differential redundancy in the video transmission process in the prior art, and the video blocking problem is solved in the scene with large network fluctuation is solved.
Referring to fig. 2, fig. 2 is a flowchart illustrating a video transmission method based on forward error correction according to an embodiment of the present application. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 2 is not limited in this embodiment. As shown in fig. 2, the present embodiment includes:
s210: the video frames of the video data are hierarchically configured.
The type detection is carried out on the video data needing video transmission, and different grade configurations are set for different types of video frames. Important data is framed to a higher level and other data is framed to a lower level accordingly.
S230: and respectively calculating the redundancy corresponding to the video frames of each level.
And carrying out differential redundancy on the data of each video level according to the network condition, wherein the video frames of different levels have different redundancies correspondingly. The higher the redundancy, the more redundant data representing the data configuration.
S250: and carrying out data coding and redundancy coding on the video frames of all levels to obtain a data packet and a redundancy packet for transmission.
And combining the calculated redundancy, the FEC encoder respectively encodes the original data and the redundant data of the video frames of all levels to respectively obtain a data packet and a redundant packet, and further transmits the data.
In the embodiment, the video frames are classified into levels of importance before video transmission, and the video data of each level are subjected to differential redundancy by adopting forward error correction suitable for redundancy, so that more redundant data are provided for the video frames with high levels, and the original data and the redundant data are encoded and transmitted by using the FEC encoder, thereby overcoming the defect that video data are not subjected to differential redundancy in the video transmission process in the prior art, and solving the video blocking problem in the scene with large network fluctuation.
Referring to fig. 3, fig. 3 is a flowchart illustrating a video transmission method based on forward error correction according to another embodiment of the present invention. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 3 is not limited in this embodiment. As shown in fig. 3, the present embodiment includes:
s310: the video frames of the video data are hierarchically configured.
The video data comprises one or more groups Of pictures, each group Of pictures comprising a key frame I and a plurality Of forward frames P, the interval between two key frames I being a GOP (group Of picture), a GOP containing a plurality Of forward frames P. Whether the image group contains the target event is detected, and different level configurations are set for video frames of different types of image groups. If the image group contains the target event, the key frames in the image group are configured to be at a first level, at least part of the forward frames in the image group are configured to be at a second level, and the first level is higher than/equal to the second level. And if the image group does not contain the target event, configuring the key frames in the image group into a first grade, and configuring the forward frames in the image group into a third grade, wherein the third grade is lower than the second grade. The higher the rank configuration, the larger the amount of transmission at the time of video transmission.
S330: and adjusting the level configuration by combining the network broadband and the packet loss rate.
In the process of transmitting a video frame of a front-end video device to a back-end device, data packet loss often occurs, and meanwhile, the current network condition also affects the video transmission condition. Therefore, the level configuration of the video frame is adjusted according to the current network condition and the packet loss condition. And calculating the packet loss rate according to the packet loss feedback information, and further calculating to obtain the current data transmission quantity, wherein the transmission quantity D is (1+ L Q) B, L is the network packet loss rate, Q is a redundancy adjustment parameter of each grade of video frame, and B is the size of the video code stream. In an embodiment of the present application, different redundancy adjustment parameters are set for video frames of different levels, and a redundancy adjustment parameter of a first level is greater than a redundancy adjustment parameter of a second level and greater than a redundancy adjustment parameter of a third level. In one embodiment, a plurality of video frames in a group of pictures are divided into a plurality of levels, wherein the redundancy adjustment parameter of the video frame of the nth level is Qn, and the data transmission amount is
Figure BDA0003535150010000061
Further, the current network broadband is obtained, and whether the grade configuration needs to be adjusted or not is judged according to the current data transmission quantity and the current network broadband. Judging whether the network bandwidth W is greater than the transmission quantity D, if the network bandwidth W is greater than or equal to the transmission quantity D, not adjusting the grade of the video frame; and if the network bandwidth W is less than the transmission quantity D, adjusting the level of part of the forward frames in the image group to a third level, wherein the third level is lower than the second level.
In a specific embodiment, if the network bandwidth W is less than the transmission amount D, the levels of the first N forward frames in the image group are configured as a second level, and the remaining forward frames are configured as a third level; the first and second ranks are of a high rank, and the third rank is of a low rank. Wherein N is a formula
Figure BDA0003535150010000062
The smallest integer of (a); wherein, W is network bandwidth, B is video code stream size, S is packet loss rate, Q1 is high-level video redundancy adjustment factor, Q2 is low-level video redundancy adjustment factor, Bm represents first-level video code stream size, F is video frame rate size, and K is ratio of I frame size to P frame size.
S350: and respectively calculating the redundancy corresponding to the video frames of each level.
Calculating the basic redundancy S by using the number of originally transmitted data packets and the transmission packet loss rate, wherein S is a formula
Figure BDA0003535150010000063
According to the video frame grade, adjusting the number of the redundant packets to be generated, wherein M is the number of the data packets which are originally transmitted, the redundancy of each grade of video frame is Q S, and Q is a redundancy adjustment parameter of each grade of video frame. The higher the level of the video frame, the larger the redundancy adjustment parameter Q of the video frame, and 1<Q<2。
S370: and carrying out data coding and redundancy coding on the video frames of all levels to obtain a data packet and a redundancy packet for transmission.
N original video data and the number Q S of redundant packets to be added are input into an FEC encoder for encoding. And transmitting the encoded data to the back-end equipment so that the back-end equipment performs decoding reading.
In the embodiment, before video transmission, multiple levels of importance are firstly classified on video frame content, then the levels are further classified according to the current network condition, a differential redundancy method is carried out on video data of each level by adopting forward error correction suitable for redundancy, more redundant data are provided for video frames with high levels, and an FEC (forward error correction) encoder is used for encoding and transmitting original data and redundant data, so that the problem that video blockage is caused in the scene with large network fluctuation due to the fact that no differential redundancy exists on the video data in the video transmission process in the prior art can be solved.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a video transmission method based on forward error correction according to the present application, and in an embodiment, a front-end video device performs real-time video communication with a back-end real-time streaming device as an example, where the first level and the second level belong to a high level, and the third level belongs to a low level. Referring to fig. 5, fig. 5 is a flowchart illustrating an embodiment of a video transmission method based on forward error correction according to the present invention. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 5 is not limited in this embodiment. As shown in fig. 5, the present embodiment includes:
s510: and the front-end video equipment encodes the video according to the level configuration information and outputs video frame data with the encoding level.
The front-end video equipment firstly carries out video grade division on video frames needing video transmission. The video data comprises one or more groups of pictures, each group of pictures comprising a key frame I and a plurality of forward frames P, the interval between two key frames I being a GOP, a GOP containing a plurality of forward frames P. Whether the image group contains the target event is detected, and different level configurations are set for video frames of different types of image groups. In one embodiment, if the group of images contains a target event, the key frames in the group of images are configured to be high-ranked, and the forward frames in the group of images are configured to be high-ranked. And if the image group does not contain the target event, configuring the key frames in the image group as a high level, and configuring the forward frames in the image group as a low level. The higher the rank configuration, the larger the amount of transmission at the time of video transmission. Taking a GOP with 25 frames as an example, please refer to fig. 6, in which fig. 6 is a schematic diagram of a video frame level configuration of the present application. If one GOP has a target event, configuring the grade of a forward frame P frame in the GOP into a high grade; and if no target event exists in other non-GOPs, the grade of all forward P frames in the GOP is configured to be low. In another embodiment, please refer to fig. 7, fig. 7 is a schematic view of another video frame level configuration of the present application. Setting the grade of a forward frame P frame in a GOP according to the network condition; in the case of network bandwidth, the rank of the first n forward frame P frames close to the key frame I frame is set to a high rank, and the others are set to a low rank.
Further, the configuration level is adjusted according to the packet loss rate. And acquiring the current network broadband W, the video code stream size B and the redundancy adjustment parameter Q of each level of video frame. And calculating the packet loss rate according to the packet loss feedback information, and further calculating to obtain the current data transmission quantity, wherein the transmission quantity D is (1+ L × Q1+ L × Q2) × B, L is the network packet loss rate, Q is the redundancy adjustment parameter of each level of video frame, Q1 is the redundancy adjustment parameter of the high-level video frame, Q2 is the redundancy adjustment parameter of the low-level video frame, and B is the size of the video code stream. In the embodiment of the application, different redundancy adjustment parameters are set for video frames of different levels, and the redundancy adjustment parameter of a high level is larger than that of a low level.
And judging whether the grade configuration needs to be adjusted or not according to the current data transmission quantity and the current network broadband. Judging whether the network bandwidth W is greater than the transmission quantity D, if the network bandwidth W is greater than or equal to the transmission quantity D, not adjusting the grade of the video frame; if the network bandwidth W is smaller than the transmission quantity D, further judging whether the image group contains a target event, and if the image group does not contain the target event, not adjusting the level of the video frame; if the image group contains the target event, the level of a part of the forward frames in the image group is adjusted to be low level.
In a specific embodiment, if the network bandwidth W is less than the transmission amount D, the levels of the first N forward frames in the image group are configured as a second level, and the remaining forward frames are configured as a third level;
wherein N is a formula
Figure BDA0003535150010000081
The smallest integer of (a); wherein, W is network bandwidth, B is video code stream size, S is packet loss rate, Q1 is high-level video redundancy adjustment factor, Q2 is low-level video redundancy adjustment factor, Bm represents high-level video code stream size, F is video frame rate size, and K is ratio of I frame to P frame size.
S530: and combining the packet loss rate to obtain the redundancy corresponding to the video frames of each level.
Calculating packet loss rate L according to the packet loss feedback information, and calculating the network packet loss rate L according to the number M of the video original data packets needing redundancy and the network packet loss rate L calculated in the first step; according to the formula:
Figure BDA0003535150010000082
and calculating the number S of the redundant packets to be generated, wherein S is the minimum integer. For example: the number M of the video original data packets is 50, the packet loss rate L is 0.2, and S is>12.5; s takes the minimum integer as 13.
According to the video frame grade, adjusting the number of redundant packets to be generated, wherein the high-grade video frame adopts Q1K redundant packets according to K calculated by the second part, and the low-grade video frame adopts Q2K redundant packets; wherein the values of the parameters Q1 and Q2 are as follows: 1< Q2< Q1< 2.
S550: the FEC coding algorithm performs data redundancy coding according to the level of the video data and the corresponding redundancy.
The FEC encoding algorithm encodes N original video data and the number of redundant packets Q1 × K (or Q2 × K) that need to be added.
S570: and transmitting the video original data and the redundant data to the back-end equipment through the communication module.
S590: and the back-end equipment recovers all the video data according to the redundant data, decodes the data and displays the data.
Referring to fig. 8, fig. 8 is a schematic flow chart of a backend real-time streaming device according to the present application. After the back-end real-time stream pulling equipment receives the video data, detecting whether packet loss exists or not, and directly detecting the video packet when the packet loss does not exist; and when packet loss exists, transmitting packet loss feedback information to the front-end video equipment, further performing video packet detection, respectively storing the packet loss feedback information in different buffer queues according to the types of the received packets, storing the video packets in the video buffer queues, and storing the FEC redundancy packets in the redundancy buffer queues. Specifically, whether a received data packet is a video packet is detected, when the data packet is detected to be the video packet, the data packet is placed in a video packet buffer queue, and when the data packet is detected not to be the video packet, the data packet is a redundant packet and is placed in an FEC packet buffer queue. Further, whether the video packets are continuous or not is detected, namely whether the video packets are missing or not is detected, when the video packets are missing and FEC redundant packets exist, the redundant data in the FEC packet buffer queue is used for recovery, and the recovered video data is decoded and displayed.
In this embodiment, before video transmission, the front-end video device performs multiple level division of importance on video frame content, further performs level division according to the current network condition and packet loss condition, and performs a differential redundancy method on video data of each level by using forward error correction suitable for redundancy, so as to provide more redundant data for a video frame with a high level, encode and transmit original data and redundant data by using an FEC encoder, and feed back a packet loss condition after the back-end device receives the data, so that the front-end video device performs further level adjustment. And the back-end equipment performs FEC decoding on the received original video data and redundant data and performs video display. The video data redundancy in the prior art can be overcome, and the video blocking problem can be solved in the scene with large network fluctuation.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a video transmission apparatus based on forward error correction according to an embodiment of the present application. In this embodiment, the forward error correction based video transmission apparatus includes a configuration module 91, a redundancy module 92, and an encoding module 93.
The configuration module 91 is configured to perform level configuration on video frames of video data; the redundancy module 92 is configured to calculate redundancies corresponding to the video frames of each level; the encoding module 93 is configured to perform data encoding and redundancy encoding on the video frames of each level to obtain a data packet and a redundancy packet for transmission. The video transmission device based on the forward error correction is used for carrying out importance level division on video frames before video transmission, a differential redundancy method is carried out on video data of each level by adopting the forward error correction suitable for redundancy, more redundant data are provided for the video frames with high levels, the original data and the redundant data are encoded and transmitted by utilizing the FEC encoder, the problem that video blockage is caused in the prior art that video data are not differentially redundant in the video transmission process and the video blockage is solved in the scene with large network fluctuation can be overcome.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a video transmission apparatus based on forward error correction according to an embodiment of the present application. In this embodiment, the forward error correction based video transmission device 01 includes a processor 02.
The processor 02 may also be referred to as a CPU (Central Processing Unit). The processor 02 may be an integrated circuit chip having signal processing capabilities. The processor 02 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor 02 may be any conventional processor or the like.
Forward error correction based video transmission device 01 may further comprise a memory (not shown in the figure) for storing instructions and data required for the operation of processor 02.
The processor 02 is configured to execute instructions to implement the methods provided by any of the embodiments of the forward error correction based video transmission method of the present application and any non-conflicting combinations.
Referring to fig. 11, fig. 11 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present disclosure. The computer readable storage medium 11 of the embodiments of the present application stores instructions/program data 12, which instructions/program data 12, when executed, implement the methods provided by any of the embodiments of the forward error correction based video transmission method of the present application and any non-conflicting combinations. The instructions/program data 12 may form a program file stored in the storage medium 11 in the form of a software product, so as to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned storage medium 11 includes: various media capable of storing program codes, such as a usb disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or terminal devices, such as a computer, a server, a mobile phone, and a tablet.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is only a logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A method for forward error correction based video transmission, the method comprising:
carrying out level configuration on video frames of video data;
respectively calculating the redundancy corresponding to the video frames of each level;
and carrying out data coding and redundancy coding on the video frames of each level to obtain a data packet and a redundancy packet for transmission.
2. The forward error correction-based video transmission method according to claim 1, wherein said video data comprises one or more groups of pictures, each of said groups of pictures comprising a key frame and a plurality of forward frames, said hierarchically configuring the video frames of the video data comprises:
detecting whether the image group contains a target event;
if the image group contains the target event, configuring the key frames in the image group into a first grade, and configuring at least part of the forward frames in the image group into a second grade, wherein the first grade is higher than/equal to the second grade.
3. The fec-based video transmission method according to claim 2, wherein said detecting whether the group of pictures contains a target event further comprises:
if the image group does not contain the target event, configuring the key frames in the image group as the first grade, and configuring the forward frames in the image group as a third grade, wherein the third grade is lower than the second grade.
4. The fec-based video transmission method according to claim 2, wherein detecting that the group of pictures contains the target event, after performing hierarchical configuration on video frames of the group of pictures, the method comprises:
judging whether the network bandwidth W is larger than the transmission quantity D or not, wherein the transmission quantity
Figure FDA0003535150000000011
B, L is the network packet loss rate, Qn is the redundancy adjustment parameter of each grade of video frame, and B is the size of the video code stream;
if the network bandwidth W is greater than or equal to the transmission quantity D, the level of the video frame is not adjusted;
if the network bandwidth W is smaller than the transmission quantity D, the level of a part of the forward frames in the image group is adjusted to a third level, and the third level is lower than the second level.
5. The forward error correction-based video transmission method according to claim 4,
if the network bandwidth W is smaller than the transmission quantity D, configuring the key frames in the image group to be a first level, configuring the levels of the first N forward frames to be a second level, and configuring the rest forward frames to be a third level;
wherein N is a formula
Figure FDA0003535150000000021
The smallest integer of (a);
wherein W is a network bandwidth, B is a video stream size, L is a network packet loss rate, Q1 is a high-level video redundancy adjustment factor, Q2 is a low-level video redundancy adjustment factor, Bm represents a high-level video stream size, F is a video frame rate size, K is a ratio of I frames to P frames, the first level and the second level belong to a high level, and the third level belongs to a low level.
6. The fec-based video transmission method according to claim 1, wherein the calculating the redundancy rates corresponding to the video frames of each level respectively comprises:
calculating the basic redundancy S, S is a satisfying formula
Figure FDA0003535150000000022
The smallest integer of (a);
the redundancy of each grade video frame is Qn S, and Qn is the redundancy adjustment parameter of each grade video frame.
7. The forward error correction-based video transmission method according to claim 6,
the higher the level of the video frame, the larger the redundancy adjustment parameter Qn of the video frame, and 1< Qn < 2.
8. The fec-based video transmission method as claimed in claim 1, wherein the data coding and redundancy coding are performed on the video frames of each level to obtain data packets and redundancy packets, and after performing transmission, the method comprises:
and receiving packet loss feedback information and acquiring the network packet loss rate.
9. A forward error correction based video transmission apparatus, comprising a processor for executing instructions to implement the forward error correction based video transmission method according to any one of claims 1 to 8.
10. A computer readable storage medium for storing instructions/program data executable to implement a forward error correction based video transmission method according to any one of claims 1 to 8.
CN202210216682.4A 2022-03-07 2022-03-07 Forward error correction-based video transmission method, apparatus and computer storage medium Pending CN114900698A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210216682.4A CN114900698A (en) 2022-03-07 2022-03-07 Forward error correction-based video transmission method, apparatus and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210216682.4A CN114900698A (en) 2022-03-07 2022-03-07 Forward error correction-based video transmission method, apparatus and computer storage medium

Publications (1)

Publication Number Publication Date
CN114900698A true CN114900698A (en) 2022-08-12

Family

ID=82714651

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210216682.4A Pending CN114900698A (en) 2022-03-07 2022-03-07 Forward error correction-based video transmission method, apparatus and computer storage medium

Country Status (1)

Country Link
CN (1) CN114900698A (en)

Similar Documents

Publication Publication Date Title
US11070794B2 (en) Video quality assessment method and apparatus
US10348454B2 (en) Error resilience for interactive real-time multimedia application
US20140348246A1 (en) Video Conversion Method and Apparatus
CN111147606B (en) Data transmission method, device, terminal and storage medium
US20090295988A1 (en) Transmission apparatus, transmission method, and reception apparatus
US20090234919A1 (en) Method of Transmitting Data in a Communication System
US20130208075A1 (en) Encoding processing for conferencing systems
US20160219318A1 (en) Information presentation device and method
CN111629210A (en) Data processing method and device and electronic equipment
CN109618170B (en) D2D real-time video streaming transmission method based on network coding
CN111263192A (en) Video processing method and related equipment
US9306987B2 (en) Content message for video conferencing
CN115037416A (en) Data forward error correction processing method, device, electronic equipment and storage medium
TWI519131B (en) Video transmission system and transmitting device and receiving device thereof
KR102383892B1 (en) Coding and decoding method, apparatus, system and medium of self-adapting system code FEC based on media content
CN111147892A (en) Method and apparatus for video transmission, storage medium, and electronic device
CN114900698A (en) Forward error correction-based video transmission method, apparatus and computer storage medium
US20110176742A1 (en) Image processing apparatus and image processing method
CN113422923B (en) Method and device for determining retransmission times, electronic equipment and storage medium
Thomos et al. Growth codes: Intermediate performance analysis and application to video
KR102104495B1 (en) Reception device and program for reception device
CN111225238A (en) Information processing method and related equipment
WO2022228037A1 (en) Method for transmitting streaming media data and related device
KR102093206B1 (en) Method and device for encoding data
WO2021082799A1 (en) Videoconference auxiliary stream processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination