CN114928746A - Method, system, device and storage medium for fault-tolerant protection of video network transmission - Google Patents
Method, system, device and storage medium for fault-tolerant protection of video network transmission Download PDFInfo
- Publication number
- CN114928746A CN114928746A CN202210389398.7A CN202210389398A CN114928746A CN 114928746 A CN114928746 A CN 114928746A CN 202210389398 A CN202210389398 A CN 202210389398A CN 114928746 A CN114928746 A CN 114928746A
- Authority
- CN
- China
- Prior art keywords
- reference list
- video
- generate
- decoding
- quantization parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a fault-tolerant protection method, a system, a device and a storage medium for video network transmission. The fault-tolerant protection method for video network transmission comprises the following steps: generating a first quantization parameter and a first reference list; coding according to the first quantization parameter and the first reference list to generate network data; decoding the network data to generate a first video frame; confirming that error data exists in the first video frame, and generating feedback information; acquiring a second frame number according to the feedback information; generating a second quantization parameter and a second reference list according to the second frame number; and coding according to the second quantization parameter and the second reference list, and generating and caching a second video frame. According to the invention, the received network data is decoded and error detection is carried out, and the first frame number corresponding to the error data is fed back to the sending end to adjust the reference list in real time, so that timely detection and error correction are realized, the real-time performance of video network transmission is met, error code diffusion is inhibited, and the visual experience of the video is improved.
Description
Technical Field
The present application relates to the field of streaming media technologies, and in particular, to a method, a system, an apparatus, and a storage medium for fault-tolerant protection of video network transmission.
Background
In a streaming media transmission system, network fluctuation can cause video packet loss or video packet transmission error, thereby affecting the visual experience of a receiving end. With the popularization of internet live broadcast, the watching experience of online videos is more and more emphasized. The current mainstream video coding standard still adopts a hybrid coding architecture, and the problem of error code diffusion still exists. If a bit of a current frame of video coding is erroneous, the error continues to a subsequent frame, which causes errors in decoding of the subsequent frame and results in error accumulation.
Most of the mainstream solutions in the internet live broadcast system at present are to enhance the channel error tolerance capability through Forward Error Correction (FEC) or Backward Error Correction (BEC). The common backward error correction technology includes using an automatic repeat request (ARQ) technology, and recovering an erroneous data message by a receiver requesting a sender to retransmit the erroneous data message; common forward error correction techniques employ channel error correction coding techniques, where the sender redundantly encodes information by using an Error Correction Code (ECC), and the redundant portion allows the receiver to detect and correct limited errors that may occur anywhere in the information without requiring retransmission from the sender.
However, the backward error correction technology increases the communication delay of video network transmission, reduces the real-time performance of live video, and has poor applicability in scenes with higher real-time requirements; the forward error correction technology only aims at a channel, does not consider the correlation of front and back data, and can still not avoid error code generation and error code diffusion although high real-time performance can be ensured.
Disclosure of Invention
The present invention aims to solve at least to some extent one of the technical problems existing in the prior art.
Therefore, an object of the embodiments of the present invention is to provide a method, a system, a device, and a storage medium for fault-tolerant protection of video network transmission, so as to improve fault-tolerant capability and error-resistant capability of video network transmission and prevent code-free spreading.
In order to achieve the technical purpose, the technical scheme adopted by the embodiment of the invention comprises the following steps:
in a first aspect, an embodiment of the present invention provides a fault-tolerant protection method for video network transmission, including the following steps:
generating a first quantization parameter and a first reference list;
coding according to the first quantization parameter and the first reference list to generate network data;
decoding the network data to generate a first video frame;
confirming that error data exist in the first video frame, and generating feedback information, wherein the feedback information comprises a first frame number, and the first frame number is a frame number corresponding to the error data;
acquiring a second frame number according to the feedback information;
generating a second quantization parameter and a second reference list according to the second frame number;
and coding according to the second quantization parameter and the second reference list, and generating and buffering a second video frame.
According to the fault-tolerant protection method for video network transmission, the received network data are decoded and subjected to error detection, the first frame number corresponding to the error data is fed back to the sending end to adjust the reference list in real time, the error data are detected and corrected in time, the continuation of the error data to subsequent frames is reduced, the instantaneity of video network transmission is met, error code diffusion is restrained, and the visual experience of videos is improved.
In addition, the fault-tolerant protection method for video network transmission according to the above embodiment of the present invention may further have the following additional technical features:
further, in the method for fault-tolerant protection of video network transmission according to an embodiment of the present invention, the encoding according to the first quantization parameter and the first reference list to generate network data includes:
performing first coding on the first quantization parameter and the first reference list to generate a third video frame, wherein the first coding comprises video data compression coding;
second encoding the third video frame, the second encoding comprising forward error correction encoding, to generate the network data.
Further, in an embodiment of the present invention, the decoding the network data to generate the first video frame includes:
performing first decoding on the network data to generate decoded data, wherein the first decoding comprises forward error correction decoding;
and performing second decoding on the decoded data to generate the first video frame, wherein the second decoding comprises video frame decoding.
Further, in an embodiment of the present invention, the generating a second quantization parameter and a second reference list according to the second frame number includes:
generating the second reference list according to the second frame number and the first reference list;
and generating the second quantization parameter according to the second frame number.
In a second aspect, an embodiment of the present invention provides a fault-tolerant protection system for video network transmission, including:
a rate control module for generating a first quantization parameter and for generating a second quantization parameter according to a second frame number;
a reference list generating module, configured to generate a first reference list and a second reference list according to the second frame number;
the coding module is used for coding according to the first quantization parameter and the first reference list to generate network data, and coding according to the second quantization parameter and the second reference list to generate and cache a second video frame;
the decoding module is used for decoding the network data to generate a first video frame;
the feedback information generating module is used for confirming that error data exist in the first video frame and generating feedback information;
and the second frame number acquisition module is used for acquiring a second frame number according to the feedback information.
Further, in one embodiment of the present invention, the encoding module includes:
a first encoding module, configured to perform first encoding on the first quantization parameter and the first reference list, and generate a third video frame;
and the second coding module is used for carrying out second coding on the third video frame to generate the network data.
Further, in one embodiment of the present invention, the decoding module includes:
the first decoding module is used for carrying out first decoding on the network data to generate decoded data;
and the second decoding module is used for carrying out second decoding on the decoded data to generate the first video frame.
Further, in an embodiment of the present invention, the reference list generating module is configured to generate the second reference list according to the second frame number and the first reference list.
In a third aspect, an embodiment of the present invention provides a fault-tolerant protection device for video network transmission, including:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, the at least one program causes the at least one processor to implement the method for fault tolerant protection of video network transmissions.
In a fourth aspect, an embodiment of the present invention provides a storage medium, in which a processor-executable program is stored, where the processor-executable program is used to implement the method for fault-tolerant protection of video network transmission when executed by a processor.
Advantages and benefits of the present invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the present application:
the embodiment of the invention realizes the timely detection and error correction of the error data by decoding and error detection of the received network data and feeding back the first frame number corresponding to the error data to the sending end to adjust the reference list in real time, reduces the continuation of the error data to the subsequent frame, inhibits error code diffusion while meeting the real-time property of video network transmission, and improves the visual experience of the video.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following description is made on the drawings of the embodiments of the present application or the related technical solutions in the prior art, and it should be understood that the drawings in the following description are only for convenience and clarity of describing some embodiments in the technical solutions of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flow chart illustrating a method for fault-tolerant protection of video network transmission according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of feedback information of an embodiment of a fault-tolerant protection method for video network transmission according to the present invention;
FIG. 3 is a schematic diagram of a fault-tolerant protection system for video network transmission according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an embodiment of a fault-tolerant protection device for video network transmission according to the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application. The step numbers in the following embodiments are provided only for convenience of illustration, the order between the steps is not limited at all, and the execution order of each step in the embodiments can be adapted according to the understanding of those skilled in the art.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of the invention and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein may be combined with other embodiments.
In a streaming media transmission system, network fluctuation can cause video packet loss or video packet transmission error, thereby affecting the visual experience of a receiving end. With the popularization of internet live broadcast, the watching experience of online videos is more and more emphasized. The current mainstream video coding standard still adopts a hybrid coding architecture, and the problem of error code diffusion still exists. If a bit of a current frame of video coding is erroneous, the error continues to a subsequent frame, which causes errors in decoding of the subsequent frame and results in error accumulation.
Most of the mainstream solutions in the internet live broadcast system at present are to enhance the channel error tolerance capability through Forward Error Correction (FEC) or Backward Error Correction (BEC). The common backward error correction technology includes using an automatic repeat request (ARQ) technology, and recovering an erroneous data message by a receiver requesting a sender to retransmit the erroneous data message; common forward error correction techniques employ channel error correction coding techniques, where the sender redundantly encodes information using an Error Correction Code (ECC), with the redundant portion allowing the receiver to detect and correct limited errors that may occur anywhere on the information without requesting retransmission from the sender.
However, the backward error correction technology increases the communication delay of video network transmission, reduces the real-time performance of live video, and has poor applicability in scenes with high real-time requirements; the forward error correction technology only aims at a channel, does not consider the correlation of front and back data, and can still not avoid error code generation and error code diffusion although high real-time performance can be ensured.
Therefore, the invention provides a method and a system for fault-tolerant protection of video network transmission, which realize timely detection and error correction of error data, reduce the continuation of the error data to subsequent frames, inhibit error code diffusion while meeting the real-time performance of video network transmission and improve the visual experience of videos by decoding and error detecting received network data and feeding back a first frame number corresponding to the error data to a sending end to adjust a reference list in real time.
A method and a system for fault-tolerant protection of video network transmission according to an embodiment of the present invention are described in detail below with reference to the accompanying drawings, and first, a method for fault-tolerant protection of video network transmission according to an embodiment of the present invention will be described with reference to the accompanying drawings.
Referring to fig. 1, an embodiment of the present invention provides a fault-tolerant protection method for video network transmission, where the fault-tolerant protection method for video network transmission in the embodiment of the present invention may be applied to a terminal, a server, or software running in the terminal or the server. The terminal may be, but is not limited to, a tablet computer, a notebook computer, a desktop computer, and the like. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, middleware service, a domain name service, a security service, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like. The fault-tolerant protection method for video network transmission in the embodiment of the invention mainly comprises the following steps:
s101, generating a first quantization parameter and a first reference list;
the first Quantization Parameter (QP) reflects the spatial detail compression of the video, and when the QP is small, most of the detail is preserved; as the QP increases, part of the details of the video are lost and the bitrate decreases; the first reference list is used to manage reference images.
Specifically, in the embodiment of the present invention, the first quantization parameter and the first reference list of the current encoded frame are output according to the set initial operation mode.
S102, coding is carried out according to the first quantization parameter and the first reference list, and network data are generated;
s102 may be further divided into the following steps S1021-S1022:
step S1021, performing first coding on the first quantization parameter and the first reference list to generate a third video frame;
wherein the first encoding comprises video data compression encoding.
Specifically, in the embodiment of the present invention, H264 coding is adopted, and video data compression is performed according to the first quantization parameter and the first reference list, so as to generate a video frame, that is, the third video frame. In an embodiment of the present invention, the VCC standard may be adopted for video data compression coding to improve compression efficiency and source fault tolerance.
In an embodiment of the present invention, in conjunction with Scalable Video Coding (SVC) techniques in H264 coding, a multi-layer bitstream is output, including a base layer and an enhancement layer.
Step S1022, perform second encoding on the third video frame, and generate the network data.
Wherein the second encoding comprises forward error correction encoding (FEC encoding).
S103, decoding the network data to generate a first video frame;
specifically, after the network data is generated through steps S101 to S102, the network data is transmitted to the decoding module through network transmission. And decoding the network data through a decoding module to generate a decoded video frame, namely the first video frame.
S103 may be further divided into the following steps S1031-S1032:
step S1031, performing first decoding on the network data to generate decoded data;
wherein the first decoding comprises forward error correction decoding.
Specifically, as shown in step S1022, the third video frame is FEC-encoded to generate the network data, and therefore, after receiving the network data, the FEC-decoding needs to be performed on the network data first.
Step S1032 is to perform a second decoding on the decoded data, and generate the first video frame.
Wherein the second decoding comprises video frame decoding.
Specifically, in the embodiment of the present invention, the FEC-decoded data is subjected to video frame decoding by using H264 decoding, so as to generate the first video frame. As can be seen from step S1021, when the VCC standard is adopted for video data compression coding, the VCC standard is adopted for decoding when video frames are decoded accordingly.
S104, confirming that error data exist in the first video frame, and generating feedback information;
the feedback information comprises a first frame number, and the first frame number is a frame number corresponding to the error data.
Specifically, the error detection is performed on the first video frame to determine whether there is error data, and if so, the feedback information is generated. As can be seen from step S1021, the first encoding in the embodiment of the present invention combines the SVC technology, so that when performing error detection on the first video frame, if the frame with the first frame number corresponding to the error data is in the base layer, the frame with the first frame number is replaced with the frame with the corresponding enhancement layer for display, and the feedback information is generated; and if the frame with the first frame number is in the enhancement layer, replacing the frame with the first frame number with the frame of the corresponding base layer for display without generating the feedback information.
S105, acquiring a second frame number according to the feedback information;
and the second frame number is obtained according to the first frame number in the feedback information, and then the video stream output by the subsequent coding frame coding is optimized according to the second frame number, so that the error code is prevented from diffusing to the subsequent video stream.
Specifically, referring to fig. 2, in an embodiment of the present invention, the first eight frame data of the normal reference relationship are generated and transmitted through steps S101 to S102 (transmitting side), and after the first eight frame data are decoded and error-detected through steps S103 to S104 (receiving side), an error occurs in the video frame with num equal to 5 (first frame number). At this time, the transmitting end changes the reference relationship of the video frame with num-9 by referring to the reference relationship of the video frame with num-3 (second frame number), and guarantees that the video frame with num-9 can be normally decoded regardless of the video frame with num-8.
S106, generating a second quantization parameter and a second reference list according to the second frame number;
specifically, according to the specific embodiment of step S105, the second reference list is generated according to the second frame number and the first reference list, and the second quantization parameter is generated according to the second frame number.
And S107, coding according to the second quantization parameter and the second reference list, generating a second video frame and caching.
Specifically, coding is performed according to the second quantization parameter and the second reference list after real-time adjustment, and a second video frame is generated and buffered in a buffer queue.
According to the fault-tolerant protection method for video network transmission, the received network data are decoded and subjected to error detection, the first frame number corresponding to the error data is fed back to the sending end to adjust the reference list in real time, timely detection and error correction of the error data are achieved, continuation of the error data to subsequent frames is reduced, real-time performance of video network transmission is met, error code diffusion is inhibited, and visual experience of videos is improved.
Next, a fault-tolerant protection system for video network transmission according to an embodiment of the present application is described with reference to the drawings.
Fig. 3 is a schematic structural diagram of a fault-tolerant protection system for video network transmission according to an embodiment of the present application.
The system specifically comprises:
a rate control module 301, configured to generate a first quantization parameter, and configured to generate a second quantization parameter according to a second frame number;
a reference list generating module 302, configured to generate a first reference list, and configured to generate a second reference list according to a second frame number;
an encoding module 303, configured to perform encoding according to the first quantization parameter and the first reference list to generate network data, and perform encoding according to the second quantization parameter and the second reference list to generate and cache a second video frame;
a decoding module 304, configured to decode the network data to generate a first video frame;
a feedback information generating module 305, configured to confirm that there is error data in the first video frame, and generate feedback information;
a second frame number obtaining module 306, configured to obtain a second frame number according to the feedback information.
In an embodiment of the invention, the encoding module comprises:
a first encoding module, configured to perform first encoding on the first quantization parameter and the first reference list, and generate a third video frame;
and the second coding module is used for carrying out second coding on the third video frame to generate the network data.
In an embodiment of the present invention, the decoding module includes:
the first decoding module is used for carrying out first decoding on the network data to generate decoded data;
and the second decoding module is used for carrying out second decoding on the decoded data to generate the first video frame.
In an embodiment of the present invention, the reference list generating module is configured to generate the second reference list according to the second frame number and the first reference list.
It can be seen that the contents in the foregoing method embodiments are all applicable to the present system embodiment, the functions specifically implemented by the present system embodiment are the same as those in the foregoing method embodiment, and the beneficial effects achieved by the present system embodiment are also the same as those achieved by the foregoing method embodiment.
Referring to fig. 4, an embodiment of the present application provides a fault-tolerant protection device for video network transmission, including:
at least one processor 401;
at least one memory 402 for storing at least one program;
when executed by the at least one processor 401, the at least one program causes the at least one processor 401 to implement the method for fault tolerant protection of video network transmissions.
Similarly, the contents in the method embodiments are all applicable to the apparatus embodiment, the functions specifically implemented by the apparatus embodiment are the same as those in the method embodiments, and the beneficial effects achieved by the apparatus embodiment are also the same as those achieved by the method embodiments.
In alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flowcharts of the present application are provided by way of example in order to provide a more comprehensive understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed, and in which sub-operations described as part of larger operations are performed independently.
Furthermore, although the present application is described in the context of functional modules, it should be understood that, unless otherwise stated to the contrary, one or more of the functions and/or features may be integrated in a single physical device and/or software module, or one or more functions and/or features may be implemented in a separate physical device or software module. It will also be appreciated that a detailed discussion regarding the actual implementation of each module is not necessary for an understanding of the present application. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be understood within the ordinary skill of an engineer given the nature, function, and interrelationships of the modules. Accordingly, those skilled in the art can, using ordinary skill, practice the present application as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative of and not intended to limit the scope of the application, which is defined by the appended claims and their full scope of equivalents.
The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solutions of the present application, which are essential or part of the technical solutions contributing to the prior art, may be embodied in the form of a software product, which is stored in a storage medium and includes several programs for enabling a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable programs that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with a program execution system, apparatus, or device (such as a computer-based system, processor-containing system, or other system that can fetch the programs from the program execution system, apparatus, or device and execute the programs). For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the program execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable program execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the foregoing description of the specification, reference to the description of "one embodiment/example," "another embodiment/example," or "certain embodiments/examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: numerous changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.
While the preferred embodiments of the present application have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A fault-tolerant protection method for video network transmission is characterized by comprising the following steps:
generating a first quantization parameter and a first reference list;
coding according to the first quantization parameter and the first reference list to generate network data;
decoding the network data to generate a first video frame;
confirming that error data exist in the first video frame, and generating feedback information, wherein the feedback information comprises a first frame number, and the first frame number is a frame number corresponding to the error data;
acquiring a second frame number according to the feedback information;
generating a second quantization parameter and a second reference list according to the second frame number;
and coding according to the second quantization parameter and the second reference list, and generating and caching a second video frame.
2. The method of claim 1, wherein the encoding according to the first quantization parameter and the first reference list to generate network data comprises:
performing first encoding on the first quantization parameter and the first reference list to generate a third video frame, wherein the first encoding comprises video data compression encoding;
second encoding the third video frame, the second encoding comprising forward error correction encoding, to generate the network data.
3. The method of claim 1, wherein said decoding the network data to generate a first video frame comprises:
performing first decoding on the network data to generate decoded data, wherein the first decoding comprises forward error correction decoding;
and performing second decoding on the decoded data to generate the first video frame, wherein the second decoding comprises video frame decoding.
4. The method of claim 1, wherein generating a second quantization parameter and a second reference list according to the second frame number comprises:
generating the second reference list according to the second frame number and the first reference list;
and generating the second quantization parameter according to the second frame number.
5. A fault tolerant protection system for video network transmission, comprising:
a rate control module for generating a first quantization parameter and for generating a second quantization parameter based on a second frame number;
a reference list generating module, configured to generate a first reference list and a second reference list according to the second frame number;
the coding module is used for coding according to the first quantization parameter and the first reference list to generate network data, and coding according to the second quantization parameter and the second reference list to generate and cache a second video frame;
the decoding module is used for decoding the network data to generate a first video frame;
the feedback information generating module is used for confirming that error data exist in the first video frame and generating feedback information;
and the second frame number acquisition module is used for acquiring a second frame number according to the feedback information.
6. The system of claim 5, wherein the encoding module comprises:
a first encoding module, configured to perform first encoding on the first quantization parameter and the first reference list, and generate a third video frame;
and the second coding module is used for carrying out second coding on the third video frame to generate the network data.
7. The fault-tolerant protection system for video network transmission according to claim 5, wherein the decoding module comprises:
the first decoding module is used for carrying out first decoding on the network data to generate decoded data;
and the second decoding module is used for carrying out second decoding on the decoded data to generate the first video frame.
8. The fault-tolerant protection system for video network transmission of claim 5, wherein the reference list generating module is configured to generate the second reference list according to the second frame number and the first reference list.
9. A fault tolerant protection device for video network transmission, comprising:
at least one processor;
at least one memory for storing at least one program;
when executed by the at least one processor, cause the at least one processor to implement a method of fault tolerant protection of video network transmissions as claimed in any one of claims 1 to 4.
10. A storage medium having stored therein a program executable by a processor, the program comprising: the processor-executable program when executed by a processor is for implementing a method of fault tolerant protection of video network transmissions as claimed in any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210389398.7A CN114928746A (en) | 2022-04-14 | 2022-04-14 | Method, system, device and storage medium for fault-tolerant protection of video network transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210389398.7A CN114928746A (en) | 2022-04-14 | 2022-04-14 | Method, system, device and storage medium for fault-tolerant protection of video network transmission |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114928746A true CN114928746A (en) | 2022-08-19 |
Family
ID=82806252
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210389398.7A Pending CN114928746A (en) | 2022-04-14 | 2022-04-14 | Method, system, device and storage medium for fault-tolerant protection of video network transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114928746A (en) |
-
2022
- 2022-04-14 CN CN202210389398.7A patent/CN114928746A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20050249240A1 (en) | Multimedia server with simple adaptation to dynamic network loss conditions | |
| US9350488B2 (en) | Content delivery system with allocation of source data and repair data among HTTP servers | |
| JP2008527862A (en) | Adaptive information delivery system using FEC feedback | |
| US10374865B2 (en) | System for processing streaming media service and method and network device thereof | |
| US20130182705A1 (en) | Method and system for transmitting encoded video signals | |
| EP2201691A1 (en) | Scalable information signal, apparatus and method for encoding a scalable information content, and apparatus and method for error correcting a scalable information signal | |
| WO2013067219A2 (en) | Content delivery system with allocation of source data and repair data among http servers | |
| US9516390B2 (en) | Scaling video delivery | |
| EP1410643A2 (en) | Method and system for streaming media with multiple description | |
| US20120140779A1 (en) | Method for equalizing the size of data packets by blocks of a multimedia stream | |
| US8045467B2 (en) | Reducing a number of data packets to increase a number of error correcting packets | |
| KR20050071568A (en) | System and method for providing error recovery for streaming fgs encoded video over an ip network | |
| US20170347130A1 (en) | Processing system and method for live video streaming based on network coding and content distribution network | |
| CN114928746A (en) | Method, system, device and storage medium for fault-tolerant protection of video network transmission | |
| WO2008134897A1 (en) | Method and system for quality service enhancement in networks for media streaming | |
| KR100792153B1 (en) | Method for Transmission Data for Multicast Based Network, Method for Processing Data and Data Transmission System | |
| Belda et al. | Hybrid FLUTE/DASH video delivery over mobile wireless networks | |
| Kim et al. | An efficient delay-constrained ARQ scheme for MMT packet-based real-time video streaming over IP networks | |
| Xu | Resource-efficient delivery of on-demand streaming data using UEP codes | |
| CN1863311A (en) | Method of transmitting video data | |
| KR20130114720A (en) | System and method for mitigating the cliff effect for content delivery over a heterogeneous network | |
| Mattoussi et al. | HbbTV based push-VOD services over DVB networks: Analysis and AL-FEC code application | |
| Mattoussi et al. | Application of AL-FEC to HbbTV DVB-T2 systems for the provision of VoD services in portable and fixed TV reception | |
| Wagner et al. | Adaptive and robust media streaming over multiple channels with bursty losses | |
| Thuneibat | Error Control Method for Interactive Video Applications over Modern Communication Networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |