CN114513672A - Method, device, equipment and medium for unified management of multi-format coding reference frames - Google Patents
Method, device, equipment and medium for unified management of multi-format coding reference frames Download PDFInfo
- Publication number
- CN114513672A CN114513672A CN202210216368.6A CN202210216368A CN114513672A CN 114513672 A CN114513672 A CN 114513672A CN 202210216368 A CN202210216368 A CN 202210216368A CN 114513672 A CN114513672 A CN 114513672A
- Authority
- CN
- China
- Prior art keywords
- reference frame
- frame
- queue
- frames
- current frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000007726 management method Methods 0.000 claims description 40
- 230000007774 longterm Effects 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 16
- 238000013507 mapping Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 230000000717 retained effect Effects 0.000 claims description 6
- 230000004931 aggregating effect Effects 0.000 claims description 3
- 239000002131 composite material Substances 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 3
- BDEDPKFUFGCVCJ-UHFFFAOYSA-N 3,6-dihydroxy-8,8-dimethyl-1-oxo-3,4,7,9-tetrahydrocyclopenta[h]isochromene-5-carbaldehyde Chemical compound O=C1OC(O)CC(C(C=O)=C2O)=C1C1=C2CC(C)(C)C1 BDEDPKFUFGCVCJ-UHFFFAOYSA-N 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/58—Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
The application provides a method, a device, equipment and a medium for uniformly managing multi-format coding reference frames, wherein a reference frame set is generated according to the relation of input current frames; allocating a reference frame set to a reference frame queue according to the HEVC specification; calling a corresponding function to generate a syntax element according to a video format by taking the reference frame set as input; and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set. The method and the device realize the management of various coding formats by using a uniform reference frame management scheme, and convert and generate the syntax elements related to the reference frame required by each format, thereby realizing the convenient management by using a system-one management reference frame in a multi-format composite coding system, and being easy to expand.
Description
Technical Field
The present application relates to the field of digital video compression technology. And more particularly, to a method, apparatus, device, and medium for unified management of multi-format coded reference frames.
Background
Reference frame management is a key technology in video coding, and is mainly responsible for managing a Decoded Picture Buffer (DPB), selecting an optimal reference scheme from the DPB, and creating a reference picture queue. The reference image management method is a high-level structure of a coding and decoding frame and provides a foundation for inter-frame prediction. Currently, each coding standard has its own set of reference frame management scheme. Managing reference frames independently for each coding standard in a multi-format composite coding system is overly complex and redundant.
Disclosure of Invention
In view of the above drawbacks of the prior art, the present application aims to provide a method, an apparatus, a device, and a medium for unified management of a multi-format coded reference frame, which are used to solve the problem that in the prior art, multi-format composite coding has complexity and redundancy with respect to reference frame management.
To achieve the above and other related objects, the present application provides a method for unified management of multiple format coded reference frames, comprising: generating a reference frame set according to the relation of the input current frame; allocating a reference frame set to a reference frame queue according to the HEVC specification; calling a corresponding function to generate a syntax element according to a video format by taking the reference frame set as input; and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
In an embodiment of the present application, the generating a reference frame set according to a relationship of an input current frame includes: determining the number of reference frames of the current frame; determining whether each reference frame is a long-term reference frame or a short-term reference frame; judging whether the current frame is a short-term reference frame according to the POC difference value of the current frame; and/or, a certain reference frame is designated as a long-term reference frame and an id is designated; it is determined whether each reference frame is referred to by the current frame.
In an embodiment of the present application, the allocating reference frame sets to reference frame queues according to HEVC specification includes: predefining a plurality of reference frame queues; and distributing each reference frame in the reference frame set to a corresponding reference frame queue according to the reference frame information.
In an embodiment of the present application, the reference frame queue includes any one or more of: a first queue for assembling a forward short-term reference frame referred to by a current frame; the second queue is used for collecting backward short-term reference frames referred by the current frame; a third queue for collecting short-term reference frames which are not referred by the current frame but need to be reserved; a fourth queue for collecting long-term reference frames referred to by the current frame; and a fifth queue for aggregating long-term reference frames that are not currently referenced but need to be retained.
In an embodiment of the present application, the syntax elements include: determining a key frame which needs to be updated by the next current frame in the reference frame queue; generating an updating instruction by the reference frame queue of the next current frame according to the reference frame set; a mapping relationship of reference frames from a set of reference frames to a next current frame is specified.
In an embodiment of the present application, the operating the reference frame queue of the next current frame according to the syntax element to ensure consistency with the reference frame set includes: marking a reference frame queue of the next current frame, and marking frames which do not belong to a reference frame set; generating an updating instruction aiming at all marked frames so as to enable the next current frame to update all marked frames; a reference frame is selected for each reference frame queue in the next current frame and all reference frame queues are mapped to the reference frames in the reference frame set used by the next current frame.
To achieve the above and other related objects, the present application provides a unified management apparatus for multiple format coded reference frames, comprising: the queue module is used for generating a reference frame set according to the relation of the input current frame; allocating a reference frame set to a reference frame queue according to the HEVC specification; the processing module is used for calling a corresponding function to generate a syntax element according to a video format by taking the reference frame set as input; and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
To achieve the above and other related objects, the present application provides a computer apparatus, comprising: a memory and a processor; the memory stores a computer program that the processor executes to implement the method as described above.
To achieve the above and other related objects, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described above.
As described above, a method, an apparatus, a device, and a medium for unified management of multi-format coded reference frames according to the present application generate a reference frame set according to a relationship of an input current frame; allocating a reference frame set to a reference frame queue according to the HEVC specification; calling a corresponding function to generate a syntax element according to a video format by taking the reference frame set as input; and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
Has the following beneficial effects:
the method and the device realize the management of various coding formats by using a uniform reference frame management scheme, and convert and generate the syntax elements related to the reference frame required by each format, thereby realizing the convenient management by using a system-one management reference frame in a multi-format composite coding system, and being easy to expand.
Drawings
Fig. 1 is a flowchart illustrating a method for unified management of multiple format coded reference frames according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of an AV1 bottom reference frame queue update according to an embodiment of the present invention.
Fig. 3A-3C are diagrams illustrating AV1 reference frame mapping according to an embodiment of the present application.
Fig. 4 is a block diagram of an apparatus for unified management of multiple format coded reference frames according to an embodiment of the present invention.
Fig. 5 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present application, and the drawings only show the components related to the present application and are not drawn according to the number, shape and size of the components in actual implementation, and the type, number and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
In order to solve the above problems, the present application provides a method, an apparatus, a device, and a medium for unified management of multi-format coded reference frames, which implement management of various coding formats by using a unified reference frame management scheme, and convert syntax elements related to reference frames required for generating each format, thereby implementing convenient management by using a system-to-system managed reference frame in a multi-format composite coding system, and facilitating expansion. Meanwhile, a specific implementation of HEVC/AV1 reference frame unified management is provided. Hevc (high Efficiency Video coding) is high Efficiency Video coding, and AV1 is a coding format.
Fig. 1 is a flowchart illustrating a unified management method for a multi-format coded reference frame according to an embodiment of the present invention. As shown, the method comprises:
step S101: a reference frame set (RPS) is generated according to the relation of the input current frame.
Briefly, after a video image is obtained, reference frame information is extracted according to the inter-frame relationship of an input current frame to form a reference frame set (RPS).
In an embodiment of the present application, the generating a reference frame set according to a relationship of an input current frame includes:
A. determining the number of reference frames of the current frame;
B. determining whether each reference frame is a long-term reference frame or a short-term reference frame; judging whether the current frame is a short-term reference frame according to the POC difference value of the current frame; and/or, a certain reference frame is designated as a long-term reference frame and an id is designated;
the GOP is a Group Of Pictures (GOP) Of several small Pictures, and POC is the display order Of Pictures in the GOP in video coding, and usually takes a value range Of 1-GOPSize.
C. It is determined whether each reference frame is referred to by the current frame.
For example, the reference frame set (RPS) may include the following information: the number of reference frames of the current frame; whether each reference frame is a long-term reference frame; POC difference of the (short term reference frame) reference frame with respect to the current frame; (long-term reference frame) long-term reference frame id/POC; whether each reference frame is referenced by the current frame, etc.
Step S102: reference frame sets are assigned to reference frame queues according to the HEVC specification.
In brief, HEVC is used to uniformly manage reference frames using a reference frame set (RPS), and a plug-in manages reference frame management information required by various coding formats. The method comprises the following steps: frame level reference frame queues are selected and updated and maintained by HEVC reference frame levels; and generating frame-level reference frame syntax elements, inputting the syntax elements into a reference frame set (RPS) of the current frame, and generating corresponding frame header/slice header syntax elements by each format plug-in according to the RPS.
HEVC (High Efficiency Video Coding) adopts a reference frame set (RPS) technique to manage already decoded frames and to serve as reference frames for subsequent encoding. The RPS is a parameter information set that contains a reference picture queue for constructing a current codec picture and manages the DPB. The encoding end configures RPS for the encoding image, so that each image contains a mark for managing the image in the DPB, and the aim of managing the reference image is further achieved. The reference frame set (RPS) of HEVC indicates all used reference frames of a current frame and reference frames that need to be retained, so that reference frame queue changes can be expressed compactly and are suitable as basic logic for reference frame queue management.
In an embodiment of the present application, the allocating reference frame sets to reference frame queues according to HEVC specification includes: predefining a plurality of reference frame queues; and distributing each reference frame in the reference frame set to a corresponding reference frame queue according to the reference frame information.
In an embodiment of the present application, the reference frame queue includes any one or more of:
a first queue for assembling a forward short-term reference frame referred to by a current frame;
the second queue is used for collecting backward short-term reference frames referred by the current frame;
a third queue for collecting short-term reference frames which are not referred by the current frame but need to be reserved;
a fourth queue for collecting long-term reference frames referred to by the current frame;
and a fifth queue for aggregating long-term reference frames that are not currently referenced but need to be retained.
For example, reference frame queue management is performed according to the HEVC specification, dividing reference frames in RPS into 5 queues:
before, forward short-term reference frame referred by current frame;
after, backward short-term reference frame referred by current frame;
follow, short-term reference frames that are not currently referenced but need to be retained;
lt _ current is a short-term reference frame referred to by the current frame;
lt _ follow, long-term reference frame that is not currently referenced but needs to be retained;
it should be noted that the queues described in the present application are not limited to the above examples, and different queues may be adjusted or added according to the requirements of different format coding.
Step S103: and calling a corresponding function to generate a syntax element according to the video format by taking the reference frame set as an input.
In an embodiment of the present application, the syntax elements include:
A. determining a key frame which needs to be updated by the next current frame in the reference frame queue;
B. generating an updating instruction by the reference frame queue of the next current frame according to the reference frame set;
C. a mapping relationship of a reference frame from a set of reference frames to a next current frame is specified.
For example, refresh _ frame _ flag selects which frames within FrameStore are updated by the current frame; enabling _ order _ hit 1 explicitly specifies a reference frame mapping relationship; ref _ order _ hit [ ] for each slot a reference frame is selected. It should be noted that the syntax elements described in the present application are not limited to the above examples, and the present application can also adjust or add the relevant syntax elements according to the coding requirements of different formats.
Step S104: and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
In an embodiment of the present application, the operating the reference frame queue of the next current frame according to the syntax element to ensure consistency with the reference frame set includes:
A. marking a reference frame queue of the next current frame, and marking frames which do not belong to a reference frame set;
B. generating an updating instruction aiming at all marked frames so as to enable the next current frame to update all marked frames;
C. a reference frame is selected for each reference frame queue in the next current frame and all reference frame queues are mapped to the reference frames in the reference frame set used by the next current frame.
For example, when managing for AV1 reference frames, the underlying reference frame queue generates maintenance update instructions from the reference frame set (RPS); a fixed mapping logic is used to map from a reference frame set (RPS) to a currently used reference frame.
In one or more embodiments, the present application takes reference frame set (RPS) generation AV1 reference frame syntax as an example for detailed illustration.
Reference frame management for AV1 includes 2 parts:
the entire reference frame queue is managed by FrameStore, where each entry corresponds to 1 reference frame held in the queue.
The reference frame for use by the current frame is mapped to 7 slots (reference frame queue):
LAST _ FRAME/LAST2_ FRAME/LAST3_ FRAME/GOLDEN _ FRAME/BWDREF _ FRAME/ALTREF2_ FRAME/ALTREF _ FRAME; each block may select 1 (single _ reference) or 2 (component _ reference) reference frames from them.
The relevant syntax elements are:
refresh _ frame _ flag selects which frames within FrameStore are updated by the current frame;
enable _ order _ hit 1 explicitly specifies the reference frame mapping relationship
ref _ order _ hit [ ] for each slot a reference frame is selected.
Step 1): a reference frame queue FrameStore marking a next current frame, wherein frames that are not already within a reference frame set (RPS) are marked as unused;
step 2): the refresh _ frame _ flag is generated to contain all the entries marked as unused, i.e. all unused entries are updated with the current frame, as shown in fig. 2.
Step 3): a reference frame is selected for each slot.
Here we choose to map all slots to the reference frame in the RPS used by the current frame. The common cases are 3:
1)1 forward reference frame F0: all 7 slots map to F0, as shown in fig. 3A, illustrating the mapping of 1 reference frame.
2)2 reference frames (forward reference frame F0+ backward reference frame F1, or 2 forward reference frames F0, F1):
LAST _ FRAME/LAST2_ FRAME/LAST3_ FRAME/GOLDEN _ FRAME maps to F0; BWDREF _ FRAME/ALTREF2_ FRAME/ALTREF _ FRAME maps to F1. As shown in fig. 3B, the mapping relationship of 1 reference frame is illustrated.
3)3 reference frames (forward reference frame F0+ backward reference frame F1+ long term reference frame F2):
LAST _ FRAME/LAST2_ FRAME/LAST3_ FRAME maps to F0; BWDREF _ FRAME/ALTREF2_ FRAME/ALTREF _ FRAME maps to F1; GOLDEN _ FRAME maps to F2. Fig. 3C illustrates the mapping relationship of 3 reference frames.
To sum up, the unified management method for multi-format coded reference frames according to the present application mainly provides a set of effective reference frame management schemes for a multi-format composite coding system, so as to manage various coding formats by using a unified reference frame management scheme, and convert syntax elements related to reference frames required by generating each format, thereby achieving convenient management and easy expansion by using a system-to-system managed reference frame in the multi-format composite coding system.
As shown in fig. 4, a block diagram of a unified management apparatus for multiple format coded reference frames according to an embodiment of the present invention is shown, and as shown in the drawing, the unified management apparatus 400 for multiple format coded reference frames includes:
a queue module 401, configured to generate a reference frame set according to a relationship of an input current frame; allocating a reference frame set to a reference frame queue according to the HEVC specification;
a processing module 402, configured to call a corresponding function to generate a syntax element according to a video format with a reference frame set as an input; and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
It is understood that the apparatus 200 can implement the unified management method for multi-format coded reference frames as described in fig. 1 through the operation of the modules.
It should be noted that the division of the modules of the above apparatus is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the processing module 402 may be a separate processing element, or may be integrated into a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and a processing element of the apparatus calls and executes the functions of the processing module 402. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
As shown in fig. 5, a schematic structural diagram of a computer device in an embodiment of the present application is shown, and as shown in the drawing, the computer device 500 includes: a memory 501, and a processor 502. The memory 501 stores a computer program, and the processor 502 executes the computer program to implement the unified management method for multi-format coded reference frames as described in fig. 1.
The Memory 501 may include a Random Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory.
The Processor 502 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, or discrete hardware components.
In an embodiment of the present application, a computer-readable storage medium stores a data transmission program, and the data transmission program, when executed by a processor, implements the unified management method for multiple format coded reference frames as shown in fig. 1.
The computer-readable storage medium, as will be appreciated by one of ordinary skill in the art: all or part of the steps for implementing the above method embodiments may be performed by hardware associated with a computer program. The aforementioned image processing program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
These computer program programs may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
In summary, the present application provides a method, an apparatus, a device and a medium for unified management of multi-format coded reference frames, which effectively overcome various disadvantages in the prior art and have high industrial utilization value.
The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which may be made by those skilled in the art without departing from the spirit and technical spirit of the present disclosure be covered by the claims of the present application.
Claims (9)
1. A unified management method for multi-format coding reference frames is characterized in that the method comprises the following steps:
generating a reference frame set according to the relation of the input current frame;
allocating a reference frame set to a reference frame queue according to the HEVC specification;
calling a corresponding function to generate a syntax element according to a video format by taking the reference frame set as input;
and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
2. The method for unified management of multi-format coded reference frames according to claim 1, wherein the generating the reference frame set according to the relation of the input current frame comprises:
determining the number of reference frames of the current frame;
determining whether each reference frame is a long-term reference frame or a short-term reference frame; judging whether the current frame is a short-term reference frame according to the POC difference value of the current frame; and/or, a certain reference frame is designated as a long-term reference frame and an id is designated;
it is determined whether each reference frame is referred to by the current frame.
3. The method for unified management of multi-format coded reference frames according to claim 1, wherein said assigning reference frame sets to reference frame queues according to HEVC specification comprises:
predefining a plurality of reference frame queues;
and distributing each reference frame in the reference frame set to a corresponding reference frame queue according to the reference frame information.
4. The method of claim 3, wherein the reference frame queue comprises any one or more of:
a first queue for assembling a forward short-term reference frame referred to by a current frame;
the second queue is used for collecting backward short-term reference frames referred by the current frame;
a third queue for collecting short-term reference frames which are not referred by the current frame but need to be reserved;
a fourth queue for collecting long-term reference frames referred to by the current frame;
and a fifth queue for aggregating long-term reference frames that are not currently referenced but need to be retained.
5. The method of claim 1, wherein the syntax element comprises:
determining a key frame which needs to be updated by the next current frame in the reference frame queue;
generating an updating instruction by the reference frame queue of the next current frame according to the reference frame set;
a mapping relationship of reference frames from a set of reference frames to a next current frame is specified.
6. The method as claimed in claim 5, wherein said operating the reference frame queue of the next current frame according to the syntax element to ensure consistency with the reference frame set comprises:
marking a reference frame queue of the next current frame, and marking frames which do not belong to a reference frame set;
generating an updating instruction aiming at all marked frames so as to enable the next current frame to update all marked frames;
a reference frame is selected for each reference frame queue in the next current frame and all reference frame queues are mapped to the reference frames in the reference frame set used by the next current frame.
7. An apparatus for unified management of multi-format coded reference frames, the apparatus comprising:
the queue module is used for generating a reference frame set according to the relation of the input current frame; allocating a reference frame set to a reference frame queue according to the HEVC specification;
the processing module is used for calling a corresponding function to generate a syntax element according to a video format by taking the reference frame set as input; and operating the reference frame queue of the next current frame according to the syntax element so as to ensure the reference frame queue to be consistent with the reference frame set.
8. A computer device, the device comprising: a memory, a processor, and a communicator; the memory stores a computing program, and the processor executes the computing program to implement the method of any one of claims 1-6.
9. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210216368.6A CN114513672B (en) | 2022-03-07 | 2022-03-07 | Method, device, equipment and medium for unified management of multi-format coding reference frames |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210216368.6A CN114513672B (en) | 2022-03-07 | 2022-03-07 | Method, device, equipment and medium for unified management of multi-format coding reference frames |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114513672A true CN114513672A (en) | 2022-05-17 |
| CN114513672B CN114513672B (en) | 2024-09-27 |
Family
ID=81553751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210216368.6A Active CN114513672B (en) | 2022-03-07 | 2022-03-07 | Method, device, equipment and medium for unified management of multi-format coding reference frames |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114513672B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330621A (en) * | 2007-06-20 | 2008-12-24 | 辉达公司 | Uniform video decoding and display |
| US20140049604A1 (en) * | 2012-08-16 | 2014-02-20 | Qualcomm Incorporated | Constructing reference picture lists for multi-view or 3dv video coding |
| CN103828375A (en) * | 2011-09-23 | 2014-05-28 | 高通股份有限公司 | Video coding with subsets of a reference picture set |
| US20170064313A1 (en) * | 2015-08-31 | 2017-03-02 | Microsoft Technology Licensing, Llc | Acceleration interface for video decoding |
| CN106664424A (en) * | 2014-01-03 | 2017-05-10 | 诺基亚技术有限公司 | Parameter set coding |
| CN106791835A (en) * | 2017-03-01 | 2017-05-31 | 北京大学 | A kind of reference pictures management method |
| WO2018110270A1 (en) * | 2016-12-12 | 2018-06-21 | ソニー株式会社 | Image processing device and method |
| WO2021054869A2 (en) * | 2020-01-23 | 2021-03-25 | Huawei Technologies Co., Ltd. | Reference picture management methods for video coding |
| CN113905241A (en) * | 2020-06-22 | 2022-01-07 | 微软技术许可有限责任公司 | Video coding |
-
2022
- 2022-03-07 CN CN202210216368.6A patent/CN114513672B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101330621A (en) * | 2007-06-20 | 2008-12-24 | 辉达公司 | Uniform video decoding and display |
| CN103828375A (en) * | 2011-09-23 | 2014-05-28 | 高通股份有限公司 | Video coding with subsets of a reference picture set |
| US20140049604A1 (en) * | 2012-08-16 | 2014-02-20 | Qualcomm Incorporated | Constructing reference picture lists for multi-view or 3dv video coding |
| CN106664424A (en) * | 2014-01-03 | 2017-05-10 | 诺基亚技术有限公司 | Parameter set coding |
| US20170064313A1 (en) * | 2015-08-31 | 2017-03-02 | Microsoft Technology Licensing, Llc | Acceleration interface for video decoding |
| WO2018110270A1 (en) * | 2016-12-12 | 2018-06-21 | ソニー株式会社 | Image processing device and method |
| CN106791835A (en) * | 2017-03-01 | 2017-05-31 | 北京大学 | A kind of reference pictures management method |
| WO2021054869A2 (en) * | 2020-01-23 | 2021-03-25 | Huawei Technologies Co., Ltd. | Reference picture management methods for video coding |
| CN113905241A (en) * | 2020-06-22 | 2022-01-07 | 微软技术许可有限责任公司 | Video coding |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114513672B (en) | 2024-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11615556B2 (en) | Context modeling of occupancy coding for point cloud coding | |
| US20240345917A1 (en) | Parity block generation method and apparatus | |
| US20240160528A1 (en) | Data Storage Method and Apparatus in Storage System | |
| WO2023160236A1 (en) | Slicing method and apparatus for multi-output neural network, and chip and storage medium | |
| CN115129801A (en) | Map data processing method, device, equipment and storage medium | |
| CN115311399A (en) | Image rendering method and device, electronic equipment and storage medium | |
| WO2019081087A1 (en) | A method for volumetric video encoding and decoding | |
| CN115599764A (en) | Method, device and medium for migrating table data | |
| JP7337193B2 (en) | Context Modeling of Occupancy Encoding for Point Cloud Encoding | |
| CN114513672B (en) | Method, device, equipment and medium for unified management of multi-format coding reference frames | |
| CN110109751B (en) | Distribution method and device of distributed graph cutting tasks and distributed graph cutting system | |
| CN103686179A (en) | Encoding and decoding methods and devices using parameter set and electronic equipment | |
| CN114503438A (en) | Semi-decoupled partitioning for video coding and decoding | |
| CN112131423A (en) | Picture acquisition method, device and system | |
| CN112883026A (en) | Data processing method and device | |
| CN108536759B (en) | Sample playback data access method and device | |
| US11941856B2 (en) | Predictive tree-based geometry coding for a point cloud | |
| CN115328608A (en) | Kubernetes container vertical expansion adjusting method and device | |
| CN108958926B (en) | Darwin streaming media server-based virtual memory pool design method | |
| CN117541744B (en) | Rendering method and device for urban live-action three-dimensional image | |
| CN114338598B (en) | Method, device and computer storage medium for mapping 5G channel resources | |
| US20240193139A1 (en) | Data encoding and decoding methods and systems | |
| WO2024031586A1 (en) | Method for encoding and decoding a 3d point cloud, encoder, decoder | |
| CN118354069A (en) | Video encoding method, video encoding device, electronic device, storage medium, and program product | |
| CN116339967A (en) | Media stream management method, module and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |