CN101562741B - Multi-layer coding rate control method and device - Google Patents

Multi-layer coding rate control method and device Download PDF

Info

Publication number
CN101562741B
CN101562741B CN 200910138431 CN200910138431A CN101562741B CN 101562741 B CN101562741 B CN 101562741B CN 200910138431 CN200910138431 CN 200910138431 CN 200910138431 A CN200910138431 A CN 200910138431A CN 101562741 B CN101562741 B CN 101562741B
Authority
CN
China
Prior art keywords
bit number
layer
enhancement layer
bit
access unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 200910138431
Other languages
Chinese (zh)
Other versions
CN101562741A (en
Inventor
张鹏
高云超
梁丽杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN 200910138431 priority Critical patent/CN101562741B/en
Publication of CN101562741A publication Critical patent/CN101562741A/en
Priority to PCT/CN2010/072588 priority patent/WO2010130190A1/en
Application granted granted Critical
Publication of CN101562741B publication Critical patent/CN101562741B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer

Abstract

The invention relates to a multi-layer coding rate control method and a device; wherein the method comprises the steps of: distributing a target bit number to an access unit of a current image group according to an obtained usable bit number, distributing a base layer bit number and a reinforced layer bit number to a base layer and a reinforced layer of the access unit according to an the target bit number, carrying out coding on the base layer according to the base layer bit number, and carrying out coding on the reinforced layer according to the reinforced layer bit number. The proposal provided by the embodiment of the invention can reasonably adjust the proportion of the base layer and the reinforced layer in the target bit number under the condition of meeting the total bit rate and improve the quality of a bit flow outputted by a coder, thereby improving the quality for decoding images.

Description

Multi-layer coding rate control and device
Technical field
The embodiment of the invention relates to field of video encoding, relates in particular to a kind of multi-layer coding rate control and device.
Background technology
At present, scalable video (Scalable Video Coding, hereinafter to be referred as: SVC) technology is to solve one of adaptive key technology of video.H.264 SVC is keeping, is strengthening video coding (Advance Video Coding, hereinafter to be referred as: on the basis of the advantage of high efficient coding AVC), a lot of good characteristics are provided, for example:, strengthen the telescopic ability in spatial domain etc. based on the flexible time domain ability of grade B picture structure.
The Rate Control technology is the important technology in the video coding, and good bit rate control method can make under the condition that bandwidth limits, and the decoded image quality of the video bit stream of encoder output meets or near rate-distortion optimization.The Rate Control technology comprise variable bit control (Variable Bit Rate, hereinafter to be referred as: VBR) and fixed bit control (Constant Bit Rate is hereinafter to be referred as CBR) two kinds of patterns.The VBR pattern is a kind of open loop tupe, its be input as video source and fixing quantization parameter (QuantityParameter, hereinafter to be referred as: QP) because the image complexity in the actual video sequence is constantly to change, bit rate is respective change thereupon also, causes the picture quality instability.The CBR pattern is a kind of closed-loop process pattern, and it is input as video source and target bits, according to the estimation of the complexity of video source, the situation that takies and the channel width of decoder buffer, QP is dynamically adjusted, and obtains satisfactory code check.For the CBR pattern, the Rate Control technology is utilized the level and smooth mechanism of buffering mostly, realizes by adjusting QP.
Different with single layer coding, SVC supports the coding of a plurality of space layer, comprise basic layer (by the image layer of reference, can not rely on the independent decoding of other layer) and the enhancement layer image layer of (during decoding with reference to other layer), wherein basic layer and enhancement layer adopt independently Rate Control technology respectively.The inventor finds in research process: this basic layer and enhancement layer adopt independently that the method for Rate Control technology has reduced the quality of encoder output bit flow, thereby have reduced decoded image quality.
Summary of the invention
The embodiment of the invention provides a kind of multi-layer coding rate control and device, improves the quality of encoder output bit flow, thereby has improved decoded image quality.
The multi-layer coding rate control that the embodiment of the invention provides comprises:
According to the available bit number of obtaining, to the access unit distribution target bit of present image group;
According to the described target bit and the distortion factor, adopt many times coding methods, obtain basic layer bit number and enhancement layer bit number, or, model according to the distortion factor and target bit, calculate basic layer bit number and enhancement layer bit number, distribute described basic layer bit number and described enhancement layer bit number for the basic layer and the enhancement layer of described access unit;
According to described basic layer bit number basic layer is encoded, enhancement layer is encoded according to described enhancement layer bit number.
The rate control device of the multi-layer coding that the embodiment of the invention provides comprises:
The target bit allocation module is used for according to the available bit number of obtaining, to the access unit distribution target bit of present image group;
Layer Bit Allocation in Discrete module, be used for adopting many times coding methods according to the described target bit and the distortion factor, obtain basic layer bit number and enhancement layer bit number, or according to the model of the distortion factor and target bit, calculate basic layer bit number and enhancement layer bit number, distribute described basic layer bit number and described enhancement layer bit number for the basic layer and the enhancement layer of described access unit;
Coding module is used for according to described basic layer bit number basic layer being encoded, and according to described enhancement layer bit number enhancement layer is encoded.
The embodiment of the invention is according to available bit number, distribute target bit to access unit, and then give the basic layer and the enhancement layer allocation bit number of each access unit, the scheme that provides by the embodiment of the invention, satisfying under the gross bit rate constraints, can rationally adjust basic layer and enhancement layer shared ratio in target bit, improve the quality of encoder output bit flow, thereby improved decoded image quality.
Description of drawings
Figure 1A is the basic layer of the SVC that the embodiment of the invention was suitable for and the schematic diagram of a kind of corresponding relation of enhancement layer;
The basic layer of the SVC that Figure 1B embodiment of the invention is suitable for and the schematic diagram of the another kind of corresponding relation of enhancement layer;
Fig. 2 is the flow chart of the embodiment of the invention one multi-layer coding rate control;
Fig. 3 is the flow chart of the embodiment of the invention two multi-layer coding rate control;
Fig. 4 is the structural representation of the rate control device of embodiment of the invention multi-layer coding.
Embodiment
Below by drawings and Examples, the technical scheme of the embodiment of the invention is described in further detail.
Can have corresponding relation between the basic layer of SVC and the enhancement layer, for example: shown in Figure 1A, be the basic layer of SVC and the schematic diagram of a kind of corresponding relation of enhancement layer, basic layer and enhancement layer have 3 grades of time domain layerings; Shown in Figure 1B, be the basic layer of SVC and the schematic diagram of the another kind of corresponding relation of enhancement layer, basic layer has 2 grades of time domain layerings, and enhancement layer has 3 grades of time domain layerings.Need to prove that the schematic diagram of above-mentioned 2 kinds of basic layers and enhancement layer corresponding relation only is that multi-layer coding rate control that the embodiment of the invention provides and device are not limited to above-mentioned 2 kinds of application scenarioss to the illustrating of basic layer and enhancement layer relation.
Fig. 2 is the flow chart of the embodiment of the invention one multi-layer coding rate control.As shown in Figure 2, present embodiment specifically comprises the steps:
Step 101, according to the available bit number obtained, to the present image group (Group of Pictures, hereinafter to be referred as: access unit GOP) distributes target bit;
Step 102, according to target bit, distribute basic layer bit number and enhancement layer bit number for the basic layer of access unit and enhancement layer;
Step 103, the basic layer of basis bit number are encoded to basic layer, according to the enhancement layer bit number enhancement layer are encoded.
Present embodiment is according to available bit number, distribute target bit to AU, and then give basic layer and the enhancement layer allocation bit number of each AU, the scheme that provides by present embodiment, satisfying under the gross bit rate constraints, can rationally adjust basic layer and enhancement layer shared ratio in target bit, improve the quality of encoder output bit flow, thereby improved decoded image quality.
Fig. 3 is the flow chart of the embodiment of the invention two multi-layer coding rate control.As shown in Figure 3, present embodiment specifically comprises the steps:
Step 201, according to the frame per second of target bit rate, virtual buffering region occupation rate and the video sequence of AU number that current GOP comprised, image, calculate the available bit number of residual image among the current GOP.
This step can be carried out according to predefined bit rate conditions, for example: according to Rate Control in the encoder the initial input value---target bit rate is carried out.Suppose that current GOP is i GOP, after the j-1 width of cloth image encoding of i GOP, the available bit number B of the residual image among this GOP except a preceding j-1 image i(j) can calculate by following formula:
B i ( j ) = R i ( j ) f × N i - V i ( j ) j = 1 B i ( j - 1 ) + R i ( j ) - R i ( j - 1 ) f × ( N i - j + 1 ) - b i ( j - 1 ) j = 2,3 , . . . , N i - - - ( 1 )
Wherein, R i(j) be the target bit rate (if the initial input value of Rate Control module---target bit rate is in time and variable amount that then target bit rate herein is a j image encoding target bit rate constantly in the encoder) of j image among i the GOP, V i(j) be the virtual buffering region occupation rate of j image among i the GOP, f is the frame per second of video sequence, N iBe i the AU number that GOP comprised, b i(j-1) be j-1 the actual bit number that image adopted.
Step 202, according to the frame per second and the virtual buffering region occupation rate of available bit number, target bit rate, video sequence, distribute target bit for each AU of current GOP.
Further, present embodiment is in the frame per second and virtual buffering region occupation rate of reference available bit number, target bit rate, video sequence, the complexity of all right reference picture and the structure of time domain layering distribute target bit for each AU of current GOP.For example can adopt different distribution principles to distribute target bit, particularly, the distribution principle of target bit can comprise: the AU that image complexity is high more need distribute many more bit numbers; The rank of the time domain classification under the AU is high more, and its assignable bit number is few more.
Present embodiment provides a kind of method of distributing target bit, specifies as follows.Wherein, current GOP is i GOP, and for convenience of description, the subscript i of each concrete parameter ignores and do not write, and for example B (j) is B i(j), other parameters similarly.
After the 1st the AU end-of-encode of current GOP, virtual buffering region target occupation rate S (2)=V (2), and the virtual buffering region target occupation rate of the basic layer of remaining time domain AU can be expressed as among the current GOP:
S ( j + 1 ) = S ( j ) - S ( 2 ) N p - 1 + W ‾ p ( j ) × ( L + 1 ) × R ( j ) ( j ) f × ( W ‾ p ( j ) + W ‾ b ( j ) × L ) - R ( j ) f - - - ( 2 )
Wherein, W p(j) be the average complexity of basic layer, W b(j) be the average complexity of enhancement layer, N pBe the number of P frame among the current GOP, L be continuous two can by between the reference picture (as I frame or P frame) can not be by the number of reference picture (as the B frame).
Consider virtual buffering region target occupation rate S (j) and actual occupation rate V (j), and the constraint of target bit rate R (j) and frame per second, j the bit number T that AU is required AU 1(j) be:
T AU 1 ( j ) = R ( j ) f + γ × [ S ( j ) - V ( j ) ] - - - ( 3 )
Wherein, γ is a constant, and its value can be determined according to actual conditions in application.
Available bit number B (j) and residue AU number according to residual image among the current GOP can obtain the bit number T that j AU can use AU 2(j) be:
T AU 2 ( j ) = W p ( j - 1 ) × B ( j ) W p ( j - 1 ) × N LZ , r + W b ( j - 1 ) × N LNZ , r - - - ( 4 )
Wherein, N LZ, rAnd N LNZ, rBe respectively the residue frame number of basic layer of time domain and enhancement layer, W p(j-1) be the related weighing coefficient of the basic layer complexity of j-1 AU, W b(j-1) be the related weighing coefficient of the enhancement layer complexity of j-1 AU.
Finally can distribute to the target bit T of j AU AU(j) be T AU 1(j) and T AU 2(j) weighted average is shown below:
T AU ( j ) = α ( β × T AU 1 ( j ) + ( 1 - β ) × T AU 2 ( j ) ) - - - ( 5 )
Wherein, α and β are constant, and the α value depends on whether comprise basic layer among the AU, and when comprising basic layer among the AU, α can value be 1, when not comprising basic layer among the AU, α can be between 0 to 1 value; β is T AU 1(j) weights.The concrete numerical value of α and β can be determined according to actual conditions in application.
Step 203, at one of them AU, according to the target bit of this AU, distribute corresponding basic layer of bit number and enhancement layer bit number for respectively the basic layer of this AU and enhancement layer.
In this step, if enhancement layer is only arranged among the AU, the enhancement layer bit number T of Fen Peiing then EL(j)=T AU(j), basic layer bit number T BL(j)=0.
If comprise enhancement layer and basic layer among the AU, the basic layer bit number T that then distributes BL(j) and enhancement layer bit number T EL(j) satisfy:
T AU(j)＝T BL(j)+T EL(j) (6)
Because the cataloged procedure of enhancement layer needs the information with reference to basic layer, for example: information such as intraframe prediction information, motion vector and residual error coefficient, therefore, T BL(j) and T EL(j) different proportionate relationship can influence the quality of encoder output bit flow, and then influences the quality of decoded picture.In order to guarantee the quality of decoded picture, present embodiment can adopt following two kinds of method distribution T BL(j) and T EL(j).
First method: according to the distortion factor and target bit, adopt many times coding methods, be met the T of rate-distortion optimization BL(j) and T EL(j).Particularly, adopt all possible T of traversal BL(j) and T EL(j) Zu He many times coding methods make the distortion factor D of coded image and the actual bit number R that adopts that encodes satisfy the Lagrangian minimum of rate-distortion optimization, promptly
Figure G2009101384313D00062
Second method:, calculate and be met the T of rate-distortion optimization according to the model (being rate distortion R-D model) of the distortion factor and target bit BL(j) and T EL(j).
T BL(j) and T EL(j) satisfy following formula:
f(T BL，T EL)＝g(D(j)) (7)
Wherein, D (j) is the distortion factor of the image of j AU, can adopt the mean absolute error MAD (j) of present image or error sum of squares SSD (j) or absolute error and SAD (j) to wait and represent.
Further, above-mentioned formula (7) can be specially following formula:
k 1 * ( T EL ( j ) - h EL ( j ) ) * ( T BL ( j ) - h BL ( j ) ) k 2 * ( T EL ( j ) - h EL ( j ) ) - k 3 * ( T BL ( j ) - h BL ( j ) ) = h 4 * MAD ( j ) - - - ( 8 )
Wherein, k 4Be the constant that obtains through experiment.h BLAnd h ELBe respectively the bit number of the header of basic layer and enhancement layer image coding, k 1, k 2, k 3, k 4Be coefficient, wherein k 1Be the constant between 4～8, k 2, k 3, k 4Obtaining value method with H.264 in ask the method for the coefficient of first order in the R-Q model similar.
According to formula (6) and (7), separate the model shown in the following equation:
T BL + T EL = T AU ( j ) f ( T BL , T EL ) = g ( D ( j ) ) ) - - - ( 9 )
Can be met the T of rate-distortion optimization BL(j) and T EL(j) value.
Need to prove: formula (8) is a kind of specific implementation of formula (7), also has other implementations certainly, can combine with formula (6), is met the T of rate-distortion optimization BL(j) and T ELThe implementation of value (j) is embodiment of the invention scope required for protection.
Step 204, the basic layer of basis bit number calculate basic layer quantization parameter, calculate enhancement layer quantization parameter according to the enhancement layer bit number.
Present embodiment can adopt the R-Q model, calculates basic layer quantization parameter and enhancement layer quantization parameter respectively.Further, this R-Q model can for dynamic image expert group (Moving Pictures ExpertsGroup, hereinafter to be referred as: MPEG)-2 (Test Model is hereinafter to be referred as TM)-5 first order modeling that is adopted for test model, also can be the second-order model that is H.264/AVC adopted, for example:
T ( j ) = c 1 × MAD ( j ) Q ( j ) + c 2 × MAD ( j ) Q 2 ( j ) - m h ( j ) - - - ( 10 )
Wherein, T (j) is a bit number, and Q (j) is a quantization parameter, m h(j) be basic layer or the header of enhancement layer and the bit number of motion vector, c 1And c 2Be constant.In actual coding, MAD (j) can obtain by the MAD prediction of former frame or basic layer.Particularly, when calculating basic layer of quantization parameter, can obtain according to basic layer bit number, the header of basic layer and the bit number of motion vector and the model shown in the formula (10); When calculating enhancement layer quantization parameter, can obtain according to the header of enhancement layer bit number, enhancement layer and the bit number of motion vector and the model shown in the formula (10).
Step 205, according to basic layer bit number and basic layer quantization parameter, basic layer is encoded, according to enhancement layer bit number and enhancement layer quantization parameter, enhancement layer is encoded, obtain and export scalable bitstream after multiplexing.
Step 206, according to the number of coded bits and the distortion factor that coding obtains, the parameter of Rate Control is upgraded.
After the basic layer of current AU and enhancement layer coding are finished, according to actual bit number that obtains of coding and distortion, parameter to Rate Control is upgraded, need updated parameters to comprise parameter relevant in above-mentioned the separate equations, for example: S (j), V (j), R (j) B (j), W with current encoded image p(j), W b(j), N LZ, r, N LNZ, r, MAD (j) and m h(j) etc.Then, jump to step 203, continue to handle next AU; If current AU is last AU, then cataloged procedure finishes.
After an AU end-of-encode, the virtual buffering region occupation rate of encoder can be upgraded by following formula:
Figure G2009101384313D00081
V i ( j ) = V i ( j - 1 ) + b i ( j - 1 ) - R i ( j - 1 ) f , j = 2,3 , . . . , N i
Present embodiment is according to available bit number, distribute target bit for each AU, and then give basic layer and the enhancement layer allocation bit number of each AU, the scheme that provides by present embodiment, satisfying under the gross bit rate constraints, can rationally adjust basic layer and enhancement layer shared ratio in target bit, improve the quality of encoder output bit flow, thereby improved decoded image quality; Further, present embodiment can be by the method for the many times R-D models of encoding or set up, be met the basic layer of rate-distortion optimization and the Bit Allocation in Discrete optimum organization of enhancement layer, thereby obtain the output bit flow of the multi-layer coding of rate-distortion optimization, improved coding quality; And present embodiment is selected suitable QP according to the bit number of each layer of distribute to, and makes encoder can make full use of layer dependencies, has improved code efficiency.
Fig. 4 is the structural representation of the rate control device of embodiment of the invention multi-layer coding.As shown in Figure 4, present embodiment specifically comprises: target bit allocation module 11, layer Bit Allocation in Discrete module 12 and coding module 13.Wherein, target bit allocation module 11 distributes target bit for the AU of current GOP according to the available bit number of obtaining; Layer Bit Allocation in Discrete module 12 distributes corresponding basic layer bit number and enhancement layer bit number for respectively the basic layer of this AU and enhancement layer according to target bit; Coding module 13 is encoded to basic layer according to basic layer bit number, according to the enhancement layer bit number enhancement layer is encoded.
Further, present embodiment can also comprise available bits computing module 14, this available bits computing module 14 calculates available bit number according to the frame per second of target bit rate, virtual buffering region occupation rate and the video sequence of AU number that current GOP comprised, image.Particularly, available bits computing module 14 can calculate available bit number according to formula (1).
Above-mentioned target bit allocation module 11 can specifically be used for frame per second, virtual buffering region occupation rate, the complexity of image and the structure of time domain layering according to available bit number, target bit rate, video sequence, distribute target bit for each AU of current GOP, particularly, target bit allocation module 11 can be distributed target bit to AU according to formula (2)-(5).
Above-mentioned layer Bit Allocation in Discrete module 12 can specifically be used for adopting many times coding methods according to the distortion factor and target bit, is met the basic layer bit number and the enhancement layer bit number of rate-distortion optimization.The model that layer Bit Allocation in Discrete module 12 also can specifically be used for according to the distortion factor and target bit calculates the basic layer bit number and the enhancement layer bit number that satisfy rate-distortion optimization.
Above-mentioned coding module 13 can specifically be used for calculating basic layer quantization parameter according to described basic layer bit number, calculate enhancement layer quantization parameter according to described enhancement layer bit number, according to basic layer bit number and described basic layer quantization parameter, basic layer is encoded, according to enhancement layer bit number and described enhancement layer quantization parameter, enhancement layer is encoded.Coding module 13 can adopt the R-Q model, calculates basic layer quantization parameter and enhancement layer quantization parameter respectively.Further, this R-Q model can be the first order modeling that MPEG-2TM-5 adopted, and also can be the second-order model that is H.264/AVC adopted.
Present embodiment can also comprise update module 15, and this update module 15 is upgraded the parameter of Rate Control according to the number of coded bits and the distortion factor that coding obtains, needs updated parameters to comprise parameter relevant with current encoded image in above-mentioned the separate equations.
Present embodiment is according to available bit number, distribute target bit for each AU, and then give basic layer and the enhancement layer allocation bit number of each AU, the scheme that provides by present embodiment, satisfying under the gross bit rate constraints, can rationally adjust basic layer and enhancement layer shared ratio in target bit, improve the quality of encoder output bit flow, thereby improved decoded image quality; Further, present embodiment can be by the method for the many times R-D models of encoding or set up, be met the basic layer of rate-distortion optimization and the Bit Allocation in Discrete optimum combination of enhancement layer, thereby obtain the output bit flow of the multi-layer coding of rate-distortion optimization, improved coding quality; And present embodiment is selected suitable QP according to the bit number of each layer of distribute to, and makes encoder can make full use of layer dependencies, has improved code efficiency.
Above-mentioned each present embodiment is the multi-layer coding method that is applicable to SVC, and the embodiment of the invention also goes for other coding techniques that adopts inter-layer prediction, for example scalable coding technology among MPEG-2 and the MPEG-4.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of program command, aforesaid program can be stored in the computer read/write memory medium, this program is when carrying out, execution comprises the step of said method embodiment, and aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
It should be noted that at last: above embodiment only in order to the technical scheme of the explanation embodiment of the invention, is not intended to limit; Although the embodiment of the invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of each embodiment technical scheme of the embodiment of the invention.

Claims (11)

1. multi-layer coding rate control is characterized in that comprising:
According to the available bit number of obtaining, to the access unit distribution target bit of present image group;
According to the described target bit and the distortion factor, adopt many times coding methods, obtain basic layer bit number and enhancement layer bit number, or, model according to the distortion factor and target bit, calculate basic layer bit number and enhancement layer bit number, distribute described basic layer bit number and described enhancement layer bit number for the basic layer and the enhancement layer of described access unit;
According to described basic layer bit number basic layer is encoded, enhancement layer is encoded according to described enhancement layer bit number.
2. multi-layer coding rate control according to claim 1, it is characterized in that also comprising: the frame per second of access unit number, target bit rate, virtual buffering region occupation rate and the video sequence that is comprised according to described present image group, calculate described available bit number.
3. multi-layer coding rate control according to claim 1, it is characterized in that, described access unit to the present image group distributes target bit to comprise: according to frame per second, virtual buffering region occupation rate, the complexity of image and the structure of time domain layering of described target bit rate, video sequence, and
Figure FSB00000538387600011
Calculate the required bit number of access unit; Bit number and the described available bit number required according to described access unit, and
Figure FSB00000538387600012
Calculate the target bit of distributing to described access unit;
Wherein, R (j) is the target bit rate of j access unit, and V (j) is the virtual buffering region occupation rate of j access unit, and f is the frame per second of video sequence, and S (j) is a virtual buffering region target occupation rate; T AU(j) be the target bit of j access unit,
Figure FSB00000538387600013
Be j the bit number that access unit can be used,
Figure FSB00000538387600014
Be j the bit number that access unit is required, γ, α and β are constant.
4. multi-layer coding rate control according to claim 1, it is characterized in that, described model according to the distortion factor and target bit, calculating described basic layer bit number and described enhancement layer bit number comprises: according to the model shown in the following formula, calculate described basic layer bit number and described enhancement layer bit number;
T BL + T EL = T AU ( j ) f ( T BL , T EL ) = g ( D ( j ) )
Wherein, T BLThe basic layer of expression bit number, T ELExpression enhancement layer bit number, T AU(j) expression target bit, D (j) represents the distortion factor,
Wherein, f (T BL, T EL)=g (D (j)) is a following formula:
k 1 * ( T EL ( j ) - h EL ( j ) ) * ( T BL ( j ) - h BL ( j ) ) k 2 * ( T EL ( j ) - h EL ( j ) ) - k 3 * ( T BL ( j ) - h BL ( j ) ) = k 4 * MAD ( j )
Wherein, h BLAnd h ELBe respectively the bit number of the header of basic layer and enhancement layer image coding, k 1, k 2, k 3, k 4Be coefficient, MAD (j) is the mean absolute error of the image of j access unit.
5. multi-layer coding rate control according to claim 1 is characterized in that, describedly according to described basic layer bit number basic layer is encoded, and according to described enhancement layer bit number enhancement layer is encoded, and comprising:
Calculate basic layer quantization parameter according to described basic layer bit number, calculate enhancement layer quantization parameter according to described enhancement layer bit number;
According to basic layer bit number and described basic layer quantization parameter, basic layer is encoded; According to enhancement layer bit number and described enhancement layer quantization parameter, enhancement layer is encoded.
6. according to the arbitrary described multi-layer coding rate control of claim 1-3, it is characterized in that, basic layer is encoded according to described basic layer bit number described, according to described enhancement layer bit number enhancement layer is also comprised after encoding:, the parameter of Rate Control is upgraded according to the number of coded bits and the distortion factor that coding obtains.
7. the rate control device of a multi-layer coding is characterized in that comprising:
The target bit allocation module is used for according to the available bit number of obtaining, to the access unit distribution target bit of present image group;
Layer Bit Allocation in Discrete module, be used for adopting many times coding methods according to the described target bit and the distortion factor, obtain basic layer bit number and enhancement layer bit number, or according to the model of the distortion factor and target bit, calculate basic layer bit number and enhancement layer bit number, distribute described basic layer bit number and described enhancement layer bit number for the basic layer and the enhancement layer of described access unit;
Coding module is used for according to described basic layer bit number basic layer being encoded, and according to described enhancement layer bit number enhancement layer is encoded.
8. the rate control device of multi-layer coding according to claim 7, it is characterized in that also comprising the available bits computing module, be used for the frame per second of the access unit number, target bit rate, virtual buffering region occupation rate and the video sequence that are comprised according to described present image group, calculate described available bit number.
9. the rate control device of multi-layer coding according to claim 7, it is characterized in that, described target bit allocation module specifically is used for frame per second, virtual buffering region occupation rate, the complexity of image and the structure of time domain layering according to target bit rate, video sequence, and
Figure FSB00000538387600031
Calculate the required bit number of access unit; Bit number and the described available bit number required according to described access unit, and
Figure FSB00000538387600032
Calculate the target bit of distributing to described access unit;
Wherein, R (j) is the target bit rate of j access unit, and V (j) is the virtual buffering region occupation rate of j access unit, and f is the frame per second of video sequence, and S (j) is a virtual buffering region target occupation rate; T AU(j) be the target bit of j access unit, Be j the bit number that access unit can be used,
Figure FSB00000538387600034
Be j the bit number that access unit is required, γ, α and β are constant.
10. according to the rate control device of the arbitrary described multi-layer coding of claim 7-9, it is characterized in that, described coding module specifically is used for calculating basic layer quantization parameter according to described basic layer bit number, calculate enhancement layer quantization parameter according to described enhancement layer bit number, according to basic layer bit number and described basic layer quantization parameter, basic layer is encoded,, enhancement layer is encoded according to enhancement layer bit number and described enhancement layer quantization parameter.
11., it is characterized in that also comprising update module according to the rate control device of the arbitrary described multi-layer coding of claim 7-9, be used for the number of coded bits and the distortion factor that obtain according to coding, the parameter of Rate Control is upgraded.
CN 200910138431 2009-05-11 2009-05-11 Multi-layer coding rate control method and device Expired - Fee Related CN101562741B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN 200910138431 CN101562741B (en) 2009-05-11 2009-05-11 Multi-layer coding rate control method and device
PCT/CN2010/072588 WO2010130190A1 (en) 2009-05-11 2010-05-11 Rate control method and device for multi layer coding

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910138431 CN101562741B (en) 2009-05-11 2009-05-11 Multi-layer coding rate control method and device

Publications (2)

Publication Number Publication Date
CN101562741A CN101562741A (en) 2009-10-21
CN101562741B true CN101562741B (en) 2011-08-24

Family

ID=41221330

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910138431 Expired - Fee Related CN101562741B (en) 2009-05-11 2009-05-11 Multi-layer coding rate control method and device

Country Status (2)

Country Link
CN (1) CN101562741B (en)
WO (1) WO2010130190A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101562741B (en) * 2009-05-11 2011-08-24 华为技术有限公司 Multi-layer coding rate control method and device
CN102763408B (en) * 2010-02-11 2020-01-17 上海诺基亚贝尔股份有限公司 SVC-based E-MBMS streaming transmission method and equipment
CN103200399B (en) * 2012-01-04 2016-08-31 北京大学 The method and device of control video quality fluctuation based on scalable video
CN102595142B (en) * 2012-03-15 2014-03-26 国网北京经济技术研究院 Method and system for power grid holographic digital map video encoding
CN103079065B (en) * 2012-12-27 2016-08-03 华为技术有限公司 A kind of video data handling procedure and device
CN104079933B (en) * 2014-07-09 2018-07-27 上海君观信息技术有限公司 Low delay bit rate control method and bits allocation method suitable for HEVC
CN104581172A (en) * 2014-12-08 2015-04-29 北京中星微电子有限公司 Hardware structure for realizing SVC macroblock-level algorithm
CN104796703B (en) * 2015-04-22 2017-11-03 哈尔滨工业大学 The bit rate control method of scalable video based on predictive mode rate smoothing
CN108401159B (en) * 2017-02-07 2022-07-08 腾讯科技（深圳）有限公司 Target code rate control method and electronic equipment
CN110636303B (en) * 2019-09-19 2022-12-06 深圳市梦网视讯有限公司 GOP layer rate control adjusting method and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1422075A (en) * 2002-12-26 2003-06-04 上海交通大学 Parallel image sequence bit rate controlling method for digital TV video coder
CN1738424A (en) * 2005-05-27 2006-02-22 上海大学 Code rate control method for subtle granule telescopic code based on H.264
CN1902939A (en) * 2004-01-05 2007-01-24 汤姆森许可贸易公司 Encoding method, decoding method, and encoding apparatus for a digital picture sequence
CN1988659A (en) * 2006-12-30 2007-06-27 清华大学 Method for control video frequency coding rate

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050169369A1 (en) * 2004-02-03 2005-08-04 Sony Corporation Scalable MPEG video/macro block rate control
KR100627500B1 (en) * 2004-03-10 2006-09-21 엘지전자 주식회사 Mobilephone sms service system and the method
WO2007058515A1 (en) * 2005-11-21 2007-05-24 Electronics And Telecommunications Research Institute Method and apparatus for controlling bitrate of scalable video stream
CN101562741B (en) * 2009-05-11 2011-08-24 华为技术有限公司 Multi-layer coding rate control method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1422075A (en) * 2002-12-26 2003-06-04 上海交通大学 Parallel image sequence bit rate controlling method for digital TV video coder
CN1902939A (en) * 2004-01-05 2007-01-24 汤姆森许可贸易公司 Encoding method, decoding method, and encoding apparatus for a digital picture sequence
CN1738424A (en) * 2005-05-27 2006-02-22 上海大学 Code rate control method for subtle granule telescopic code based on H.264
CN1988659A (en) * 2006-12-30 2007-06-27 清华大学 Method for control video frequency coding rate

Also Published As

Publication number Publication date
WO2010130190A1 (en) 2010-11-18
CN101562741A (en) 2009-10-21

Similar Documents

Publication Publication Date Title
CN101562741B (en) Multi-layer coding rate control method and device
CN101141636B (en) Data rate control method and video signal encoder
CN102067610B (en) Rate control model adaptation based on slice dependencies for video coding
US7391809B2 (en) Scalable video transcoding
US8175149B2 (en) Method and apparatus for controlling bitrate of scalable video stream
CN103826124B (en) Managing encoder parameters for parallel transcoding
CN101917614B (en) Bit rate control method based on H.264 hierarchical B-frame coding structure
CN101317463B (en) Method and device for implementing quantization in encoding and decoding course
US20160191927A1 (en) Scalable video encoder/decoder with drift control
CN101518088B (en) Method for rho-domain frame level bit allocation for effective rate control and enhanced video encoding quality
US20070274388A1 (en) Method and apparatus for encoding/decoding FGS layers using weighting factor
CN101855910A (en) Video compression and tranmission techniques
CN102932641B (en) A kind of constant-quality bit rate control method
US20110292995A1 (en) Moving image encoding apparatus, moving image encoding method, and moving image encoding computer program
CN102461169A (en) Motion based dynamic resolution multiple bit rate video encoding
CN102186084B (en) Spatial enhancement layer code rate control realization method for scalable video coding
CN101287112B (en) Optimizing method controlled by adaptive code rate
JP2000516050A (en) Apparatus and method for optimizing rate control in a coding system
CN105472394A (en) Method and apparatus for encoding video using variable partitions for predictive encoding, and method and apparatus for decoding video using variable partitions for predictive encoding
CN102217315A (en) I-frame de-flickering for gop-parallel multi-thread video encoding
CN101548549A (en) Image encoding and decoding
US7480332B2 (en) Bit rate control method and apparatus for MPEG-4 video coding
CN101888561B (en) Multi-view video transmission error control method for rate distortion optimization dynamic regulation
CN101771875A (en) Encoding device, method for adjusting target amount of code and record medium
CN101883283A (en) Control method for code rate of three-dimensional video based on SAQD domain

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110824

Termination date: 20140511