CN102427530A - Intra prediction method - Google Patents

Intra prediction method Download PDF

Info

Publication number
CN102427530A
CN102427530A CN2011103062650A CN201110306265A CN102427530A CN 102427530 A CN102427530 A CN 102427530A CN 2011103062650 A CN2011103062650 A CN 2011103062650A CN 201110306265 A CN201110306265 A CN 201110306265A CN 102427530 A CN102427530 A CN 102427530A
Authority
CN
China
Prior art keywords
intra
matrix
predictive mode
mode
intra prediction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011103062650A
Other languages
Chinese (zh)
Other versions
CN102427530B (en
Inventor
施云惠
尹宝才
王瑾
丁文鹏
李敬华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Technology
Original Assignee
Beijing University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Technology filed Critical Beijing University of Technology
Priority to CN 201110306265 priority Critical patent/CN102427530B/en
Publication of CN102427530A publication Critical patent/CN102427530A/en
Application granted granted Critical
Publication of CN102427530B publication Critical patent/CN102427530B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses an intra prediction method, which comprises the following steps of: (1) defining N templates in different directions corresponding to N novel intra prediction modes, wherein N is an arbitrary value between 1 and 9, and searching m image blocks which are most similar to the current image blocks to be predicted in a coded image region in a template matching mode; (2) rearranging the most similar m image blocks which are searched in each template to construct a low-rank observation matrix; (3) performing low-rank matrix filling on observation matrixes obtained in N different prediction modes, and reconstructing unknown element values in the observation matrixes to obtain predicted values of the N current image blocks; (4) performing intra prediction on the current image blocks to be predicted by a standard intra prediction method in H.264; and (5) selecting an optimized predicted value from the predicted values obtained in the steps (3) and (4) through rate-distortion optimization, namely selecting an optimized predicted value from (N+1) predicted values. By the method, spatial correlation in an image can be more effectively utilized.

Description

Intra-frame prediction method
Technical field
The invention belongs to field of video encoding, relate to a kind of intra-frame prediction method.
Background technology
As the video coding international standard of latest generation, H.264/AVC introduced such as effective means such as multi-direction infra-frame predictions.Play an important role on the spatial redundancy in the intracoded frame of multi-direction infra-frame prediction in reducing image or video sequence.H.264/AVC 4 * 4 luminance block and 8 * 8 luminance block are adopted 9 kinds of intra prediction modes, and 16 * 16 luminance block and 8 * 8 chrominance block are adopted 4 kinds of intra prediction modes.The corresponding specific direction of each predictive mode, the adjacent image piece prediction that the predicted picture piece has been encoded according to them draws.The predictive mode of 8 kinds of band directions is arranged in 9 kinds of intra prediction modes for 4 * 4 image blocks, as shown in Figure 1.The predictive mode 2 that does not have expression among Fig. 1 is not promptly with the DC predictive mode of direction.The predicted value of whole 4 * 4 image blocks is the mean value of its adjacent pixel values in the DC predictive mode, and the DC predictive mode is more effective to the smoothed image piece.The infra-frame prediction of band direction obtains predicted value through the adjacent pixel values that will encode along the specific direction extrapolation, and this is more effective to the image block that the simple edges profile is arranged.Yet this infra-frame prediction mode based on extrapolation is not utilized the global space correlation in the frame, and from the boundary pixel common forecasting inaccuracy of pixel far away of having encoded.
Many correlative studys have launched to improve infra-frame prediction efficient." Intra Prediction by Template Matching ", Thiow Keng Tan, Choong Seng Boon and Yoshinori Suzuki; 2006 IEEE International Conference on Image Processing; Having proposed a kind of intra-frame prediction method based on template matches among the pp.1693-1696, is that template is being searched for the predicted value that the encoded image piece the most similar with it obtains current image block in the coding region through the adjacent encoded pixels with current image block." Intra Prediction by Averaged Template Matching Predictors ", Thiow Keng Tan, Choong Seng Boon and Yoshinori Suzuki; 2007 IEEE Consumer Communications and Networking Conference do further improvement through the mode that will be averaged by the predicted value that multi-direction and template different size obtain among the pp.405-409 on this basis.At " Improved is Intra Coding Based on Bi-directional Intra Prediction H.264; Directional Transform; and Adaptive Coefficient Scanning "; Yan Ye and M.Karczewicz, 2008 IEEE International Conference on Image Processing have improved the effect of infra-frame prediction through extra bidirectional frame inner estimation mode with to the direction transformation of some predictive mode among the pp.2116-2119." Sparse Approximation with Adaptive Dictionary for Image Prediction "; M.Turkan and C.Guillemot; 2009 IEEE International Conference on Image Processing; Pp.25-28 has proposed a kind ofly to utilize the method for one group of redundant dictionary to solve the infra-frame prediction problem based on rarefaction representation, and this provides a kind of new thinking for the coding of rest image.
Matrix filling problem is used for recovering unknown element from the sample of a small amount of known elements of an imperfect matrix.This is an ill-conditioning problem, and is not unique because known sample far fewer than matrix element, is separated.Yet if matrix to be recovered is low-rank or approximate low-rank, matrix can be through separating the difficult order minimum optimization problem accurate reconstruction of following NP:
min?rank(A),s.t.A ij=M ij,(i,j)∈Ω
Wherein A is a matrix to be rebuild, and M is observing matrix and M ∈ R N * n, Ω is the subclass that comprises the index of m known observation element.Above-mentioned order minimum optimization problem can use following optimization problem to replace:
min||A|| *,s.t.A ij=M ij,(i,j)∈Ω
Wherein || A|| *Be the nuclear norm of matrix A, the singular value sum of representing matrix.It is because nuclear norm is a convex function that nuclear norm is used for the alternative of rank of matrix, can effectively find the solution through the mode of positive semidefinite planning.The optimization problem that Candes etc. are verified rank of matrix is minimum and the protruding optimization problem of nuclear norm minimum have identical unique solution.Recently make it obtain application in the progress that solves on the low-rank matrix filling problem such as numerous areas such as commending system, recognition of face and video denoisings.Meanwhile, the many efficient algorithms of separating order minimum optimization problem such as SVT and FPCA have also proposed.
Intra-frame prediction method in the conventional images video coding can only utilize the local space correlation, can not effectively utilize the overall correlation in the image/video frame, therefore can not fully remove spatial redundancy.In addition, existing intra-frame prediction method is to leaving the boundary pixel common forecasting inaccuracy of pixel value far away of having encoded.
Summary of the invention
Technology of the present invention is dealt with problems and is: overcome the deficiency that existing infra-prediction techniques exists, a kind of intra-frame prediction method of filling based on the low-rank matrix is provided.
Of the present invention opening one's minds is: fill with the low-rank matrix and accomplish infra-frame prediction, be about to predict in the infra-frame prediction that the unknown pixel value solves as the problem of rebuilding unknown matrix element in the filling of low-rank matrix.Because image block has overall similitude in image or the frame of video, in coding region the search image block similar with current image block to be predicted and it is arranged again after obtain a low-rank or be similar to the observing matrix of low-rank.Utilize low-rank matrix filling theory to rebuild element value unknown in the observing matrix, promptly obtain predicted value current image block.For compatible with existing coding standard when increasing new intra prediction mode, and then designed a kind of new intra prediction mode coding method, thereby reduced code check with the required bit of minimizing coded prediction mode number.
Technical solution of the present invention is: intra-frame prediction method may further comprise the steps:
(1) template of N different directions of definition, corresponding N new intra prediction mode, N is any natural number between 1~9; Adopt the mode of template matches in image coding region, to search for m the image block the most similar with current image block to be predicted, m is the natural number less than 20;
(2) m the most similar image block that each template is searched arranged again, the observing matrix of a low-rank of structure;
(3) observing matrix that N different predictive modes is obtained carries out the low-rank matrix respectively fills, and rebuilds the unknown element value in the observing matrix, obtains N current image block predicted value;
(4) the standard intra-frame prediction method carries out infra-frame prediction to current image block to be predicted in using H.264;
(5) the predicted value that predicted value that obtains from step (3) and step (4) obtain, adopt rate-distortion optimization to select an optimum prediction value; Promptly from N+1 predicted value, select an optimum prediction value.
Further, step (1) is specially:
Represent current image block with B, use B sExpression comprises the big image block of B and adjacent boundary pixel thereof, B sSize be n * n, B sIn have only border pixel values known, the unknown pixel value is a value to be predicted; Search obtains m image block the most similar with B as template in image coding region, to utilize the boundary pixel of having encoded, and these similar image pieces are used B iExpression, i=1 ..., m, B sWith B iSize is identical.
Further, step (2) is specially:
M image block launches by row or by row, with each image block B iA n is classified in rearrangement as 2* 1 vector form, it is expressed as
Figure BDA0000097767370000041
N then 2* (m+1) matrix M is expressed as:
M=(V s,V 1,V 2,...,V m)
V wherein sExpression is from image block B sThe vector that obtains.
Further, step (3) is rebuild the unknown element value among the observing matrix M through the nuclear norm minimum optimization problem of finding the solution following belt restraining:
min||A|| *,s.t.A+E=M,P Ω(E)=0 (1)
Wherein A representes matrix to be rebuild, || A|| *Be the nuclear norm of matrix A, the singular value sum of representing matrix, E representes the compensation to unknown element among the M, Ω has comprised the index of all known elements in the matrix M, P ΩBe illustrated in the rectangular projection operator in the matrix scope; If (i, j) ∈ Ω, then P Ω(X) (i, j) element of position equals X in Ij, otherwise be zero.
Further, adopt non-accurate augmentation Lagrange multiplier algorithm to find the solution the objective function optimization problem of formula (1), the part Augmented Lagrangian Functions that obtains formula (1) is:
L ( A , E , Y , u ) = | | A | | * + < Y , M - A - E > + &mu; 2 | | M - A - E | | F 2
Wherein Y is a penalty factor, and μ is an arithmetic number, || X|| FBe the F norm of matrix X,
Figure BDA0000097767370000043
X *The adjoint matrix of representing matrix X; Classify the reconstructed value of unknown element among the A as image block according to the corresponded manner rearrangement, promptly obtain predicted value current image block.
Further, described intra-frame prediction method is further comprising the steps of:
In being incorporated into infra-frame prediction H.264/AVC in 9 kinds of intra prediction modes of 4 * 4 image blocks; The N that step (3) is obtained new predictive mode is as the subpattern of former DC predictive mode; That is: remained unchanged with 8 intra prediction modes of direction originally and former DC pattern is replaced by a new mixed mode, wherein new mixed mode comprises N predictive mode and the original DC predictive mode that increases newly; Perhaps
In being incorporated into infra-frame prediction H.264/AVC in 9 kinds of intra prediction modes of 8 * 8 image blocks; The N that step (3) is obtained new predictive mode is as the subpattern of former DC predictive mode; That is: original 8 intra prediction modes except that the DC predictive mode remain unchanged and former DC pattern by a new mixed mode replacement, wherein new mixed mode comprises N predictive mode and the original DC predictive mode that increases newly; Perhaps
In being incorporated into infra-frame prediction H.264/AVC in 4 kinds of intra prediction modes of 16 * 16 image blocks; The N that step (3) is obtained new predictive mode is as the subpattern of former DC predictive mode; That is: original 3 intra prediction modes except that the DC predictive mode remain unchanged and former DC pattern by a new mixed mode replacement, wherein new mixed mode comprises N predictive mode and the original DC predictive mode that increases newly.
Preferably, N is 7 in the step (1).
The bit number that original 8 intra prediction modes except that the DC predictive mode are encoded is 3; And be 6 to the bit number that new mixed mode is encoded; Wherein preceding 3 bits are represented the DC predictive mode in 9 kinds of intra prediction modes of 4 * 4 image blocks, and back 3 bits are represented 8 sub-modes; Perhaps
The bit number that original 8 intra prediction modes except that the DC predictive mode are encoded is 3; And be 6 to the bit number that new mixed mode is encoded; Wherein preceding 3 bits are represented the DC predictive mode in 9 kinds of intra prediction modes of 8 * 8 image blocks, and back 3 bits are represented 8 sub-modes; Perhaps
The bit number that original 3 intra prediction modes except that the DC predictive mode are encoded is 2; And be 5 to the bit number that new mixed mode is encoded; Wherein preceding 2 bits are represented the DC predictive mode in 4 kinds of intra prediction modes of 16 * 16 image blocks, and back 3 bits are represented 8 sub-modes.
The present invention compared with prior art has following advantage: the mode that the present invention proposes to utilize the low-rank matrix to fill is done infra-frame prediction.If image block is through certain permutatation and reorganization, they can be expressed as the matrix of a low-rank or approximate low-rank.Unknown predicted value can be regarded as the element lost in the low-rank matrix.According to low-rank matrix filling theory, predicted value can be through mode accurate reconstruction from limited sample of separating order minimum optimization problem." Exact Matrix Completion via Convex Optimization; " E.J.Candes and B.Recht; The 46th Annual Allerton Conference on Communication; Control and Computing, low-rank characteristic that pp.806-812 is verified has guaranteed and can obtain accurate reconstruction with high probability.Compare with the H.264/AVC middle infra-frame prediction of extrapolating of standard, the infra-frame prediction mode based on the filling of low-rank matrix that the present invention proposes can more effectively be utilized the spatial coherence in the image.In the image current block and the strong spatial coherence of coding region can provide more fully than the boundary pixel of corresponding specific direction that information is used for infra-frame prediction.
Description of drawings
Below will combine the accompanying drawing specific embodiments of the invention to describe.
Fig. 1 is that 4 * 4 image blocks are adjacent encoded pixels and 8 intra prediction modes of being with directions.
Fig. 2 is according to intra-frame prediction method general frame figure of the present invention.
Fig. 3 is the template of 7 different directions.
Fig. 4 is the observing matrix of structure.
Fig. 5 is the distribution of optimum prediction subpattern in Foreman (QCIF) the sequence mixed mode.
Fig. 6 is the distribution of optimum prediction subpattern in Bus (QCIF) the sequence mixed mode.
Fig. 7 is the R-D curve of Foreman (CIF) video sequence.
Fig. 8 is the R-D curve of Akiyo (CIF) video sequence.
Embodiment
The general frame that proposes a plan is as shown in Figure 2.Behind the search image block similar with current image block to be predicted, it is an observing matrix that these image blocks can reorganize in coding region.Most elements in the observing matrix is come own coding region, and the pixel in the corresponding current image block of unknown element wherein.The mode that unknown pixel is filled through the low-rank matrix is rebuild to lay equal stress on and is arranged as the form of image block, thereby has formed the prediction to current image block.The predicted value that is finally obtained by aforesaid way is selected optimum prediction value based on the predicted value that the infra-frame prediction of extrapolating obtains with rate-distortion optimization (RDO) with tradition.
Intra-frame prediction method provided by the invention may further comprise the steps:
(1) template of N different directions of definition, corresponding N new intra prediction mode, N is preferably 7, and it is 7 that present embodiment is got N, and N also can be any natural number between 1~9; Adopt the mode of template matches in image coding region, to search for m the image block the most similar with current image block to be predicted.
The m value is generally the natural number less than 20, and it is 5 that present embodiment is got m.
Represent current image block with B, use B sExpression comprises the big image block of B and adjacent boundary pixel thereof, B sSize be n * n, B sIn have only border pixel values known, the unknown pixel value is a value to be predicted; Search obtains m image block the most similar with B as template in image coding region, to utilize the boundary pixel of having encoded, and these similar image pieces are used B iExpression, i=1 ..., m, B sWith B iSize is identical.
(2) m the most similar image block that each template is searched arranged again, the observing matrix of a low-rank of structure.
M image block launches by row or by row, with each image block B iA n is classified in rearrangement as 2* 1 vector form, it is expressed as N then 2* (m+1) matrix M is expressed as:
M=(V s,V 1,V 2,...,V m)
V wherein sExpression is from image block B sThe vector that obtains.
(3) observing matrix that 7 different predictive modes is obtained carries out the low-rank matrix respectively fills, and rebuilds the unknown element value in the observing matrix, obtains 7 current image block predicted values.
Nuclear norm minimum optimization problem through finding the solution following belt restraining is rebuild the unknown element value among the observing matrix M:
min||A|| *,s.t.A+E=M,P Ω(E)=0 (1)
Wherein A representes matrix to be rebuild, || A|| *Be the nuclear norm of matrix A, the singular value sum of representing matrix, E representes the compensation to unknown element among the M, Ω has comprised the index of all known elements in the matrix M, P ΩBe illustrated in the rectangular projection operator in the matrix scope; If (i, j) ∈ Ω, then P Ω(X) (i, j) element of position equals X in Ij, otherwise be zero.
Adopt non-accurate augmentation Lagrange multiplier algorithm to find the solution the objective function optimization problem of formula (1), the part Augmented Lagrangian Functions that obtains formula (1) is:
L ( A , E , Y , u ) = | | A | | * + < Y , M - A - E > + &mu; 2 | | M - A - E | | F 2
Wherein Y is a penalty factor, and μ is an arithmetic number, || X|| FBe the F norm of matrix X,
Figure BDA0000097767370000073
X *The adjoint matrix of representing matrix X; Classify the reconstructed value of unknown element among the A as image block according to the corresponded manner rearrangement, promptly obtain predicted value current image block.
(4) the standard intra-frame prediction method carries out infra-frame prediction to current image block to be predicted in using H.264.
This step is traditional predicted value that obtains based on the infra-frame prediction of direction prediction.
(5) the predicted value that predicted value that obtains from step (3) and step (4) obtain, adopt rate-distortion optimization to select an optimum prediction value; Promptly from 7+1 predicted value, select an optimum prediction value.
The present invention further verifies the performance of the intra-frame prediction method that proposes.To be incorporated among the reference software JM 11.0 H.264/AVC based on the intra-frame prediction method that the low-rank matrix is filled.Coding parameter is provided with as follows:
● class: main class
● test video sequence form: QCIF and CIF
● video sequence coding mode: full I frame
● entropy coding algorithm: CABAC
● rate-distortion optimization: open
● quantization parameter value: 2227323742
In being incorporated into infra-frame prediction H.264/AVC in 9 kinds of intra prediction modes of 4 * 4 image blocks; 7 new predictive modes that step (3) is obtained are as the subpattern of former DC predictive mode; That is: remained unchanged with 8 intra prediction modes of direction originally and former DC pattern is replaced by a new mixed mode, wherein new mixed mode comprises 7 predictive modes and the original DC predictive mode that increases newly.
The bit number that original 8 intra prediction modes except that the DC predictive mode are encoded is 3; And be 6 to the bit number that new mixed mode is encoded; Wherein preceding 3 bits are represented the DC predictive mode in 9 kinds of intra prediction modes of 4 * 4 image blocks, and back 3 bits are represented 8 sub-modes.
In the infra-frame prediction of 4 * 4 of brightness, implement, test the validity of various video sequence with verification algorithm.The distribution of optimum subpattern such as Fig. 5 and shown in Figure 6 in the mixed mode 2 of some video sequence.It is optimization model that mixed mode is on average had the subpattern of the infra-frame prediction that 50% image block can finally select to fill based on the low-rank matrix.This has proved the validity of the intra-frame prediction method of filling based on the low-rank matrix that proposes.
H.264/AVC, the decoded frame that the present invention obtains obtains better visual quality than standard, especially under low code check.The present invention and standard H.264/AVC for the contrast of the reconstructed image objective quality of QCIF and CIF video sequence respectively shown in Table I and Table II, the code check that wherein reduces is that calculating comes according to BD-Rate.Can find out with standard therefrom and H.264/AVC compare that algorithm of the present invention is on average having 4.21% code check saving to the QCIF video sequence under the reconstruction quality on an equal basis, the CIF video sequence is on average had 5.39% code check saving.Scheme to Foreman (CIF) and the proposition of Akiyo (CIF) video sequence can obtain respectively to save up to 15.85% and 6.16% code check.Corresponding R-D curve such as Fig. 7 and shown in Figure 8.
Table I the present invention and JM11.0 compare the code check of QCIF video test sequence
Figure BDA0000097767370000091
Table II the present invention and JM11.0 compare the code check of CIF video test sequence
Figure BDA0000097767370000092
In addition; In being incorporated into infra-frame prediction H.264/AVC in 9 kinds of intra prediction modes of 8 * 8 image blocks; 7 new predictive modes that step (3) is obtained are as the subpattern of former DC predictive mode; That is: original 8 intra prediction modes except that the DC predictive mode remain unchanged and former DC pattern by a new mixed mode replacement, wherein new mixed mode comprises 7 predictive modes and the original DC predictive mode that increases newly.
The bit number that original 8 intra prediction modes except that the DC predictive mode are encoded is 3; And be 6 to the bit number that new mixed mode is encoded; Wherein preceding 3 bits are represented the DC predictive mode in 9 kinds of intra prediction modes of 8 * 8 image blocks, and back 3 bits are represented 8 sub-modes.
Have again; In being incorporated into infra-frame prediction H.264/AVC in 4 kinds of intra prediction modes of 16 * 16 image blocks; 7 new predictive modes that step (3) is obtained are as the subpattern of former DC predictive mode; That is: original 3 intra prediction modes except that the DC predictive mode remain unchanged and former DC pattern by a new mixed mode replacement, wherein new mixed mode comprises 7 predictive modes and the original DC predictive mode that increases newly.
The bit number that original 3 intra prediction modes except that the DC predictive mode are encoded is 2; And be 5 to the bit number that new mixed mode is encoded; Wherein preceding 2 bits are represented the DC predictive mode in 4 kinds of intra prediction modes of 16 * 16 image blocks, and back 3 bits are represented 8 sub-modes.
The present invention is not limited to the content that claim and the foregoing description are addressed, so long as any invention of creating out according to design of the present invention all should belong within protection scope of the present invention.

Claims (9)

1. intra-frame prediction method is characterized in that, may further comprise the steps:
(1) template of N different directions of definition, corresponding N new intra prediction mode, N is any natural number between 1~9; Adopt the mode of template matches in image coding region, to search for m the image block the most similar with current image block to be predicted, m is the natural number less than 20;
(2) m the most similar image block that each template is searched arranged again, the observing matrix of a low-rank of structure;
(3) observing matrix that N different predictive modes is obtained carries out the low-rank matrix respectively fills, and rebuilds the unknown element value in the observing matrix, obtains N current image block predicted value;
(4) the standard intra-frame prediction method carries out infra-frame prediction to current image block to be predicted in using H.264;
(5) the predicted value that predicted value that obtains from step (3) and step (4) obtain, adopt rate-distortion optimization to select an optimum prediction value; Promptly from N+1 predicted value, select an optimum prediction value.
2. intra-frame prediction method according to claim 1 is characterized in that, step (1) is specially:
Represent current image block with B, use B sExpression comprises the big image block of B and adjacent boundary pixel thereof, B sSize be n * n, B sIn have only border pixel values known, the unknown pixel value is a value to be predicted; Search obtains m image block the most similar with B as template in image coding region, to utilize the boundary pixel of having encoded, and these similar image pieces are used B iExpression, i=1 ..., m, B sWith B iSize is identical.
3. intra-frame prediction method according to claim 2 is characterized in that, step (2) is specially:
M image block launches by row or by row, with each image block B iA n is classified in rearrangement as 2* 1 vector form, it is expressed as N then 2* (m+1) matrix M is expressed as:
M=(V s,V 1,V 2,...,V m)
V wherein sExpression is from image block B sThe vector that obtains.
4. intra-frame prediction method according to claim 3 is characterized in that, step (3) is rebuild the unknown element value among the observing matrix M through the nuclear norm minimum optimization problem of finding the solution following belt restraining:
min||A|| *,s.t.A+E=M,P Ω(E)=0 (1)
Wherein A representes matrix to be rebuild, || A|| *Be the nuclear norm of matrix A, the singular value sum of representing matrix, E representes the compensation to unknown element among the M, Ω has comprised the index of all known elements in the matrix M, P ΩBe illustrated in the rectangular projection operator in the matrix scope; If (i, j) ∈ Ω, then P Ω(X) (i, j) element of position equals X in Ij, otherwise be zero.
5. intra-frame prediction method according to claim 4 is characterized in that, adopts non-accurate augmentation Lagrange multiplier algorithm to find the solution the objective function optimization problem of formula (1), and the part Augmented Lagrangian Functions that obtains formula (1) is:
L ( A , E , Y , u ) = | | A | | * + < Y , M - A - E > + &mu; 2 | | M - A - E | | F 2
Wherein Y is a penalty factor, and μ is an arithmetic number, || X|| FBe the F norm of matrix X,
Figure FDA0000097767360000022
X *The adjoint matrix of representing matrix X; Classify the reconstructed value of unknown element among the A as image block according to the corresponded manner rearrangement, promptly obtain predicted value current image block.
6. intra-frame prediction method according to claim 1 is characterized in that, and is further comprising the steps of:
In being incorporated into infra-frame prediction H.264/AVC in 9 kinds of intra prediction modes of 4 * 4 image blocks; The N that step (3) is obtained new predictive mode is as the subpattern of former DC predictive mode; That is: remained unchanged with 8 intra prediction modes of direction originally and former DC pattern is replaced by a new mixed mode, wherein new mixed mode comprises N predictive mode and the original DC predictive mode that increases newly; Perhaps
In being incorporated into infra-frame prediction H.264/AVC in 9 kinds of intra prediction modes of 8 * 8 image blocks; The N that step (3) is obtained new predictive mode is as the subpattern of former DC predictive mode; That is: original 8 intra prediction modes except that the DC predictive mode remain unchanged and former DC pattern by a new mixed mode replacement, wherein new mixed mode comprises N predictive mode and the original DC predictive mode that increases newly; Perhaps
In being incorporated into infra-frame prediction H.264/AVC in 4 kinds of intra prediction modes of 16 * 16 image blocks; The N that step (3) is obtained new predictive mode is as the subpattern of former DC predictive mode; That is: original 3 intra prediction modes except that the DC predictive mode remain unchanged and former DC pattern by a new mixed mode replacement, wherein new mixed mode comprises N predictive mode and the original DC predictive mode that increases newly.
7. intra-frame prediction method according to claim 6 is characterized in that, N is 7 in the step (1).
8. intra-frame prediction method according to claim 7; It is characterized in that; The bit number that original 8 intra prediction modes except that the DC predictive mode are encoded is 3; And be 6 to the bit number that new mixed mode is encoded, wherein preceding 3 bits are represented the DC predictive mode in 9 kinds of intra prediction modes of 4 * 4 image blocks, back 3 bits are represented 8 sub-modes; Perhaps
The bit number that original 8 intra prediction modes except that the DC predictive mode are encoded is 3; And be 6 to the bit number that new mixed mode is encoded; Wherein preceding 3 bits are represented the DC predictive mode in 9 kinds of intra prediction modes of 8 * 8 image blocks, and back 3 bits are represented 8 sub-modes; Perhaps
The bit number that original 3 intra prediction modes except that the DC predictive mode are encoded is 2; And be 5 to the bit number that new mixed mode is encoded; Wherein preceding 2 bits are represented the DC predictive mode in 4 kinds of intra prediction modes of 16 * 16 image blocks, and back 3 bits are represented 8 sub-modes.
9. intra-frame prediction method according to claim 1 is characterized in that, m is any natural number between 5~10 in the step (1).
CN 201110306265 2011-10-11 2011-10-11 Intra prediction method Active CN102427530B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110306265 CN102427530B (en) 2011-10-11 2011-10-11 Intra prediction method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110306265 CN102427530B (en) 2011-10-11 2011-10-11 Intra prediction method

Publications (2)

Publication Number Publication Date
CN102427530A true CN102427530A (en) 2012-04-25
CN102427530B CN102427530B (en) 2013-10-23

Family

ID=45961468

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110306265 Active CN102427530B (en) 2011-10-11 2011-10-11 Intra prediction method

Country Status (1)

Country Link
CN (1) CN102427530B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103903291A (en) * 2012-12-24 2014-07-02 阿里巴巴集团控股有限公司 Method and device for automatically modifying image
WO2015180658A1 (en) * 2014-05-28 2015-12-03 华为技术有限公司 Template matching-based intra-prediction coding and decoding and array scanning method and device
CN107155108A (en) * 2017-06-19 2017-09-12 电子科技大学 A kind of intra-frame prediction method changed based on brightness
TWI650009B (en) * 2016-06-24 2019-02-01 聯發科技股份有限公司 Methods and apparatuses of decoder side intra mode derivation
CN111201795A (en) * 2017-10-09 2020-05-26 华为技术有限公司 Memory access window and padding for motion vector modification
CN111654703A (en) * 2015-05-04 2020-09-11 谷歌有限责任公司 Encoding for prefetching of application streams
WO2020221372A1 (en) * 2019-05-01 2020-11-05 Beijing Bytedance Network Technology Co., Ltd. Context coding for matrix-based intra prediction
WO2020253528A1 (en) * 2019-06-17 2020-12-24 Zhejiang Dahua Technology Co., Ltd. Systems and methods for predicting a coding block
US11425389B2 (en) 2019-04-12 2022-08-23 Beijing Bytedance Network Technology Co., Ltd. Most probable mode list construction for matrix-based intra prediction
US11451784B2 (en) 2019-05-31 2022-09-20 Beijing Bytedance Network Technology Co., Ltd. Restricted upsampling process in matrix-based intra prediction
US11457207B2 (en) 2019-04-16 2022-09-27 Beijing Bytedance Network Technology Co., Ltd. Matrix derivation in intra coding mode
US11463729B2 (en) 2019-05-01 2022-10-04 Beijing Bytedance Network Technology Co., Ltd. Matrix-based intra prediction using filtering
US11606570B2 (en) 2019-10-28 2023-03-14 Beijing Bytedance Network Technology Co., Ltd. Syntax signaling and parsing based on colour component
US11659185B2 (en) 2019-05-22 2023-05-23 Beijing Bytedance Network Technology Co., Ltd. Matrix-based intra prediction using upsampling
US11805275B2 (en) 2019-06-05 2023-10-31 Beijing Bytedance Network Technology Co., Ltd Context determination for matrix-based intra prediction

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1615020A (en) * 2004-11-10 2005-05-11 华中科技大学 Method for pridicting sortable complex in frame
CN1662066A (en) * 2004-02-26 2005-08-31 中国科学院计算技术研究所 Method for selecting predicting mode within frame
CN101222635A (en) * 2008-01-24 2008-07-16 北京工业大学 Infra-frame prediction method
EP2046053A1 (en) * 2007-10-05 2009-04-08 Thomson Licensing Method and device for adaptively quantizing parameters for image coding

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1662066A (en) * 2004-02-26 2005-08-31 中国科学院计算技术研究所 Method for selecting predicting mode within frame
CN1615020A (en) * 2004-11-10 2005-05-11 华中科技大学 Method for pridicting sortable complex in frame
EP2046053A1 (en) * 2007-10-05 2009-04-08 Thomson Licensing Method and device for adaptively quantizing parameters for image coding
CN101222635A (en) * 2008-01-24 2008-07-16 北京工业大学 Infra-frame prediction method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
尹宝才等: "《快速帧内预测方法》", 《北京工业大学学报》, vol. 35, no. 10, 31 October 2009 (2009-10-31), pages 1423 - 1427 *

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103903291A (en) * 2012-12-24 2014-07-02 阿里巴巴集团控股有限公司 Method and device for automatically modifying image
WO2015180658A1 (en) * 2014-05-28 2015-12-03 华为技术有限公司 Template matching-based intra-prediction coding and decoding and array scanning method and device
US10219003B2 (en) 2014-05-28 2019-02-26 Huawei Technologies Co., Ltd. Intra-frame predictive coding and decoding methods based on template matching, array scanning method and apparatus, and apparatus
CN111654703A (en) * 2015-05-04 2020-09-11 谷歌有限责任公司 Encoding for prefetching of application streams
CN111654703B (en) * 2015-05-04 2024-03-15 谷歌有限责任公司 Encoding for prefetching of application streams
TWI650009B (en) * 2016-06-24 2019-02-01 聯發科技股份有限公司 Methods and apparatuses of decoder side intra mode derivation
CN107155108A (en) * 2017-06-19 2017-09-12 电子科技大学 A kind of intra-frame prediction method changed based on brightness
CN107155108B (en) * 2017-06-19 2019-07-12 电子科技大学 A kind of intra-frame prediction method based on brightness change
CN111201795B (en) * 2017-10-09 2022-07-26 华为技术有限公司 Memory access window and padding for motion vector modification
CN111201795A (en) * 2017-10-09 2020-05-26 华为技术有限公司 Memory access window and padding for motion vector modification
US11451782B2 (en) 2019-04-12 2022-09-20 Beijing Bytedance Network Technology Co., Ltd. Calculation in matrix-based intra prediction
US11463702B2 (en) 2019-04-12 2022-10-04 Beijing Bytedance Network Technology Co., Ltd. Chroma coding mode determination based on matrix-based intra prediction
US11831877B2 (en) 2019-04-12 2023-11-28 Beijing Bytedance Network Technology Co., Ltd Calculation in matrix-based intra prediction
US11425389B2 (en) 2019-04-12 2022-08-23 Beijing Bytedance Network Technology Co., Ltd. Most probable mode list construction for matrix-based intra prediction
US11457220B2 (en) 2019-04-12 2022-09-27 Beijing Bytedance Network Technology Co., Ltd. Interaction between matrix-based intra prediction and other coding tools
US11457207B2 (en) 2019-04-16 2022-09-27 Beijing Bytedance Network Technology Co., Ltd. Matrix derivation in intra coding mode
US11463729B2 (en) 2019-05-01 2022-10-04 Beijing Bytedance Network Technology Co., Ltd. Matrix-based intra prediction using filtering
US11546633B2 (en) 2019-05-01 2023-01-03 Beijing Bytedance Network Technology Co., Ltd. Context coding for matrix-based intra prediction
WO2020221372A1 (en) * 2019-05-01 2020-11-05 Beijing Bytedance Network Technology Co., Ltd. Context coding for matrix-based intra prediction
US11659185B2 (en) 2019-05-22 2023-05-23 Beijing Bytedance Network Technology Co., Ltd. Matrix-based intra prediction using upsampling
US11451784B2 (en) 2019-05-31 2022-09-20 Beijing Bytedance Network Technology Co., Ltd. Restricted upsampling process in matrix-based intra prediction
US11943444B2 (en) 2019-05-31 2024-03-26 Beijing Bytedance Network Technology Co., Ltd. Restricted upsampling process in matrix-based intra prediction
US11805275B2 (en) 2019-06-05 2023-10-31 Beijing Bytedance Network Technology Co., Ltd Context determination for matrix-based intra prediction
WO2020253528A1 (en) * 2019-06-17 2020-12-24 Zhejiang Dahua Technology Co., Ltd. Systems and methods for predicting a coding block
US11606570B2 (en) 2019-10-28 2023-03-14 Beijing Bytedance Network Technology Co., Ltd. Syntax signaling and parsing based on colour component

Also Published As

Publication number Publication date
CN102427530B (en) 2013-10-23

Similar Documents

Publication Publication Date Title
CN102427530B (en) Intra prediction method
CN104041035B (en) Lossless coding and coherent signal method for expressing for composite video
US9485515B2 (en) Video coding using reference motion vectors
CN110024393A (en) Low complex degree sign prediction for video coding
CN104918056B (en) The method decoded to intra prediction mode
JP7012809B2 (en) Image coding device, moving image decoding device, moving image coding data and recording medium
CN112913250B (en) Encoder, decoder and corresponding methods using IBC search range optimization for arbitrary CTU sizes
CN107409218A (en) The Fast video coding method split using block
US20120275522A1 (en) Method and apparatus for motion vector encoding/decoding using spatial division, and method and apparatus for image encoding/decoding using same
CN107027025B (en) A kind of light field image compression method based on macro block of pixels adaptive prediction
CN103782598A (en) Fast encoding method for lossless coding
KR20210035347A (en) Effective prediction using partition coding
CN104601998A (en) Apparatus and method for encoding image
JP2021516493A (en) Methods and devices for merging multi-sign bit concealment and residual sign prediction
CN103873861A (en) Coding mode selection method for HEVC (high efficiency video coding)
CN106797468A (en) Improved pallet mode in efficient video coding (HEVC) screen content coding (SCC)
US20150208067A1 (en) A method of video coding by predicting the partitioning of a current block, a decoding method, and corresponding coding and decoding devices and computer programs
CN103338370B (en) A kind of multi-view depth video fast encoding method
CN103327325A (en) Intra-frame prediction mode rapid self-adaptation selection method based on HEVC standard
CN104780379A (en) Compression method for screen image set
JP2010534015A (en) Image processing method and corresponding electronic device
WO2014058796A1 (en) Method and apparatus for video coding using reference motion vectors
CN103596003B (en) Interframe predication quick mode selecting method for high-performance video coding
CN104702959B (en) A kind of intra-frame prediction method and system of Video coding
US11558619B2 (en) Adaptation of scan order for entropy coding

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant