CN101710993A - Block-based self-adaptive super-resolution video processing method and system - Google Patents
Block-based self-adaptive super-resolution video processing method and system Download PDFInfo
- Publication number
- CN101710993A CN101710993A CN 200910241349 CN200910241349A CN101710993A CN 101710993 A CN101710993 A CN 101710993A CN 200910241349 CN200910241349 CN 200910241349 CN 200910241349 A CN200910241349 A CN 200910241349A CN 101710993 A CN101710993 A CN 101710993A
- Authority
- CN
- China
- Prior art keywords
- sampling
- piece
- block
- rate distortion
- pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses block-based self-adaptive super-resolution video processing method and system. The method comprises the following steps of: selecting a block-based down-sampling mode for a video image; carrying out down-sampling on the current video image according to the down-sampling mode and acquiring a down-sampling block; selecting a basis rate anamorphic coding mode by combining a block coding forecasting mode and the down-sampling mode to code the acquired down-sampling block; decoding the coded down-sampling block, acquiring a decoded down-sampling block, carrying out type division on the decoded down-sampling block and carrying out up-sampling on the down-sampling block on the basis of the type of the down-sampling block to acquire an up-sampling reestablishment block. The invention can improve the compression efficiency of a vide code at a middle and low code rate and ensure that the code performance is not lower than the performance of the traditional mixed code at a high code rate at the same time.
Description
Technical field
The present invention relates to data compression and image processing field, relate in particular to a kind of block-based self-adaptive super-resolution video processing method and system.
Background technology
Along with network and development of Communication Technique, vision signal more and more need be passed through Network Transmission.But under the situation of limited bandwidth, network is merely able to transmit the encoded video of low code check.General method only reduces code check by adjusting quantization parameter, and this will inevitably cause the reduction of video encoding quality.Therefore, improve the quality of hanging down encoded video under the code check and receive increasing concern.Developing into of super resolution technology addresses this problem, and a kind of feasible method is provided.Super-resolution technique is meant the nonredundancy information of utilizing multiframe to exist to exist between the low-resolution image of sub-pix displacement, generates a frame or multiframe high-definition picture.Along with the proposition of the super-resolution algorithms of some low complex degrees, super-resolution has also obtained application gradually in video compression.
Existing down-sampling coding techniques will carry out the area characteristic information of down-sampling coding usually encodes as load information, rebuilds to adopt corresponding up-sampling technology at coding side.These load informations are unfavorable for improving code efficiency.
Summary of the invention
The object of the present invention is to provide a kind of block-based self-adaptive super-resolution video processing method and system.Based on the present invention, the compression efficiency of video coding can guarantee that under the high code check, coding efficiency is not less than the performance of traditional hybrid encoding frame simultaneously in can improving, under the low code check.
The self-adaptive super-resolution video processing method that the present invention is based on piece comprises the steps: down-sampling pattern determining step, to video image, selects block-based down-sampling pattern; The down-sampling step according to described down-sampling pattern, is carried out down-sampling to current video image, obtains the down-sampling piece; Coding step, combined block coded prediction pattern and described down-sampling pattern are selected the coding mode according to rate distortion, and the described down-sampling piece that obtains is encoded; Decoding step is decoded to the down-sampling piece of coding, obtains decoded down-sampling piece, and it is carried out type divide, and based on the type of described down-sampling piece, described down-sampling piece is carried out up-sampling, obtains the up-sampling reconstructed block; Wherein, in the described coding step, described selection is specially according to the coding mode of rate distortion: determine the set of first rate distortion and second rate distortion, described first rate distortion is not for carrying out down-sampling, the resulting rate distortion of direct coding down-sampling piece; The set of described second rate distortion comprises that a plurality of second rate distortions, described second rate distortion are the different down-sampling pattern of employing to the encode rate distortion that produces and described down-sampling piece carried out the rate distortion sum that up-sampling produced of described down-sampling piece; The minimum pairing coding mode of rate distortion is selected in relatively first rate distortion and second rate distortion set.
In above-mentioned self-adaptive super-resolution video processing method, in the preferred described down-sampling step, described down-sampling pattern comprises: pattern 0 is to mode 3.Wherein, pattern 0 is the maintainance block original pixels; Pattern 1 is the vertical direction down-sampling, obtains 16 * 8 piece; Pattern 2 is the horizontal direction down-sampling, obtains 8 * 16 piece; Mode 3 is horizontal direction and vertical direction while down-sampling, obtains 8 * 8 piece.
In above-mentioned self-adaptive super-resolution video processing method, in the preferred described decoding step, the described division that down-sampling is certainly carried out type comprises the steps: the 1-norm calculation step of AC coefficient, calculate in the DCT coefficient of j 8 * 8 of down-sampling piece of described decoding and rebuilding the 1-norm S of AC coefficient
jThe smooth block determining step is judged in the DCT coefficient of individual 8 * 8 of j the 1-norm S of AC coefficient
jWhether less than threshold value T
F,If,, then j 8 * 8 is smooth block; Otherwise, be moving mass or non-motion texture block; Wherein, described threshold value T
F,For setting in advance; Moving mass, non-motion texture block determining step, the movement differential between down-sampling piece behind the calculating decoding and rebuilding and the prediction piece judges whether described movement differential is positioned at threshold interval [T
Ml, T
Mu], if described j 8 * 8 is moving mass, if not, described j 8 * 8 is non-motion texture block.
In above-mentioned self-adaptive super-resolution video processing method, in the preferred described decoding step, according to following rule described down-sampling piece is carried out up-sampling, obtain the up-sampling reconstructed block:, utilize spatial domain interpolation algorithm decoding and rebuilding down-sampling piece if j 8 * 8 is smooth block; If j 8 * 8 is non-motion texture block, utilize the edge to keep interpolation algorithm to rebuild the down-sampling piece of decoding; If j 8 * 8 is moving mass, utilize the super-resolution rebuilding algorithm to rebuild the down-sampling piece of decoding; Wherein, described super-resolution rebuilding algorithm is:
The low-resolution image piece that described down-sampling piece is formed projects to the correspondence position of high-definition picture piece, and the pixel of disappearance position utilizes the respective pixel of reference block to rebuild, and reconstruction formula is as follows,
SR(x，y)＝R(x，y)+g(x′，y′)-R(x″，y″)＝R(x，y)+e(x′，y′)
Wherein, (x y) is the coordinate of missing pixel to be rebuild in the described high-definition picture piece, SR (x y) is the value of the missing pixel of rebuilding.; R (x, y) be the pixel value .g that lacks in the corresponding current reconstructed block in the reference image block of deriving by the motion vector of down-sampling piece (x ', y ') is the high-definition picture piece neutralization (x of current down-sampling piece before sampling, y) Dui Ying nearest neighbor pixels value, R (x "; y ") be and g (x ', y ') corresponding reference piece in pixel value.
In above-mentioned self-adaptive super-resolution video processing method, in the preferred described rate distortion calculation procedure, according to described second rate distortion of rate-distortion optimization Model Calculation, described rate-distortion optimization model is:
JD
i＝D
i+λ×R
i+D
u
Wherein, D
iThe distortion of presentation code down-sampling piece, R
iThe bit number that presentation code down-sampling piece is used, D
uDistortion in the expression up-sampling reconstructed block between missing pixel and original pixels.I is the down-sampling coding mode.
On the other hand, the present invention also provides a kind of block-based adaptive super-resolution processing system for video, comprising: down-sampling pattern determination module, down sample module, coding module, decoder module, rate distortion computing module.Wherein, be used for, select block-based down-sampling pattern video image; Be used for current video image being carried out down-sampling, obtain the down-sampling piece according to described down-sampling pattern; Coding module is used for combined block coded prediction pattern and described down-sampling pattern, selects the coding mode according to rate distortion, and the described down-sampling piece that obtains is encoded; Decoder module is used for the down-sampling piece of coding is decoded, and obtains described down-sampling piece, and described down-sampling piece is carried out type divide, and based on the type of described down-sampling piece, described down-sampling piece is carried out decoding and rebuilding; Wherein, in the described coding module, described selection is specially according to the coding mode of rate distortion: determine the set of first rate distortion and second rate distortion, described first rate distortion is not for carrying out down-sampling, the resulting rate distortion of direct coding down-sampling piece; The set of described second rate distortion comprises that a plurality of second rate distortions, described second rate distortion are the different down-sampling pattern of employing to the encode rate distortion that produces and described down-sampling piece carried out the rate distortion sum that up-sampling produced of described down-sampling piece; The minimum pairing coding mode of rate distortion is selected in relatively first rate distortion and second rate distortion set.In above-mentioned adaptive super-resolution processing system for video, preferred described down-sampling pattern comprises pattern 0 to mode 3, and wherein, pattern 0 is the maintainance block original pixels; Pattern 1 is the vertical direction down-sampling, obtains 16 * 8 piece; Pattern 2 is the horizontal direction down-sampling, obtains 8 * 16 piece; Mode 3 is horizontal direction and vertical direction while down-sampling, obtains 8 * 8 piece.
In above-mentioned adaptive super-resolution processing system for video, in the preferred described decoder module, comprise type division submodule, described type is divided submodule and is comprised: the 1-norm calculation unit of AC coefficient, be used for calculating j 8 * 8 DCT coefficient of the down-sampling piece of described decoding and rebuilding, the 1-norm S of AC coefficient
jThe smooth block judging unit is used for judging j 8 * 8 DCT coefficient, the 1-norm S of AC coefficient
jWhether less than threshold value T
F,If,, then j 8 * 8 is smooth block; Otherwise, be moving mass or non-motion texture block; Wherein, described threshold value T
F,For setting in advance; Moving mass, non-motion texture block judging unit are used to calculate down-sampling piece behind the decoding and rebuilding and the movement differential between the prediction piece, judge whether described movement differential is positioned at threshold interval [T
Ml, T
Mu], if described j 8 * 8 is moving mass, if not, described j 8 * 8 is non-motion texture block, wherein, and described threshold interval [T
Ml, T
Mu] set in advance.
In above-mentioned adaptive super-resolution processing system for video, preferred described decoder module comprises up-sampling reconstruction submodule, described reconstruction submodule is rebuild described down-sampling piece according to following rule: if j 8 * 8 is smooth block, utilize spatial domain interpolation algorithm decoding and rebuilding down-sampling piece; If .j 8 * 8 is non-motion texture block, utilize the edge to keep interpolation algorithm to rebuild the down-sampling piece of decoding; If j 8 * 8 is moving mass, utilize the super-resolution rebuilding algorithm to rebuild the down-sampling piece of decoding; And described super-resolution rebuilding algorithm is: the low-resolution image piece that described down-sampling piece is formed projects to the correspondence position of high-definition picture piece, and the pixel of disappearance position utilizes the respective pixel of reference block to rebuild, and reconstruction formula is as follows,
SR(x，y)＝R(x，y)+g(x′，y′)-R(x″，y″)＝R(x，y)+e(x′，y′)
Wherein, (x y) is the coordinate of missing pixel to be rebuild in the described high-definition picture piece, SR (x y) is the value of the missing pixel of rebuilding.; R (x, y) be the pixel value .g that lacks in the corresponding current reconstructed block in the reference image block of deriving by the motion vector of down-sampling piece (x ', y ') is the high-definition picture piece neutralization (x of current down-sampling piece before sampling, y) Dui Ying nearest neighbor pixels value, R (x "; y ") be and g (x ', y ') corresponding reference piece in pixel value.
In above-mentioned adaptive super-resolution processing system for video, in the preferred described coding module, according to described second rate distortion of rate-distortion optimization Model Calculation, described rate-distortion optimization model is:
JD
i＝D
i+λ×R
i+D
u
Wherein, D
iThe distortion of presentation code down-sampling piece, R
iThe bit number that presentation code down-sampling piece is used, D
uDistortion in the expression up-sampling reconstructed block between missing pixel and original pixels.I is the down-sampling coding mode.
The present invention has following beneficial effect:
The first, utilization is selected the down-sampling pattern based on the mode decision algorithm of rate distortion optimum, has set up new rate-distortion model, and distortion (Distortion) part has comprised the distortion of the missing pixel of rebuilding, and has guaranteed that coding efficiency can not reduce.
The second, utilize reconstructed blocks characteristics of signals behind the coding, with 8 * 8 be base unit, vision signal is divided into smoothly, move and three kinds of signals of texture region of non-motion.Smooth region utilizes the DCT coefficient feature of 8 * 8 correspondences to judge, moving region and non-motion texture region utilize the movement differential of reconstructed blocks and prediction piece to judge.This method has been avoided the side information of coding zones of different video signal characteristic, has improved coding efficiency.
Three, when high-resolution reconstruction, the present invention has adopted based on the block type adaptive super-resolution reconstructing method, adopts simple interpolation algorithm for smooth region; Adopt super-resolution technique to rebuild in the moving region; At the texture region of non-motion, the interpolation algorithm that the present invention has adopted the edge to keep has kept the image high-frequency information preferably, has not only improved the subjective and objective quality of encode video image, has also reduced the complexity of algorithm simultaneously.
Description of drawings
Fig. 1 the present invention is based on the flow chart of steps of the self-adaptive super-resolution video processing method of piece for basis;
Fig. 2 the present invention is based in the self-adaptive super-resolution video processing method of piece for basis, when carrying out decoding step, and the flow chart of steps that block type is divided;
Fig. 3 the present invention is based in the self-adaptive super-resolution video processing method of piece for basis, when carrying out decoding step, and low complex degree super-resolution rebuilding algorithm schematic diagram;
Fig. 4 a is that resolution is 1080p, the RD curve synoptic diagram of cycle tests Bluesky;
Fig. 4 b is that resolution is 1080p, the RD curve synoptic diagram of cycle tests Pedestrian_area;
Fig. 5 the present invention is based on the simple structure block diagram of the adaptive super-resolution processing system for video of piece for basis;
Fig. 6 the present invention is based in the adaptive super-resolution processing system for video of piece for basis, and the type of decoder module is divided the simple structure block diagram of submodule.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the embodiment of the invention is described in further detail below in conjunction with the drawings and specific embodiments.
Basic thought of the present invention: utilize picture characteristics to select suitable down-sampling pattern and corresponding method for reconstructing, the piece of the video image behind the coding down-sampling, up-sampling is rebuild the image block of original resolution during decoding, thereby reaches the purpose that improves the encoding compression performance.
With reference to Fig. 1, Fig. 1 comprises the steps: for according to the flow chart of steps that the present invention is based on the self-adaptive super-resolution video processing method of piece
Step 110 to video image, is selected block-based down-sampling pattern.
Step 120 according to described down-sampling pattern, is carried out down-sampling to current video image, obtains the down-sampling piece.
Step 130, combined block coded prediction pattern and described down-sampling pattern are selected the coding mode according to rate distortion, and the described down-sampling piece that obtains is encoded.
Step 140 is decoded to the down-sampling piece of coding, obtains decoded down-sampling piece, and it is carried out type divide, and based on the type of described down-sampling piece, described down-sampling piece is carried out up-sampling, obtains the up-sampling reconstructed block.
Wherein, in the step 130, described selection is specially according to the coding mode of rate distortion:
Determine the set of first rate distortion and second rate distortion, described first rate distortion is not for carrying out down-sampling, the resulting rate distortion of direct coding down-sampling piece; The set of described second rate distortion comprises that a plurality of second rate distortions, described second rate distortion are the different down-sampling pattern of employing to the encode rate distortion that produces and described down-sampling piece carried out the rate distortion sum that up-sampling produced of described down-sampling piece; The minimum pairing coding mode of rate distortion is selected in relatively first rate distortion and second rate distortion set.
For example said process is described.
The first, calculate first rate distortion.
The coding original block, rate distortion is respectively R
1, D
1, first rate distortion is D
1+ λ * R
1
The two rate distortions set of the second, calculating
The set of second rate distortion comprises a plurality of second rate distortions.For a certain down-sampling pattern, the down-sampling piece is encoded the encoding rate distortion R of down-sampling piece
2, D
2, but the distortion D of the down-sampling piece also has up-sampling reconstructed block time disappearance part
3, promptly second rate distortion is D
2+ D
3+ λ * R
2Calculate pairing second rate distortion of each down-sampling pattern, obtain the set of second rate distortion.
Three, determine minimum rate distortion corresponding codes pattern
Determine rate distortion minimum in second distortion set, and rate distortion that should minimum compares with described first rate distortion, determine the rate distortion of minimum, thereby, can determine this minimum rate distortion corresponding codes pattern.
With the example that is embodied as on the AVS reference software, introduce implementation of the present invention in detail below.
About step 110, step 120 and step 130, the coding of down-sampling and down-sampling piece
As shown in table 1, the present invention has defined down-sampling pattern in 4, and down-sampling is not carried out in pattern 0 expression, pattern 1～3, and horizontal down-sampling, vertical down-sampling and both direction down-sampling are simultaneously adopted in expression respectively.With the example that is embodied as on AVS reference software P frame, with 3 kinds of down-sampling patterns, associating block encoding predictive mode, as shown in table 2, respectively these 8 kinds of patterns are encoded.For newly-increased down-sampling pattern, no longer proceed mode division, P_L0_16x8_down for example, the present invention only divides the piece of this 16x8 and encodes, and comprises the motion vector of 1 16x8 and the DCT coefficient of 2 8x8 pieces.
The block-based down-sampling pattern of table 1
| The down-sampling pattern | Pattern description |
| ??0 | The maintainance block original pixels |
| ??1 | The vertical direction down-sampling obtains 16 * 8 |
| ??2 | The horizontal direction down-sampling obtains 8 * 16 |
| ??3 | Level and vertical direction be down-sampling simultaneously, obtains 8 * 8 |
Block mode in the block-based adaptive super-resolution video coding of table 2
| Block mode | Describe |
| ??0 | ??P_L01_6x16 |
| ??1 | ??P_L0_L0_16x8 |
| ??2 | ??P_L0_L0_8x16 |
| ??3 | ??P_8x8 |
| ??4 | ??P_8x8ref0 |
| ??5 | ??P_L0_16x8_down |
| ??6 | ??P_L0_8x16_down |
| ??7 | ??P_L0_8x8_down |
About in the step 140, the division of block type
Rebuilding in view of piece is to carry out on decoded vision signal, therefore the present invention directly analyzes the characteristic of decoding and rebuilding piece, 8x8 piece in the video image down-sampling piece is divided into 3 types: smooth block, the texture block of moving mass and non-motion (non-moving mass, but comprise the piece of more radio-frequency component).The algorithm flow chart that block type is divided comprises the steps: as shown in Figure 2
Step 210: calculate in the DCT coefficient of j 8 * 8 of down-sampling piece of described decoding and rebuilding the 1-norm S of AC coefficient
j
Step 220: judge in the DCT coefficient of individual 8 * 8 of j the 1-norm S of AC coefficient
jWhether less than threshold value T
F,If,, then j 8 * 8 is smooth block; If not, execution in step 230.
Step 230: the movement differential between down-sampling piece behind the calculating decoding and rebuilding and the prediction piece.
Step 240: judge whether described movement differential is positioned at threshold interval [T
Ml, T
Mu], if described j 8 * 8 is moving mass, if not, described j 8 * 8 is non-motion texture block.
Below above-mentioned steps is elaborated.The 1-norm S of AC coefficient in the DCT coefficient of each the 8x8 piece in the down-sampling piece of calculating decoding and rebuilding
j,
Wherein, j is the index of 8x8 piece in the down-sampling piece, and i is the coefficient index that scans according to zig-zag in the 8x8 piece.If S
jLess than preset threshold T
F,Judge that this 8x8 piece is a smooth block; Otherwise, be non-smooth block.For non-smooth block, the present invention has further done the segmentation of moving mass and non-moving mass, calculates the movement differential of reconstructed block and prediction piece,
Y wherein
J, k, lBe the reconstructed block signal, X
J, k, lIt is the prediction piece of motion vector points.If SAD
jAt preset threshold [T
Ml, T
Mu] in the scope, judge that current block is a moving mass, otherwise, be non-motion texture block.
Because the division of video signal characteristic of the present invention is an information of utilizing the decoding and reconstituting image, so any additional side information of can encoding, decoding end can utilize identical judgment criterion to make the judgement of block type.
About in the step 140, the super-resolution rebuilding of down-sampling piece
For three kinds of above-mentioned different video picture signals, the super-resolution algorithms reconstruct high-resolution piece that the present invention samples different respectively.For smooth block,,, utilized bilinear interpolation as the present invention so utilize simple spatial domain interpolation algorithm just can well rebuild the piece of original resolution owing to mainly comprise low-frequency component; Texture region for non-motion, interpolation algorithm (the S.Battiato that the present invention has utilized the edge to keep, G.Gallom and F.Stanco, " Alocally-adaptive zooming algorithm for digital images, " Image andVision Computing, Vol.20, No.11, pp.805-812, September 20021,2) detail textures that, has well kept reconstructed blocks; For moving mass, owing to can from reference block, obtain movable information more accurately, help the reconstruction of super-resolution algorithms, so for the reconstruction of such down-sampling piece, the present invention has adopted the super-resolution rebuilding algorithm of low complex degree; Super-resolution algorithms as shown in Figure 3, the low-resolution image piece that at first down-sampling is obtained projects to the correspondence position of high-definition picture piece, the pixel of disappearance position utilizes the respective pixel of reference block to rebuild, reconstruction formula is as follows,
SR(x，y)＝R(x，y)+g(x′，y′)-R(x″，y″)＝R(x，y)+e(x′，y′)(3)
Wherein, (x, y) be the coordinate of missing pixel to be rebuild in the high-resolution piece, (x y) is the value .R (x of the missing pixel of rebuilding to SR, y) be the pixel value .g that lacks in the corresponding current reconstructed block in the reference image block of deriving by the motion vector of down-sampling piece (x ', y ') be the high-definition picture piece neutralization of current down-sampling piece before sampling (x, y) Dui Ying nearest neighbor pixels value, R (x "; y ") be and g (x ', y ') corresponding reference piece in pixel value.
Image block to different characteristic adopts different super-resolution algorithms, not only can improve the reconstruction quality of integral image, also can reduce the complexity of encoding and decoding simultaneously.
The rate-distortion optimization model of down-sampling piece
Owing to introduced the down-sampling block mode, the present invention has set up the rate-distortion optimization model of down-sampling piece,
JD
i＝D
i+λ×R
i+D
u??????????????(4)
Wherein, D
iThe distortion of presentation code down-sampling piece, R
iThe bit number that presentation code down-sampling piece is used, D
uDistortion in the expression up-sampling reconstructed block between missing pixel and original pixels.I is the down-sampling coding mode.
Original other 5 kinds of block modes among the associating AVS at the block mode of coding side selection RD optimum, are realized adaptive super-resolution coding.
Fig. 4 and table 3 have listed the result that the present invention realizes on AVS reference software P frame, its intermediate-resolution is respectively 720p and 1080p, and reference frame number is that 2, the first frames are I frame coding, and all the other are P frame coding.
With reference to Fig. 4 a, Fig. 4 b.Fig. 4 a is that resolution is 1080p, the RD curve synoptic diagram of cycle tests Bluesky; Fig. 4 b is that resolution is 1080p, the RD curve synoptic diagram of cycle tests Pedestrian_area.Transverse axis is encoder bit rate (kbps of unit) among the figure, and the longitudinal axis is image Y-PSNR (dB of unit), and curve a, c are original AVS coding efficiency, and curve b, c are the curve that has adopted the adaptive down-sampling coding techniques.As can be seen from Figure 4 the block-based adaptive super-resolution method for video coding of the present invention's proposition not only can significantly improve coding efficiency under the low code check, also can improve simultaneously the coding efficiency under the high code check, this is because the present invention has adopted the rate-distortion optimization model as down-sampling mode decision criterion, overcome D.Barreto, L.Alvarez, R.Molina, A.Katsaggelos, the method shortcoming that performance reduces under high code check situation with G.Callic ó has guaranteed coding efficiency stability.Listed the result who tests on multisequencing more in table 3, experiment shows that the present invention can effectively improve video coding performance.
Table 3 test result
The present invention adopt the super-resolution algorithms of low complex degree, simultaneously for non-moving region, adopted the lower interpolation algorithm of complexity, reduced the complexity of whole encoding and decoding framework, meet the real-time requirement of video coding.
Though the present invention is on the P of AVS reference software frame, it can be equally applicable to other encoding and decoding platform, as H.264/AVC, and VC-1 etc.The present invention is applicable to the coding of I frame and B frame too.
With reference to Fig. 5, Fig. 5 is according to the simple structure block diagram that the present invention is based on the adaptive super-resolution processing system for video of piece, comprising:
Down-sampling pattern determination module 510 is used for current video image, selects block-based current down-sampling pattern.
Down sample module 520 is used for according to described current down-sampling pattern current video image being carried out down-sampling, obtains the down-sampling piece.
Coding module 530 is used for combined block coded prediction pattern and described down-sampling pattern, and the described down-sampling piece that obtains is encoded.
Decoder module 540 is used for the down-sampling piece of coding is decoded, and obtains described down-sampling piece, and described down-sampling piece is carried out type divide, and based on the type of described down-sampling piece, described down-sampling piece is carried out decoding and rebuilding.
In coding module 530, selection is specially according to the coding mode of rate distortion: calculate first rate distortion and second rate distortion, first rate distortion is not for carrying out down-sampling, the resulting rate distortion of direct coding down-sampling piece, second rate distortion is for encoding to the down-sampling piece and the down-sampling piece being carried out the rate distortion that described up-sampling reconstructed block that up-sampling obtains is produced; Relatively first rate distortion and second rate distortion are selected the less pairing coding mode of rate distortion.
Wherein, described down-sampling pattern comprises:
Pattern 0: maintainance block original pixels;
Pattern 1: the vertical direction down-sampling obtains 16 * 8 piece;
Pattern 2: the horizontal direction down-sampling obtains 8 * 16 piece;
Mode 3: horizontal direction and vertical direction be down-sampling simultaneously, obtains 8 * 8 piece.
With reference to Fig. 6, Fig. 6 the present invention is based in the adaptive super-resolution processing system for video of piece for basis, and the type of decoder module is divided the simple structure block diagram of submodule.
The type of decoder module is divided submodule and is comprised 1-norm calculation unit 610, smooth block judging unit 620 and the moving mass of AC coefficient, non-motion texture block judging unit 630.The 1-norm calculation unit 610 of AC coefficient is used for calculating j 8 * 8 DCT coefficient of the down-sampling piece of described decoding and rebuilding, the 1-norm S of AC coefficient
jSmooth block judging unit 620 is used for judging j 8 * 8 DCT coefficient, the 1-norm S of AC coefficient
jWhether less than threshold value T
F,If,, then j 8 * 8 is smooth block; Otherwise, be moving mass or non-motion texture block; Wherein, described threshold value T
F,For setting in advance; Moving mass, non-motion texture block judging unit 630 are used to calculate down-sampling piece behind the decoding and rebuilding and the movement differential between the prediction piece, judge whether described movement differential is positioned at threshold interval [T
Ml, T
Mu], if described j 8 * 8 is moving mass, if not, described j 8 * 8 is non-motion texture block, wherein, and described threshold interval [T
Ml, T
Mu] set in advance.
In the described decoder module, reconstructing undersampled of the following rule of foundation:, utilize spatial domain interpolation algorithm decoding and rebuilding down-sampling piece if j 8 * 8 is smooth block; If j 8 * 8 is non-motion texture block, utilize the edge to keep interpolation algorithm to rebuild the down-sampling piece of decoding; If j 8 * 8 is moving mass, utilize the super-resolution rebuilding algorithm to rebuild the down-sampling piece of decoding; And described super-resolution rebuilding algorithm is: the low-resolution image piece that described down-sampling piece is formed projects to the correspondence position of high-definition picture piece, and the pixel of disappearance position utilizes the respective pixel of reference block to rebuild, and reconstruction formula is as follows,
SR(x，y)＝R(x，y)+g(x′，y′)-R(x″，y″)＝R(x，y)+e(x′，y′)
Wherein, (x y) is the coordinate of missing pixel to be rebuild in the described high-definition picture piece, SR (x y) is the value of the missing pixel of rebuilding.; R (x, y) be the pixel value .g that lacks in the corresponding current reconstructed block in the reference image block of deriving by the motion vector of down-sampling piece (x ', y ') is the high-definition picture piece neutralization (x of current down-sampling piece before sampling, y) Dui Ying nearest neighbor pixels value, R (x "; y ") be and g (x ', y ') corresponding reference piece in pixel value.
In the rate distortion computing module, according to the described rate distortion of rate-distortion optimization Model Calculation, described rate-distortion optimization model is:
JD
i＝D
i+λ×R
i+D
u
Wherein, D
iThe distortion of presentation code down-sampling piece, R
iThe bit number that presentation code down-sampling piece is used, D
uDistortion in the expression up-sampling reconstructed block between missing pixel and original pixels.I is the down-sampling coding mode.
More than the adaptive super-resolution processing system for video that the present invention is based on piece has been done simple explanation, its principle is similar to block-based self-adaptive super-resolution video processing method, the explanation that relevant part can the reference mass evaluation method does not repeat them here.
More than a kind of block-based self-adaptive super-resolution video processing method provided by the present invention and system are described in detail, used specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (10)
1. a block-based self-adaptive super-resolution video processing method is characterized in that, comprises the steps:
Down-sampling pattern determining step to video image, is selected block-based down-sampling pattern;
The down-sampling step according to described down-sampling pattern, is carried out down-sampling to current video image, obtains the down-sampling piece;
Coding step, combined block coded prediction pattern and described down-sampling pattern are selected the coding mode according to rate distortion, and the described down-sampling piece that obtains is encoded;
Decoding step is decoded to the down-sampling piece of coding, obtains decoded down-sampling piece, and it is carried out type divide, and based on the type of described down-sampling piece, described down-sampling piece is carried out up-sampling, obtains the up-sampling reconstructed block;
Wherein, in the described coding step, described selection is specially according to the coding mode of rate distortion:
Determine the set of first rate distortion and second rate distortion, described first rate distortion is not for carrying out down-sampling, the resulting rate distortion of direct coding down-sampling piece; The set of described second rate distortion comprises that a plurality of second rate distortions, described second rate distortion are the different down-sampling pattern of employing to the encode rate distortion that produces and described down-sampling piece carried out the rate distortion sum that up-sampling produced of described down-sampling piece;
The minimum pairing coding mode of rate distortion is selected in relatively first rate distortion and second rate distortion set.
2. self-adaptive super-resolution video processing method according to claim 1 is characterized in that, in the described down-sampling step, described down-sampling pattern comprises:
Pattern 0: maintainance block original pixels;
Pattern 1: the vertical direction down-sampling obtains 16 * 8 piece;
Pattern 2: the horizontal direction down-sampling obtains 8 * 16 piece;
Mode 3: horizontal direction and vertical direction be down-sampling simultaneously, obtains 8 * 8 piece.
3. self-adaptive super-resolution video processing method according to claim 2 is characterized in that, in the described decoding step, the described division that the down-sampling piece is carried out type comprises the steps:
The 1-norm calculation step of AC coefficient is calculated in the DCT coefficient of j 8 * 8 of down-sampling piece of described decoding and rebuilding the 1-norm S of AC coefficient
j
The smooth block determining step is judged in the DCT coefficient of individual 8 * 8 of j the 1-norm S of AC coefficient
jWhether less than threshold value T
f,, if then j 8 * 8 is smooth block; Otherwise, be moving mass or non-motion texture block; Wherein, described threshold value T
f, for setting in advance;
Moving mass, non-motion texture block determining step, the movement differential between down-sampling piece behind the calculating decoding and rebuilding and the prediction piece judges whether described movement differential is positioned at threshold interval [T
Ml, T
Mu], if described j 8 * 8 is moving mass, if not, described j 8 * 8 is non-motion texture block.
4. self-adaptive super-resolution video processing method according to claim 3 is characterized in that, in the described decoding step, according to following rule described down-sampling piece is carried out up-sampling, obtains the up-sampling reconstructed block:
If j 8 * 8 is smooth block, utilize spatial domain interpolation algorithm decoding and rebuilding down-sampling piece;
If j 8 * 8 is non-motion texture block, utilize the edge to keep interpolation algorithm to rebuild the down-sampling piece of decoding;
If j 8 * 8 is moving mass, utilize the super-resolution rebuilding algorithm to rebuild the down-sampling piece of decoding;
Wherein, described super-resolution rebuilding algorithm is:
The low-resolution image piece that described down-sampling piece is formed projects to the correspondence position of high-definition picture piece, and the pixel of disappearance position utilizes the respective pixel of reference block to rebuild, and reconstruction formula is as follows,
SR(x，y)＝R(x，y)+g(x′，y′)-R(x″，y″)＝R(x，y)+e(x′，y′)
Wherein, (x y) is the coordinate of missing pixel to be rebuild in the described high-definition picture piece, SR (x y) is the value of the missing pixel of rebuilding.; R (x, y) be the pixel value .g that lacks in the corresponding current reconstructed block in the reference image block of deriving by the motion vector of down-sampling piece (x ', y ') is the high-definition picture piece neutralization (x of current down-sampling piece before sampling, y) Dui Ying nearest neighbor pixels value, R (x "; y ") be and g (x ', y ') corresponding reference piece in pixel value.
5. self-adaptive super-resolution video processing method according to claim 4 is characterized in that, in the described coding step, according to described second rate distortion of rate-distortion optimization Model Calculation, described rate-distortion optimization model is:
JD
i＝D
i+λ×R
i+D
u
Wherein, D
iThe distortion of presentation code down-sampling piece, R
iThe bit number that presentation code down-sampling piece is used, D
uDistortion in the expression up-sampling reconstructed block between missing pixel and original pixels, i is the down-sampling coding mode.
6. a block-based adaptive super-resolution processing system for video is characterized in that, comprising:
Down-sampling pattern determination module is used for video image, selects block-based down-sampling pattern;
Down sample module is used for according to described down-sampling pattern current video image being carried out down-sampling, obtains the down-sampling piece;
Coding module is used for combined block coded prediction pattern and described down-sampling pattern, selects the coding mode according to rate distortion, and the described down-sampling piece that obtains is encoded;
Decoder module is used for the down-sampling piece of coding is decoded, and obtains described down-sampling piece, and described down-sampling piece is carried out type divide, and based on the type of described down-sampling piece, described down-sampling piece is carried out decoding and rebuilding;
Wherein, in the described coding module, described selection is specially according to the coding mode of rate distortion:
Determine the set of first rate distortion and second rate distortion, described first rate distortion is not for carrying out down-sampling, the resulting rate distortion of direct coding down-sampling piece; The set of described second rate distortion comprises that a plurality of second rate distortions, described second rate distortion are the different down-sampling pattern of employing to the encode rate distortion that produces and described down-sampling piece carried out the rate distortion sum that up-sampling produced of described down-sampling piece;
The minimum pairing coding mode of rate distortion is selected in relatively first rate distortion and second rate distortion set.
7. adaptive super-resolution processing system for video according to claim 6 is characterized in that, comprising: described down-sampling pattern comprises:
Pattern 0: maintainance block original pixels;
Pattern 1: the vertical direction down-sampling obtains 16 * 8 piece;
Pattern 2: the horizontal direction down-sampling obtains 8 * 16 piece;
Mode 3: horizontal direction and vertical direction be down-sampling simultaneously, obtains 8 * 8 piece.
8. adaptive super-resolution processing system for video according to claim 7 is characterized in that, in the described decoder module, comprises type division submodule, and described type is divided submodule and comprised:
The 1-norm calculation unit of AC coefficient is used for calculating j 8 * 8 DCT coefficient of the down-sampling piece of described decoding and rebuilding, the 1-norm S of AC coefficient
j
The smooth block judging unit is used for judging j 8 * 8 DCT coefficient, the 1-norm S of AC coefficient
jWhether less than threshold value T
f,, if then j 8 * 8 is smooth block; Otherwise, be moving mass or non-motion texture block; Wherein, described threshold value T
f, for setting in advance;
Moving mass, non-motion texture block judging unit are used to calculate down-sampling piece behind the decoding and rebuilding and the movement differential between the prediction piece, judge whether described movement differential is positioned at threshold interval [T
Ml, T
Mu], if described j 8 * 8 is moving mass, if not, described j 8 * 8 is non-motion texture block, wherein, and described threshold interval [T
Ml, T
Mu] set in advance.
9. adaptive super-resolution processing system for video according to claim 8 is characterized in that, described decoder module comprises up-sampling reconstruction submodule, and described reconstruction submodule is rebuild described down-sampling piece according to following rule:
If j 8 * 8 is smooth block, utilize spatial domain interpolation algorithm decoding and rebuilding down-sampling piece;
If j 8 * 8 is non-motion texture block, utilize the edge to keep interpolation algorithm to rebuild the down-sampling piece of decoding;
If j 8 * 8 is moving mass, utilize the super-resolution rebuilding algorithm to rebuild the down-sampling piece of decoding; And described super-resolution rebuilding algorithm is:
The low-resolution image piece that described down-sampling piece is formed projects to the correspondence position of high-definition picture piece, and the pixel of disappearance position utilizes the respective pixel of reference block to rebuild, and reconstruction formula is as follows,
SR(x，y)＝R(x，y)+g(x′，y′)-R(x″，y″)＝R(x，y)+e(x′，y′)
Wherein, (x y) is the coordinate of missing pixel to be rebuild in the described high-definition picture piece, SR (x y) is the value of the missing pixel of rebuilding.; R (x, y) be the pixel value .g that lacks in the corresponding current reconstructed block in the reference image block of deriving by the motion vector of down-sampling piece (x ', y ') is the high-definition picture piece neutralization (x of current down-sampling piece before sampling, y) Dui Ying nearest neighbor pixels value, R (x "; y ") be and g (x ', y ') corresponding reference piece in pixel value.
10. adaptive super-resolution processing system for video according to claim 9 is characterized in that, in the described coding module, according to described second rate distortion of rate-distortion optimization Model Calculation, described rate-distortion optimization model is:
JD
i＝D
i+λ×R
i+D
u
Wherein, D
iThe distortion of presentation code down-sampling piece, R
iThe bit number that presentation code down-sampling piece is used, D
uDistortion in the expression up-sampling reconstructed block between missing pixel and original pixels, i is the down-sampling coding mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200910241349 CN101710993B (en) | 2009-11-30 | 2009-11-30 | Block-based self-adaptive super-resolution video processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200910241349 CN101710993B (en) | 2009-11-30 | 2009-11-30 | Block-based self-adaptive super-resolution video processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101710993A true CN101710993A (en) | 2010-05-19 |
| CN101710993B CN101710993B (en) | 2012-04-11 |
Family
ID=42403749
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200910241349 Active CN101710993B (en) | 2009-11-30 | 2009-11-30 | Block-based self-adaptive super-resolution video processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101710993B (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102413281A (en) * | 2010-12-13 | 2012-04-11 | 松翰科技股份有限公司 | Image acquisition device and image data transmission method thereof |
| CN102800069A (en) * | 2012-05-22 | 2012-11-28 | 湖南大学 | Image super-resolution method for combining soft decision self-adaptation interpolation and bicubic interpolation |
| CN103268589A (en) * | 2013-05-10 | 2013-08-28 | 中科创达软件股份有限公司 | Somatosensory interaction method based on front-facing camera of mobile terminal |
| WO2013155899A1 (en) * | 2012-04-16 | 2013-10-24 | Mediatek Inc. | Method and apparatus for sample adaptive offset coding with separate sign and magnitude |
| CN103903236A (en) * | 2014-03-10 | 2014-07-02 | 北京信息科技大学 | Method and device for reconstructing super-resolution facial image |
| CN104050688A (en) * | 2013-03-15 | 2014-09-17 | Arm有限公司 | Methods of and apparatus for encoding and decoding data |
| CN104378631A (en) * | 2013-08-12 | 2015-02-25 | 三星电子株式会社 | Method for selecting resolution with minimum distortion value and device performing the method |
| WO2015085636A1 (en) * | 2013-12-13 | 2015-06-18 | 清华大学深圳研究生院 | Super-resolution processing method for video |
| CN104780383A (en) * | 2015-02-02 | 2015-07-15 | 杭州电子科技大学 | 3D-HEVC (High Efficiency Video Coding) multi-resolution video coding method |
| CN106791837A (en) * | 2016-12-15 | 2017-05-31 | 北京数码视讯科技股份有限公司 | Forerunner's analysis method and device of Video coding |
| CN107018429A (en) * | 2017-04-26 | 2017-08-04 | 陈翟 | Internet video data compression and frame picture display process |
| CN107343208A (en) * | 2016-04-29 | 2017-11-10 | 掌赢信息科技（上海）有限公司 | One kind control video code rate method and electronic equipment |
| CN108184116A (en) * | 2017-12-18 | 2018-06-19 | 西南技术物理研究所 | A kind of image rebuilding method suitable for the transmission of wireless data chain |
| CN109218727A (en) * | 2017-06-30 | 2019-01-15 | 华为软件技术有限公司 | The method and apparatus of video processing |
| CN109905717A (en) * | 2017-12-11 | 2019-06-18 | 四川大学 | A kind of H.264/AVC Encoding Optimization based on Space-time domain down-sampling and reconstruction |
| CN110278415A (en) * | 2019-07-02 | 2019-09-24 | 浙江大学 | A kind of web camera video quality improvements method |
| WO2019237659A1 (en) * | 2018-06-11 | 2019-12-19 | Suzhou Aqueti Technology Co., Ltd. | Blind compressive sampling method, apparatus and imaging system |
| CN111698503A (en) * | 2020-06-22 | 2020-09-22 | 深圳市迪威码半导体有限公司 | Video high-power compression method based on preprocessing |
| CN111937385A (en) * | 2018-04-13 | 2020-11-13 | 皇家Kpn公司 | Video coding based on frame-level super-resolution |
| WO2021003671A1 (en) * | 2019-07-09 | 2021-01-14 | Alibaba Group Holding Limited | Resolution-adaptive video coding |
| CN109379592B (en) * | 2018-10-26 | 2021-04-30 | 北京北方安恒利数码技术有限公司 | Image encoding method and apparatus thereof |
| CN114363617A (en) * | 2022-03-18 | 2022-04-15 | 武汉大学 | Network lightweight video stream transmission method, system and equipment |
| WO2023198074A1 (en) * | 2022-04-12 | 2023-10-19 | Zhejiang Dahua Technology Co., Ltd. | Video processing method, electronic device, and computer-readable storage medium |
| CN117058002A (en) * | 2023-10-12 | 2023-11-14 | 深圳云天畅想信息科技有限公司 | Video frame super-resolution reconstruction method and device and computer equipment |
| CN117221547A (en) * | 2023-11-07 | 2023-12-12 | 四川新视创伟超高清科技有限公司 | CTU-level downsampling-based 8K video coding method and device |
-
2009
- 2009-11-30 CN CN 200910241349 patent/CN101710993B/en active Active
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102413281A (en) * | 2010-12-13 | 2012-04-11 | 松翰科技股份有限公司 | Image acquisition device and image data transmission method thereof |
| US8693774B2 (en) | 2010-12-13 | 2014-04-08 | Sonix Technology Co., Ltd. | Image accessing apparatus and image data transmission method thereof |
| WO2013155899A1 (en) * | 2012-04-16 | 2013-10-24 | Mediatek Inc. | Method and apparatus for sample adaptive offset coding with separate sign and magnitude |
| CN104247429A (en) * | 2012-04-16 | 2014-12-24 | 联发科技股份有限公司 | Method and apparatus for sample adaptive offset coding with separate sign and magnitude |
| CN102800069A (en) * | 2012-05-22 | 2012-11-28 | 湖南大学 | Image super-resolution method for combining soft decision self-adaptation interpolation and bicubic interpolation |
| CN104050688B (en) * | 2013-03-15 | 2019-06-04 | Arm有限公司 | Data encoding and decoding method and apparatus and computer readable recording medium |
| CN104050688A (en) * | 2013-03-15 | 2014-09-17 | Arm有限公司 | Methods of and apparatus for encoding and decoding data |
| CN103268589A (en) * | 2013-05-10 | 2013-08-28 | 中科创达软件股份有限公司 | Somatosensory interaction method based on front-facing camera of mobile terminal |
| CN104378631A (en) * | 2013-08-12 | 2015-02-25 | 三星电子株式会社 | Method for selecting resolution with minimum distortion value and device performing the method |
| WO2015085636A1 (en) * | 2013-12-13 | 2015-06-18 | 清华大学深圳研究生院 | Super-resolution processing method for video |
| CN103903236B (en) * | 2014-03-10 | 2016-08-31 | 北京信息科技大学 | The method and apparatus of face image super-resolution rebuilding |
| CN103903236A (en) * | 2014-03-10 | 2014-07-02 | 北京信息科技大学 | Method and device for reconstructing super-resolution facial image |
| CN104780383B (en) * | 2015-02-02 | 2017-09-19 | 杭州电子科技大学 | A kind of 3D HEVC multi-resolution video coding methods |
| CN104780383A (en) * | 2015-02-02 | 2015-07-15 | 杭州电子科技大学 | 3D-HEVC (High Efficiency Video Coding) multi-resolution video coding method |
| CN107343208A (en) * | 2016-04-29 | 2017-11-10 | 掌赢信息科技（上海）有限公司 | One kind control video code rate method and electronic equipment |
| CN107343208B (en) * | 2016-04-29 | 2019-10-11 | 掌赢信息科技（上海）有限公司 | A kind of control video code rate method and electronic equipment |
| CN106791837B (en) * | 2016-12-15 | 2019-11-26 | 北京数码视讯科技股份有限公司 | The forerunner's analysis method and device of Video coding |
| CN106791837A (en) * | 2016-12-15 | 2017-05-31 | 北京数码视讯科技股份有限公司 | Forerunner's analysis method and device of Video coding |
| CN107018429A (en) * | 2017-04-26 | 2017-08-04 | 陈翟 | Internet video data compression and frame picture display process |
| CN109218727A (en) * | 2017-06-30 | 2019-01-15 | 华为软件技术有限公司 | The method and apparatus of video processing |
| CN109905717A (en) * | 2017-12-11 | 2019-06-18 | 四川大学 | A kind of H.264/AVC Encoding Optimization based on Space-time domain down-sampling and reconstruction |
| CN108184116A (en) * | 2017-12-18 | 2018-06-19 | 西南技术物理研究所 | A kind of image rebuilding method suitable for the transmission of wireless data chain |
| CN111937385A (en) * | 2018-04-13 | 2020-11-13 | 皇家Kpn公司 | Video coding based on frame-level super-resolution |
| CN111937385B (en) * | 2018-04-13 | 2024-04-16 | 皇家Kpn公司 | Video coding based on frame-level super resolution |
| WO2019237659A1 (en) * | 2018-06-11 | 2019-12-19 | Suzhou Aqueti Technology Co., Ltd. | Blind compressive sampling method, apparatus and imaging system |
| CN109379592B (en) * | 2018-10-26 | 2021-04-30 | 北京北方安恒利数码技术有限公司 | Image encoding method and apparatus thereof |
| CN110278415A (en) * | 2019-07-02 | 2019-09-24 | 浙江大学 | A kind of web camera video quality improvements method |
| CN114026867B (en) * | 2019-07-09 | 2024-04-02 | 阿里巴巴集团控股有限公司 | Resolution adaptive video codec |
| WO2021003671A1 (en) * | 2019-07-09 | 2021-01-14 | Alibaba Group Holding Limited | Resolution-adaptive video coding |
| CN114026867A (en) * | 2019-07-09 | 2022-02-08 | 阿里巴巴集团控股有限公司 | Resolution adaptive video encoding and decoding |
| CN111698503A (en) * | 2020-06-22 | 2020-09-22 | 深圳市迪威码半导体有限公司 | Video high-power compression method based on preprocessing |
| CN111698503B (en) * | 2020-06-22 | 2022-09-09 | 深圳市迪威码半导体有限公司 | Video high-power compression method based on preprocessing |
| CN114363617A (en) * | 2022-03-18 | 2022-04-15 | 武汉大学 | Network lightweight video stream transmission method, system and equipment |
| WO2023198074A1 (en) * | 2022-04-12 | 2023-10-19 | Zhejiang Dahua Technology Co., Ltd. | Video processing method, electronic device, and computer-readable storage medium |
| CN117058002A (en) * | 2023-10-12 | 2023-11-14 | 深圳云天畅想信息科技有限公司 | Video frame super-resolution reconstruction method and device and computer equipment |
| CN117058002B (en) * | 2023-10-12 | 2024-02-02 | 深圳云天畅想信息科技有限公司 | Video frame super-resolution reconstruction method and device and computer equipment |
| CN117221547A (en) * | 2023-11-07 | 2023-12-12 | 四川新视创伟超高清科技有限公司 | CTU-level downsampling-based 8K video coding method and device |
| CN117221547B (en) * | 2023-11-07 | 2024-01-23 | 四川新视创伟超高清科技有限公司 | CTU-level downsampling-based 8K video coding method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101710993B (en) | 2012-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101710993B (en) | Block-based self-adaptive super-resolution video processing method and system | |
| JP5044057B2 (en) | Method and apparatus for selecting a filter | |
| CN101778275B (en) | Image processing method of self-adaptive time domain and spatial domain resolution ratio frame | |
| CN101175209B (en) | Adaptive de-blocking filtering method for mpeg video decoder | |
| CN102065298B (en) | High-performance macroblock coding implementation method | |
| CN106131554B (en) | The point self-adapted compensation method of HEVC quick sample product based on major side direction | |
| CN104539962A (en) | Layered video coding method fused with visual perception features | |
| CN106060539B (en) | A kind of method for video coding of low transmission bandwidth | |
| CN106507116B (en) | A kind of 3D-HEVC coding method predicted based on 3D conspicuousness information and View Synthesis | |
| CN106170093B (en) | Intra-frame prediction performance improving coding method | |
| CN101404766B (en) | Multi-view point video signal encoding method | |
| CN101895751A (en) | Method and device for intra-frame prediction and intra-frame prediction-based encoding/decoding method and system | |
| CN103596004A (en) | Intra-frame prediction method and device based on mathematical statistics and classification training in HEVC | |
| CN105306957A (en) | Adaptive loop filtering method and device | |
| CN106937116A (en) | Low-complexity video coding method based on random training set adaptive learning | |
| CN109587503A (en) | A kind of 3D-HEVC depth map intra-frame encoding mode high-speed decision method based on edge detection | |
| CN102917226B (en) | Intra-frame video coding method based on self-adaption downsampling and interpolation | |
| CN1194544C (en) | Video encoding method based on prediction time and space domain conerent movement vectors | |
| CN108769696A (en) | A kind of DVC-HEVC video transcoding methods based on Fisher discriminates | |
| Hu et al. | Deep inter prediction with error-corrected auto-regressive network for video coding | |
| CN110677644B (en) | Video coding and decoding method and video coding intra-frame predictor | |
| CN113079373A (en) | Video coding method based on HEVC-SCC | |
| CN114745551A (en) | Method for processing video frame image and electronic equipment | |
| CN106878754A (en) | A kind of 3D video depths image method for choosing frame inner forecast mode | |
| CN110446040A (en) | A kind of inter-frame encoding methods and system suitable for HEVC standard |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |