CN101577825B - Interactive quantized noise calculating method in compressed video super-resolution - Google Patents
Interactive quantized noise calculating method in compressed video super-resolution Download PDFInfo
- Publication number
- CN101577825B CN101577825B CN 200910062069 CN200910062069A CN101577825B CN 101577825 B CN101577825 B CN 101577825B CN 200910062069 CN200910062069 CN 200910062069 CN 200910062069 A CN200910062069 A CN 200910062069A CN 101577825 B CN101577825 B CN 101577825B
- Authority
- CN
- China
- Prior art keywords
- dct coefficient
- quantizing
- resolution
- parameter
- probability
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses an interactive quantized noise calculating method in compressed video super-resolution. The method includes the following steps of: first counting the appearance probability ofDCT coefficients before quantization before a coding end does quantized operation to the DCT coefficients of a video frame and calculating Laplace parameter capable of representing the distribution o f the DCT coefficients before quantization; then writing the distribution parameter of the DCT coefficients before quantization of an obtained image block in a Data-user field reserved in a code stream to be sent to a decoding end through coding; and finally obtaining the distribution parameter of the DCT coefficients before quantization in the code stream from the decoding end, calculating and obtaining the quantized noise according to the distribution probability density of the DCT coefficients before quantization and coefficients after quantization and consequently obtaining a final high-resolution image in a super-resolution algorithm. The calculating method is applicable to the compressed video super-resolution algorithm interacting between the coding end and the decoding end, improves the accuracy of quantized noise by obtaining the distribution parameter of the DCT coefficients before quantization at the coding end and providing the distribution parameter for the decoding end tocalculate the quantized noise.
Description
Technical field
The present invention relates to interactive quantized noise calculating method in a kind of compressed video super-resolution, belong to field of multimedia communication.
Background technology
In video monitoring, for the needs that transmit and store, the resolution of image is often less, and the open market main flow is CIF (352*288) resolution, and the resolution during playback video often is difficult to the identification monitored object.The way of lifting resolution commonly used is to adopt better watch-dog, but such investment is big and existing equipment can't be reused, thereby under the prerequisite that does not increase new watch-dog, the resolution that promotes monitor video by software seems very urgent and important.In traditional super-resolution rebuilding algorithm, at first reason such as optical dimming, motion blur, down-sampling and the noise to image deterioration carried out mathematical modeling, then and the inversion operation by matrix obtain high-resolution image, the model that therefore degrades accurately has important effect to super-resolution rebuilding.In compressed video, quantification is the main cause that causes information loss in the compression process, just need obtain the distribution character that quantizes preceding DCT coefficient in order to obtain accurate quantization noise model, existing algorithm is with DCT coefficient distributed model parameter or be assumed to be preset parameter or it is carried out iterative as variable, accuracy is not high, but also has problems such as computation complexity height.Conventional model meets even distribution to generally adopting the preceding DCT domain coefficient of quantification to distribute to the modeling of quantizing noise in the method for reconstructing of compressed video, studies show that, the DCT coefficient distributes and satisfies laplacian distribution before quantizing, traditional like this can not accurately express quantizing noise at DCT coefficient distributed model before quantizing in the compressed video super resolution reconstruction algorithm, therefore can influence effect and the quality that the supercompression video super-resolution is rebuild.On the other hand, simple at decoding end rebuilding super resolution image, there are two problems:
(1) quantize before the DCT coefficient distribute and meet laplacian distribution, but decoding end has only the back of quantification DCT coefficient, calculates quantizing noise and need introduce new variable and characterize the laplacian distribution parameter, obtains the value of this parameter by iteration optimization, has increased computing cost; (2) quantizing noise characterizes in the DCT territory and calculates, and needs to introduce the frequency domain constraint in the super-resolution rebuilding algorithm, the computation complexity height, and convergence is slow.
Summary of the invention
In order to solve above-mentioned the deficiencies in the prior art, the present invention proposes a kind of computational methods of compressed video super-resolution interactive quantized noise, DCT coefficient distributed model parameter before the video coding end calculates quantification, then it is delivered to decoding end, and decoding end quantizes preceding DCT coefficient distribution probability density and quantizes back DCT coefficient by image block to obtain more accurate quantizing noise, reconstructs better video quality.
Technical scheme of the present invention may further comprise the steps:
(1) before coding side frame of video DCT domain coefficient carries out quantization operation, the number of times that DCT coefficient before quantizing occurs is added up, obtain the probability that each coefficient occurs, the object of statistical operation is a DCT coefficient before quantizing in the image block, and the size of image block is the integral multiple of discrete cosine transform block size in the coding; Calculate the probability that quantizes preceding DCT coefficient appearance according to following formula:
Wherein, DCT coefficient before the different quantification in the i presentation video piece, n are the total numbers of DCT coefficient before the quantification in the image block, the number of times that the DCT coefficient occurred before C (y) expression quantized, and P (y) is corresponding probability.
(2) will quantize preceding DCT coefficient and corresponding probability and bring Laplce's probability distribution formula calculating acquisition distributed constant into; Get the laplacian distribution parameter according to following formula:
Wherein, the distribution probability of DCT coefficient before P (y) expression quantizes, y is DCT coefficient before quantizing, λ represents the laplacian distribution parameter, in practical operation, DCT coefficient 0 before quantizing is added up, and the distributed constant that obtains with this value is as the parameter of token image piece, λ=2P (0).
(3) the laplacian distribution parameter value that will obtain image block writes the Data_user field of reserving in the code stream, sends to decoding end by coding side; At coding side, the parameter that the DCT coefficient distributed before the sign that obtains quantized writes the Data_User field in the code stream, according to the image block sequence arrangement of correspondence, sends to decoding end by code stream when coding.
(4) in obtaining the Data_user field of code stream, decoding end extracts DCT coefficient laplacian distribution parameter before the quantification of correspondence image piece.
(5) calculate the quantizing noise value of each quantization parameter according to DCT coefficient distribution probability densitometer before quantizing quantification that back DCT coefficient and coding side transmit; Calculate the value of quantizing noise according to following formula:
Wherein, q is a quantization step, and y is DCT coefficient before quantizing, y
qFor quantizing back DCT coefficient, k represents the value of quantizing noise.
The present invention and prior art contrast, effect is positive and tangible: the present invention is applicable to the bigger situation of quantizing noise influence in the compressed video, obtain to quantize preceding DCT coefficient distributed constant by coding side and be transferred to decoding end, directly calculate quantizing noise value accurately, coding and decoding improves the model that obtains of quantizing noise in the super-resolution rebuilding of compressed video alternately.
Description of drawings
Fig. 1 is an original image.
Fig. 2 is the image that reconstruction in 30 o'clock obtains for quantization step.
Fig. 3 is that the quantizing noise compensation of coefficient calculations obtains reconstructed image before utilizing decoding end to quantize.
Embodiment
Below the present invention is further illustrated by specific embodiment:
For calculation procedure is described, from Fig. 1, get a discrete cosine transform block arbitrarily computational process is described, we get first in the present embodiment, and its image block matrix is I1, then has:
Numeric representation pixel value wherein.I1 is carried out dct transform, obtains matrix I2:
DCT coefficient before wherein numeric representation quantizes.In the quantization operation, we get quantization step q=30, obtain quantizing back DCT coefficient matrix I3:
(1) use following formula to calculate and quantize the probability that preceding DCT coefficient occurs:
Wherein, DCT coefficient before the different quantification in the i presentation video piece, n is the total number of the coefficient in the image block, the number of times that the DCT coefficient occurred before C (y) expression quantized, P (y) is corresponding probability.According to analyzing as can be known in an embodiment n=63 (first coefficient is represented DC coefficient among the I2, does not participate in statistics).
(2) calculate the laplacian distribution parameter according to following formula:
The distribution probability of DCT coefficient before P (y) expression quantizes, y is DCT coefficient before quantizing, λ represents the laplacian distribution parameter, probability density when using the DCT coefficient to be 0 value is found the solution the λ value, make y=0: λ=2P (0) can obtain λ=2P (0)=8/63 from I2.
(3) for each image block to obtaining Laplce's parameter distribution of a correspondence, at coding side, these parameters are write Data_User field in the code stream, when coding,, send to decoding end by code stream according to the image block sequence arrangement of correspondence.
(4) the Laplce's parameter in decoding end reception code stream, the λ value of acquisition respective image piece.
(5) calculate the value of single quantizing noise according to following formula:
Wherein, q is a quantization step, and y is DCT coefficient before quantizing, y
qFor quantizing back DCT coefficient, k represents the value of quantizing noise.We find from I3: quantization step is 30 o'clock, and it is 0 that DCT quantizes the back coefficient, and can draw: q=30, y
q=0,
λ=8/63。Pass through integral and calculating
The quantizing noise that calculates can compensate in the image reconstruction and go.
Calculate the image subjective quality that quantizes loss in compensation below by the quantizing noise that relates among example explanation the present invention:
Fig. 1 is original image lena.bmp, and Fig. 2 is the image that reconstruction in 30 o'clock obtains for quantization step, and Fig. 3 obtains reconstructed image for utilizing the preceding coefficient calculations of decoding end quantification to obtain the quantizing noise compensation.By observing, can find that calculating quantizing noise alternately by the encoding and decoding end can obtain subjective picture quality preferably in compressed image is rebuild.
Claims (5)
1. interactive quantized noise calculating method in the compressed video super-resolution is characterized in that may further comprise the steps:
(1) before coding side frame of video DCT domain coefficient carries out quantization operation, the number of times that DCT coefficient before quantizing occurs is added up, obtain each and quantize the probability that preceding DCT coefficient occurs, the object of statistical operation is a DCT coefficient before quantizing in the image block, and the size of image block is the integral multiple of discrete cosine transform block size in the coding;
(2) will quantize preceding DCT coefficient and corresponding probability and bring Laplce's probability distribution formula calculating acquisition distributed constant into;
(3) the image block laplacian distribution parameter value that obtains is write the Data_user field of reserving in the code stream, send to decoding end by coding side;
(4) in obtaining the Data_user field of code stream, decoding end extracts DCT coefficient laplacian distribution parameter before the quantification of correspondence image piece;
(5) according to quantizing the quantizing noise value that DCT coefficient distribution probability before the quantification that back DCT coefficient and coding side transmit calculates each quantization parameter.
2. according to interactive quantized noise calculating method in the described compressed video super-resolution of claim 1, it is characterized in that: calculate the probability that quantizes preceding DCT coefficient appearance according to following formula in the step (1):
Wherein, y
iCoefficient value before quantizing in the presentation video DCT coefficient block, DCT coefficient before the different quantification in the i presentation video piece, n are the total numbers of DCT coefficient before the quantification in the image block, C (y
i) expression quantize before the number of times that occurs of DCT coefficient, P (y
i) be corresponding probability.
3. according to interactive quantized noise calculating method in the described compressed video super-resolution of claim 1, it is characterized in that: step gets the laplacian distribution parameter according to following formula in (2):
Wherein, the distribution probability of DCT coefficient before P (y) expression quantizes, y is DCT coefficient before quantizing, λ represents the laplacian distribution parameter, in practical operation, to DCT coefficient value before quantizing is that 0 number of times that occurs is added up, and is worth the parameter of the distributed constant of acquisition as the token image piece with this, gets λ=2P (0).
4. according to interactive quantized noise calculating method in the described compressed video super-resolution of claim 1, it is characterized in that: in the step (3), at coding side, the parameter that the DCT coefficient distributed before the sign that obtains quantized writes the Data_User field in the code stream, when coding,, send to decoding end by code stream according to the image block sequence arrangement of correspondence.
5. according to interactive quantized noise calculating method in the described compressed video super-resolution of claim 1, it is characterized in that: the value of calculating quantizing noise in the step (5) according to following formula:
Wherein, q is a quantization step, and y is DCT coefficient before quantizing, y
qFor quantizing back DCT coefficient, k represents the value of quantizing noise, the distribution probability of DCT coefficient before P (y) expression quantizes.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200910062069 CN101577825B (en) | 2009-05-15 | 2009-05-15 | Interactive quantized noise calculating method in compressed video super-resolution |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200910062069 CN101577825B (en) | 2009-05-15 | 2009-05-15 | Interactive quantized noise calculating method in compressed video super-resolution |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101577825A CN101577825A (en) | 2009-11-11 |
CN101577825B true CN101577825B (en) | 2011-09-07 |
Family
ID=41272585
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200910062069 Expired - Fee Related CN101577825B (en) | 2009-05-15 | 2009-05-15 | Interactive quantized noise calculating method in compressed video super-resolution |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101577825B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2492397A (en) * | 2011-06-30 | 2013-01-02 | Canon Kk | Encoding and decoding residual image data using probabilistic models |
EP2575364B1 (en) * | 2011-09-30 | 2020-03-18 | BlackBerry Limited | Methods and devices for data compression using a non-uniform reconstruction space |
CN107945108A (en) * | 2016-10-13 | 2018-04-20 | 华为技术有限公司 | Method for processing video frequency and device |
CN109660813B (en) * | 2017-10-12 | 2021-04-16 | 上海富瀚微电子股份有限公司 | Quantization noise linear fitting method, coding device and coding method |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1578449A (en) * | 2003-06-27 | 2005-02-09 | 成津C&C株式会社 | Method for recovering and reconsisting super-resolution image from low-resolution compression image |
-
2009
- 2009-05-15 CN CN 200910062069 patent/CN101577825B/en not_active Expired - Fee Related
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1578449A (en) * | 2003-06-27 | 2005-02-09 | 成津C&C株式会社 | Method for recovering and reconsisting super-resolution image from low-resolution compression image |
Non-Patent Citations (3)
Title |
---|
Cheng Yan,Fang Xiang-zhong.Compressed Multi-image Reconstruction Based on Quantization Noise Distrubution.《Journal of Donghua University(Eng. Ed)》.2007,第24卷(第6期),756-761. * |
J R Price,M Rabbani.Biased Reconstruction for JPEG Decoding.《IEEE Tans. Signal Processing Letters》.1999,第6卷(第12期),297-299. * |
徐忠强,朱秀昌.压缩视频超分辨率重建技术.《电子与信息学报》.2007,第29卷(第2期),499-505. * |
Also Published As
Publication number | Publication date |
---|---|
CN101577825A (en) | 2009-11-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Batista et al. | Compression of ECG signals by optimized quantization of discrete cosine transform coefficients | |
CN103607591B (en) | Video image compression method combining super-resolution reconstruction | |
Arikan | Compression of motion capture databases | |
CN113259676B (en) | Image compression method and device based on deep learning | |
CN101742306A (en) | High dynamic range codecs | |
CN103313061B (en) | The video compress transmission method of a kind of adaptive RTS threshold adjustment and system | |
CN108737823B (en) | Image coding method and device and decoding method and device based on super-resolution technology | |
CN101577825B (en) | Interactive quantized noise calculating method in compressed video super-resolution | |
CN103501438B (en) | A kind of content-adaptive method for compressing image based on principal component analysis | |
CN105392009B (en) | Low bit rate image sequence coding method based on block adaptive sampling and super-resolution rebuilding | |
CN102123278A (en) | Signal source encoding method based on distributed compressive sensing technology | |
CN108419083B (en) | Image multilevel wavelet full subband compressed sensing coding method | |
CN109922339A (en) | In conjunction with the image coding framework of multi-sampling rate down-sampling and super-resolution rebuilding technology | |
Zhang et al. | A new image compression algorithm based on non-uniform partition and U-system | |
CN104333757B (en) | Based on the video coding-decoding method described CS measured values more | |
CN106385584A (en) | Spatial correlation-based distributed video compressive sensing adaptive sampling and coding method | |
CN110290386A (en) | A kind of low bit- rate human motion video coding system and method based on generation confrontation network | |
KR20200044667A (en) | AI encoding apparatus and operating method for the same, and AI decoding apparatus and operating method for the same | |
CN101272489A (en) | Encoding and decoding device and method for video image quality enhancement | |
US7778468B2 (en) | Decoding apparatus, dequantizing method, and program thereof | |
CN111757126A (en) | VR-oriented real-time image compression method, system and storage medium | |
Nascimento et al. | Improved two-dimensional dynamic S-EMG Signal compression with robust automatic segmentation | |
CN109743571B (en) | Image coding method based on parallel compressed sensing multilayer residual error coefficients | |
CN1825894A (en) | All phase cosine double orthogonal transformation and JPEG improving method | |
CN103167282B (en) | A kind of online updating method of image compression dynamic regulation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110907 Termination date: 20140515 |