CN105791876B - The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method - Google Patents

The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method Download PDF

Info

Publication number
CN105791876B
CN105791876B CN201610144343.4A CN201610144343A CN105791876B CN 105791876 B CN105791876 B CN 105791876B CN 201610144343 A CN201610144343 A CN 201610144343A CN 105791876 B CN105791876 B CN 105791876B
Authority
CN
China
Prior art keywords
pixel
point
median
interpolation
tap
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610144343.4A
Other languages
Chinese (zh)
Other versions
CN105791876A (en
Inventor
蒋洁
刘敬彪
叶德周
潘勉
蔡文郁
于海滨
盛庆华
刘圆圆
顾梅园
孔庆鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiaxing Huaji Environmental Protection Technology Co Ltd
Original Assignee
Hangzhou Dianzi University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dianzi University filed Critical Hangzhou Dianzi University
Priority to CN201610144343.4A priority Critical patent/CN105791876B/en
Publication of CN105791876A publication Critical patent/CN105791876A/en
Application granted granted Critical
Publication of CN105791876B publication Critical patent/CN105791876B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/523Motion estimation or motion compensation with sub-pixel accuracy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/53Multi-resolution motion estimation; Hierarchical motion estimation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses a kind of HEVC being layered interpolation based on low complex degree to divide pixel motion estimating method.This method includes:Area-of-interest is initialized on whole pixel precision;Pixel original value is converted into the median of corresponding integer by linear transformation;1/2 point of pixel carries out interpolation calculation using 8 tap filters;Linear inversion obtains 1/2 image element interpolation filter result of original value;Motion vector refinement is to 1/2 point of pixel precision;Interpolation calculation is carried out using 6 tap filters to 1/2 point of pixel median in vertical direction;According to 1/2 point of pixel median that different tap filterings obtain, 1/4 point of pixel median is solved using its mean value;Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result;Motion vector refinement is to 1/4 point of pixel precision.The present invention can accelerate HEVC and divide pixel motion estimation procedure to improve coding rate, and then promote satisfaction of the encoder to real-time coding demand.

Description

The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method
Technical field
The present invention relates to divide pixel motion to estimate in HEVC, and in particular to a kind of HEVC being layered interpolation based on low complex degree Divide pixel motion estimating method.
Background technology
Estimation is a part crucial in Video coding, is based primarily upon Block- matching and layering interpolation realizes that high-precision is transported The solution of dynamic vector, and then release the redundancy of video in time.Wherein, Block- matching refers on reference frame according to corresponding It is searched for criterion and obtains corresponding blocks and optimal matching blocks.And it refers to being asked by the interpolation calculation of multistage different accuracy to be layered interpolation Solve the motion vector of different accuracy.Whether interpolation calculation is used according to estimation, estimation can be divided into whole pixel Estimation and be divided to pixel motion estimate two parts.Although estimation can largely compress video, its The complexity of body exacerbates binary encoding and takes, and the introducing that pixel motion is estimated especially is divided further to exacerbate the problem.
And the complexity for dividing pixel motion to estimate is concentrated mainly on its a large amount of interpolation calculation, particularly, in HEVC (high property Can Video coding) in use the interpolation filter compared to H.264 more tap numbers.
For this purpose, some researchers attempt to get around complicated interpolation calculation process by establishing model of error estimate to add Pixel motion is divided to estimate soon.Its main policies is estimated to establish second order error using best whole pixel and its neighbouring whole pixel Curved surface, the minimum point quickening by solving second order error curved surface approach and most preferably divide pixel, to avoid excessive interpolation with Search for matching process.Certainly, the premise that their strategies prove effective is to calculate the operation cost of minimum compared to interpolation and search matching Process is much smaller.Wherein, more typically there are Salih Dikbas et al. (Salih Dikbas, Tarik Arici, Yucel Altunbasak.Fast motion estimation with interpolation-freesub-sample accuracy [J].Circuits and Systems for Video Technology,IEEE Transactions on,2010,20 (7):1047-1051.) carried second order error estimation model and some other researcher (Jing-Fu Chang, Jin- Jang Leou.A quadratic prediction based fractional-pixel motion estimation algorithm for H.264[J].Journal of Visual Communication and Image Representation,2006,17(5):1074-1089.) " degeneration " second order error that its second order model simplification is formed is estimated Model.Theirs the experimental results showed that, by model estimate method can largely reduce encoder complexity.
Other than establishing model of error estimate, threshold value control means (Tsuyoshi Sotetsumoto, Tian Song, Takashi Shimamoto.Low complexity algorithm for sub-pixel motion estimation of HEVC [C] .IEEE, 2013:1-4) also be used to reduce divides pixel motion to estimate complexity.
However, other researchers (Tokunbo Ogunfunmi, Obianuju Ndili, Pavel Arnaudov.On low power fractional motion estimation algorithms for H.264[C] .IEEE, 2012:The complexity of point pixel motion estimation 103-108) is primarily focused on in hard-wired influence, side Interpolation Process is improved again to accelerate a point hardware realization for pixel motion estimation.
Invention content
In view of the deficiencies of the prior art, the present invention proposes a kind of HEVC points of pixels being layered interpolation based on low complex degree to transport Dynamic method of estimation.
The present invention provides a kind of HEVC being layered interpolation based on low complex degree to divide pixel motion estimating method, this method packet It includes:
Step 1:Area-of-interest is initialized on whole pixel precision;
Step 2:Pixel original value is converted into the median of corresponding integer by linear transformation;
Step 3:1/2 point of pixel carries out interpolation calculation using 8 tap filters;Specially:Following 8 are utilized to whole pixel Tap FIR filters carry out filtering interpolation:{ -1,4, -11,40,40, -11,4, -1 } 1/2 point of pixel is obtained.
Step 4:Linear inversion obtains 1/2 image element interpolation filter result of original value;
Step 5:Motion vector refinement is to 1/2 point of pixel precision;
Step 6:1/2 point of pixel median in vertical direction carries out interpolation calculation using 6 tap filters;Specific packet It includes:1/2 point of pixel on whole pixel and horizontal direction is filtered using following 6 tap FIR filters simultaneously:{1,- 5,20,20,-5,1}。
Step 7:1/2 point of pixel median is obtained according to different tap filterings, is solved among 1/4 point of pixel using mean value Value;
Step 8:Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result;Motion vector It is refined to 1/4 point of pixel precision.
Institute's extracting method can preferably take into account the complexity and code efficiency of software and hardware realization.
The 1/2 point of pixel median obtained according to different tap filterings in step 7 solves 1/4 point of pixel using its mean value Median;1/2 point of pixel median that wherein different tap filterings obtain refers specifically to 1/2 point of pixel median in vertical direction and adopts With step 6 result of calculation, 1/2 point of pixel median uses step 3 result of calculation in horizontal direction.
Advantageous effect:Coding rate is improved to accelerate to divide pixel motion estimation procedure, and then promotes encoder to real-time The satisfaction of code requirement.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, will make below to required in the embodiment of the present invention Attached drawing is briefly described, it should be apparent that, drawings described below is only some embodiments of the present invention, for For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings Attached drawing.
Fig. 1 is the particular flow sheet of the present invention;
Fig. 2 is the corresponding memory module schematic diagram of different accuracy pixel;
Fig. 3 is 1/2 image element interpolation module diagram;
Fig. 4 is 1/4 image element interpolation module diagram.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiment is a part of the embodiment of the present invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other reality that those of ordinary skill in the art are obtained without making creative work Example is applied, the scope of protection of the invention should be all belonged to.
As shown in Figure 1, a kind of HEVC being layered interpolation based on low complex degree divides pixel motion estimating method, this method packet It includes:
Step 1:Area-of-interest is initialized on whole pixel precision;
Step 2:Pixel original value is converted into the median of corresponding integer by linear transformation;
Step 3:1/2 point of pixel carries out interpolation calculation using 8 tap filters;
Step 4:Linear inversion obtains 1/2 image element interpolation filter result of original value;
Step 5:Motion vector refinement is to 1/2 point of pixel precision;
Step 6:Interpolation calculation is carried out again using 6 tap filters;
Step 7:1/2 point of pixel median is obtained according to different tap filterings, is solved among 1/4 point of pixel using mean value Value;
Step 8:Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result;Motion vector It is refined to 1/4 point of pixel precision.
Fig. 2 shows different accuracy location of pixels relationships.As shown in Fig. 2, whole pixel is stored in memory module (0,0) In, it is stored in memory module (0,2) with 1/2 point of pixel in whole pixel same level direction, it is same vertical with whole pixel 1/2 point of pixel in direction is stored in memory module (2,0), and remaining 1/2 point of pixel is stored in memory module (2,2) In.
Fig. 3 shows 1/2 image element interpolation module diagram.As shown in figure 3, this method includes:Linear transformation, Ke Yitong It crosses the operations such as displacement, addition and realizes that rapid translating is used for intermediate computations at corresponding integer data;
For subsequently calculating in direct copying whole pixel deposit caching 0.
Calculating is filtered in the horizontal direction using 8 tap FIR filters in HEVC to whole pixel and is stored in result slow It deposits in 2.
It is copied directly in memory module (0,0) after value in caching 0 is carried out corresponding linear inversion.
Vertical direction filtering is carried out using HEVC8 tap FIR filters to the value in caching 0 and is carried out result corresponding Linear inversion is stored in memory module (2,0).
It is copied directly in memory module (0,2) after value in caching 2 is carried out corresponding linear inversion.
Similarly, to caching 2 in value using HEVC8 tap FIR filters carry out vertical direction filtering and by result into In the corresponding linear inversion deposit memory module (2,2) of row.
Estimate to obtain motion vector and 1/2 image element interpolation as a result, being refined to motion vector according to whole pixel motion Obtain the motion vector of 1/2 point of pixel precision.
Fig. 4 shows 1/4 image element interpolation module diagram.As shown in figure 4, this method includes:
The value of caching 0 is filtered using 6 tap FIR filters H.264 and is stored in result slow in vertical direction It deposits in 1.
Similarly, the value of caching 2 is filtered in vertical direction using 6 tap FIR filters H.264 and by result In deposit caching 3.
According to the result of calculation of caching 0,1,2,3,1/4 point of pixel is calculated separately by the way of the solution of adjacency mean value Value, and by final calculation result carry out corresponding linear inversion be stored in respectively memory module (3,0), (1,1), (0,1), (1,0), (3,1), (0,3), (1,3), (2,1), (3,2), (3,3), (2,3), (1,2).
Motion vector and 1/4 image element interpolation are obtained as a result, carrying out essence to motion vector according to 1/2 point of pixel motion estimation Refining obtains the motion vector of 1/4 point of pixel precision.
The method of the embodiment of the present invention is mainly used in HEVC coding standards, divides pixel motion to estimate for improving it Complexity, meanwhile, ensure coding compression performance.
Those of ordinary skill in the art may realize that each method steps in conjunction with described in the embodiments described herein Rapid and unit, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and soft The interchangeability of part, the step of generally describing each embodiment according to function in the above description and composition.These Function is implemented in hardware or software actually, depends on the specific application and design constraint of technical solution.Ability Domain those of ordinary skill can use different methods to achieve the described function each specific application, but this reality Now it should not be considered as beyond the scope of the present invention.
Method or step described in conjunction with the examples disclosed in this document can use the software journey that hardware, processor execute The combination of sequence or the two is implemented.Software program can be placed in random access memory (RAM), memory, read-only memory (ROM), Institute is public in electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field In any other form of storage medium known.
Although by reference to attached drawing and combining the mode of preferred embodiment to the present invention have been described in detail, the present invention It is not limited to this.Without departing from the spirit and substance of the premise in the present invention, those of ordinary skill in the art can be to the present invention Embodiment carry out various equivalent modifications or substitutions, and these modifications or substitutions all should be in the covering scope of the present invention.

Claims (1)

1. the HEVC for being layered interpolation based on low complex degree divides pixel motion estimating method, which is characterized in that this method includes:
Step 1:Area-of-interest is initialized on whole pixel precision;
Step 2:Pixel original value is converted into the median of corresponding integer by linear transformation;
Step 3:1/2 point of pixel carries out interpolation calculation using 8 tap filters;Specially:Following 8 tap is utilized to whole pixel FIR filter carries out filtering interpolation:{ -1,4, -11,40,40, -11,4, -1 } median of 1/2 point of pixel is obtained;
Step 4:Linear inversion obtains 1/2 image element interpolation filter result of original value;
Step 5:Motion vector refinement is to 1/2 point of pixel precision;
Step 6:1/2 point of pixel median in vertical direction carries out interpolation calculation using 6 tap filters;It specifically includes:It is right 1/2 point of pixel on whole pixel and horizontal direction is filtered using following 6 tap FIR filters simultaneously:{1,-5,20, 20,-5,1};
Step 7:According to 1/2 point of pixel median that different tap filterings obtain, solved among 1/4 point of pixel using its mean value Value;1/2 point of pixel median that wherein different tap filterings obtain refers specifically to 1/2 point of pixel median in vertical direction and uses step Rapid six result of calculation, 1/2 point of pixel median uses step 3 result of calculation in horizontal direction;
Step 8:Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result;Motion vector refinement To 1/4 point of pixel precision.
CN201610144343.4A 2016-03-14 2016-03-14 The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method Active CN105791876B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610144343.4A CN105791876B (en) 2016-03-14 2016-03-14 The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610144343.4A CN105791876B (en) 2016-03-14 2016-03-14 The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method

Publications (2)

Publication Number Publication Date
CN105791876A CN105791876A (en) 2016-07-20
CN105791876B true CN105791876B (en) 2018-11-13

Family

ID=56392749

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610144343.4A Active CN105791876B (en) 2016-03-14 2016-03-14 The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method

Country Status (1)

Country Link
CN (1) CN105791876B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106658024B (en) * 2016-10-20 2019-07-16 杭州当虹科技股份有限公司 A kind of quick method for video coding

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101198063A (en) * 2006-12-05 2008-06-11 华为技术有限公司 Encoding and decoding method and device, image element interpolation processing method and device
CN102497550A (en) * 2011-12-05 2012-06-13 南京大学 Parallel acceleration method and device for motion compensation interpolation in H.264 encoding
CN102833550A (en) * 2012-09-03 2012-12-19 北京大学深圳研究生院 Low-complexity sub-pixel interpolation filter
CN103747269A (en) * 2013-09-30 2014-04-23 北京大学深圳研究生院 Filter interpolation method and filter

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140078394A1 (en) * 2012-09-17 2014-03-20 General Instrument Corporation Selective use of chroma interpolation filters in luma interpolation process

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101198063A (en) * 2006-12-05 2008-06-11 华为技术有限公司 Encoding and decoding method and device, image element interpolation processing method and device
CN102497550A (en) * 2011-12-05 2012-06-13 南京大学 Parallel acceleration method and device for motion compensation interpolation in H.264 encoding
CN102833550A (en) * 2012-09-03 2012-12-19 北京大学深圳研究生院 Low-complexity sub-pixel interpolation filter
CN103747269A (en) * 2013-09-30 2014-04-23 北京大学深圳研究生院 Filter interpolation method and filter

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
1/2 and 1/4 pixel paralleled fme with a scalable search pattern for hevc Ultra-HD encoding;Dandan ding,Xin Ye,Silong Wang;《Proceedings of ICCT 2015》;20151020;全文 *
a low complexity and high performance interpolation filter for MPEG IVC;Hao Lv,Ronggang Wang,Yangang Cai;《proceedings of the 19th international conference on digital signal processing》;20140823;全文 *
an optimally scalable and cost-effective fractional-pixel motion estimation algorithm for Hevc;huang Li,Yihao Zhang,Hongyang Chao;《ICASSP 2013》;20130531;全文 *
基于DCT的HEVC帧内预测快速算法研究及优化;桂祁平;《中国优秀硕士学位论文全文数据库》;20140715;全文 *
基于SSE2对H.265/HEVC中分像素插值的优化;陈丽丽,沈燕飞,邓米克,蔡志峰;《计算机工程与应用》;20140312;全文 *

Also Published As

Publication number Publication date
CN105791876A (en) 2016-07-20

Similar Documents

Publication Publication Date Title
US8374456B2 (en) Method for synthesizing a virtual image from a reduced resolution depth image
CN107016642B (en) Method and apparatus for resolution up-scaling of noisy input images
JP5419744B2 (en) How to synthesize a virtual image
JP5291133B2 (en) Image processing method, image processing apparatus, video encoding / decoding method, video encoding / decoding apparatus, and programs thereof
EP1925159A2 (en) Adaptive area of influence filter for moving object boundaries
JP2010218549A (en) Method for filtering depth image
CN107172322B (en) Video noise reduction method and device
TW201023654A (en) An efficient adaptive mode selection technique for H.264/AVC-coded video delivery in burst-packet-loss networks
CN111915487A (en) Face super-resolution method and device based on hierarchical multi-scale residual fusion network
CN110322404B (en) Image enhancement method and system
CN107301662A (en) Compression restoration methods, device, equipment and the storage medium of depth image
Khan et al. Efficient edge-based image interpolation method using neighboring slope information
CN105791876B (en) The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method
CN115131229A (en) Image noise reduction and filtering data processing method and device and computer equipment
Wang et al. Compressed screen content image super resolution
CN116385312A (en) Low-illumination image denoising method based on phase correlation
CN110766117B (en) Two-dimensional code generation method and system
CN113382126B (en) Image reversible information hiding method and system based on attention guidance
Qin et al. Blind Single-Image Super Resolution Reconstruction with Gaussian Blur and Pepper & Salt Noise.
CN106157252B (en) A kind of image processing method and image processing apparatus
CN103079074A (en) Block matching method and module and motion estimation method and device
Kong et al. Contour enhanced image super-resolution
CN110738612A (en) Method for reducing noise of X-ray perspective image and computer readable storage medium
CN105637865B (en) Image prediction processing method and relevant device
CN113615197B (en) Method and apparatus for bit depth control of bi-directional optical flow

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20201109

Address after: 310016 room 3003-1, building 1, Gaode land center, Jianggan District, Hangzhou City, Zhejiang Province

Patentee after: Zhejiang Zhiduo Network Technology Co.,Ltd.

Address before: Hangzhou City, Zhejiang province 310018 Xiasha Higher Education Park No. 2 street

Patentee before: HANGZHOU DIANZI University

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20201202

Address after: Room 1004-3, building 8, 3333 Guangyi Road, Daqiao Town, Nanhu District, Jiaxing City, Zhejiang Province

Patentee after: Jiaxing Huaji Environmental Protection Technology Co., Ltd

Address before: 310016 room 3003-1, building 1, Gaode land center, Jianggan District, Hangzhou City, Zhejiang Province

Patentee before: Zhejiang Zhiduo Network Technology Co.,Ltd.

TR01 Transfer of patent right