CN105791876B - The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method - Google Patents
The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method Download PDFInfo
- Publication number
- CN105791876B CN105791876B CN201610144343.4A CN201610144343A CN105791876B CN 105791876 B CN105791876 B CN 105791876B CN 201610144343 A CN201610144343 A CN 201610144343A CN 105791876 B CN105791876 B CN 105791876B
- Authority
- CN
- China
- Prior art keywords
- pixel
- point
- median
- interpolation
- tap
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/53—Multi-resolution motion estimation; Hierarchical motion estimation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of HEVC being layered interpolation based on low complex degree to divide pixel motion estimating method.This method includes：Area-of-interest is initialized on whole pixel precision；Pixel original value is converted into the median of corresponding integer by linear transformation；1/2 point of pixel carries out interpolation calculation using 8 tap filters；Linear inversion obtains 1/2 image element interpolation filter result of original value；Motion vector refinement is to 1/2 point of pixel precision；Interpolation calculation is carried out using 6 tap filters to 1/2 point of pixel median in vertical direction；According to 1/2 point of pixel median that different tap filterings obtain, 1/4 point of pixel median is solved using its mean value；Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result；Motion vector refinement is to 1/4 point of pixel precision.The present invention can accelerate HEVC and divide pixel motion estimation procedure to improve coding rate, and then promote satisfaction of the encoder to real-time coding demand.
Description
Technical field
The present invention relates to divide pixel motion to estimate in HEVC, and in particular to a kind of HEVC being layered interpolation based on low complex degree
Divide pixel motion estimating method.
Background technology
Estimation is a part crucial in Video coding, is based primarily upon Block- matching and layering interpolation realizes that high-precision is transported
The solution of dynamic vector, and then release the redundancy of video in time.Wherein, Block- matching refers on reference frame according to corresponding
It is searched for criterion and obtains corresponding blocks and optimal matching blocks.And it refers to being asked by the interpolation calculation of multistage different accuracy to be layered interpolation
Solve the motion vector of different accuracy.Whether interpolation calculation is used according to estimation, estimation can be divided into whole pixel
Estimation and be divided to pixel motion estimate two parts.Although estimation can largely compress video, its
The complexity of body exacerbates binary encoding and takes, and the introducing that pixel motion is estimated especially is divided further to exacerbate the problem.
And the complexity for dividing pixel motion to estimate is concentrated mainly on its a large amount of interpolation calculation, particularly, in HEVC (high property
Can Video coding) in use the interpolation filter compared to H.264 more tap numbers.
For this purpose, some researchers attempt to get around complicated interpolation calculation process by establishing model of error estimate to add
Pixel motion is divided to estimate soon.Its main policies is estimated to establish second order error using best whole pixel and its neighbouring whole pixel
Curved surface, the minimum point quickening by solving second order error curved surface approach and most preferably divide pixel, to avoid excessive interpolation with
Search for matching process.Certainly, the premise that their strategies prove effective is to calculate the operation cost of minimum compared to interpolation and search matching
Process is much smaller.Wherein, more typically there are Salih Dikbas et al. (Salih Dikbas, Tarik Arici, Yucel
Altunbasak.Fast motion estimation with interpolation-freesub-sample accuracy
[J].Circuits and Systems for Video Technology,IEEE Transactions on,2010,20
(7):1047-1051.) carried second order error estimation model and some other researcher (Jing-Fu Chang, Jin-
Jang Leou.A quadratic prediction based fractional-pixel motion estimation
algorithm for H.264[J].Journal of Visual Communication and Image
Representation,2006,17(5):1074-1089.) " degeneration " second order error that its second order model simplification is formed is estimated
Model.Theirs the experimental results showed that, by model estimate method can largely reduce encoder complexity.
Other than establishing model of error estimate, threshold value control means (Tsuyoshi Sotetsumoto, Tian Song,
Takashi Shimamoto.Low complexity algorithm for sub-pixel motion estimation of
HEVC [C] .IEEE, 2013:1-4) also be used to reduce divides pixel motion to estimate complexity.
However, other researchers (Tokunbo Ogunfunmi, Obianuju Ndili, Pavel
Arnaudov.On low power fractional motion estimation algorithms for H.264[C]
.IEEE, 2012:The complexity of point pixel motion estimation 103-108) is primarily focused on in hard-wired influence, side
Interpolation Process is improved again to accelerate a point hardware realization for pixel motion estimation.
Invention content
In view of the deficiencies of the prior art, the present invention proposes a kind of HEVC points of pixels being layered interpolation based on low complex degree to transport
Dynamic method of estimation.
The present invention provides a kind of HEVC being layered interpolation based on low complex degree to divide pixel motion estimating method, this method packet
It includes：
Step 1：Area-of-interest is initialized on whole pixel precision；
Step 2：Pixel original value is converted into the median of corresponding integer by linear transformation；
Step 3：1/2 point of pixel carries out interpolation calculation using 8 tap filters；Specially：Following 8 are utilized to whole pixel
Tap FIR filters carry out filtering interpolation：{ -1,4, -11,40,40, -11,4, -1 } 1/2 point of pixel is obtained.
Step 4：Linear inversion obtains 1/2 image element interpolation filter result of original value；
Step 5：Motion vector refinement is to 1/2 point of pixel precision；
Step 6：1/2 point of pixel median in vertical direction carries out interpolation calculation using 6 tap filters；Specific packet
It includes：1/2 point of pixel on whole pixel and horizontal direction is filtered using following 6 tap FIR filters simultaneously:{1,-
5,20,20,-5,1}。
Step 7：1/2 point of pixel median is obtained according to different tap filterings, is solved among 1/4 point of pixel using mean value
Value；
Step 8：Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result；Motion vector
It is refined to 1/4 point of pixel precision.
Institute's extracting method can preferably take into account the complexity and code efficiency of software and hardware realization.
The 1/2 point of pixel median obtained according to different tap filterings in step 7 solves 1/4 point of pixel using its mean value
Median；1/2 point of pixel median that wherein different tap filterings obtain refers specifically to 1/2 point of pixel median in vertical direction and adopts
With step 6 result of calculation, 1/2 point of pixel median uses step 3 result of calculation in horizontal direction.
Advantageous effect：Coding rate is improved to accelerate to divide pixel motion estimation procedure, and then promotes encoder to real-time
The satisfaction of code requirement.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, will make below to required in the embodiment of the present invention
Attached drawing is briefly described, it should be apparent that, drawings described below is only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is the particular flow sheet of the present invention；
Fig. 2 is the corresponding memory module schematic diagram of different accuracy pixel；
Fig. 3 is 1/2 image element interpolation module diagram；
Fig. 4 is 1/4 image element interpolation module diagram.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiment is a part of the embodiment of the present invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other reality that those of ordinary skill in the art are obtained without making creative work
Example is applied, the scope of protection of the invention should be all belonged to.
As shown in Figure 1, a kind of HEVC being layered interpolation based on low complex degree divides pixel motion estimating method, this method packet
It includes：
Step 1：Area-of-interest is initialized on whole pixel precision；
Step 2：Pixel original value is converted into the median of corresponding integer by linear transformation；
Step 3：1/2 point of pixel carries out interpolation calculation using 8 tap filters；
Step 4：Linear inversion obtains 1/2 image element interpolation filter result of original value；
Step 5：Motion vector refinement is to 1/2 point of pixel precision；
Step 6：Interpolation calculation is carried out again using 6 tap filters；
Step 7：1/2 point of pixel median is obtained according to different tap filterings, is solved among 1/4 point of pixel using mean value
Value；
Step 8：Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result；Motion vector
It is refined to 1/4 point of pixel precision.
Fig. 2 shows different accuracy location of pixels relationships.As shown in Fig. 2, whole pixel is stored in memory module (0,0)
In, it is stored in memory module (0,2) with 1/2 point of pixel in whole pixel same level direction, it is same vertical with whole pixel
1/2 point of pixel in direction is stored in memory module (2,0), and remaining 1/2 point of pixel is stored in memory module (2,2)
In.
Fig. 3 shows 1/2 image element interpolation module diagram.As shown in figure 3, this method includes：Linear transformation, Ke Yitong
It crosses the operations such as displacement, addition and realizes that rapid translating is used for intermediate computations at corresponding integer data；
For subsequently calculating in direct copying whole pixel deposit caching 0.
Calculating is filtered in the horizontal direction using 8 tap FIR filters in HEVC to whole pixel and is stored in result slow
It deposits in 2.
It is copied directly in memory module (0,0) after value in caching 0 is carried out corresponding linear inversion.
Vertical direction filtering is carried out using HEVC8 tap FIR filters to the value in caching 0 and is carried out result corresponding
Linear inversion is stored in memory module (2,0).
It is copied directly in memory module (0,2) after value in caching 2 is carried out corresponding linear inversion.
Similarly, to caching 2 in value using HEVC8 tap FIR filters carry out vertical direction filtering and by result into
In the corresponding linear inversion deposit memory module (2,2) of row.
Estimate to obtain motion vector and 1/2 image element interpolation as a result, being refined to motion vector according to whole pixel motion
Obtain the motion vector of 1/2 point of pixel precision.
Fig. 4 shows 1/4 image element interpolation module diagram.As shown in figure 4, this method includes：
The value of caching 0 is filtered using 6 tap FIR filters H.264 and is stored in result slow in vertical direction
It deposits in 1.
Similarly, the value of caching 2 is filtered in vertical direction using 6 tap FIR filters H.264 and by result
In deposit caching 3.
According to the result of calculation of caching 0,1,2,3,1/4 point of pixel is calculated separately by the way of the solution of adjacency mean value
Value, and by final calculation result carry out corresponding linear inversion be stored in respectively memory module (3,0), (1,1), (0,1),
(1,0), (3,1), (0,3), (1,3), (2,1), (3,2), (3,3), (2,3), (1,2).
Motion vector and 1/4 image element interpolation are obtained as a result, carrying out essence to motion vector according to 1/2 point of pixel motion estimation
Refining obtains the motion vector of 1/4 point of pixel precision.
The method of the embodiment of the present invention is mainly used in HEVC coding standards, divides pixel motion to estimate for improving it
Complexity, meanwhile, ensure coding compression performance.
Those of ordinary skill in the art may realize that each method steps in conjunction with described in the embodiments described herein
Rapid and unit, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and soft
The interchangeability of part, the step of generally describing each embodiment according to function in the above description and composition.These
Function is implemented in hardware or software actually, depends on the specific application and design constraint of technical solution.Ability
Domain those of ordinary skill can use different methods to achieve the described function each specific application, but this reality
Now it should not be considered as beyond the scope of the present invention.
Method or step described in conjunction with the examples disclosed in this document can use the software journey that hardware, processor execute
The combination of sequence or the two is implemented.Software program can be placed in random access memory (RAM), memory, read-only memory (ROM),
Institute is public in electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field
In any other form of storage medium known.
Although by reference to attached drawing and combining the mode of preferred embodiment to the present invention have been described in detail, the present invention
It is not limited to this.Without departing from the spirit and substance of the premise in the present invention, those of ordinary skill in the art can be to the present invention
Embodiment carry out various equivalent modifications or substitutions, and these modifications or substitutions all should be in the covering scope of the present invention.
Claims (1)
1. the HEVC for being layered interpolation based on low complex degree divides pixel motion estimating method, which is characterized in that this method includes：
Step 1：Area-of-interest is initialized on whole pixel precision；
Step 2：Pixel original value is converted into the median of corresponding integer by linear transformation；
Step 3：1/2 point of pixel carries out interpolation calculation using 8 tap filters；Specially：Following 8 tap is utilized to whole pixel
FIR filter carries out filtering interpolation：{ -1,4, -11,40,40, -11,4, -1 } median of 1/2 point of pixel is obtained；
Step 4：Linear inversion obtains 1/2 image element interpolation filter result of original value；
Step 5：Motion vector refinement is to 1/2 point of pixel precision；
Step 6：1/2 point of pixel median in vertical direction carries out interpolation calculation using 6 tap filters；It specifically includes：It is right
1/2 point of pixel on whole pixel and horizontal direction is filtered using following 6 tap FIR filters simultaneously:{1,-5,20,
20,-5,1}；
Step 7：According to 1/2 point of pixel median that different tap filterings obtain, solved among 1/4 point of pixel using its mean value
Value；1/2 point of pixel median that wherein different tap filterings obtain refers specifically to 1/2 point of pixel median in vertical direction and uses step
Rapid six result of calculation, 1/2 point of pixel median uses step 3 result of calculation in horizontal direction；
Step 8：Inverse transformation is carried out to 1/4 point of pixel median and obtains final 1/4 image element interpolation result；Motion vector refinement
To 1/4 point of pixel precision.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610144343.4A CN105791876B (en) | 2016-03-14 | 2016-03-14 | The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610144343.4A CN105791876B (en) | 2016-03-14 | 2016-03-14 | The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105791876A CN105791876A (en) | 2016-07-20 |
| CN105791876B true CN105791876B (en) | 2018-11-13 |
Family
ID=56392749
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610144343.4A Active CN105791876B (en) | 2016-03-14 | 2016-03-14 | The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105791876B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106658024B (en) * | 2016-10-20 | 2019-07-16 | 杭州当虹科技股份有限公司 | A kind of quick method for video coding |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198063A (en) * | 2006-12-05 | 2008-06-11 | 华为技术有限公司 | Encoding and decoding method and device, image element interpolation processing method and device |
| CN102497550A (en) * | 2011-12-05 | 2012-06-13 | 南京大学 | Parallel acceleration method and device for motion compensation interpolation in H.264 encoding |
| CN102833550A (en) * | 2012-09-03 | 2012-12-19 | 北京大学深圳研究生院 | Low-complexity sub-pixel interpolation filter |
| CN103747269A (en) * | 2013-09-30 | 2014-04-23 | 北京大学深圳研究生院 | Filter interpolation method and filter |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140078394A1 (en) * | 2012-09-17 | 2014-03-20 | General Instrument Corporation | Selective use of chroma interpolation filters in luma interpolation process |
-
2016
- 2016-03-14 CN CN201610144343.4A patent/CN105791876B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198063A (en) * | 2006-12-05 | 2008-06-11 | 华为技术有限公司 | Encoding and decoding method and device, image element interpolation processing method and device |
| CN102497550A (en) * | 2011-12-05 | 2012-06-13 | 南京大学 | Parallel acceleration method and device for motion compensation interpolation in H.264 encoding |
| CN102833550A (en) * | 2012-09-03 | 2012-12-19 | 北京大学深圳研究生院 | Low-complexity sub-pixel interpolation filter |
| CN103747269A (en) * | 2013-09-30 | 2014-04-23 | 北京大学深圳研究生院 | Filter interpolation method and filter |
Non-Patent Citations (5)
| Title |
|---|
| 1/2 and 1/4 pixel paralleled fme with a scalable search pattern for hevc Ultra-HD encoding;Dandan ding，Xin Ye，Silong Wang;《Proceedings of ICCT 2015》;20151020;全文 * |
| a low complexity and high performance interpolation filter for MPEG IVC;Hao Lv,Ronggang Wang,Yangang Cai;《proceedings of the 19th international conference on digital signal processing》;20140823;全文 * |
| an optimally scalable and cost-effective fractional-pixel motion estimation algorithm for Hevc;huang Li,Yihao Zhang,Hongyang Chao;《ICASSP 2013》;20130531;全文 * |
| 基于DCT的HEVC帧内预测快速算法研究及优化;桂祁平;《中国优秀硕士学位论文全文数据库》;20140715;全文 * |
| 基于SSE2对H.265/HEVC中分像素插值的优化;陈丽丽，沈燕飞，邓米克，蔡志峰;《计算机工程与应用》;20140312;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105791876A (en) | 2016-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8374456B2 (en) | Method for synthesizing a virtual image from a reduced resolution depth image | |
| CN107016642B (en) | Method and apparatus for resolution up-scaling of noisy input images | |
| JP5419744B2 (en) | How to synthesize a virtual image | |
| JP5291133B2 (en) | Image processing method, image processing apparatus, video encoding / decoding method, video encoding / decoding apparatus, and programs thereof | |
| EP1925159A2 (en) | Adaptive area of influence filter for moving object boundaries | |
| JP2010218549A (en) | Method for filtering depth image | |
| CN107172322B (en) | Video noise reduction method and device | |
| TW201023654A (en) | An efficient adaptive mode selection technique for H.264/AVC-coded video delivery in burst-packet-loss networks | |
| CN111915487A (en) | Face super-resolution method and device based on hierarchical multi-scale residual fusion network | |
| CN110322404B (en) | Image enhancement method and system | |
| CN107301662A (en) | Compression restoration methods, device, equipment and the storage medium of depth image | |
| Khan et al. | Efficient edge-based image interpolation method using neighboring slope information | |
| CN105791876B (en) | The HEVC that interpolation is layered based on low complex degree divides pixel motion estimating method | |
| CN115131229A (en) | Image noise reduction and filtering data processing method and device and computer equipment | |
| Wang et al. | Compressed screen content image super resolution | |
| CN116385312A (en) | Low-illumination image denoising method based on phase correlation | |
| CN110766117B (en) | Two-dimensional code generation method and system | |
| CN113382126B (en) | Image reversible information hiding method and system based on attention guidance | |
| Qin et al. | Blind Single-Image Super Resolution Reconstruction with Gaussian Blur and Pepper & Salt Noise. | |
| CN106157252B (en) | A kind of image processing method and image processing apparatus | |
| CN103079074A (en) | Block matching method and module and motion estimation method and device | |
| Kong et al. | Contour enhanced image super-resolution | |
| CN110738612A (en) | Method for reducing noise of X-ray perspective image and computer readable storage medium | |
| CN105637865B (en) | Image prediction processing method and relevant device | |
| CN113615197B (en) | Method and apparatus for bit depth control of bi-directional optical flow |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201109 Address after: 310016 room 3003-1, building 1, Gaode land center, Jianggan District, Hangzhou City, Zhejiang Province Patentee after: Zhejiang Zhiduo Network Technology Co.,Ltd. Address before: Hangzhou City, Zhejiang province 310018 Xiasha Higher Education Park No. 2 street Patentee before: HANGZHOU DIANZI University |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201202 Address after: Room 1004-3, building 8, 3333 Guangyi Road, Daqiao Town, Nanhu District, Jiaxing City, Zhejiang Province Patentee after: Jiaxing Huaji Environmental Protection Technology Co., Ltd Address before: 310016 room 3003-1, building 1, Gaode land center, Jianggan District, Hangzhou City, Zhejiang Province Patentee before: Zhejiang Zhiduo Network Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |