WO2007038357A3 - Multi-dimensional neighboring block prediction for video encoding - Google Patents

Multi-dimensional neighboring block prediction for video encoding Download PDF

Info

Publication number
WO2007038357A3
WO2007038357A3 PCT/US2006/037130 US2006037130W WO2007038357A3 WO 2007038357 A3 WO2007038357 A3 WO 2007038357A3 US 2006037130 W US2006037130 W US 2006037130W WO 2007038357 A3 WO2007038357 A3 WO 2007038357A3
Authority
WO
WIPO (PCT)
Prior art keywords
search engine
video block
dimensional pipeline
motion estimation
video encoding
Prior art date
Application number
PCT/US2006/037130
Other languages
French (fr)
Other versions
WO2007038357A2 (en
Inventor
Kai Wang
Narendranath Malayath
Raghavendra C Nagaraj
Original Assignee
Qualcomm Inc
Kai Wang
Narendranath Malayath
Raghavendra C Nagaraj
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc, Kai Wang, Narendranath Malayath, Raghavendra C Nagaraj filed Critical Qualcomm Inc
Priority to CN2006800416881A priority Critical patent/CN101305615B/en
Priority to AT06815254T priority patent/ATE518372T1/en
Priority to EP06815254A priority patent/EP1958448B1/en
Priority to JP2008532452A priority patent/JP2009510845A/en
Publication of WO2007038357A2 publication Critical patent/WO2007038357A2/en
Publication of WO2007038357A3 publication Critical patent/WO2007038357A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/57—Motion estimation characterised by a search window with variable size or shape
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H04N19/197—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters including determination of the initial value of an encoding parameter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/43—Hardware specially adapted for motion estimation or compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H04N19/52—Processing of motion vectors by encoding by predictive encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/56—Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/567—Motion estimation based on rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Abstract

The motion estimation techniques and video encoding device(s) described use a two dimensional pipeline to generate accurate motion estimation parameters for a current video block. The two dimensional pipeline uses previously calculated motion estimation parameters of relevant neighboring video blocks, including a preceding video block on a same row as the current video block, prior to the generation of the accurate motion vectors, motion vector predictors, and mode decision of the current video block The use of the two dimensional pipeline allows accurate motion vector prediction from neighboring video blocks previously not available, in the computation of motion vectors. Three engines may be used in the two dimensional pipeline, a fetch engine, an integer search engine and a fractional and spatial search engine. While the fetch engine and fraction and spatial search engine operate on one row, the integer search engine operates on another row.
PCT/US2006/037130 2005-09-22 2006-09-22 Multi-dimensional neighboring block prediction for video encoding WO2007038357A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN2006800416881A CN101305615B (en) 2005-09-22 2006-09-22 Multi-dimensional neighboring block prediction for video encoding
AT06815254T ATE518372T1 (en) 2005-09-22 2006-09-22 MULTI-DIMENSIONAL ADJACENT BLOCK PEDICTION FOR VIDEO CODING
EP06815254A EP1958448B1 (en) 2005-09-22 2006-09-22 Multi-dimensional neighboring block prediction for video encoding
JP2008532452A JP2009510845A (en) 2005-09-22 2006-09-22 Multidimensional neighborhood block prediction for video encoding

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US71989105P 2005-09-22 2005-09-22
US60/719,891 2005-09-22
US11/533,745 US8761259B2 (en) 2005-09-22 2006-09-20 Multi-dimensional neighboring block prediction for video encoding
US11/533,745 2006-09-20

Publications (2)

Publication Number Publication Date
WO2007038357A2 WO2007038357A2 (en) 2007-04-05
WO2007038357A3 true WO2007038357A3 (en) 2007-05-18

Family

ID=37810755

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/037130 WO2007038357A2 (en) 2005-09-22 2006-09-22 Multi-dimensional neighboring block prediction for video encoding

Country Status (7)

Country Link
US (1) US8761259B2 (en)
EP (1) EP1958448B1 (en)
JP (1) JP2009510845A (en)
KR (1) KR100955152B1 (en)
CN (1) CN101305615B (en)
AT (1) ATE518372T1 (en)
WO (1) WO2007038357A2 (en)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060120612A1 (en) * 2004-12-08 2006-06-08 Sharath Manjunath Motion estimation techniques for video encoding
US7683910B2 (en) * 2006-06-29 2010-03-23 Microsoft Corporation Strategies for lossy compression of textures
KR100827093B1 (en) * 2006-10-13 2008-05-02 삼성전자주식회사 Method for video encoding and apparatus for the same
JP4898415B2 (en) * 2006-12-19 2012-03-14 キヤノン株式会社 Moving picture coding apparatus and moving picture coding method
US8127233B2 (en) * 2007-09-24 2012-02-28 Microsoft Corporation Remote user interface updates using difference and motion encoding
US8619877B2 (en) * 2007-10-11 2013-12-31 Microsoft Corporation Optimized key frame caching for remote interface rendering
US8121423B2 (en) 2007-10-12 2012-02-21 Microsoft Corporation Remote user interface raster segment motion detection and encoding
US8106909B2 (en) * 2007-10-13 2012-01-31 Microsoft Corporation Common key frame caching for a remote user interface
EP2051530A2 (en) * 2007-10-17 2009-04-22 Electronics and Telecommunications Research Institute Video encoding apparatus and method using pipeline technique with variable time slot
KR100939917B1 (en) 2008-03-07 2010-02-03 에스케이 텔레콤주식회사 Encoding system using motion estimation and encoding method using motion estimation
KR101364195B1 (en) 2008-06-26 2014-02-21 에스케이텔레콤 주식회사 Method and Apparatus for Encoding and Decoding Motion Vector
KR101522850B1 (en) * 2010-01-14 2015-05-26 삼성전자주식회사 Method and apparatus for encoding/decoding motion vector
TWI404422B (en) * 2010-04-14 2013-08-01 Himax Tech Ltd Method and system of hierarchical motion estimation
KR20120016991A (en) * 2010-08-17 2012-02-27 오수미 Inter prediction process
CA2807780C (en) 2010-09-24 2018-09-18 Panasonic Corporation Image coding method, image decoding method, image coding apparatus, and image decoding apparatus
MX2013008691A (en) * 2011-02-10 2013-08-21 Panasonic Corp Moving picture encoding method, moving picture encoding device, moving picture decoding method, moving picture decoding device, and moving picture encoding decoding device.
KR101809879B1 (en) * 2011-09-28 2017-12-15 가부시키가이샤 제이브이씨 켄우드 Video encoding device, video encoding method and recording medium storing video encoding program
CN102339592A (en) * 2011-09-29 2012-02-01 中山大学 Video memory compression method based on LCD (liquid crystal display) controller
TWI523497B (en) * 2011-11-10 2016-02-21 Sony Corp Image processing apparatus and method
US20130235926A1 (en) * 2012-03-07 2013-09-12 Broadcom Corporation Memory efficient video parameter processing
US9277222B2 (en) * 2012-05-14 2016-03-01 Qualcomm Incorporated Unified fractional search and motion compensation architecture across multiple video standards
US8787689B2 (en) * 2012-05-15 2014-07-22 Omnivision Technologies, Inc. Apparatus and method for correction of distortion in digital image data
US9979960B2 (en) 2012-10-01 2018-05-22 Microsoft Technology Licensing, Llc Frame packing and unpacking between frames of chroma sampling formats with different chroma resolutions
CN103327340B (en) * 2013-06-20 2016-06-15 华为技术有限公司 A kind of integer searches method and device
US9292899B2 (en) 2013-09-25 2016-03-22 Apple Inc. Reference frame data prefetching in block processing pipelines
US9224186B2 (en) 2013-09-27 2015-12-29 Apple Inc. Memory latency tolerance in block processing pipelines
US9942560B2 (en) 2014-01-08 2018-04-10 Microsoft Technology Licensing, Llc Encoding screen capture data
US9774881B2 (en) 2014-01-08 2017-09-26 Microsoft Technology Licensing, Llc Representing motion vectors in an encoded bitstream
US9749642B2 (en) 2014-01-08 2017-08-29 Microsoft Technology Licensing, Llc Selection of motion vector precision
US9715559B2 (en) * 2014-03-17 2017-07-25 Qualcomm Incorporated Hash-based encoder search for intra block copy
US10602174B2 (en) 2016-08-04 2020-03-24 Intel Corporation Lossless pixel compression for random video memory access
US10715818B2 (en) * 2016-08-04 2020-07-14 Intel Corporation Techniques for hardware video encoding
US10368080B2 (en) 2016-10-21 2019-07-30 Microsoft Technology Licensing, Llc Selective upsampling or refresh of chroma sample values
US20200014918A1 (en) * 2018-07-08 2020-01-09 Mellanox Technologies, Ltd. Application accelerator
US20200014945A1 (en) * 2018-07-08 2020-01-09 Mellanox Technologies, Ltd. Application acceleration
US11252464B2 (en) 2017-06-14 2022-02-15 Mellanox Technologies, Ltd. Regrouping of video data in host memory
US10291925B2 (en) * 2017-07-28 2019-05-14 Intel Corporation Techniques for hardware video encoding
US11025913B2 (en) 2019-03-01 2021-06-01 Intel Corporation Encoding video using palette prediction and intra-block copy
US20190222858A1 (en) * 2019-03-26 2019-07-18 Intel Corporation Optimal out of loop inter motion estimation with multiple candidate support
US10855983B2 (en) 2019-06-13 2020-12-01 Intel Corporation Encoding video using two-stage intra search

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5414469A (en) * 1991-10-31 1995-05-09 International Business Machines Corporation Motion video compression system with multiresolution features
GB9519923D0 (en) * 1995-09-29 1995-11-29 Philips Electronics Nv Motion estimation for predictive image coding
US5652625A (en) * 1996-06-19 1997-07-29 United Microelectronics Corp. Multi-stage pipeline architecture for motion estimation block matching
JPH1023413A (en) 1996-07-03 1998-01-23 Fuji Xerox Co Ltd Encoding device
US6023296A (en) * 1997-07-10 2000-02-08 Sarnoff Corporation Apparatus and method for object based rate control in a coding system
US6690833B1 (en) * 1997-07-14 2004-02-10 Sarnoff Corporation Apparatus and method for macroblock based rate control in a coding system
US6418166B1 (en) * 1998-11-30 2002-07-09 Microsoft Corporation Motion estimation and block matching pattern
CN1147159C (en) 1999-04-27 2004-04-21 三星电子株式会社 Method and device for evaluate high speed motion of real time motion image coding
TW550953B (en) 2000-06-16 2003-09-01 Intel Corp Method of performing motion estimation
CN1156168C (en) * 2001-01-12 2004-06-30 北京航空航天大学 Quick video motion estimating method
AU2002343220A1 (en) * 2001-11-09 2003-05-19 Matsushita Electric Industrial Co., Ltd. Moving picture coding method and apparatus
JP4130783B2 (en) * 2002-04-23 2008-08-06 松下電器産業株式会社 Motion vector encoding method and motion vector decoding method
US7817717B2 (en) * 2002-06-18 2010-10-19 Qualcomm Incorporated Motion estimation techniques for video encoding
US6925123B2 (en) * 2002-08-06 2005-08-02 Motorola, Inc. Method and apparatus for performing high quality fast predictive motion search
US7555044B2 (en) * 2002-10-04 2009-06-30 General Instrument Corporation Frequency coefficient scanning paths for coding digital video content
JP4289126B2 (en) 2003-11-04 2009-07-01 ソニー株式会社 Data processing apparatus and method and encoding apparatus
KR101160640B1 (en) 2003-12-30 2012-06-28 삼성전자주식회사 Data processing system and data processing method
JP3879741B2 (en) 2004-02-25 2007-02-14 ソニー株式会社 Image information encoding apparatus and image information encoding method
JP4577048B2 (en) 2004-03-11 2010-11-10 パナソニック株式会社 Image coding method, image coding apparatus, and image coding program
US7606427B2 (en) * 2004-07-08 2009-10-20 Qualcomm Incorporated Efficient rate control techniques for video encoding
JP4145275B2 (en) * 2004-07-27 2008-09-03 富士通株式会社 Motion vector detection / compensation device
US20060120612A1 (en) * 2004-12-08 2006-06-08 Sharath Manjunath Motion estimation techniques for video encoding
US7813432B2 (en) * 2004-12-30 2010-10-12 Intel Corporation Offset buffer for intra-prediction of digital video
US9172973B2 (en) * 2005-04-01 2015-10-27 Broadcom Corporation Method and system for motion estimation in a video encoder
US7852940B2 (en) * 2005-10-20 2010-12-14 Qualcomm Incorporated Scalable motion estimation for video encoding
US8208548B2 (en) * 2006-02-09 2012-06-26 Qualcomm Incorporated Video encoding

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
CHUAN-YU CHO ET AL: "An embedded merging scheme for H.264/AVC motion estimation", PROCEEDINGS 2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING. ICIP-2003. BARCELONA, SPAIN, SEPT. 14 - 17, 2003, INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, NEW YORK, NY : IEEE, US, vol. VOL. 2 OF 3, 14 September 2003 (2003-09-14), pages 909 - 912, XP010669886, ISBN: 0-7803-7750-8 *
HUANG S-Y ET AL: "A simple and efficient block motion estimation algorithm based on full-search array architecture", SIGNAL PROCESSING. IMAGE COMMUNICATION, ELSEVIER SCIENCE PUBLISHERS, AMSTERDAM, NL, vol. 19, no. 10, November 2004 (2004-11-01), pages 975 - 992, XP004663483, ISSN: 0923-5965 *
SCHIEFER P: "A novel VLSI-architecture for motion-estimation: the picture processing RAM", CIRCUITS AND SYSTEMS, 1992., PROCEEDINGS OF THE 35TH MIDWEST SYMPOSIUM ON WASHINGTON, DC, USA 9-12 AUG. 1992, NEW YORK, NY, USA,IEEE, US, 9 August 1992 (1992-08-09), pages 536 - 539, XP010057718, ISBN: 0-7803-0510-8 *
YANFEI SHEN ET AL: "Fast mode selection based on texture analysis and local motion activity in H.264/JVT", COMMUNICATIONS, CIRCUITS AND SYSTEMS, 2004. ICCCAS 2004. 2004 INTERNATIONAL CONFERENCE ON CHENGDU, CHINA 27-29 JUNE 2004, PISCATAWAY, NJ, USA,IEEE, US, 27 June 2004 (2004-06-27), pages 539 - 542Vol1, XP010731803, ISBN: 0-7803-8647-7 *

Also Published As

Publication number Publication date
CN101305615B (en) 2011-06-08
US8761259B2 (en) 2014-06-24
US20070110160A1 (en) 2007-05-17
KR100955152B1 (en) 2010-04-28
CN101305615A (en) 2008-11-12
WO2007038357A2 (en) 2007-04-05
ATE518372T1 (en) 2011-08-15
EP1958448B1 (en) 2011-07-27
EP1958448A2 (en) 2008-08-20
JP2009510845A (en) 2009-03-12
KR20080046238A (en) 2008-05-26

Similar Documents

Publication Publication Date Title
WO2007038357A3 (en) Multi-dimensional neighboring block prediction for video encoding
WO2007035276A3 (en) Adaptive motion search range
TW200943969A (en) Motion estimation with an adaptive search range
WO2007117711A3 (en) Dynamic selection of motion estimation search ranges and extended motion vector ranges
WO2007120286A3 (en) System and method for fast motion estimation
WO2007035387A3 (en) Adaptive motion estimation for temporal prediction filter over irregular motion vector samples
WO2005001773A3 (en) Method and apparatus for motion compensated predictive coding
WO2006063191A3 (en) Motion estimation techniques for video encoding
MY155930A (en) Motion vector calculation method
EP2602998A4 (en) Method and device for generating a predicted value of an image
MY167467A (en) Performing motion vector prediction for video coding
MY144087A (en) Macroblock encoding method and encoder
WO2006105054A3 (en) Method and system for improving video metadata through the use of frame-to-frame correspondences
JP2008182741A5 (en)
EP1773070A3 (en) Motion estimation method, video encoding method and apparatus using the same
MY172478A (en) Method and apparatus for encoding and decoding motion vector by predicting motion vector according to mode
WO2009045021A3 (en) Method and apparatus for inter prediction encoding/decoding an image using sub-pixel motion estimation
EP2271105A3 (en) Motion vector calculating method
MY193321A (en) Method and apparatus for encoding and decoding motion vector based on reduced motion vector predictor candidates
JP2009105982A5 (en)
WO2010041856A3 (en) A method and an apparatus for processing a video signal
WO2011126278A3 (en) Method and apparatus for encoding and decoding video
WO2007124491A3 (en) Method and system for video encoding and transcoding
BRPI0911485A2 (en) image prediction encoding device, image prediction encoding method, image prediction encoding program, image prediction decoding device, image prediction decoding method and image prediction decoding program
WO2003007590A3 (en) Motion estimation for video compression systems

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680041688.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006815254

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2008532452

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020087008581

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 755/MUMNP/2008

Country of ref document: IN