WO2013148002A3 - Context based video encoding and decoding - Google Patents

Context based video encoding and decoding Download PDF

Info

Publication number
WO2013148002A3
WO2013148002A3 PCT/US2013/025123 US2013025123W WO2013148002A3 WO 2013148002 A3 WO2013148002 A3 WO 2013148002A3 US 2013025123 W US2013025123 W US 2013025123W WO 2013148002 A3 WO2013148002 A3 WO 2013148002A3
Authority
WO
WIPO (PCT)
Prior art keywords
modeling
data
objects
motion estimation
video data
Prior art date
Application number
PCT/US2013/025123
Other languages
French (fr)
Other versions
WO2013148002A2 (en
Inventor
Nigel Lee
Renato Pizzorni
Darin Deforest
Charles P. Pace
Original Assignee
Euclid Discoveries, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/725,940 external-priority patent/US9578345B2/en
Application filed by Euclid Discoveries, Llc filed Critical Euclid Discoveries, Llc
Priority to CA2868448A priority Critical patent/CA2868448A1/en
Priority to JP2015503204A priority patent/JP2015515806A/en
Priority to EP13710636.5A priority patent/EP2815572A2/en
Publication of WO2013148002A2 publication Critical patent/WO2013148002A2/en
Publication of WO2013148002A3 publication Critical patent/WO2013148002A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/23—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A model-based compression codec applies higher-level modeling to produce better predictions than can be found through conventional block-based motion estimation and compensation. Computer- vision-based feature and object detection algorithms identify regions of interest throughout the video datacube. The detected features and objects are modeled with a compact set of parameters, and similar feature/object instances are associated across frames. Associated features/objects are formed into tracks and related to specific blocks of video data to be encoded. The tracking information is used to produce model-based predictions for those blocks of data, enabling more efficient navigation of the prediction search space than is typically achievable through conventional motion estimation methods. A hybrid framework enables modeling of data at multiple fidelities and selects the appropriate level of modeling for each portion of video data.
PCT/US2013/025123 2012-03-26 2013-02-07 Context based video encoding and decoding WO2013148002A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA2868448A CA2868448A1 (en) 2012-03-26 2013-02-07 Context based video encoding and decoding
JP2015503204A JP2015515806A (en) 2012-03-26 2013-02-07 Context-based video encoding and decoding
EP13710636.5A EP2815572A2 (en) 2012-03-26 2013-02-07 Context based video encoding and decoding

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201261615795P 2012-03-26 2012-03-26
US61/615,795 2012-03-26
US201261707650P 2012-09-28 2012-09-28
US61/707,650 2012-09-28
US13/725,940 2012-12-21
US13/725,940 US9578345B2 (en) 2005-03-31 2012-12-21 Model-based video encoding and decoding

Publications (2)

Publication Number Publication Date
WO2013148002A2 WO2013148002A2 (en) 2013-10-03
WO2013148002A3 true WO2013148002A3 (en) 2013-12-19

Family

ID=47901315

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/025123 WO2013148002A2 (en) 2012-03-26 2013-02-07 Context based video encoding and decoding

Country Status (5)

Country Link
EP (1) EP2815572A2 (en)
JP (1) JP2015515806A (en)
CA (1) CA2868448A1 (en)
TW (1) TW201342926A (en)
WO (1) WO2013148002A2 (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9743078B2 (en) * 2004-07-30 2017-08-22 Euclid Discoveries, Llc Standards-compliant model-based video encoding and decoding
US9532069B2 (en) 2004-07-30 2016-12-27 Euclid Discoveries, Llc Video compression repository and model reuse
US9578345B2 (en) 2005-03-31 2017-02-21 Euclid Discoveries, Llc Model-based video encoding and decoding
AU2013403225B2 (en) 2013-10-14 2018-06-14 Microsoft Technology Licensing, Llc Features of base color index map mode for video and image coding and decoding
CN105659602B (en) 2013-10-14 2019-10-08 微软技术许可有限责任公司 Coder side option for the intra block duplication prediction mode that video and image encode
KR102170169B1 (en) 2013-10-14 2020-10-26 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 Features of intra block copy prediction mode for video and image coding and decoding
US10390034B2 (en) 2014-01-03 2019-08-20 Microsoft Technology Licensing, Llc Innovations in block vector prediction and estimation of reconstructed sample values within an overlap area
US10469863B2 (en) 2014-01-03 2019-11-05 Microsoft Technology Licensing, Llc Block vector prediction in video and image coding/decoding
US11284103B2 (en) 2014-01-17 2022-03-22 Microsoft Technology Licensing, Llc Intra block copy prediction with asymmetric partitions and encoder-side search patterns, search ranges and approaches to partitioning
US10542274B2 (en) 2014-02-21 2020-01-21 Microsoft Technology Licensing, Llc Dictionary encoding and decoding of screen content
US9621917B2 (en) 2014-03-10 2017-04-11 Euclid Discoveries, Llc Continuous block tracking for temporal prediction in video encoding
US10097851B2 (en) 2014-03-10 2018-10-09 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding
US10091507B2 (en) 2014-03-10 2018-10-02 Euclid Discoveries, Llc Perceptual optimization for model-based video encoding
TWI499985B (en) * 2014-04-30 2015-09-11 Univ Nat Taiwan Science Tech Automatic method and system thereof for selecting feature points in an image
KR102413529B1 (en) 2014-06-19 2022-06-24 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 Unified intra block copy and inter prediction modes
US9767853B2 (en) 2014-07-21 2017-09-19 International Business Machines Corporation Touch screen video scrolling
CN105874795B (en) 2014-09-30 2019-11-29 微软技术许可有限责任公司 When wavefront parallel processing is activated to the rule of intra-picture prediction mode
CN106664405B (en) 2015-06-09 2020-06-09 微软技术许可有限责任公司 Robust encoding/decoding of escape-coded pixels with palette mode
US10986349B2 (en) 2017-12-29 2021-04-20 Microsoft Technology Licensing, Llc Constraints on locations of reference blocks for intra block copy prediction
US11830225B2 (en) * 2018-05-30 2023-11-28 Ati Technologies Ulc Graphics rendering with encoder feedback
CN110503636B (en) * 2019-08-06 2024-01-26 腾讯医疗健康(深圳)有限公司 Parameter adjustment method, focus prediction method, parameter adjustment device and electronic equipment
CN111083497B (en) * 2019-12-31 2022-07-08 北京奇艺世纪科技有限公司 Video screenshot method and device
CN113938666B (en) * 2021-10-25 2023-07-25 珠海普罗米修斯视觉技术有限公司 Video data transmission method, device and storage medium based on key frames
US20240146963A1 (en) * 2022-10-17 2024-05-02 Alibaba Damo (Hangzhou) Technology Co., Ltd. Method and apparatus for talking face video compression

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6738424B1 (en) * 1999-12-27 2004-05-18 Objectvideo, Inc. Scene model generation from video for use in video processing
WO2008091483A2 (en) * 2007-01-23 2008-07-31 Euclid Discoveries, Llc Computer method and apparatus for processing image data
US20110058609A1 (en) * 2009-09-04 2011-03-10 Stmicroelectronics Pvt. Ltd. System and method for object based parametric video coding

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7457435B2 (en) 2004-11-17 2008-11-25 Euclid Discoveries, Llc Apparatus and method for processing video data
US7457472B2 (en) 2005-03-31 2008-11-25 Euclid Discoveries, Llc Apparatus and method for processing video data
US7436981B2 (en) 2005-01-28 2008-10-14 Euclid Discoveries, Llc Apparatus and method for processing video data
US7508990B2 (en) 2004-07-30 2009-03-24 Euclid Discoveries, Llc Apparatus and method for processing video data
AU2005269310C1 (en) 2004-07-30 2010-05-20 Euclid Discoveries, Llc Apparatus and method for processing video data
EP1800238A4 (en) 2004-09-21 2012-01-25 Euclid Discoveries Llc Apparatus and method for processing video data
EP1878256A4 (en) * 2005-03-31 2011-06-08 Euclid Discoveries Llc Apparatus and method for processing video data
CN102172026B (en) * 2008-10-07 2015-09-09 欧几里得发现有限责任公司 The video compression of feature based

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6738424B1 (en) * 1999-12-27 2004-05-18 Objectvideo, Inc. Scene model generation from video for use in video processing
WO2008091483A2 (en) * 2007-01-23 2008-07-31 Euclid Discoveries, Llc Computer method and apparatus for processing image data
US20110058609A1 (en) * 2009-09-04 2011-03-10 Stmicroelectronics Pvt. Ltd. System and method for object based parametric video coding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
EBRAHIMI T ET AL: "MPEG-4 natural video coding - An overview", SIGNAL PROCESSING. IMAGE COMMUNICATION, ELSEVIER SCIENCE PUBLISHERS, AMSTERDAM, NL, vol. 15, no. 4-5, 1 January 2000 (2000-01-01), pages 365 - 385, XP027357196, ISSN: 0923-5965, [retrieved on 20000101] *

Also Published As

Publication number Publication date
TW201342926A (en) 2013-10-16
WO2013148002A2 (en) 2013-10-03
EP2815572A2 (en) 2014-12-24
CA2868448A1 (en) 2013-10-03
JP2015515806A (en) 2015-05-28

Similar Documents

Publication Publication Date Title
WO2013148002A3 (en) Context based video encoding and decoding
JP2015029335A5 (en)
JP2015019420A5 (en)
JP2015519835A5 (en)
WO2013173185A8 (en) Programmable and scalable searching for candidate blocks for inter-coding or intra coding
MY165809A (en) Parallelization friendly merge candidates for video coding
WO2015152608A3 (en) Interlayer video decoding method for performing sub-block-based prediction and apparatus therefor, and interlayer video encoding method for performing sub-block-based prediction and apparatus therefor
WO2011010858A3 (en) Motion vector prediction method, and apparatus and method for encoding and decoding image using the same
MX2013013029A (en) Image decoding method, image encoding method, image decoding device, image encoding device, and image encoding/decoding device.
WO2012030193A3 (en) Method for encoding and decoding video, and apparatus using same
JP2015515227A5 (en)
EP4354867A3 (en) Method and apparatus for video coding
JP2014514811A5 (en)
EP3664453A3 (en) Image prediction encoding device, image prediction encoding method, image prediction encoding program, image prediction decoding device, image prediction decoding method, and image prediction decoding program
WO2013012867A3 (en) Buffering prediction data in video coding
FI3567854T3 (en) Image predictive decoding method
WO2012093898A3 (en) Method for encoding and decoding image information and device using same
WO2011090313A3 (en) Method and apparatus for encoding/decoding images using a motion vector of a previous block as a motion vector for the current block
WO2011087321A3 (en) Method and apparatus for encoding and decoding motion vector
JP2014180027A5 (en)
MX2020001492A (en) Prediction encoding method, prediction encoding device, and prediction encoding program for motion vector, as well as prediction decoding method, prediction decoding device, and prediction decoding program for motion vector.
WO2012161952A3 (en) Method and apparatus for using segmentation-based coding of prediction information
JP2014180026A5 (en)
WO2011087320A3 (en) Method and apparatus for encoding video using variable partitions for predictive encoding, and method and apparatus for decoding video using variable partitions for predictive encoding
MY181411A (en) Video encoding method and device involving intra prediction, and video decoding method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13710636

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2013710636

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2868448

Country of ref document: CA

Ref document number: 2015503204

Country of ref document: JP

Kind code of ref document: A