CN103210645B - 使用运动补偿的基于实例的超分辨率的视频解码 - Google Patents

使用运动补偿的基于实例的超分辨率的视频解码 Download PDF

Info

Publication number
CN103210645B
CN103210645B CN201180043275.8A CN201180043275A CN103210645B CN 103210645 B CN103210645 B CN 103210645B CN 201180043275 A CN201180043275 A CN 201180043275A CN 103210645 B CN103210645 B CN 103210645B
Authority
CN
China
Prior art keywords
video sequence
motion
input video
resolution
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201180043275.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN103210645A (zh
Inventor
张冬青
M.G.雅各布
S.布哈加瓦赛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN103210645A publication Critical patent/CN103210645A/zh
Application granted granted Critical
Publication of CN103210645B publication Critical patent/CN103210645B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN201180043275.8A 2010-09-10 2011-09-09 使用运动补偿的基于实例的超分辨率的视频解码 Expired - Fee Related CN103210645B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US40308610P 2010-09-10 2010-09-10
US61/403,086 2010-09-10
PCT/US2011/050915 WO2012033963A2 (en) 2010-09-10 2011-09-09 Methods and apparatus for decoding video signals using motion compensated example-based super-resolution for video compression

Publications (2)

Publication Number Publication Date
CN103210645A CN103210645A (zh) 2013-07-17
CN103210645B true CN103210645B (zh) 2016-09-07

Family

ID=44652031

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201180043275.8A Expired - Fee Related CN103210645B (zh) 2010-09-10 2011-09-09 使用运动补偿的基于实例的超分辨率的视频解码
CN201180043723.4A Expired - Fee Related CN103141092B (zh) 2010-09-10 2011-09-09 针对视频压缩使用运动补偿的基于示例的超分辨率来编码视频信号的方法和设备

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201180043723.4A Expired - Fee Related CN103141092B (zh) 2010-09-10 2011-09-09 针对视频压缩使用运动补偿的基于示例的超分辨率来编码视频信号的方法和设备

Country Status (7)

Country Link
US (2) US20130163673A1 (enExample)
EP (2) EP2614642A2 (enExample)
JP (2) JP6042813B2 (enExample)
KR (2) KR101906614B1 (enExample)
CN (2) CN103210645B (enExample)
BR (1) BR112013004107A2 (enExample)
WO (2) WO2012033962A2 (enExample)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2526699A1 (en) * 2010-01-22 2012-11-28 Thomson Licensing Data pruning for video compression using example-based super-resolution
KR101789845B1 (ko) 2010-01-22 2017-11-20 톰슨 라이센싱 샘플링 기반 초 해상도 비디오 인코딩 및 디코딩을 위한 방법 및 장치
WO2012033972A1 (en) 2010-09-10 2012-03-15 Thomson Licensing Methods and apparatus for pruning decision optimization in example-based data pruning compression
WO2012033970A1 (en) 2010-09-10 2012-03-15 Thomson Licensing Encoding of a picture in a video sequence by example - based data pruning using intra- frame patch similarity
WO2013105946A1 (en) * 2012-01-11 2013-07-18 Thomson Licensing Motion compensating transformation for video coding
CN104376544B (zh) * 2013-08-15 2017-04-19 北京大学 一种基于多区域尺度放缩补偿的非局部超分辨率重建方法
US9774865B2 (en) 2013-12-16 2017-09-26 Samsung Electronics Co., Ltd. Method for real-time implementation of super resolution
JP6986721B2 (ja) * 2014-03-18 2021-12-22 パナソニックＩｐマネジメント株式会社 復号装置及び符号化装置
CN106056540A (zh) * 2016-07-08 2016-10-26 北京邮电大学 基于鲁棒光流和Zernike不变矩的视频时空超分辨率重建方法
EP3574652B8 (en) * 2017-01-27 2024-07-17 H2VR HoldCo, Inc. d/b/a Megapixel VR Method and system for transmitting alternative image content of a physical display to different viewers
CN111882486B (zh) * 2020-06-21 2023-03-10 南开大学 一种基于低秩先验信息的混合分辨率多视点视频超分辨方法
CN118283201B (zh) * 2024-06-03 2024-10-15 上海蜜度科技股份有限公司 视频合成方法、系统、存储介质及电子设备

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009087641A2 (en) * 2008-01-10 2009-07-16 Ramot At Tel-Aviv University Ltd. System and method for real-time super-resolution

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11711A (en) 1854-09-19 William h
US10711A (en) 1854-03-28 Improvement in furnaces for zinc-white
US5537155A (en) * 1994-04-29 1996-07-16 Motorola, Inc. Method for estimating motion in a video sequence
US6043838A (en) * 1997-11-07 2000-03-28 General Instrument Corporation View offset estimation for stereoscopic video coding
US6766067B2 (en) * 2001-04-20 2004-07-20 Mitsubishi Electric Research Laboratories, Inc. One-pass super-resolution images
US7656950B2 (en) * 2002-05-29 2010-02-02 Diego Garrido Video interpolation coding
US7119837B2 (en) * 2002-06-28 2006-10-10 Microsoft Corporation Video processing system and method for automatic enhancement of digital video
AU2002951574A0 (en) * 2002-09-20 2002-10-03 Unisearch Limited Method of signalling motion information for efficient scalable video compression
DE10310023A1 (de) * 2003-02-28 2004-09-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Verfahren und Anordnung zur Videocodierung, wobei die Videocodierung Texturanalyse und Textursynthese umfasst, sowie ein entsprechendes Computerprogramm und ein entsprechendes computerlesbares Speichermedium
US7218796B2 (en) * 2003-04-30 2007-05-15 Microsoft Corporation Patch-based video super-resolution
KR100504594B1 (ko) * 2003-06-27 2005-08-30 주식회사 성진씨앤씨 데이터 압축 처리된 저해상도 영상으로부터 초해상도 영상복원 및 재구성 방법
US7715658B2 (en) * 2005-08-03 2010-05-11 Samsung Electronics Co., Ltd. Apparatus and method for super-resolution enhancement processing
US7460730B2 (en) * 2005-08-04 2008-12-02 Microsoft Corporation Video registration and image sequence stitching
CN100413316C (zh) * 2006-02-14 2008-08-20 华为技术有限公司 一种视频图像超分辨率重构方法
US7933464B2 (en) * 2006-10-17 2011-04-26 Sri International Scene-based non-uniformity correction and enhancement method using super-resolution
KR101381600B1 (ko) * 2006-12-20 2014-04-04 삼성전자주식회사 텍스처 합성을 이용한 영상의 부호화, 복호화 방법 및 장치
US8417037B2 (en) * 2007-07-16 2013-04-09 Alexander Bronstein Methods and systems for representation and matching of video content
JP4876048B2 (ja) * 2007-09-21 2012-02-15 株式会社日立製作所 映像送受信方法、受信装置、映像蓄積装置
US8989519B2 (en) * 2009-04-20 2015-03-24 Yeda Research & Development Co. Ltd. Super resolution from a single signal
CN101551903A (zh) * 2009-05-11 2009-10-07 天津大学 步态识别中的超分辨率图像恢复方法
EP2526699A1 (en) * 2010-01-22 2012-11-28 Thomson Licensing Data pruning for video compression using example-based super-resolution

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009087641A2 (en) * 2008-01-10 2009-07-16 Ramot At Tel-Aviv University Ltd. System and method for real-time super-resolution

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Region-Based Super-Resolution for Compression;D.Barreto;《MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING》;20070308;第18卷;全文 *

Also Published As

Publication number Publication date
WO2012033963A3 (en) 2012-09-27
KR101878515B1 (ko) 2018-07-13
WO2012033962A2 (en) 2012-03-15
KR20130105827A (ko) 2013-09-26
CN103210645A (zh) 2013-07-17
WO2012033963A8 (en) 2012-07-19
US20130163676A1 (en) 2013-06-27
JP6042813B2 (ja) 2016-12-14
BR112013004107A2 (pt) 2016-06-14
EP2614641A2 (en) 2013-07-17
CN103141092A (zh) 2013-06-05
CN103141092B (zh) 2016-11-16
WO2012033962A3 (en) 2012-09-20
WO2012033963A2 (en) 2012-03-15
US20130163673A1 (en) 2013-06-27
JP2013537380A (ja) 2013-09-30
KR20130143566A (ko) 2013-12-31
EP2614642A2 (en) 2013-07-17
KR101906614B1 (ko) 2018-10-10
JP2013537381A (ja) 2013-09-30

Similar Documents

Publication Publication Date Title
CN103141092B (zh) 针对视频压缩使用运动补偿的基于示例的超分辨率来编码视频信号的方法和设备
Agustsson et al. Scale-space flow for end-to-end optimized video compression
Jia et al. Spatial-temporal residue network based in-loop filter for video coding
CN107318026B (zh) 视频编码器以及视频编码方法
CN102282838B (zh) 针对多次曝光的增强动态范围图像和视频的方法和系统
JP2013537381A5 (enExample)
KR101855542B1 (ko) 예제 기반 데이터 프루닝을 이용한 비디오 부호화
US20250392747A1 (en) Inter coding using deep learning in video compression
WO2015176280A1 (en) Re-encoding image sets using frequency-domain differences
CN101529912A (zh) 用于在多通路编码器中高效地进行第一通路编码的方法和设备
KR101883265B1 (ko) 패치 시프팅을 통해 벡터 양자화 에러를 감소시키기 위한 방법들 및 장치
CN120752644A (zh) 用于视频处理的方法、装置和介质
WO2024020053A1 (en) Neural network-based adaptive image and video compression method
WO2024020112A1 (en) A neural network-based adaptive image and video compression method with variable rate
WO2024015638A9 (en) A neural network-based image and video compression method with conditional coding
KR20240024921A (ko) 이미지 또는 비디오를 인코딩/디코딩하기 위한 방법들 및 장치들
CN119422374A (zh) 基于可变速率神经网络的压缩
EP4541019A1 (en) Neural network-based image and video compression method with parallel processing
Lu et al. Neighbor-Aware Feature-Driven Motion Compensation for Learned Video Compression
CN121890085A (zh) Vcm中基于自适应时空重采样的编码和解码方法
CN121890076A (zh) 基于感兴趣区域的帧配置及编码或解码方法
CN121890081A (zh) 使用对特征图中的感兴趣区的压缩的编码器和解码器

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20190524

Address after: American Delaware

Patentee after: Interactive Digital VC Holding Company

Address before: I Si Eli Murli Nor, France

Patentee before: Thomson Licensing SA

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20160907

Termination date: 20200909

CF01 Termination of patent right due to non-payment of annual fee