JP2013537381A - ビデオ圧縮のための動き補償学習型超解像を用いてビデオ信号を復号する方法と装置 - Google Patents

ビデオ圧縮のための動き補償学習型超解像を用いてビデオ信号を復号する方法と装置 Download PDF

Info

Publication number
JP2013537381A
JP2013537381A JP2013528306A JP2013528306A JP2013537381A JP 2013537381 A JP2013537381 A JP 2013537381A JP 2013528306 A JP2013528306 A JP 2013528306A JP 2013528306 A JP2013528306 A JP 2013528306A JP 2013537381 A JP2013537381 A JP 2013537381A
Authority
JP
Japan
Prior art keywords
motion
resolution
video sequence
input video
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2013528306A
Other languages
English (en)
Japanese (ja)
Other versions
JP2013537381A5 (https=
Inventor
ザン，ドン−チン
ジョージ ヤコブ，ミトゥン
バガヴァシー，シタラム
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of JP2013537381A publication Critical patent/JP2013537381A/ja
Publication of JP2013537381A5 publication Critical patent/JP2013537381A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
JP2013528306A 2010-09-10 2011-09-09 ビデオ圧縮のための動き補償学習型超解像を用いてビデオ信号を復号する方法と装置 Pending JP2013537381A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US40308610P 2010-09-10 2010-09-10
US61/403,086 2010-09-10
PCT/US2011/050915 WO2012033963A2 (en) 2010-09-10 2011-09-09 Methods and apparatus for decoding video signals using motion compensated example-based super-resolution for video compression

Publications (2)

Publication Number Publication Date
JP2013537381A true JP2013537381A (ja) 2013-09-30
JP2013537381A5 JP2013537381A5 (https=) 2014-10-30

Family

ID=44652031

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2013528306A Pending JP2013537381A (ja) 2010-09-10 2011-09-09 ビデオ圧縮のための動き補償学習型超解像を用いてビデオ信号を復号する方法と装置
JP2013528305A Expired - Fee Related JP6042813B2 (ja) 2010-09-10 2011-09-09 ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2013528305A Expired - Fee Related JP6042813B2 (ja) 2010-09-10 2011-09-09 ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置

Country Status (7)

Country Link
US (2) US20130163673A1 (https=)
EP (2) EP2614642A2 (https=)
JP (2) JP2013537381A (https=)
KR (2) KR101878515B1 (https=)
CN (2) CN103141092B (https=)
BR (1) BR112013004107A2 (https=)
WO (2) WO2012033963A2 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022036964A (ja) * 2014-03-18 2022-03-08 パナソニックＩｐマネジメント株式会社 画像復号装置、画像符号化装置及び記録媒体

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101789845B1 (ko) 2010-01-22 2017-11-20 톰슨 라이센싱 샘플링 기반 초 해상도 비디오 인코딩 및 디코딩을 위한 방법 및 장치
EP2526699A1 (en) * 2010-01-22 2012-11-28 Thomson Licensing Data pruning for video compression using example-based super-resolution
WO2012033972A1 (en) 2010-09-10 2012-03-15 Thomson Licensing Methods and apparatus for pruning decision optimization in example-based data pruning compression
US9338477B2 (en) 2010-09-10 2016-05-10 Thomson Licensing Recovering a pruned version of a picture in a video sequence for example-based data pruning using intra-frame patch similarity
WO2013105946A1 (en) * 2012-01-11 2013-07-18 Thomson Licensing Motion compensating transformation for video coding
CN104376544B (zh) * 2013-08-15 2017-04-19 北京大学 一种基于多区域尺度放缩补偿的非局部超分辨率重建方法
US9774865B2 (en) * 2013-12-16 2017-09-26 Samsung Electronics Co., Ltd. Method for real-time implementation of super resolution
CN106056540A (zh) * 2016-07-08 2016-10-26 北京邮电大学 基于鲁棒光流和Zernike不变矩的视频时空超分辨率重建方法
ES2899651T5 (en) * 2017-01-27 2025-01-28 H2Vr Holdco Inc D/B/A Megapixel Vr Method and system for transmitting alternative image content of a physical display to different viewers
CN111882486B (zh) * 2020-06-21 2023-03-10 南开大学 一种基于低秩先验信息的混合分辨率多视点视频超分辨方法
CN118283201B (zh) * 2024-06-03 2024-10-15 上海蜜度科技股份有限公司 视频合成方法、系统、存储介质及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018398A (ja) * 2001-04-20 2003-01-17 Mitsubishi Electric Research Laboratories Inc ピクセル画像から超解像度画像を生成する方法
US20040017852A1 (en) * 2002-05-29 2004-01-29 Diego Garrido Predictive interpolation of a video signal
JP2006519533A (ja) * 2003-02-28 2006-08-24 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ ビデオコーディングがテクスチャ解析およびテクスチャ合成を含むビデオコーディングのための方法およびアセンブリと、対応するコンピュータプログラムおよび対応するコンピュータで読み込み可能な記録媒体
JP2010514325A (ja) * 2006-12-20 2010-04-30 サムスン エレクトロニクス カンパニー リミテッド テクスチャ合成を利用した映像の符号化、復号化の方法及び装置
WO2011090798A1 (en) * 2010-01-22 2011-07-28 Thomson Licensing Data pruning for video compression using example-based super-resolution

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11711A (en) 1854-09-19 William h
US10711A (en) 1854-03-28 Improvement in furnaces for zinc-white
US5537155A (en) * 1994-04-29 1996-07-16 Motorola, Inc. Method for estimating motion in a video sequence
US6043838A (en) * 1997-11-07 2000-03-28 General Instrument Corporation View offset estimation for stereoscopic video coding
US7119837B2 (en) * 2002-06-28 2006-10-10 Microsoft Corporation Video processing system and method for automatic enhancement of digital video
AU2002951574A0 (en) * 2002-09-20 2002-10-03 Unisearch Limited Method of signalling motion information for efficient scalable video compression
US7218796B2 (en) * 2003-04-30 2007-05-15 Microsoft Corporation Patch-based video super-resolution
KR100504594B1 (ko) * 2003-06-27 2005-08-30 주식회사 성진씨앤씨 데이터 압축 처리된 저해상도 영상으로부터 초해상도 영상복원 및 재구성 방법
US7715658B2 (en) * 2005-08-03 2010-05-11 Samsung Electronics Co., Ltd. Apparatus and method for super-resolution enhancement processing
US7460730B2 (en) * 2005-08-04 2008-12-02 Microsoft Corporation Video registration and image sequence stitching
CN100413316C (zh) * 2006-02-14 2008-08-20 华为技术有限公司 一种视频图像超分辨率重构方法
US7933464B2 (en) * 2006-10-17 2011-04-26 Sri International Scene-based non-uniformity correction and enhancement method using super-resolution
US8417037B2 (en) * 2007-07-16 2013-04-09 Alexander Bronstein Methods and systems for representation and matching of video content
JP4876048B2 (ja) * 2007-09-21 2012-02-15 株式会社日立製作所 映像送受信方法、受信装置、映像蓄積装置
WO2009087641A2 (en) * 2008-01-10 2009-07-16 Ramot At Tel-Aviv University Ltd. System and method for real-time super-resolution
US8989519B2 (en) * 2009-04-20 2015-03-24 Yeda Research & Development Co. Ltd. Super resolution from a single signal
CN101551903A (zh) * 2009-05-11 2009-10-07 天津大学 步态识别中的超分辨率图像恢复方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018398A (ja) * 2001-04-20 2003-01-17 Mitsubishi Electric Research Laboratories Inc ピクセル画像から超解像度画像を生成する方法
US20040017852A1 (en) * 2002-05-29 2004-01-29 Diego Garrido Predictive interpolation of a video signal
JP2006519533A (ja) * 2003-02-28 2006-08-24 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ ビデオコーディングがテクスチャ解析およびテクスチャ合成を含むビデオコーディングのための方法およびアセンブリと、対応するコンピュータプログラムおよび対応するコンピュータで読み込み可能な記録媒体
JP2010514325A (ja) * 2006-12-20 2010-04-30 サムスン エレクトロニクス カンパニー リミテッド テクスチャ合成を利用した映像の符号化、復号化の方法及び装置
WO2011090798A1 (en) * 2010-01-22 2011-07-28 Thomson Licensing Data pruning for video compression using example-based super-resolution

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
JPN5013010492; Ｄ．　ＢＡＲＲＥＴＯ　ｅｔ　ａｌ．: 'ＲＥＧＩＯＮ-ＢＡＳＥＤ　ＳＵＰＥＲ-ＲＥＳＯＬＵＴＩＯＮ　ＦＯＲ　ＣＯＭＰＲＥＳＳＩＯＮ' ＭＵＬＴＩＤＩＭＥＮＳＩＯＮＡＬ　ＳＹＳＴＥＭＳ　ＡＮＤ　ＳＩＧＮＡＬ　ＰＲＯＣＥＳＳＩＮＧ Ｖｏｌ．１８，　Ｎｏ．２-３, 20070308, ｐｐ．５９　-　８１, ＫＬＵＷＥＲ *
JPN6015039702; Ｆｅｎｇ　Ｗｕ　ａｎｄ　Ｘｉａｏｙａｎ　Ｓｕｎ: 'Ｉｍａｇｅ　Ｃｏｍｐｒｅｓｓｉｏｎ　ｂｙ　Ｖｉｓｕａｌ　Ｐａｔｔｅｒｎ　Ｖｅｃｔｏｒ　Ｑｕａｎｔｉｚａｔｉｏｎ　（ＶＰＶＱ）' Ｄａｔａ　Ｃｏｍｐｒｅｓｓｉｏｎ　Ｃｏｎｆｅｒｅｎｃｅ　（ＤＣＣ　２００８） , 200803, ｐｐ．１２３　-　１３１, ＩＥＥＥ *
JPN6015041688; Ｗｉｌｌｉａｍ　Ｔ．　Ｆｒｅｅｍａｎ　ｅｔ　ａｌ．: 'Ｅｘａｍｐｌｅ-Ｂａｓｅｄ　Ｓｕｐｅｒ-Ｒｅｓｏｌｕｔｉｏｎ' Ｃｏｍｐｕｔｅｒ　Ｇｒａｐｈｉｃｓ　ａｎｄ　Ａｐｐｌｉｃａｔｉｏｎｓ Ｖｏｌ．２２，　Ｎｏ．２, 2002, ｐｐ．５６　-　６５, ＩＥＥＥ *
JPN7015002864; Ａｌｊｏｓｃｈａ　Ｓｍｏｌｉｃ　ｅｔ　ａｌ．: 'Ｉｍｐｒｏｖｅｄ　Ｖｉｄｅｏ　Ｃｏｄｉｎｇ　ＵｓｉｎｇＬｏｎｇ-ｔｅｒｍ　Ｇｌｏｂａｌ　Ｍｏｔｉｏｎ　Ｃｏｍｐｅｎｓａｔｉｏｎ' Ｖｉｓｕａｌ　Ｃｏｍｍｕｎｉｃａｔｉｏｎｓ　ａｎｄ　Ｉｍａｇｅ　Ｐｒｏｃｅｓｓｉｎｇ　２００４ Ｖｏｌ．５３０８, 200401, ｐｐ．３４３　-　３５４, ＳＰＩＥ *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022036964A (ja) * 2014-03-18 2022-03-08 パナソニックＩｐマネジメント株式会社 画像復号装置、画像符号化装置及び記録媒体
JP7236667B2 (ja) 2014-03-18 2023-03-10 パナソニックＩｐマネジメント株式会社 画像復号装置、画像符号化装置及び記録媒体

Also Published As

Publication number Publication date
WO2012033962A3 (en) 2012-09-20
WO2012033963A2 (en) 2012-03-15
CN103141092B (zh) 2016-11-16
CN103210645B (zh) 2016-09-07
US20130163673A1 (en) 2013-06-27
JP2013537380A (ja) 2013-09-30
EP2614642A2 (en) 2013-07-17
EP2614641A2 (en) 2013-07-17
KR20130105827A (ko) 2013-09-26
KR101878515B1 (ko) 2018-07-13
WO2012033962A2 (en) 2012-03-15
US20130163676A1 (en) 2013-06-27
CN103210645A (zh) 2013-07-17
KR101906614B1 (ko) 2018-10-10
WO2012033963A8 (en) 2012-07-19
JP6042813B2 (ja) 2016-12-14
BR112013004107A2 (pt) 2016-06-14
KR20130143566A (ko) 2013-12-31
WO2012033963A3 (en) 2012-09-27
CN103141092A (zh) 2013-06-05

Similar Documents

Publication Publication Date Title
JP6042813B2 (ja) ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置
Agustsson et al. Scale-space flow for end-to-end optimized video compression
JP2013537381A5 (https=)
CN114793282B (zh) 带有比特分配的基于神经网络的视频压缩
US8787459B2 (en) Video coding methods and apparatus
CN107318026B (zh) 视频编码器以及视频编码方法
US9554145B2 (en) Re-encoding image sets using frequency-domain differences
KR20120118477A (ko) 샘플링 기반 초 해상도 비디오 인코딩 및 디코딩을 위한 방법 및 장치
KR20130105855A (ko) 예제 기반 데이터 프루닝을 이용한 비디오 부호화
TW202420815A (zh) 使用神經網路進行圖像區域的並行處理－解碼、後濾波和ｒｄｏｑ
KR20120123132A (ko) 패치 시프팅을 통해 벡터 양자화 에러를 감소시키기 위한 방법들 및 장치
CN119605167A (zh) 基于神经网络的自适应图像和视频压缩方法
CN120752644A (zh) 用于视频处理的方法、装置和介质
CN116438567A (zh) 用于视频编码的基于神经网络的环内滤波
WO2025051017A1 (en) Method, non-transitory computer readable storage medium and decoder for generative face video compression using dense motion flow translator
CN121925847A (zh) 用于对基于感兴趣区的图像信息进行编码和解码的方法
CN119563317A (zh) 并行处理的基于神经网络的图像和视频压缩方法
WO2023001042A1 (en) Signaling of down-sampling information for video bitstreams
WO2026007010A1 (en) System and method for unified reference picture synthesis
CN121890085A (zh) Vcm中基于自适应时空重采样的编码和解码方法
KR20250143642A (ko) 기계를 위한 적응적인 영상 복원 방법
KR20250045443A (ko) 관심 영역 기반 영상 정보 부호화 및 복호화 방법
CN121890081A (zh) 使用对特征图中的感兴趣区的压缩的编码器和解码器
CN121040073A (zh) 用于视频处理的方法、装置和介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140908

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20140908

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20151013

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20151020

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20160119

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20160621