JP6042813B2 - ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置 - Google Patents
ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置 Download PDFInfo
- Publication number
- JP6042813B2 JP6042813B2 JP2013528305A JP2013528305A JP6042813B2 JP 6042813 B2 JP6042813 B2 JP 6042813B2 JP 2013528305 A JP2013528305 A JP 2013528305A JP 2013528305 A JP2013528305 A JP 2013528305A JP 6042813 B2 JP6042813 B2 JP 6042813B2
- Authority
- JP
- Japan
- Prior art keywords
- motion
- pictures
- resolution
- picture
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000033001 locomotion Effects 0.000 title claims description 172
- 238000000034 method Methods 0.000 title claims description 93
- 230000006835 compression Effects 0.000 title description 23
- 238000007906 compression Methods 0.000 title description 23
- 230000003068 static effect Effects 0.000 claims description 47
- 230000008569 process Effects 0.000 claims description 42
- 230000009466 transformation Effects 0.000 claims description 21
- 238000013459 approach Methods 0.000 claims description 14
- 230000002441 reversible effect Effects 0.000 claims description 11
- 238000000844 transformation Methods 0.000 claims description 10
- 238000005192 partition Methods 0.000 claims description 5
- 238000004513 sizing Methods 0.000 claims 1
- 238000004891 communication Methods 0.000 description 42
- 238000013138 pruning Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000007423 decrease Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000153 supplemental effect Effects 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US40308610P | 2010-09-10 | 2010-09-10 | |
| US61/403,086 | 2010-09-10 | ||
| PCT/US2011/050913 WO2012033962A2 (en) | 2010-09-10 | 2011-09-09 | Methods and apparatus for encoding video signals using motion compensated example-based super-resolution for video compression |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2013537380A JP2013537380A (ja) | 2013-09-30 |
| JP2013537380A5 JP2013537380A5 (enExample) | 2014-10-30 |
| JP6042813B2 true JP6042813B2 (ja) | 2016-12-14 |
Family
ID=44652031
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2013528305A Expired - Fee Related JP6042813B2 (ja) | 2010-09-10 | 2011-09-09 | ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置 |
| JP2013528306A Pending JP2013537381A (ja) | 2010-09-10 | 2011-09-09 | ビデオ圧縮のための動き補償学習型超解像を用いてビデオ信号を復号する方法と装置 |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2013528306A Pending JP2013537381A (ja) | 2010-09-10 | 2011-09-09 | ビデオ圧縮のための動き補償学習型超解像を用いてビデオ信号を復号する方法と装置 |
Country Status (7)
| Country | Link |
|---|---|
| US (2) | US20130163673A1 (enExample) |
| EP (2) | EP2614641A2 (enExample) |
| JP (2) | JP6042813B2 (enExample) |
| KR (2) | KR101906614B1 (enExample) |
| CN (2) | CN103210645B (enExample) |
| BR (1) | BR112013004107A2 (enExample) |
| WO (2) | WO2012033962A2 (enExample) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2526699A1 (en) * | 2010-01-22 | 2012-11-28 | Thomson Licensing | Data pruning for video compression using example-based super-resolution |
| EP2526698A1 (en) | 2010-01-22 | 2012-11-28 | Thomson Licensing | Methods and apparatus for sampling -based super resolution video encoding and decoding |
| WO2012033972A1 (en) | 2010-09-10 | 2012-03-15 | Thomson Licensing | Methods and apparatus for pruning decision optimization in example-based data pruning compression |
| WO2012033970A1 (en) | 2010-09-10 | 2012-03-15 | Thomson Licensing | Encoding of a picture in a video sequence by example - based data pruning using intra- frame patch similarity |
| WO2013105946A1 (en) * | 2012-01-11 | 2013-07-18 | Thomson Licensing | Motion compensating transformation for video coding |
| CN104376544B (zh) * | 2013-08-15 | 2017-04-19 | 北京大学 | 一种基于多区域尺度放缩补偿的非局部超分辨率重建方法 |
| US9774865B2 (en) * | 2013-12-16 | 2017-09-26 | Samsung Electronics Co., Ltd. | Method for real-time implementation of super resolution |
| JP6986721B2 (ja) * | 2014-03-18 | 2021-12-22 | パナソニックIpマネジメント株式会社 | 復号装置及び符号化装置 |
| CN106056540A (zh) * | 2016-07-08 | 2016-10-26 | 北京邮电大学 | 基于鲁棒光流和Zernike不变矩的视频时空超分辨率重建方法 |
| CN110226329B (zh) * | 2017-01-27 | 2021-09-21 | 阿帕里奥全球咨询股份有限公司 | 用于将物理显示器的替代图像内容发送到不同观看者的方法和系统 |
| CN111882486B (zh) * | 2020-06-21 | 2023-03-10 | 南开大学 | 一种基于低秩先验信息的混合分辨率多视点视频超分辨方法 |
| CN118283201B (zh) * | 2024-06-03 | 2024-10-15 | 上海蜜度科技股份有限公司 | 视频合成方法、系统、存储介质及电子设备 |
Family Cites Families (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11711A (en) | 1854-09-19 | William h | ||
| US10711A (en) | 1854-03-28 | Improvement in furnaces for zinc-white | ||
| US5537155A (en) * | 1994-04-29 | 1996-07-16 | Motorola, Inc. | Method for estimating motion in a video sequence |
| US6043838A (en) * | 1997-11-07 | 2000-03-28 | General Instrument Corporation | View offset estimation for stereoscopic video coding |
| US6766067B2 (en) * | 2001-04-20 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | One-pass super-resolution images |
| US7656950B2 (en) * | 2002-05-29 | 2010-02-02 | Diego Garrido | Video interpolation coding |
| US7119837B2 (en) * | 2002-06-28 | 2006-10-10 | Microsoft Corporation | Video processing system and method for automatic enhancement of digital video |
| AU2002951574A0 (en) * | 2002-09-20 | 2002-10-03 | Unisearch Limited | Method of signalling motion information for efficient scalable video compression |
| DE10310023A1 (de) * | 2003-02-28 | 2004-09-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Verfahren und Anordnung zur Videocodierung, wobei die Videocodierung Texturanalyse und Textursynthese umfasst, sowie ein entsprechendes Computerprogramm und ein entsprechendes computerlesbares Speichermedium |
| US7218796B2 (en) * | 2003-04-30 | 2007-05-15 | Microsoft Corporation | Patch-based video super-resolution |
| KR100504594B1 (ko) * | 2003-06-27 | 2005-08-30 | 주식회사 성진씨앤씨 | 데이터 압축 처리된 저해상도 영상으로부터 초해상도 영상복원 및 재구성 방법 |
| US7715658B2 (en) * | 2005-08-03 | 2010-05-11 | Samsung Electronics Co., Ltd. | Apparatus and method for super-resolution enhancement processing |
| US7460730B2 (en) * | 2005-08-04 | 2008-12-02 | Microsoft Corporation | Video registration and image sequence stitching |
| CN100413316C (zh) * | 2006-02-14 | 2008-08-20 | 华为技术有限公司 | 一种视频图像超分辨率重构方法 |
| US7933464B2 (en) * | 2006-10-17 | 2011-04-26 | Sri International | Scene-based non-uniformity correction and enhancement method using super-resolution |
| KR101381600B1 (ko) * | 2006-12-20 | 2014-04-04 | 삼성전자주식회사 | 텍스처 합성을 이용한 영상의 부호화, 복호화 방법 및 장치 |
| US8417037B2 (en) * | 2007-07-16 | 2013-04-09 | Alexander Bronstein | Methods and systems for representation and matching of video content |
| JP4876048B2 (ja) * | 2007-09-21 | 2012-02-15 | 株式会社日立製作所 | 映像送受信方法、受信装置、映像蓄積装置 |
| WO2009087641A2 (en) * | 2008-01-10 | 2009-07-16 | Ramot At Tel-Aviv University Ltd. | System and method for real-time super-resolution |
| US8989519B2 (en) * | 2009-04-20 | 2015-03-24 | Yeda Research & Development Co. Ltd. | Super resolution from a single signal |
| CN101551903A (zh) * | 2009-05-11 | 2009-10-07 | 天津大学 | 步态识别中的超分辨率图像恢复方法 |
| EP2526699A1 (en) * | 2010-01-22 | 2012-11-28 | Thomson Licensing | Data pruning for video compression using example-based super-resolution |
-
2011
- 2011-09-09 KR KR1020137006098A patent/KR101906614B1/ko not_active Expired - Fee Related
- 2011-09-09 EP EP11757721.3A patent/EP2614641A2/en not_active Withdrawn
- 2011-09-09 BR BR112013004107A patent/BR112013004107A2/pt not_active Application Discontinuation
- 2011-09-09 JP JP2013528305A patent/JP6042813B2/ja not_active Expired - Fee Related
- 2011-09-09 JP JP2013528306A patent/JP2013537381A/ja active Pending
- 2011-09-09 WO PCT/US2011/050913 patent/WO2012033962A2/en not_active Ceased
- 2011-09-09 EP EP11757722.1A patent/EP2614642A2/en not_active Withdrawn
- 2011-09-09 KR KR1020137009099A patent/KR101878515B1/ko not_active Expired - Fee Related
- 2011-09-09 CN CN201180043275.8A patent/CN103210645B/zh not_active Expired - Fee Related
- 2011-09-09 US US13/820,901 patent/US20130163673A1/en not_active Abandoned
- 2011-09-09 CN CN201180043723.4A patent/CN103141092B/zh not_active Expired - Fee Related
- 2011-09-09 WO PCT/US2011/050915 patent/WO2012033963A2/en not_active Ceased
- 2011-09-09 US US13/821,078 patent/US20130163676A1/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| KR101878515B1 (ko) | 2018-07-13 |
| CN103210645A (zh) | 2013-07-17 |
| JP2013537380A (ja) | 2013-09-30 |
| KR20130105827A (ko) | 2013-09-26 |
| WO2012033962A3 (en) | 2012-09-20 |
| WO2012033962A2 (en) | 2012-03-15 |
| WO2012033963A2 (en) | 2012-03-15 |
| CN103141092A (zh) | 2013-06-05 |
| EP2614642A2 (en) | 2013-07-17 |
| BR112013004107A2 (pt) | 2016-06-14 |
| CN103141092B (zh) | 2016-11-16 |
| US20130163676A1 (en) | 2013-06-27 |
| KR101906614B1 (ko) | 2018-10-10 |
| KR20130143566A (ko) | 2013-12-31 |
| WO2012033963A3 (en) | 2012-09-27 |
| EP2614641A2 (en) | 2013-07-17 |
| JP2013537381A (ja) | 2013-09-30 |
| US20130163673A1 (en) | 2013-06-27 |
| CN103210645B (zh) | 2016-09-07 |
| WO2012033963A8 (en) | 2012-07-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6042813B2 (ja) | ビデオ圧縮のための動き補償事例ベース超解像を用いてビデオ信号を符号化する方法と装置 | |
| Agustsson et al. | Scale-space flow for end-to-end optimized video compression | |
| JP2013537381A5 (enExample) | ||
| CN114793282B (zh) | 带有比特分配的基于神经网络的视频压缩 | |
| CN102823242B (zh) | 基于取样超分辨率视频编码和解码的方法和装置 | |
| US9554145B2 (en) | Re-encoding image sets using frequency-domain differences | |
| KR101838320B1 (ko) | 예시-기반 데이터 프루닝을 이용한 비디오 디코딩 | |
| JP5844745B2 (ja) | パッチシフティングを通じてベクトル量子化誤差を低減する方法および装置 | |
| TW202420815A (zh) | 使用神經網路進行圖像區域的並行處理-解碼、後濾波和rdoq | |
| CN120752644A (zh) | 用于视频处理的方法、装置和介质 | |
| WO2025051017A1 (en) | Method, non-transitory computer readable storage medium and decoder for generative face video compression using dense motion flow translator | |
| CN116438567A (zh) | 用于视频编码的基于神经网络的环内滤波 | |
| WO2024015639A9 (en) | Neural network-based image and video compression method with parallel processing | |
| WO2023001042A1 (en) | Signaling of down-sampling information for video bitstreams | |
| KR20250045443A (ko) | 관심 영역 기반 영상 정보 부호화 및 복호화 방법 | |
| KR20250143642A (ko) | 기계를 위한 적응적인 영상 복원 방법 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20140908 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20140908 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20150814 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20150901 |
|
| A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20151201 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20151224 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20160322 |
|
| A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20160621 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20160920 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20161018 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20161110 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 6042813 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
| S531 | Written request for registration of change of domicile |
Free format text: JAPANESE INTERMEDIATE CODE: R313531 |
|
| R371 | Transfer withdrawn |
Free format text: JAPANESE INTERMEDIATE CODE: R371 |
|
| R371 | Transfer withdrawn |
Free format text: JAPANESE INTERMEDIATE CODE: R371 |
|
| S531 | Written request for registration of change of domicile |
Free format text: JAPANESE INTERMEDIATE CODE: R313531 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| LAPS | Cancellation because of no payment of annual fees | ||
| S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |