CA2960617A1 - Perceptual optimization for model-based video encoding - Google Patents
Perceptual optimization for model-based video encoding Download PDFInfo
- Publication number
- CA2960617A1 CA2960617A1 CA2960617A CA2960617A CA2960617A1 CA 2960617 A1 CA2960617 A1 CA 2960617A1 CA 2960617 A CA2960617 A CA 2960617A CA 2960617 A CA2960617 A CA 2960617A CA 2960617 A1 CA2960617 A1 CA 2960617A1
- Authority
- CA
- Canada
- Prior art keywords
- block
- frame
- blocks
- tcsf
- motion vector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000005457 optimization Methods 0.000 title description 8
- 239000013598 vector Substances 0.000 claims abstract description 170
- 238000000034 method Methods 0.000 claims abstract description 70
- 230000002123 temporal effect Effects 0.000 claims abstract description 56
- 238000013139 quantization Methods 0.000 claims abstract description 55
- 230000035945 sensitivity Effects 0.000 claims abstract description 26
- 230000006870 function Effects 0.000 claims description 14
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000008447 perception Effects 0.000 claims description 6
- 230000000873 masking effect Effects 0.000 claims description 5
- 230000008569 process Effects 0.000 abstract description 31
- 230000000007 visual effect Effects 0.000 abstract description 8
- 238000013442 quality metrics Methods 0.000 abstract 1
- 238000007906 compression Methods 0.000 description 36
- 230000006835 compression Effects 0.000 description 34
- 238000004458 analytical method Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 13
- 230000000644 propagated effect Effects 0.000 description 10
- 238000001914 filtration Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 7
- 238000003708 edge detection Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 241000023320 Luma <angiosperm> Species 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000011218 segmentation Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 230000006837 decompression Effects 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 238000012935 Averaging Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 229910003460 diamond Inorganic materials 0.000 description 1
- 239000010432 diamond Substances 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000001303 quality assessment method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/527—Global motion vector estimation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201462049342P | 2014-09-11 | 2014-09-11 | |
| US62/049,342 | 2014-09-11 | ||
| US14/532,947 US9621917B2 (en) | 2014-03-10 | 2014-11-04 | Continuous block tracking for temporal prediction in video encoding |
| US14/532,947 | 2014-11-04 | ||
| US201462078181P | 2014-11-11 | 2014-11-11 | |
| US62/078,181 | 2014-11-11 | ||
| US201562158523P | 2015-05-07 | 2015-05-07 | |
| US62/158,523 | 2015-05-07 | ||
| PCT/US2015/048353 WO2016040116A1 (en) | 2014-09-11 | 2015-09-03 | Perceptual optimization for model-based video encoding |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2960617A1 true CA2960617A1 (en) | 2016-03-17 |
Family
ID=55459438
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2960617A Abandoned CA2960617A1 (en) | 2014-09-11 | 2015-09-03 | Perceptual optimization for model-based video encoding |
Country Status (5)
| Country | Link |
|---|---|
| EP (1) | EP3175618A1 (cg-RX-API-DMAC7.html) |
| JP (1) | JP6698077B2 (cg-RX-API-DMAC7.html) |
| CN (1) | CN106688232A (cg-RX-API-DMAC7.html) |
| CA (1) | CA2960617A1 (cg-RX-API-DMAC7.html) |
| WO (1) | WO2016040116A1 (cg-RX-API-DMAC7.html) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9532069B2 (en) | 2004-07-30 | 2016-12-27 | Euclid Discoveries, Llc | Video compression repository and model reuse |
| US9578345B2 (en) | 2005-03-31 | 2017-02-21 | Euclid Discoveries, Llc | Model-based video encoding and decoding |
| US9743078B2 (en) | 2004-07-30 | 2017-08-22 | Euclid Discoveries, Llc | Standards-compliant model-based video encoding and decoding |
| CA2942336A1 (en) | 2014-03-10 | 2015-09-17 | Euclid Discoveries, Llc | Continuous block tracking for temporal prediction in video encoding |
| US10097851B2 (en) | 2014-03-10 | 2018-10-09 | Euclid Discoveries, Llc | Perceptual optimization for model-based video encoding |
| US10091507B2 (en) | 2014-03-10 | 2018-10-02 | Euclid Discoveries, Llc | Perceptual optimization for model-based video encoding |
| CN109547802A (zh) * | 2017-09-22 | 2019-03-29 | 江苏智谋科技有限公司 | 基于三维视觉技术的无人机避障系统 |
| CN107843227B (zh) * | 2017-12-09 | 2020-04-10 | 连云港杰瑞电子有限公司 | 一种基于校准技术提高编码器精度的方法 |
| CN108172168B (zh) * | 2017-12-22 | 2019-11-15 | 深圳市华星光电半导体显示技术有限公司 | 一种补偿表压缩方法 |
| US10652550B2 (en) | 2017-12-22 | 2020-05-12 | Shenzhen China Star Optoelectronics Semiconductor Display Technology Co., Ltd. | Compensation table compressing method |
| WO2020065520A2 (en) | 2018-09-24 | 2020-04-02 | Beijing Bytedance Network Technology Co., Ltd. | Extended merge prediction |
| WO2019194572A1 (en) * | 2018-04-03 | 2019-10-10 | Samsung Electronics Co., Ltd. | Methods and apparatus for determining adjustment parameter during encoding of spherical multimedia content |
| WO2019205129A1 (en) | 2018-04-28 | 2019-10-31 | SZ DJI Technology Co., Ltd. | Motion estimation |
| KR102738271B1 (ko) | 2018-06-05 | 2024-12-04 | 두인 비전 컴퍼니 리미티드 | Ibc 및 atmvp 간의 상호 작용 |
| CN110636297B (zh) * | 2018-06-21 | 2021-05-14 | 北京字节跳动网络技术有限公司 | 分量相关的子块分割 |
| CN110636298B (zh) | 2018-06-21 | 2022-09-13 | 北京字节跳动网络技术有限公司 | 对于Merge仿射模式和非Merge仿射模式的统一约束 |
| EP3811620A1 (en) | 2018-06-21 | 2021-04-28 | InterDigital VC Holdings, Inc. | Refinement mode processing in video encoding and decoding |
| CN110859057A (zh) * | 2018-06-29 | 2020-03-03 | 深圳市大疆创新科技有限公司 | 运动矢量确定方法、设备及机器可读存储介质 |
| JP6941744B2 (ja) * | 2018-09-26 | 2021-09-29 | 富士フイルム株式会社 | 画像処理装置、撮影装置、画像処理方法及び画像処理プログラム |
| US10992938B2 (en) * | 2018-09-28 | 2021-04-27 | Ati Technologies Ulc | Spatial block-level pixel activity extraction optimization leveraging motion vectors |
| WO2020094150A1 (en) | 2018-11-10 | 2020-05-14 | Beijing Bytedance Network Technology Co., Ltd. | Rounding in current picture referencing |
| WO2020156538A1 (en) * | 2019-02-03 | 2020-08-06 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between mv precisions and mv difference coding |
| CN109819252B (zh) * | 2019-03-20 | 2021-05-18 | 福州大学 | 一种不依赖gop结构的量化参数级联方法 |
| CN109982082B (zh) * | 2019-05-05 | 2022-11-15 | 山东大学 | 一种基于局部纹理特性的hevc多失真准则率失真优化方法 |
| CN111882564A (zh) * | 2020-07-27 | 2020-11-03 | 山东大学 | 一种超高清医学病理图像的压缩处理方法 |
| US11638025B2 (en) * | 2021-03-19 | 2023-04-25 | Qualcomm Incorporated | Multi-scale optical flow for learned video compression |
| CN113556544B (zh) * | 2021-06-30 | 2024-04-19 | 北京锐马视讯科技有限公司 | 基于场景自适应的视频编码方法和装置、设备及存储介质 |
| CN119478754B (zh) * | 2024-05-24 | 2025-04-29 | 南京师范大学 | 基于差分特征增强的多视角中学实验步骤检测方法及系统 |
| CN119316569B (zh) * | 2024-12-16 | 2025-04-08 | 深圳金三立视频科技股份有限公司 | 一种用于山火检测的火点视频实时监控方法及系统 |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3112035B2 (ja) * | 1991-10-07 | 2000-11-27 | 株式会社日立製作所 | 動画像圧縮符号化装置及び方法 |
| KR970010101B1 (en) * | 1994-06-30 | 1997-06-21 | Daewoo Electronics Co Ltd | Post-processing method of digital transmission pictures |
| JP4608801B2 (ja) * | 2000-05-25 | 2011-01-12 | ソニー株式会社 | 画像情報変換装置及び方法 |
| US6831947B2 (en) * | 2001-03-23 | 2004-12-14 | Sharp Laboratories Of America, Inc. | Adaptive quantization based on bit rate prediction and prediction error energy |
| KR100539923B1 (ko) * | 2003-02-10 | 2005-12-28 | 삼성전자주식회사 | 화상통화시 화자의 영상을 구분하여 차등적 부호화할 수있는 비디오 엔코더 및 이를 이용한 비디오신호의 압축방법 |
| CN101189882B (zh) * | 2004-07-20 | 2012-08-01 | 高通股份有限公司 | 用于视频压缩的编码器辅助帧率上变换（ea-fruc）的方法和装置 |
| JP4249672B2 (ja) * | 2004-08-16 | 2009-04-02 | Ｋｄｄｉ株式会社 | ビデオ情報複数同時符号化装置 |
| JP2006067302A (ja) * | 2004-08-27 | 2006-03-09 | Toshiba Corp | 画像符号化装置、画像符号化方法および画像符号化プログラム |
| US8135062B1 (en) * | 2006-01-16 | 2012-03-13 | Maxim Integrated Products, Inc. | Method and apparatus for QP modulation based on perceptual models for picture encoding |
| CN101184221A (zh) * | 2007-12-06 | 2008-05-21 | 上海大学 | 基于视觉关注度的视频编码方法 |
| KR100952340B1 (ko) * | 2008-01-24 | 2010-04-09 | 에스케이 텔레콤주식회사 | 시공간적 복잡도를 이용한 부호화 모드 결정 방법 및 장치 |
| CN101325711A (zh) * | 2008-07-16 | 2008-12-17 | 上海大学 | 基于时空掩盖效应的自适应码率控制方法 |
| US8848788B2 (en) * | 2009-05-16 | 2014-09-30 | Thomson Licensing | Method and apparatus for joint quantization parameter adjustment |
| US8737464B1 (en) * | 2011-07-21 | 2014-05-27 | Cisco Technology, Inc. | Adaptive quantization for perceptual video coding |
| CN104780369B (zh) * | 2012-08-21 | 2018-04-17 | 华为技术有限公司 | 一种获得视频编码压缩质量的方法及装置 |
-
2015
- 2015-09-03 WO PCT/US2015/048353 patent/WO2016040116A1/en not_active Ceased
- 2015-09-03 CN CN201580049004.1A patent/CN106688232A/zh active Pending
- 2015-09-03 CA CA2960617A patent/CA2960617A1/en not_active Abandoned
- 2015-09-03 JP JP2017513750A patent/JP6698077B2/ja active Active
- 2015-09-03 EP EP15770689.6A patent/EP3175618A1/en not_active Withdrawn
Also Published As
| Publication number | Publication date |
|---|---|
| WO2016040116A1 (en) | 2016-03-17 |
| JP6698077B2 (ja) | 2020-05-27 |
| CN106688232A (zh) | 2017-05-17 |
| EP3175618A1 (en) | 2017-06-07 |
| JP2017532858A (ja) | 2017-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10097851B2 (en) | Perceptual optimization for model-based video encoding | |
| US10091507B2 (en) | Perceptual optimization for model-based video encoding | |
| JP6698077B2 (ja) | モデルベースの映像符号化用の知覚的最適化 | |
| US11228766B2 (en) | Dynamic scaling for consistent video quality in multi-frame size encoding | |
| US9621917B2 (en) | Continuous block tracking for temporal prediction in video encoding | |
| US10212456B2 (en) | Deblocking filter for high dynamic range (HDR) video | |
| EP1797722B1 (en) | Adaptive overlapped block matching for accurate motion compensation | |
| EP3075154B1 (en) | Selection of motion vector precision | |
| US20110206132A1 (en) | Data Compression for Video | |
| US9294764B2 (en) | Video encoder with intra-prediction candidate screening and methods for use therewith | |
| US20110206119A1 (en) | Data Compression for Video | |
| US9591313B2 (en) | Video encoder with transform size preprocessing and methods for use therewith | |
| KR20200002036A (ko) | 비디오 코딩에서 모션 보상 예측을 위한 광흐름 추정 | |
| US12464125B2 (en) | Method and apparatus for video coding using deep learning based in-loop filter for inter prediction | |
| US9438925B2 (en) | Video encoder with block merging and methods for use therewith | |
| KR101700410B1 (ko) | 인트라 모드를 이용한 쿼터 픽셀 해상도를 갖는 영상 보간 방법 및 장치 | |
| WO2023048646A9 (en) | Methods and systems for performing combined inter and intra prediction | |
| EP2899975A1 (en) | Video encoder with intra-prediction pre-processing and methods for use therewith | |
| Li et al. | Fast mode decision based on human noticeable luminance difference and rate distortion cost for H. 264/AVC | |
| US20240314307A1 (en) | Temporal filter | |
| Corrêa | Computational Complexity Reduction and Scaling for High Efficiency Video Encoders | |
| WO2024081291A1 (en) | Method and apparatus for cross-component prediction for video coding | |
| CN116647683A (zh) | 量化处理方法和装置 | |
| Su | Content based low complexity algorithms for high efficiency video coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request |
Effective date: 20200821 |
|
| EEER | Examination request |
Effective date: 20200821 |
|
| FZDE | Discontinued |
Effective date: 20230310 |
|
| FZDE | Discontinued |
Effective date: 20230310 |