CN112166608B - 采用简化梯度推导的双向光流方法 - Google Patents

采用简化梯度推导的双向光流方法 Download PDF

Info

Publication number
CN112166608B
CN112166608B CN201980034247.6A CN201980034247A CN112166608B CN 112166608 B CN112166608 B CN 112166608B CN 201980034247 A CN201980034247 A CN 201980034247A CN 112166608 B CN112166608 B CN 112166608B
Authority
CN
China
Prior art keywords
block
sub
bdof
prediction
coding block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980034247.6A
Other languages
English (en)
Chinese (zh)
Other versions
CN112166608A (zh
Inventor
贺玉文
修晓宇
叶艳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
Vid Scale Inc
InterDigital VC Holdings Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vid Scale Inc, InterDigital VC Holdings Inc filed Critical Vid Scale Inc
Priority to CN202411530256.3A priority Critical patent/CN119484836A/zh
Priority to CN202411530258.2A priority patent/CN119484837A/zh
Publication of CN112166608A publication Critical patent/CN112166608A/zh
Application granted granted Critical
Publication of CN112166608B publication Critical patent/CN112166608B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20182—Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN201980034247.6A 2018-04-06 2019-04-05 采用简化梯度推导的双向光流方法 Active CN112166608B (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202411530256.3A CN119484836A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置
CN202411530258.2A CN119484837A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862653674P 2018-04-06 2018-04-06
US62/653,674 2018-04-06
PCT/US2019/025933 WO2019195643A1 (en) 2018-04-06 2019-04-05 A bi-directional optical flow method with simplified gradient derivation

Related Child Applications (2)

Application Number Title Priority Date Filing Date
CN202411530256.3A Division CN119484836A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置
CN202411530258.2A Division CN119484837A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置

Publications (2)

Publication Number Publication Date
CN112166608A CN112166608A (zh) 2021-01-01
CN112166608B true CN112166608B (zh) 2024-11-08

Family

ID=66770524

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201980034247.6A Active CN112166608B (zh) 2018-04-06 2019-04-05 采用简化梯度推导的双向光流方法
CN202411530256.3A Pending CN119484836A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置
CN202411530258.2A Pending CN119484837A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN202411530256.3A Pending CN119484836A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置
CN202411530258.2A Pending CN119484837A (zh) 2018-04-06 2019-04-05 用于视频解码的方法、用于视频编码的方法及其装置

Country Status (5)

Country Link
US (3) US11575933B2 (https=)
EP (1) EP3777159A1 (https=)
JP (3) JP2021520710A (https=)
CN (3) CN112166608B (https=)
WO (1) WO2019195643A1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2018271194B2 (en) 2017-05-17 2021-04-08 Kt Corporation Method and device for video signal processing
EP3780598A4 (en) 2018-03-29 2022-01-26 Nippon Hoso Kyokai Image encoding device, image decoding device, and program
CN112840659B (zh) * 2018-09-14 2024-07-09 松下电器（美国）知识产权公司 编码装置、解码装置和记录介质
IL281581B2 (en) 2018-09-21 2025-05-01 Vid Scale Inc Complexity reduction and bit width control for bidirectional optical streaming
CN117880513A (zh) 2018-10-22 2024-04-12 北京字节跳动网络技术有限公司 基于编解码信息的解码器侧运动矢量推导的限制
CN112913240B (zh) * 2018-10-22 2024-08-06 北京字节跳动网络技术有限公司 解码器侧运动矢量推导和其他编解码工具之间的并置
MX2021007180A (es) * 2018-12-28 2021-08-05 Sony Group Corp Dispositivo y metodo de procesamiento de imagen.
JP6867611B2 (ja) 2019-03-11 2021-04-28 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
ES2957801T3 (es) * 2019-03-12 2024-01-25 Lg Electronics Inc Método y dispositivo de inter predicción basándose en DMVR y BDOF
US11962796B2 (en) 2019-04-01 2024-04-16 Qualcomm Incorporated Gradient-based prediction refinement for video coding
US11317088B2 (en) * 2019-05-17 2022-04-26 Qualcomm Incorporated Gradient-based prediction refinement for video coding
WO2020233659A1 (en) 2019-05-21 2020-11-26 Beijing Bytedance Network Technology Co., Ltd. Adaptive motion vector difference resolution for affine mode
CN120343267A (zh) 2019-06-21 2025-07-18 松下电器（美国）知识产权公司 编码装置、解码装置和非暂时性计算机可读介质
CN117336468A (zh) 2019-08-10 2024-01-02 北京字节跳动网络技术有限公司 视频比特流中的子图片相关信令通知
KR20220066045A (ko) 2019-09-19 2022-05-23 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 비디오 코딩의 스케일링 윈도우
CN117615155A (zh) 2019-09-19 2024-02-27 北京字节跳动网络技术有限公司 视频编解码中的参考样点位置推导
BR112022006453A2 (pt) 2019-10-05 2022-09-27 Beijing Bytedance Network Tech Co Ltd Método de processamento de dados de dados de vídeo, aparelho para processar dados de vídeo, meio de armazenamento não transitório legível por computador e meio de gravação não transitório legível por computador
CN117499640A (zh) * 2019-10-12 2024-02-02 北京字节跳动网络技术有限公司 视频编解码中的预测类型信令
CN117376557A (zh) 2019-10-13 2024-01-09 北京字节跳动网络技术有限公司 参考图片重采样与视频编解码工具之间的相互作用
EP4032290A4 (en) 2019-10-18 2022-11-30 Beijing Bytedance Network Technology Co., Ltd. SYNTAX RESTRICTIONS IN PARAMETER SET SIGNALING OF SUBPICTURES
CN115280774B (zh) 2019-12-02 2025-08-19 抖音视界有限公司 视觉媒体处理的方法、装置及非暂时性计算机可读存储介质
KR102922307B1 (ko) 2019-12-27 2026-02-05 두인 비전 컴퍼니 리미티드 비디오 픽처 헤더의 슬라이스 유형의 시그널링
CN121173953A (zh) * 2019-12-30 2025-12-19 Oppo广东移动通信有限公司 帧间预测方法、编码器、解码器及存储介质
WO2021188707A1 (en) * 2020-03-20 2021-09-23 Beijing Dajia Internet Information Technology Co., Ltd. Methods and apparatuses for simplification of bidirectional optical flow and decoder side motion vector refinement
WO2021190464A1 (en) 2020-03-23 2021-09-30 Beijing Bytedance Network Technology Co., Ltd. Controlling deblocking filtering at different levels in coded video
JP2021193781A (ja) * 2020-06-08 2021-12-23 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
CN118435601A (zh) * 2021-08-19 2024-08-02 联发科技股份有限公司 视频编解码系统中硬件友好的模板匹配方法和装置
CN118923113A (zh) * 2021-12-22 2024-11-08 抖音视界有限公司 用于视频处理的方法、装置和介质
KR20240069100A (ko) * 2022-11-11 2024-05-20 삼성전자주식회사 영역 분리를 이용한 영상 처리 장치, 영상 처리 방법, 및 이를 포함하는 전자 시스템
WO2025064640A1 (en) * 2023-09-20 2025-03-27 Bytedance Inc. Method, apparatus, and medium for video processing
US20250267274A1 (en) * 2024-02-20 2025-08-21 Tencent America LLC Uni-directional optical flow

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2661892B1 (en) 2011-01-07 2022-05-18 Nokia Technologies Oy Motion prediction in video coding
US9648318B2 (en) * 2012-09-30 2017-05-09 Qualcomm Incorporated Performing residual prediction in video coding
US9800857B2 (en) * 2013-03-08 2017-10-24 Qualcomm Incorporated Inter-view residual prediction in multi-view or 3-dimensional video coding
US20180242004A1 (en) 2015-08-23 2018-08-23 Lg Electronics Inc. Inter prediction mode-based image processing method and apparatus therefor
US10375413B2 (en) 2015-09-28 2019-08-06 Qualcomm Incorporated Bi-directional optical flow for video coding
EP3413563B1 (en) 2016-02-03 2026-02-18 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Moving image decoding device, moving image encoding device, and prediction image generation device
EP3398331A4 (en) 2016-02-05 2019-04-10 Mediatek Inc. METHOD AND APPARATUS FOR MOTION COMPENSATION BASED ON BIDIRECTIONAL OPTICAL FLUSH TECHNOLOGIES FOR VIDEO CODING
CN105847804B (zh) 2016-05-18 2017-12-15 信阳师范学院 一种基于稀疏冗余表示模型的视频帧率上转换方法
WO2018021373A1 (ja) 2016-07-29 2018-02-01 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法及び復号方法
US10931969B2 (en) * 2017-01-04 2021-02-23 Qualcomm Incorporated Motion vector reconstructions for bi-directional optical flow (BIO)
US12063387B2 (en) 2017-01-05 2024-08-13 Hfi Innovation Inc. Decoder-side motion vector restoration for video coding
US10523964B2 (en) 2017-03-13 2019-12-31 Qualcomm Incorporated Inter prediction refinement based on bi-directional optical flow (BIO)
US10595035B2 (en) 2017-03-22 2020-03-17 Qualcomm Incorporated Constraining motion vector information derived by decoder-side motion vector derivation
CN117097890A (zh) * 2017-06-05 2023-11-21 松下电器（美国）知识产权公司 解码装置、编码装置、存储介质、解码方法和编码方法
JP7168593B2 (ja) 2017-07-03 2022-11-09 ヴィド スケール インコーポレイテッド 双方向オプティカルフローに基づいた動き補償予測
CN118264800A (zh) * 2017-12-14 2024-06-28 Lg电子株式会社 解码和编码设备及发送用于图像的数据的设备
US11265551B2 (en) * 2018-01-18 2022-03-01 Qualcomm Incorporated Decoder-side motion vector derivation

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques

Also Published As

Publication number Publication date
US20250280148A1 (en) 2025-09-04
CN119484836A (zh) 2025-02-18
JP2025066135A (ja) 2025-04-22
EP3777159A1 (en) 2021-02-17
CN112166608A (zh) 2021-01-01
CN119484837A (zh) 2025-02-18
US20210029378A1 (en) 2021-01-28
JP2021520710A (ja) 2021-08-19
US11575933B2 (en) 2023-02-07
JP2026021587A (ja) 2026-02-10
RU2020135518A (ru) 2022-04-29
US20230188748A1 (en) 2023-06-15
WO2019195643A1 (en) 2019-10-10

Similar Documents

Publication Publication Date Title
CN112166608B (zh) 采用简化梯度推导的双向光流方法
JP7649771B2 (ja) 双方向オプティカルフローに基づいた動き補償予測
JP7808670B2 (ja) 組みあわせたインターおよびイントラ予測
CN111630855B (zh) 基于局部照明补偿的运动补偿双向预测
JP7398442B2 (ja) ビデオコーディングのための双予測
JP7382332B2 (ja) マージモード用のサブブロック動き導出およびデコーダサイド動きベクトル精緻化
CN113615186A (zh) 对称运动矢量差译码
CN113016186B (zh) 用于基于仿射模型的视频译码的仿射运动估计
RU2830998C2 (ru) Метод двунаправленного оптического потока с упрощенным выведением градиента
WO2024133579A1 (en) Gpm combination with inter tools
WO2023118309A1 (en) Gdr interaction with template based tools in inter slice
WO2025002756A1 (en) Bi-prediction intra block copy with local illumination compensation
CN121359443A (zh) 对帧内块复制的改进
KR20260055522A (ko) 대칭 모션 벡터 차이 코딩

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20240815

Address after: Delaware, USA

Applicant after: Interactive Digital VC Holdings

Country or region after: U.S.A.

Address before: Wilmington, Delaware, USA

Applicant before: VID SCALE, Inc.

Country or region before: U.S.A.

GR01 Patent grant
GR01 Patent grant