JP2021520710A - 簡易化された勾配導出による双方向オプティカルフロー方法 - Google Patents

簡易化された勾配導出による双方向オプティカルフロー方法 Download PDF

Info

Publication number
JP2021520710A
JP2021520710A JP2020553659A JP2020553659A JP2021520710A JP 2021520710 A JP2021520710 A JP 2021520710A JP 2020553659 A JP2020553659 A JP 2020553659A JP 2020553659 A JP2020553659 A JP 2020553659A JP 2021520710 A JP2021520710 A JP 2021520710A
Authority
JP
Japan
Prior art keywords
gradient
bdof
difference
horizontal
vertical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2020553659A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021520710A5 (enExample
Inventor
フ、ユーウェン
シウ、シャオユウ
ユー、ヤン
Original Assignee
ヴィド スケール インコーポレイテッド
ヴィド スケール インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ヴィド スケール インコーポレイテッド, ヴィド スケール インコーポレイテッド filed Critical ヴィド スケール インコーポレイテッド
Publication of JP2021520710A publication Critical patent/JP2021520710A/ja
Publication of JP2021520710A5 publication Critical patent/JP2021520710A5/ja
Priority to JP2025010575A priority Critical patent/JP2025066135A/ja
Priority to JP2025194252A priority patent/JP2026021587A/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20048—Transform domain processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20182—Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
JP2020553659A 2018-04-06 2019-04-05 簡易化された勾配導出による双方向オプティカルフロー方法 Pending JP2021520710A (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2025010575A JP2025066135A (ja) 2018-04-06 2025-01-24 簡易化された勾配導出による双方向オプティカルフロー方法
JP2025194252A JP2026021587A (ja) 2018-04-06 2025-11-13 簡易化された勾配導出による双方向オプティカルフロー方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862653674P 2018-04-06 2018-04-06
US62/653,674 2018-04-06
PCT/US2019/025933 WO2019195643A1 (en) 2018-04-06 2019-04-05 A bi-directional optical flow method with simplified gradient derivation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025010575A Division JP2025066135A (ja) 2018-04-06 2025-01-24 簡易化された勾配導出による双方向オプティカルフロー方法

Publications (2)

Publication Number Publication Date
JP2021520710A true JP2021520710A (ja) 2021-08-19
JP2021520710A5 JP2021520710A5 (enExample) 2021-09-30

Family

ID=66770524

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2020553659A Pending JP2021520710A (ja) 2018-04-06 2019-04-05 簡易化された勾配導出による双方向オプティカルフロー方法
JP2025010575A Ceased JP2025066135A (ja) 2018-04-06 2025-01-24 簡易化された勾配導出による双方向オプティカルフロー方法
JP2025194252A Pending JP2026021587A (ja) 2018-04-06 2025-11-13 簡易化された勾配導出による双方向オプティカルフロー方法

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2025010575A Ceased JP2025066135A (ja) 2018-04-06 2025-01-24 簡易化された勾配導出による双方向オプティカルフロー方法
JP2025194252A Pending JP2026021587A (ja) 2018-04-06 2025-11-13 簡易化された勾配導出による双方向オプティカルフロー方法

Country Status (5)

Country Link
US (3) US11575933B2 (enExample)
EP (1) EP3777159A1 (enExample)
JP (3) JP2021520710A (enExample)
CN (3) CN119484837A (enExample)
WO (1) WO2019195643A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116866581A (zh) 2017-05-17 2023-10-10 株式会社Kt 对视频解码和编码的方法以及存储压缩视频数据的装置
EP3780598A4 (en) * 2018-03-29 2022-01-26 Nippon Hoso Kyokai PICTURE CODING DEVICE, PICTURE DECODING DEVICE, AND PROGRAM
JP7004835B2 (ja) * 2018-09-14 2022-01-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法、および復号方法
CN112715030B (zh) 2018-09-21 2024-04-23 Vid拓展公司 用于双向光流的复杂度降低和位宽控制
CN112889284B (zh) * 2018-10-22 2024-12-13 北京字节跳动网络技术有限公司 基于子块的解码器侧运动矢量推导
CN117880513A (zh) 2018-10-22 2024-04-12 北京字节跳动网络技术有限公司 基于编解码信息的解码器侧运动矢量推导的限制
WO2020137643A1 (ja) * 2018-12-28 2020-07-02 ソニー株式会社 画像処理装置および方法
JP6867611B2 (ja) * 2019-03-11 2021-04-28 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
PL3941060T3 (pl) * 2019-03-12 2023-12-27 Lg Electronics Inc. Sposób i urządzenie inter-predykcji oparte na dmvr i bdof
US11962796B2 (en) 2019-04-01 2024-04-16 Qualcomm Incorporated Gradient-based prediction refinement for video coding
US11317088B2 (en) * 2019-05-17 2022-04-26 Qualcomm Incorporated Gradient-based prediction refinement for video coding
WO2020233659A1 (en) 2019-05-21 2020-11-26 Beijing Bytedance Network Technology Co., Ltd. Adaptive motion vector difference resolution for affine mode
MX2021012502A (es) * 2019-06-21 2021-11-12 Panasonic Ip Corp America Codificador, decodificador, metodo de codificacion y metodo de decodificacion.
JP7372443B2 (ja) 2019-08-10 2023-10-31 北京字節跳動網絡技術有限公司 サブピクチャに依存するビデオビットストリーム内のシグナリング
KR102737934B1 (ko) 2019-09-19 2024-12-04 두인 비전 컴퍼니 리미티드 비디오 코딩에서 레퍼런스 샘플 위치 유도
CN114503574B (zh) 2019-09-19 2025-01-10 北京字节跳动网络技术有限公司 视频编解码中的缩放窗口
MX2022003836A (es) 2019-10-05 2022-05-12 Beijing Bytedance Network Tech Co Ltd Se?alizacion basada en los niveles de las herramientas de codificacion de video.
CN117499640A (zh) 2019-10-12 2024-02-02 北京字节跳动网络技术有限公司 视频编解码中的预测类型信令
EP4029274A4 (en) 2019-10-13 2022-11-30 Beijing Bytedance Network Technology Co., Ltd. INTERPLAY BETWEEN REFERENCE IMAGE CAPTURE AND VIDEO ENCODING TOOLS
CN117676135A (zh) 2019-10-18 2024-03-08 北京字节跳动网络技术有限公司 子图片与环路滤波之间的相互影响
WO2021110017A1 (en) 2019-12-02 2021-06-10 Beijing Bytedance Network Technology Co., Ltd. Merge with motion vector differencing in affine mode
MX2022007503A (es) 2019-12-27 2022-07-04 Beijing Bytedance Network Tech Co Ltd Se?alizacion de tipos de corte en encabezados de imagenes de video.
CN121262368A (zh) * 2019-12-30 2026-01-02 Oppo广东移动通信有限公司 帧间预测方法、编码器、解码器及存储介质
CN115315955A (zh) * 2020-03-20 2022-11-08 北京达佳互联信息技术有限公司 用于双向光流和解码器侧运动矢量细化的简化的方法和装置
EP4107941A4 (en) 2020-03-23 2023-04-19 Beijing Bytedance Network Technology Co., Ltd. PREDICTION REFINEMENT FOR AFFINE MERGE AND AFFINER MOTION VECTOR PREDICTION MODE
JP2021193781A (ja) * 2020-06-08 2021-12-23 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
US20240357081A1 (en) * 2021-08-19 2024-10-24 Mediatek Inc. Method and Apparatus for Hardware-Friendly Template Matching in Video Coding System
WO2023116778A1 (en) 2021-12-22 2023-06-29 Beijing Bytedance Network Technology Co., Ltd. Method, apparatus, and medium for video processing
KR20240069100A (ko) * 2022-11-11 2024-05-20 삼성전자주식회사 영역 분리를 이용한 영상 처리 장치, 영상 처리 방법, 및 이를 포함하는 전자 시스템
CN121890077A (zh) * 2023-09-20 2026-04-17 字节跳动有限公司 用于视频处理的方法、装置和介质
US20250267274A1 (en) * 2024-02-20 2025-08-21 Tencent America LLC Uni-directional optical flow

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques
JP2021507589A (ja) * 2017-12-14 2021-02-22 エルジー エレクトロニクス インコーポレイティド 映像コーディングシステムにおけるインター予測による映像デコーディング方法及び装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
HRP20250027T1 (hr) 2011-01-07 2025-03-14 Nokia Technologies Oy Predviđanje kretnji kod kodiranja videa
US9648318B2 (en) * 2012-09-30 2017-05-09 Qualcomm Incorporated Performing residual prediction in video coding
US9800857B2 (en) * 2013-03-08 2017-10-24 Qualcomm Incorporated Inter-view residual prediction in multi-view or 3-dimensional video coding
US20180242004A1 (en) 2015-08-23 2018-08-23 Lg Electronics Inc. Inter prediction mode-based image processing method and apparatus therefor
US10375413B2 (en) 2015-09-28 2019-08-06 Qualcomm Incorporated Bi-directional optical flow for video coding
CN115037929A (zh) 2016-02-03 2022-09-09 Oppo广东移动通信有限公司 运动图像解码装置、编码装置、以及预测图像生成装置
EP3398331A4 (en) 2016-02-05 2019-04-10 Mediatek Inc. METHOD AND APPARATUS FOR MOTION COMPENSATION BASED ON BIDIRECTIONAL OPTICAL FLUSH TECHNOLOGIES FOR VIDEO CODING
CN105847804B (zh) 2016-05-18 2017-12-15 信阳师范学院 一种基于稀疏冗余表示模型的视频帧率上转换方法
WO2018021373A1 (ja) 2016-07-29 2018-02-01 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法及び復号方法
US10931969B2 (en) * 2017-01-04 2021-02-23 Qualcomm Incorporated Motion vector reconstructions for bi-directional optical flow (BIO)
US12063387B2 (en) 2017-01-05 2024-08-13 Hfi Innovation Inc. Decoder-side motion vector restoration for video coding
US10523964B2 (en) 2017-03-13 2019-12-31 Qualcomm Incorporated Inter prediction refinement based on bi-directional optical flow (BIO)
US10595035B2 (en) 2017-03-22 2020-03-17 Qualcomm Incorporated Constraining motion vector information derived by decoder-side motion vector derivation
KR102574175B1 (ko) * 2017-06-05 2023-09-04 파나소닉 인텔렉츄얼 프로퍼티 코포레이션 오브 아메리카 부호화 장치, 복호 장치, 부호화 방법 및 복호 방법
BR112020000032A2 (pt) * 2017-07-03 2020-07-14 Vid Scale, Inc. dispositivo e método de codificação de dados de vídeo.
US11265551B2 (en) * 2018-01-18 2022-03-01 Qualcomm Incorporated Decoder-side motion vector derivation

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques
JP2021507589A (ja) * 2017-12-14 2021-02-22 エルジー エレクトロニクス インコーポレイティド 映像コーディングシステムにおけるインター予測による映像デコーディング方法及び装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHEN, JIANLE ET AL.: "Algorithm Description of Joint Exploration Test Model 7 (JEM 7)", JVET-G1001 (VERSION 1), JPN6023022032, 19 August 2017 (2017-08-19), pages 23 - 27, ISSN: 0005076913 *

Also Published As

Publication number Publication date
EP3777159A1 (en) 2021-02-17
CN119484837A (zh) 2025-02-18
JP2026021587A (ja) 2026-02-10
US20230188748A1 (en) 2023-06-15
CN112166608A (zh) 2021-01-01
WO2019195643A1 (en) 2019-10-10
US20250280148A1 (en) 2025-09-04
US20210029378A1 (en) 2021-01-28
RU2020135518A (ru) 2022-04-29
CN119484836A (zh) 2025-02-18
CN112166608B (zh) 2024-11-08
JP2025066135A (ja) 2025-04-22
US11575933B2 (en) 2023-02-07

Similar Documents

Publication Publication Date Title
JP7448600B2 (ja) 局所照明補償に基づいた動き補償双予測
US20230188748A1 (en) Bi-directional optical flow method with simplified gradient derivation
JP7649771B2 (ja) 双方向オプティカルフローに基づいた動き補償予測
JP7808670B2 (ja) 組みあわせたインターおよびイントラ予測
JP7398442B2 (ja) ビデオコーディングのための双予測
JP7382332B2 (ja) マージモード用のサブブロック動き導出およびデコーダサイド動きベクトル精緻化
JP2023130415A (ja) オプティカルフローを用いたインター予測リファインメントのためのシステム、装置、および方法
US10917660B2 (en) Prediction approaches for intra planar coding
JP2022516433A (ja) 対称的な動きベクトル差分符号化
JP2021529462A (ja) アフィン動きモデルを基にしたビデオコーディングのためのアダプティブ制御点の選択
JP2022525401A (ja) 対称的マージモード動きベクトル符号化
JP2022516091A (ja) 履歴ベースの動きベクトル予測
RU2830998C2 (ru) Метод двунаправленного оптического потока с упрощенным выведением градиента

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201202

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20201014

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20210129

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220405

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230515

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230606

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20230906

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231205

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240305

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240605

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20240924

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20241115

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250124

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260422