CA3043050A1 - Motion vector reconstructions for bi-directional optical flow (bio) - Google Patents

Motion vector reconstructions for bi-directional optical flow (bio) Download PDF

Info

Publication number
CA3043050A1
CA3043050A1 CA3043050A CA3043050A CA3043050A1 CA 3043050 A1 CA3043050 A1 CA 3043050A1 CA 3043050 A CA3043050 A CA 3043050A CA 3043050 A CA3043050 A CA 3043050A CA 3043050 A1 CA3043050 A1 CA 3043050A1
Authority
CA
Canada
Prior art keywords
block
sub
video data
predictive
motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3043050A
Other languages
English (en)
French (fr)
Inventor
Yi-Wen Chen
Hsiao-Chiang Chuang
Xiang Li
Li Zhang
Wei-Jung Chien
Jianle Chen
Marta Karczewicz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CA3043050A1 publication Critical patent/CA3043050A1/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/577Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/537Motion estimation other than block-based
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/144Movement detection
    • H04N5/145Movement estimation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CA3043050A 2017-01-04 2018-01-04 Motion vector reconstructions for bi-directional optical flow (bio) Pending CA3043050A1 (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201762442357P 2017-01-04 2017-01-04
US62/442,357 2017-01-04
US201762445152P 2017-01-11 2017-01-11
US62/445,152 2017-01-11
US15/861,515 US10931969B2 (en) 2017-01-04 2018-01-03 Motion vector reconstructions for bi-directional optical flow (BIO)
US15/861,515 2018-01-03
PCT/US2018/012360 WO2018129172A1 (en) 2017-01-04 2018-01-04 Motion vector reconstructions for bi-directional optical flow (bio)

Publications (1)

Publication Number Publication Date
CA3043050A1 true CA3043050A1 (en) 2018-07-12

Family

ID=62711435

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3043050A Pending CA3043050A1 (en) 2017-01-04 2018-01-04 Motion vector reconstructions for bi-directional optical flow (bio)

Country Status (13)

Country Link
US (1) US10931969B2 (enExample)
EP (1) EP3566441B1 (enExample)
JP (1) JP7159166B2 (enExample)
KR (1) KR102579523B1 (enExample)
CN (1) CN110036638B (enExample)
AU (1) AU2018205783B2 (enExample)
BR (1) BR112019013684A2 (enExample)
CA (1) CA3043050A1 (enExample)
CL (1) CL2019001393A1 (enExample)
CO (1) CO2019007120A2 (enExample)
TW (1) TWI761415B (enExample)
WO (1) WO2018129172A1 (enExample)
ZA (1) ZA201904373B (enExample)

Families Citing this family (70)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114615493A (zh) * 2016-03-24 2022-06-10 英迪股份有限公司 视频解码方法、视频编码方法和可读记录介质
KR102437110B1 (ko) * 2016-07-14 2022-08-26 삼성전자주식회사 비디오 복호화 방법 및 그 장치 및 비디오 부호화 방법 및 그 장치
CN116708830A (zh) * 2017-04-24 2023-09-05 Sk电信有限公司 编解码视频数据的装置、存储编码视频数据比特流的方法
CN117014631A (zh) * 2017-04-27 2023-11-07 松下电器(美国)知识产权公司 解码装置、编码装置以及非暂时性记录介质
CN116866585A (zh) 2017-05-17 2023-10-10 株式会社Kt 对图像解码和编码的方法以及存储压缩视频数据的装置
WO2018212111A1 (ja) * 2017-05-19 2018-11-22 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法及び復号方法
WO2019003993A1 (ja) * 2017-06-26 2019-01-03 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 符号化装置、復号装置、符号化方法及び復号方法
KR102595689B1 (ko) * 2017-09-29 2023-10-30 인텔렉추얼디스커버리 주식회사 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
EP3713236A4 (en) * 2017-12-14 2021-04-21 LG Electronics Inc. METHOD AND DEVICE FOR DECODING IMAGE ACCORDING TO INTER-PREDICTION IN AN IMAGE CODING SYSTEM
CN118075487A (zh) 2018-02-06 2024-05-24 松下电器(美国)知识产权公司 编码方法、解码方法、处理比特流的方法以及比特流生成装置
US11109053B2 (en) * 2018-03-05 2021-08-31 Panasonic Intellectual Property Corporation Of America Encoding method, decoding method, encoder, and decoder
WO2019190907A1 (en) * 2018-03-30 2019-10-03 Vid Scale, Inc Template-based inter prediction techniques based on encoding and decoding latency reduction
CN119484836A (zh) * 2018-04-06 2025-02-18 交互数字Vc控股公司 用于视频解码的方法、用于视频编码的方法及其装置
US10841575B2 (en) * 2018-04-15 2020-11-17 Arris Enterprises Llc Unequal weight planar motion vector derivation
CN112042189B (zh) * 2018-04-30 2023-07-21 寰发股份有限公司 照度补偿方法及相应的电子装置
KR102738271B1 (ko) 2018-06-05 2024-12-04 두인 비전 컴퍼니 리미티드 Ibc 및 atmvp 간의 상호 작용
MX2020013386A (es) 2018-06-11 2021-03-09 Hfi Innovation Inc Metodo y aparato de flujo optico bidireccional para la codificacion de video.
WO2019244119A1 (en) 2018-06-21 2019-12-26 Beijing Bytedance Network Technology Co., Ltd. Sub-block mv inheritance between color components
TWI739120B (zh) 2018-06-21 2021-09-11 大陸商北京字節跳動網絡技術有限公司 合併仿射模式與非合併仿射模式的統一拘束
GB2590222B (en) 2018-08-04 2023-02-01 Beijing Bytedance Network Tech Co Ltd MVD precision for affine
WO2020035029A1 (en) * 2018-08-17 2020-02-20 Mediatek Inc. Method and apparatus of simplified sub-mode for video coding
US11245922B2 (en) 2018-08-17 2022-02-08 Mediatek Inc. Shared candidate list
CN112930684B (zh) * 2018-08-17 2023-10-13 寰发股份有限公司 在视频编解码系统中利用双向预测处理视频的方法、设备
US11665365B2 (en) 2018-09-14 2023-05-30 Google Llc Motion prediction coding with coframe motion vectors
EP3854089A1 (en) 2018-09-21 2021-07-28 Vid Scale, Inc. Complexity reduction and bit-width control for bi-directional optical flow
US11146800B2 (en) * 2018-09-24 2021-10-12 Tencent America LLC Low latency local illumination compensation
WO2020065518A1 (en) 2018-09-24 2020-04-02 Beijing Bytedance Network Technology Co., Ltd. Bi-prediction with weights in video coding and decoding
TW202029755A (zh) * 2018-09-26 2020-08-01 美商Vid衡器股份有限公司 視訊編碼雙預測
WO2020070612A1 (en) 2018-10-06 2020-04-09 Beijing Bytedance Network Technology Co., Ltd. Improvement for temporal gradient calculating in bio
CN111083489B (zh) * 2018-10-22 2024-05-14 北京字节跳动网络技术有限公司 多次迭代运动矢量细化
CN112913241B (zh) * 2018-10-22 2024-03-26 北京字节跳动网络技术有限公司 解码器侧运动矢量推导的限制
WO2020084476A1 (en) 2018-10-22 2020-04-30 Beijing Bytedance Network Technology Co., Ltd. Sub-block based prediction
CN111093073B (zh) 2018-10-24 2024-04-19 北京字节跳动网络技术有限公司 用于子块运动矢量预测的基于搜索的运动候选推导
CN119011819A (zh) * 2018-11-05 2024-11-22 北京字节跳动网络技术有限公司 用于具有细化的帧间预测的插值
KR102759405B1 (ko) 2018-11-10 2025-01-23 두인 비전 컴퍼니 리미티드 페어와이즈 평균 후보 계산에서 라운딩
CN111436229B (zh) 2018-11-12 2024-06-28 北京字节跳动网络技术有限公司 帧间预测的带宽控制方法
WO2020103872A1 (en) * 2018-11-20 2020-05-28 Beijing Bytedance Network Technology Co., Ltd. Prediction refinement for combined inter intra prediction mode
EP3861742A4 (en) 2018-11-20 2022-04-13 Beijing Bytedance Network Technology Co., Ltd. DIFFERENCE CALCULATION BASED ON SPATIAL POSITION
WO2020103943A1 (en) 2018-11-22 2020-05-28 Beijing Bytedance Network Technology Co., Ltd. Using collocated blocks in sub-block temporal motion vector prediction mode
CN117880497A (zh) 2018-11-30 2024-04-12 腾讯美国有限责任公司 用于视频编解码的方法和装置
CN118433390A (zh) * 2018-12-21 2024-08-02 Vid拓展公司 对称运动矢量差译码
WO2020125804A1 (en) * 2018-12-21 2020-06-25 Beijing Bytedance Network Technology Co., Ltd. Inter prediction using polynomial model
CN113545065B (zh) 2019-03-06 2023-12-12 北京字节跳动网络技术有限公司 转换后的单向预测候选的使用
JP6867611B2 (ja) 2019-03-11 2021-04-28 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
RS66495B1 (sr) * 2019-03-12 2025-03-31 Lg Electronics Inc Inter predikcioni postupak i uređaj zasnovan na dmvr i bdof
WO2020182213A1 (en) 2019-03-13 2020-09-17 Beijing Bytedance Network Technology Co., Ltd. Sub-block transform in transform skip mode
US11985324B2 (en) 2019-03-14 2024-05-14 Hfi Innovation Inc. Methods and apparatuses of video processing with motion refinement and sub-partition base padding
KR102850505B1 (ko) 2019-03-15 2025-08-25 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 양방향 광 흐름을 위한 비트-폭 제어를 위한 방법 및 디바이스
WO2020187198A1 (en) 2019-03-17 2020-09-24 Beijing Bytedance Network Technology Co., Ltd. Prediction refinement based on optical flow
KR102610709B1 (ko) 2019-04-02 2023-12-05 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 디코더 측 움직임 벡터 유도
CN115996290B (zh) 2019-04-25 2024-01-12 北京达佳互联信息技术有限公司 对视频信号解码的双向光流方法、计算设备和存储介质
EP3949403A4 (en) * 2019-05-11 2022-06-22 Beijing Bytedance Network Technology Co., Ltd. INTERACTIONS BETWEEN SEVERAL INTRACODING PROCEDURES
CN113906738B (zh) 2019-05-21 2024-01-12 北京字节跳动网络技术有限公司 仿射模式的自适应运动矢量差分辨率
CN113411605B (zh) * 2019-06-21 2022-05-31 杭州海康威视数字技术股份有限公司 一种编解码方法、装置及其设备
CN120343266A (zh) * 2019-06-21 2025-07-18 松下电器(美国)知识产权公司 编码装置、解码装置和非暂时性计算机可读介质
US11272203B2 (en) * 2019-07-23 2022-03-08 Tencent America LLC Method and apparatus for video coding
CN114270831B (zh) 2019-08-10 2024-07-30 北京字节跳动网络技术有限公司 视频处理中的子图片尺寸定义
KR102808776B1 (ko) 2019-08-13 2025-05-15 두인 비전 컴퍼니 리미티드 서브 블록 기반 인터 예측의 모션 정밀도
EP4032300A4 (en) 2019-09-20 2022-11-09 Telefonaktiebolaget Lm Ericsson (Publ) Methods of video encoding and/or decoding with bidirectional optical flow simplification on shift operations and related apparatus
WO2021052507A1 (en) 2019-09-22 2021-03-25 Beijing Bytedance Network Technology Co., Ltd. Sub-picture coding and decoding of video
WO2021056217A1 (zh) * 2019-09-24 2021-04-01 北京大学 视频处理方法和装置
WO2020256601A2 (en) * 2019-10-03 2020-12-24 Huawei Technologies Co., Ltd. Method and apparatus of picture-level signaling for bidirectional optical flow and decoder side motion vector refinement
CN114631317B (zh) 2019-10-18 2024-03-15 北京字节跳动网络技术有限公司 子图片的参数集信令中的语法约束
CN115280774B (zh) 2019-12-02 2025-08-19 抖音视界有限公司 视觉媒体处理的方法、装置及非暂时性计算机可读存储介质
WO2021134306A1 (zh) * 2019-12-30 2021-07-08 Oppo广东移动通信有限公司 帧间预测方法、编码器、解码器及存储介质
EP4107941A4 (en) 2020-03-23 2023-04-19 Beijing Bytedance Network Technology Co., Ltd. PREDICTION REFINEMENT FOR AFFINE MERGE AND AFFINER MOTION VECTOR PREDICTION MODE
US20210337192A1 (en) * 2020-04-24 2021-10-28 Realtek Semiconductor Corp. Image processing method and associated encoder
EP4315860A4 (en) * 2021-03-29 2025-02-19 Beijing Dajia Internet Information Technology Co., Ltd. Overlapped block motion compensation for inter prediction
EP4512074A1 (en) * 2022-04-19 2025-02-26 Beijing Dajia Internet Information Technology Co., Ltd. Methods and devices for enhanced local illumination compensation
WO2024206162A1 (en) * 2023-03-24 2024-10-03 Bytedance Inc. Method, apparatus, and medium for video processing

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE369701T1 (de) * 2002-01-17 2007-08-15 Koninkl Philips Electronics Nv Einheit und verfahren zur schätzung eines aktuellen bewegungsvektors
JP2007179354A (ja) * 2005-12-28 2007-07-12 Fujitsu Ltd オプティカルフロー算出装置、オプティカルフロー算出方法、オプティカルフロー算出プログラムおよび記録媒体
WO2011126309A2 (ko) * 2010-04-06 2011-10-13 삼성전자 주식회사 비디오 부호화 방법 및 장치, 비디오 복호화 방법 및 장치
CN103039075B (zh) * 2010-05-21 2015-11-25 Jvc建伍株式会社 图像编码装置、图像编码方法、以及图像解码装置、图像解码方法
JP5686019B2 (ja) * 2010-05-21 2015-03-18 株式会社Jvcケンウッド 画像復号装置、画像復号方法および画像復号プログラム
CN103327327B (zh) * 2013-06-03 2016-03-30 电子科技大学 用于高性能视频编码hevc的帧间预测编码单元选择方法
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques
CN105261038B (zh) * 2015-09-30 2018-02-27 华南理工大学 基于双向光流和感知哈希的指尖跟踪方法
CN115118971B (zh) * 2016-05-13 2025-06-17 交互数字Vc控股公司 用于视频编码的通用式多假设预测的系统及方法
CA3025340C (en) * 2016-05-25 2025-10-07 Arris Enterprises Llc GENERAL PROCESS FOR BLOCK PARTITIONING
KR102735582B1 (ko) * 2016-12-27 2024-11-29 파나소닉 인텔렉츄얼 프로퍼티 코포레이션 오브 아메리카 부호화 장치, 복호 장치, 부호화 방법 및 복호 방법

Also Published As

Publication number Publication date
JP7159166B2 (ja) 2022-10-24
KR20190103171A (ko) 2019-09-04
KR102579523B1 (ko) 2023-09-15
WO2018129172A1 (en) 2018-07-12
AU2018205783B2 (en) 2023-02-02
BR112019013684A2 (pt) 2020-01-28
CL2019001393A1 (es) 2019-09-27
JP2020503799A (ja) 2020-01-30
ZA201904373B (en) 2023-03-29
EP3566441B1 (en) 2024-07-31
US10931969B2 (en) 2021-02-23
TW201830966A (zh) 2018-08-16
EP3566441C0 (en) 2024-07-31
AU2018205783A1 (en) 2019-05-23
TWI761415B (zh) 2022-04-21
CO2019007120A2 (es) 2019-09-18
CN110036638B (zh) 2023-06-27
CN110036638A (zh) 2019-07-19
US20180192072A1 (en) 2018-07-05
EP3566441A1 (en) 2019-11-13

Similar Documents

Publication Publication Date Title
EP3566441B1 (en) Motion vector reconstructions for bi-directional optical flow (bio)
AU2018236214B2 (en) Inter prediction refinement based on bi-directional optical flow (BIO)
EP3643066B1 (en) A memory-bandwidth-efficient design for bi-directional optical flow (bio)
EP3782367B1 (en) Limitation of the mvp derivation based on decoder-side motion vector derivation
US10757442B2 (en) Partial reconstruction based template matching for motion vector derivation
EP3741119A1 (en) Improved decoder-side motion vector derivation
CA3053479A1 (en) Constraining motion vector information derived by decoder-side motion vector derivation
HK40005288B (en) Methods, apparatuses, devices and storage medium for decoding video data
HK40015019A (en) A memory-bandwidth-efficient design for bi-directional optical flow (bio)
HK40005288A (en) Methods, apparatuses, devices and storage medium for decoding video data
HK40018555A (en) Partial reconstruction based template matching for motion vector derivation
HK40009763B (zh) 对视频数据进行解码的方法、装置和设备,以及媒体

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20220824

EEER Examination request

Effective date: 20220824

EEER Examination request

Effective date: 20220824

EEER Examination request

Effective date: 20220824