JP7313533B2 - オプティカルフローによる予測洗練化における方法および装置 - Google Patents

オプティカルフローによる予測洗練化における方法および装置 Download PDF

Info

Publication number
JP7313533B2
JP7313533B2 JP2022501055A JP2022501055A JP7313533B2 JP 7313533 B2 JP7313533 B2 JP 7313533B2 JP 2022501055 A JP2022501055 A JP 2022501055A JP 2022501055 A JP2022501055 A JP 2022501055A JP 7313533 B2 JP7313533 B2 JP 7313533B2
Authority
JP
Japan
Prior art keywords
block
prof
prediction
samples
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022501055A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022531629A (ja
Inventor
シウ、シャオユー
チェン、イ-ウェン
ワン、シャンリン
ユー、ビン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Publication of JP2022531629A publication Critical patent/JP2022531629A/ja
Priority to JP2023069637A priority Critical patent/JP7763805B2/ja
Application granted granted Critical
Publication of JP7313533B2 publication Critical patent/JP7313533B2/ja
Priority to JP2023134199A priority patent/JP7813752B2/ja
Priority to JP2023144689A priority patent/JP7813753B2/ja
Priority to JP2025139847A priority patent/JP2025172820A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
JP2022501055A 2019-07-10 2020-07-10 オプティカルフローによる予測洗練化における方法および装置 Active JP7313533B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2023069637A JP7763805B2 (ja) 2019-07-10 2023-04-20 オプティカルフローによる予測洗練化における方法および装置
JP2023134199A JP7813752B2 (ja) 2019-07-10 2023-08-21 オプティカルフローによる予測洗練化における方法および装置
JP2023144689A JP7813753B2 (ja) 2019-07-10 2023-09-06 オプティカルフローによる予測洗練化における方法および装置
JP2025139847A JP2025172820A (ja) 2019-07-10 2025-08-25 オプティカルフローによる予測洗練化における方法および装置

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962872700P 2019-07-10 2019-07-10
US62/872,700 2019-07-10
US201962873837P 2019-07-12 2019-07-12
US62/873,837 2019-07-12
PCT/US2020/041701 WO2021007557A1 (en) 2019-07-10 2020-07-10 Methods and apparatus on prediction refinement with optical flow

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023069637A Division JP7763805B2 (ja) 2019-07-10 2023-04-20 オプティカルフローによる予測洗練化における方法および装置

Publications (2)

Publication Number Publication Date
JP2022531629A JP2022531629A (ja) 2022-07-07
JP7313533B2 true JP7313533B2 (ja) 2023-07-24

Family

ID=74115339

Family Applications (5)

Application Number Title Priority Date Filing Date
JP2022501055A Active JP7313533B2 (ja) 2019-07-10 2020-07-10 オプティカルフローによる予測洗練化における方法および装置
JP2023069637A Active JP7763805B2 (ja) 2019-07-10 2023-04-20 オプティカルフローによる予測洗練化における方法および装置
JP2023134199A Active JP7813752B2 (ja) 2019-07-10 2023-08-21 オプティカルフローによる予測洗練化における方法および装置
JP2023144689A Active JP7813753B2 (ja) 2019-07-10 2023-09-06 オプティカルフローによる予測洗練化における方法および装置
JP2025139847A Pending JP2025172820A (ja) 2019-07-10 2025-08-25 オプティカルフローによる予測洗練化における方法および装置

Family Applications After (4)

Application Number Title Priority Date Filing Date
JP2023069637A Active JP7763805B2 (ja) 2019-07-10 2023-04-20 オプティカルフローによる予測洗練化における方法および装置
JP2023134199A Active JP7813752B2 (ja) 2019-07-10 2023-08-21 オプティカルフローによる予測洗練化における方法および装置
JP2023144689A Active JP7813753B2 (ja) 2019-07-10 2023-09-06 オプティカルフローによる予測洗練化における方法および装置
JP2025139847A Pending JP2025172820A (ja) 2019-07-10 2025-08-25 オプティカルフローによる予測洗練化における方法および装置

Country Status (7)

Country Link
US (3) US12132910B2 (cg-RX-API-DMAC7.html)
EP (2) EP3991431A4 (cg-RX-API-DMAC7.html)
JP (5) JP7313533B2 (cg-RX-API-DMAC7.html)
KR (3) KR20260042316A (cg-RX-API-DMAC7.html)
CN (2) CN114342378A (cg-RX-API-DMAC7.html)
MX (4) MX2022000395A (cg-RX-API-DMAC7.html)
WO (1) WO2021007557A1 (cg-RX-API-DMAC7.html)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021052225A (ja) 2019-09-20 2021-04-01 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
CN119324985B (zh) * 2019-09-24 2025-10-14 Oppo广东移动通信有限公司 用于基于子画面的图像编码/解码的方法和装置及发送比特流的方法
JP2021052389A (ja) * 2020-08-21 2021-04-01 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
US20220201313A1 (en) * 2020-12-22 2022-06-23 Qualcomm Incorporated Bi-directional optical flow in video coding
US11949863B2 (en) * 2021-08-02 2024-04-02 Tencent America LLC Geometric partition mode with intra block copy
WO2023182781A1 (ko) * 2022-03-21 2023-09-28 주식회사 윌러스표준기술연구소 템플릿 매칭에 기초한 비디오 신호 처리 방법 및 이를 위한 장치
EP4736452A1 (en) * 2023-06-29 2026-05-06 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106664416B (zh) * 2014-07-06 2019-11-05 Lg电子株式会社 处理视频信号的方法及其装置
US10158836B2 (en) * 2015-01-30 2018-12-18 Qualcomm Incorporated Clipping for cross-component prediction and adaptive color transform for video coding
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques
WO2017164441A1 (ko) * 2016-03-24 2017-09-28 엘지전자 주식회사 비디오 코딩 시스템에서 인터 예측 방법 및 장치
US10798385B2 (en) * 2016-04-25 2020-10-06 Lg Electronics Inc. Inter-prediction method and apparatus in image coding system
US10728572B2 (en) * 2016-09-11 2020-07-28 Lg Electronics Inc. Method and apparatus for processing video signal by using improved optical flow motion vector
US10523964B2 (en) 2017-03-13 2019-12-31 Qualcomm Incorporated Inter prediction refinement based on bi-directional optical flow (BIO)
US10701390B2 (en) * 2017-03-14 2020-06-30 Qualcomm Incorporated Affine motion information derivation
BR112020000032A2 (pt) * 2017-07-03 2020-07-14 Vid Scale, Inc. dispositivo e método de codificação de dados de vídeo.
CN118264800A (zh) 2017-12-14 2024-06-28 Lg电子株式会社 解码和编码设备及发送用于图像的数据的设备
US11303898B2 (en) * 2019-04-03 2022-04-12 Mediatek Inc. Coding transform coefficients with throughput constraints
WO2020207475A1 (en) * 2019-04-12 2020-10-15 Mediatek Inc. Method and apparatus of simplified affine subblock process for video coding system
EP3942824B1 (en) * 2019-04-25 2026-03-18 Beijing Dajia Internet Information Technology Co., Ltd. Methods and apparatuses for prediction refinement with optical flow
WO2020223552A1 (en) * 2019-04-30 2020-11-05 Beijing Dajia Internet Information Technology Co., Ltd. Methods and apparatus of prediction refinement with optical flow
CN113994692A (zh) * 2019-06-19 2022-01-28 北京达佳互联信息技术有限公司 用于利用光流的预测细化的方法和装置
CN114073090B (zh) * 2019-07-01 2026-03-27 交互数字Ce专利控股公司 仿射运动补偿的双向光流细化

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
BROSS, Benjamin et al.,Versatile Video Coding (Draft 5),Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, 19-27 Mar. 2019, [JVET-N1001-v10],JVET-N1001 (version 10),ITU-T,2019年07月02日,<URL:http://phenix.it-sudparis.eu/jvet/doc_end_user/documents/14_Geneva/wg11/JVET-N1001-v10.zip>: JVET-N1001-v10.docx: pp.219-233
XIU, Xiaoyu et al.,CE4/9-related: Combined Test of JVET-O0593/JVET-O0252/JVET-O0281/JVET-O0615 on harmonization on BDOF and PROF,Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, 3-12 July 2019, [JVET-O01142-v2],JVET-O1142 (version 2),ITU-T,2019年07月09日,<URL:https://jvet-experts.org/doc_end_user/documents/15_Gothenburg/wg11/JVET-O1142-v2.zip>: JVET-O1142-v2.docx; pp.1-5, JVET-O1142-spec-change-WD-r2.docx; pp.1-21
XIU, Xiaoyu et al.,CE4-related: Prediction sample padding unification for BDOF and PROF,Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, 3-12 July 2019, [JVET-O0594],JVET-O0594 (version 1),ITU-T,2019年06月26日,<URL:https://jvet-experts.org/doc_end_user/documents/15_Gothenburg/wg11/JVET-O0594-v1.zip>: JVET-O0594.docx; pp.1-4

Also Published As

Publication number Publication date
US20260197460A1 (en) 2026-07-09
KR20260042316A (ko) 2026-03-30
MX2022000395A (es) 2022-04-06
CN115002454A (zh) 2022-09-02
US20240430438A1 (en) 2024-12-26
EP3991431A1 (en) 2022-05-04
US12593048B2 (en) 2026-03-31
JP2023164968A (ja) 2023-11-14
EP4554217A2 (en) 2025-05-14
KR20220025205A (ko) 2022-03-03
JP2023159292A (ja) 2023-10-31
US12132910B2 (en) 2024-10-29
JP7763805B2 (ja) 2025-11-04
KR20220140047A (ko) 2022-10-17
EP4554217A3 (en) 2025-06-25
KR102453806B1 (ko) 2022-10-11
US20220132138A1 (en) 2022-04-28
EP3991431A4 (en) 2022-09-28
MX2025007806A (es) 2025-08-01
JP2022531629A (ja) 2022-07-07
CN114342378A (zh) 2022-04-12
MX2025007807A (es) 2025-08-01
WO2021007557A1 (en) 2021-01-14
JP7813753B2 (ja) 2026-02-13
CN115002454B (zh) 2024-11-15
KR102942293B1 (ko) 2026-03-19
JP2023089253A (ja) 2023-06-27
MX2025007805A (es) 2025-08-01
JP2025172820A (ja) 2025-11-26
JP7813752B2 (ja) 2026-02-13

Similar Documents

Publication Publication Date Title
JP7372433B2 (ja) オプティカルフローを用いた予測リファインメントに関する方法および装置
JP7281602B2 (ja) オプティカルフローによる予測洗練化、双方向オプティカルフローおよびデコーダ側の動きベクトル洗練化のための方法および装置
JP7813753B2 (ja) オプティカルフローによる予測洗練化における方法および装置
US12506874B2 (en) Methods and apparatus for prediction refinement with optical flow
WO2020220048A1 (en) Methods and apparatuses for prediction refinement with optical flow
WO2020223552A1 (en) Methods and apparatus of prediction refinement with optical flow

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220210

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220210

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20220330

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220628

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220927

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20221223

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230420

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20230420

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20230427

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20230428

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230613

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230711

R150 Certificate of patent or registration of utility model

Ref document number: 7313533

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250