KR102453806B1 - 광 흐름을 이용한 예측 개선 방법 및 장치 - Google Patents

광 흐름을 이용한 예측 개선 방법 및 장치 Download PDF

Info

Publication number
KR102453806B1
KR102453806B1 KR1020227004521A KR20227004521A KR102453806B1 KR 102453806 B1 KR102453806 B1 KR 102453806B1 KR 1020227004521 A KR1020227004521 A KR 1020227004521A KR 20227004521 A KR20227004521 A KR 20227004521A KR 102453806 B1 KR102453806 B1 KR 102453806B1
Authority
KR
South Korea
Prior art keywords
prof
video
prediction
sample
bdof
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227004521A
Other languages
English (en)
Korean (ko)
Other versions
KR20220025205A (ko
Inventor
샤오위 슈
이-원 천
샹린 왕
빙 위
Original Assignee
베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 filed Critical 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드
Priority to KR1020227034882A priority Critical patent/KR102942293B1/ko
Publication of KR20220025205A publication Critical patent/KR20220025205A/ko
Application granted granted Critical
Publication of KR102453806B1 publication Critical patent/KR102453806B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/577Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/109Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/573Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
KR1020227004521A 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치 Active KR102453806B1 (ko)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020227034882A KR102942293B1 (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962872700P 2019-07-10 2019-07-10
US62/872,700 2019-07-10
US201962873837P 2019-07-12 2019-07-12
US62/873,837 2019-07-12
PCT/US2020/041701 WO2021007557A1 (en) 2019-07-10 2020-07-10 Methods and apparatus on prediction refinement with optical flow

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020227034882A Division KR102942293B1 (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치

Publications (2)

Publication Number Publication Date
KR20220025205A KR20220025205A (ko) 2022-03-03
KR102453806B1 true KR102453806B1 (ko) 2022-10-11

Family

ID=74115339

Family Applications (3)

Application Number Title Priority Date Filing Date
KR1020227004521A Active KR102453806B1 (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치
KR1020227034882A Active KR102942293B1 (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치
KR1020267008275A Pending KR20260042316A (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치

Family Applications After (2)

Application Number Title Priority Date Filing Date
KR1020227034882A Active KR102942293B1 (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치
KR1020267008275A Pending KR20260042316A (ko) 2019-07-10 2020-07-10 광 흐름을 이용한 예측 개선 방법 및 장치

Country Status (7)

Country Link
US (2) US12132910B2 (enExample)
EP (2) EP4554217A3 (enExample)
JP (5) JP7313533B2 (enExample)
KR (3) KR102453806B1 (enExample)
CN (2) CN114342378A (enExample)
MX (4) MX2022000395A (enExample)
WO (1) WO2021007557A1 (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021052225A (ja) 2019-09-20 2021-04-01 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
CN119450036B (zh) * 2019-09-24 2025-10-14 Oppo广东移动通信有限公司 用于基于子画面的图像编码/解码的方法和装置及发送比特流的方法
JP2021052389A (ja) * 2020-08-21 2021-04-01 Kddi株式会社 画像復号装置、画像復号方法及びプログラム
US20220201313A1 (en) * 2020-12-22 2022-06-23 Qualcomm Incorporated Bi-directional optical flow in video coding
US11949863B2 (en) * 2021-08-02 2024-04-02 Tencent America LLC Geometric partition mode with intra block copy
US20250211783A1 (en) * 2022-03-21 2025-06-26 Wilus Institute Of Standards And Technology Inc. Video signal processing method based on template matching, and device therefor
WO2025002275A1 (en) * 2023-06-29 2025-01-02 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019117640A1 (ko) * 2017-12-14 2019-06-20 엘지전자 주식회사 영상 코딩 시스템에서 인터 예측에 따른 영상 디코딩 방법 및 장치

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170026334A (ko) * 2014-07-06 2017-03-08 엘지전자 주식회사 비디오 신호의 처리 방법 및 이를 위한 장치
WO2017036399A1 (en) * 2015-09-02 2017-03-09 Mediatek Inc. Method and apparatus of motion compensation for video coding based on bi prediction optical flow techniques
KR102638991B1 (ko) * 2016-03-24 2024-02-21 엘지전자 주식회사 비디오 코딩 시스템에서 인터 예측 방법 및 장치
KR102873107B1 (ko) * 2016-04-25 2025-10-17 엘지전자 주식회사 영상 코딩 시스템에서 인터 예측 방법 및 장치
WO2018048265A1 (ko) * 2016-09-11 2018-03-15 엘지전자 주식회사 향상된 옵티컬 플로우 움직임 백터를 이용하여 비디오 신호를 처리하는 방법 및 장치
US10523964B2 (en) 2017-03-13 2019-12-31 Qualcomm Incorporated Inter prediction refinement based on bi-directional optical flow (BIO)
US10701390B2 (en) * 2017-03-14 2020-06-30 Qualcomm Incorporated Affine motion information derivation
EP3649780B1 (en) * 2017-07-03 2025-06-25 InterDigital VC Holdings, Inc. Motion-compensation prediction based on bi-directional optical flow
US11303898B2 (en) * 2019-04-03 2022-04-12 Mediatek Inc. Coding transform coefficients with throughput constraints
US11985330B2 (en) * 2019-04-12 2024-05-14 Hfi Innovation Inc. Method and apparatus of simplified affine subblock process for video coding system
WO2021001220A1 (en) * 2019-07-01 2021-01-07 Interdigital Vc Holdings France, Sas Bi-directional optical flow refinement of affine motion compensation

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019117640A1 (ko) * 2017-12-14 2019-06-20 엘지전자 주식회사 영상 코딩 시스템에서 인터 예측에 따른 영상 디코딩 방법 및 장치

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Xiaoyu Xiu, et. al, "CE4-related: Prediction sample padding unification for BDOF and PROF", Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting, 2019.07.12,*

Also Published As

Publication number Publication date
CN114342378A (zh) 2022-04-12
JP7813753B2 (ja) 2026-02-13
KR102942293B1 (ko) 2026-03-19
CN115002454B (zh) 2024-11-15
CN115002454A (zh) 2022-09-02
MX2025007807A (es) 2025-08-01
US20240430438A1 (en) 2024-12-26
MX2022000395A (es) 2022-04-06
JP2022531629A (ja) 2022-07-07
EP3991431A1 (en) 2022-05-04
JP2023089253A (ja) 2023-06-27
JP2023159292A (ja) 2023-10-31
EP3991431A4 (en) 2022-09-28
US20220132138A1 (en) 2022-04-28
MX2025007806A (es) 2025-08-01
MX2025007805A (es) 2025-08-01
JP7813752B2 (ja) 2026-02-13
JP7763805B2 (ja) 2025-11-04
JP7313533B2 (ja) 2023-07-24
KR20220025205A (ko) 2022-03-03
JP2023164968A (ja) 2023-11-14
EP4554217A3 (en) 2025-06-25
WO2021007557A1 (en) 2021-01-14
US12132910B2 (en) 2024-10-29
JP2025172820A (ja) 2025-11-26
EP4554217A2 (en) 2025-05-14
KR20220140047A (ko) 2022-10-17
US12593048B2 (en) 2026-03-31
KR20260042316A (ko) 2026-03-30

Similar Documents

Publication Publication Date Title
KR102453806B1 (ko) 광 흐름을 이용한 예측 개선 방법 및 장치
KR102486982B1 (ko) 광학 흐름을 사용한 예측 미세조정을 위한 방법 및 장치
KR102533731B1 (ko) 광 흐름에 의한 예측 개선, 양방향 광 흐름 및 디코더 측 움직임 벡터 개선을 위한 방법들 및 장치들
KR102502614B1 (ko) 광학 흐름을 사용한 예측 미세조정을 위한 방법 및 장치
KR102399229B1 (ko) 광학 흐름에 의한 예측 미세화 방법 및 장치
EP3970374A1 (en) Methods and apparatus for prediction refinement with optical flow
WO2020223552A1 (en) Methods and apparatus of prediction refinement with optical flow
KR102959697B1 (ko) 광학 흐름을 사용한 예측 미세조정을 위한 방법 및 장치
KR20260061486A (ko) 광학 흐름을 사용한 예측 미세조정을 위한 방법 및 장치

Legal Events

Date Code Title Description
A201 Request for examination
A302 Request for accelerated examination
PA0105 International application

Patent event date: 20220210

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20220210

Comment text: Request for Examination of Application

PA0302 Request for accelerated examination

Patent event date: 20220210

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20220315

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20220706

A107 Divisional application of patent
GRNT Written decision to grant
PA0104 Divisional application for international application

Comment text: Divisional Application for International Patent

Patent event code: PA01041R01D

Patent event date: 20221006

PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20221006

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20221006

End annual number: 3

Start annual number: 1

PG1601 Publication of registration