IL281581B2 - Complexity reduction and bit width control for bidirectional optical streaming - Google Patents

Complexity reduction and bit width control for bidirectional optical streaming

Info

Publication number
IL281581B2
IL281581B2 IL281581A IL28158121A IL281581B2 IL 281581 B2 IL281581 B2 IL 281581B2 IL 281581 A IL281581 A IL 281581A IL 28158121 A IL28158121 A IL 28158121A IL 281581 B2 IL281581 B2 IL 281581B2
Authority
IL
Israel
Prior art keywords
array
calculating
gradient
component
bit
Prior art date
Application number
IL281581A
Other languages
English (en)
Hebrew (he)
Other versions
IL281581B1 (en
IL281581A (en
Inventor
Xiaoyu Xiu
Yuwen He
Yan Ye
Jiancong Luo
Original Assignee
Vid Scale Inc
Interdigital Vc Holdings Inc
Xiaoyu Xiu
Yuwen He
Yan Ye
Jiancong Luo
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vid Scale Inc, Interdigital Vc Holdings Inc, Xiaoyu Xiu, Yuwen He, Yan Ye, Jiancong Luo filed Critical Vid Scale Inc
Publication of IL281581A publication Critical patent/IL281581A/en
Publication of IL281581B1 publication Critical patent/IL281581B1/en
Publication of IL281581B2 publication Critical patent/IL281581B2/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/563Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/577Motion compensation with bidirectional frame interpolation, i.e. using B-pictures

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
IL281581A 2018-09-21 2019-09-17 Complexity reduction and bit width control for bidirectional optical streaming IL281581B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862734763P 2018-09-21 2018-09-21
US201862738655P 2018-09-28 2018-09-28
US201962789331P 2019-01-07 2019-01-07
PCT/US2019/051560 WO2020061082A1 (en) 2018-09-21 2019-09-17 Complexity reduction and bit-width control for bi-directional optical flow

Publications (3)

Publication Number Publication Date
IL281581A IL281581A (en) 2021-05-31
IL281581B1 IL281581B1 (en) 2025-01-01
IL281581B2 true IL281581B2 (en) 2025-05-01

Family

ID=68104762

Family Applications (1)

Application Number Title Priority Date Filing Date
IL281581A IL281581B2 (en) 2018-09-21 2019-09-17 Complexity reduction and bit width control for bidirectional optical streaming

Country Status (8)

Country Link
US (5) US11470308B2 (https=)
EP (1) EP3854089A1 (https=)
JP (3) JP7311589B2 (https=)
KR (2) KR102708989B1 (https=)
CN (2) CN112715030B (https=)
IL (1) IL281581B2 (https=)
TW (3) TWI866421B (https=)
WO (1) WO2020061082A1 (https=)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020061082A1 (en) 2018-09-21 2020-03-26 Vid Scale, Inc. Complexity reduction and bit-width control for bi-directional optical flow
CN112913241B (zh) 2018-10-22 2024-03-26 北京字节跳动网络技术有限公司 解码器侧运动矢量推导的限制
WO2020084461A1 (en) 2018-10-22 2020-04-30 Beijing Bytedance Network Technology Co., Ltd. Restrictions on decoder side motion vector derivation based on coding information
EP4300965A3 (en) * 2018-11-05 2024-01-17 Beijing Bytedance Network Technology Co., Ltd. Interpolation for inter prediction with refinement
CN119967170A (zh) * 2018-12-21 2025-05-09 韩国电子通信研究院 图像编码/解码方法和装置以及存储比特流的记录介质
JP7303255B2 (ja) * 2019-01-09 2023-07-04 ベイジン ダジア インターネット インフォメーション テクノロジー カンパニー リミテッド ビデオコーディングの方法、ビデオコーディングデバイス、コンピュータ可読記憶媒体およびコンピュータプログラム
KR102489605B1 (ko) 2019-01-09 2023-01-17 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 조합된 인터 및 인트라 예측을 위한 시스템 및 방법
CN116886925B (zh) * 2019-02-08 2024-11-08 北京达佳互联信息技术有限公司 一种用于视频编码的方法、计算设备和介质
CN118450122A (zh) * 2019-03-11 2024-08-06 松下电器(美国)知识产权公司 比特流的发送装置、比特流的发送方法和非暂时性存储介质
KR102850505B1 (ko) * 2019-03-15 2025-08-25 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 양방향 광 흐름을 위한 비트-폭 제어를 위한 방법 및 디바이스
GB2585039A (en) * 2019-06-25 2020-12-30 Sony Corp Image data encoding and decoding
US11736720B2 (en) * 2019-09-03 2023-08-22 Tencent America LLC Motion vector refinement methods for video encoding
EP4032300A4 (en) 2019-09-20 2022-11-09 Telefonaktiebolaget Lm Ericsson (Publ) Methods of video encoding and/or decoding with bidirectional optical flow simplification on shift operations and related apparatus
EP4231642A1 (en) * 2019-12-30 2023-08-23 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Inter-frame prediction method, encoder, decoder and storage medium
CN114079784A (zh) * 2020-08-20 2022-02-22 Oppo广东移动通信有限公司 帧间预测方法、编码器、解码器以及计算机存储介质
EP4723623A1 (en) * 2024-10-03 2026-04-08 InterDigital CE Patent Holdings, SAS Rate-distortion optimization with motion information

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06168239A (ja) 1992-11-27 1994-06-14 Toshiba Corp 文書作成装置
JP2991878B2 (ja) * 1992-11-27 1999-12-20 三菱電機株式会社 オプティカルフロー演算回路
EP2375751A1 (en) * 2010-04-12 2011-10-12 Panasonic Corporation Complexity reduction of edge-detection based spatial interpolation
US9172972B2 (en) 2011-01-05 2015-10-27 Qualcomm Incorporated Low complexity interpolation filtering with adaptive tap size
EP4040791A1 (en) 2015-06-08 2022-08-10 Vid Scale, Inc. Intra block copy mode for screen content coding
EP3340620B1 (en) 2015-08-23 2024-10-02 LG Electronics Inc. Inter prediction mode-based image processing method and apparatus therefor
US10341659B2 (en) * 2016-10-05 2019-07-02 Qualcomm Incorporated Systems and methods of switching interpolation filters
WO2018084339A1 (ko) 2016-11-04 2018-05-11 엘지전자(주) 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
WO2018113658A1 (en) * 2016-12-22 2018-06-28 Mediatek Inc. Method and apparatus of motion refinement for video coding
US10931969B2 (en) * 2017-01-04 2021-02-23 Qualcomm Incorporated Motion vector reconstructions for bi-directional optical flow (BIO)
US10701366B2 (en) * 2017-02-21 2020-06-30 Qualcomm Incorporated Deriving motion vector information at a video decoder
WO2018166357A1 (en) * 2017-03-16 2018-09-20 Mediatek Inc. Method and apparatus of motion refinement based on bi-directional optical flow for video coding
CN116847086A (zh) * 2017-05-17 2023-10-03 株式会社Kt 对图像解码的方法以及存储压缩视频数据的装置
WO2018226015A1 (ko) * 2017-06-09 2018-12-13 한국전자통신연구원 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
US10904565B2 (en) * 2017-06-23 2021-01-26 Qualcomm Incorporated Memory-bandwidth-efficient design for bi-directional optical flow (BIO)
EP3649780B1 (en) * 2017-07-03 2025-06-25 InterDigital VC Holdings, Inc. Motion-compensation prediction based on bi-directional optical flow
WO2019061475A1 (en) * 2017-09-30 2019-04-04 SZ DJI Technology Co., Ltd. IMAGE PROCESSING
US10776688B2 (en) * 2017-11-06 2020-09-15 Nvidia Corporation Multi-frame video interpolation using optical flow
US11109053B2 (en) * 2018-03-05 2021-08-31 Panasonic Intellectual Property Corporation Of America Encoding method, decoding method, encoder, and decoder
JP2021520710A (ja) 2018-04-06 2021-08-19 ヴィド スケール インコーポレイテッド 簡易化された勾配導出による双方向オプティカルフロー方法
KR102596104B1 (ko) * 2018-06-11 2023-10-30 에이치에프아이 이노베이션 인크. 비디오 코딩을 위한 양방향 광학 흐름의 방법 및 장치
EP3834416A4 (en) 2018-08-17 2022-08-17 HFI Innovation Inc. Methods and apparatuses of video processing with bi-direction predicition in video coding systems
WO2020061082A1 (en) 2018-09-21 2020-03-26 Vid Scale, Inc. Complexity reduction and bit-width control for bi-directional optical flow

Also Published As

Publication number Publication date
TW202402055A (zh) 2024-01-01
US20230053233A1 (en) 2023-02-16
US20260039801A1 (en) 2026-02-05
KR20240142584A (ko) 2024-09-30
IL281581B1 (en) 2025-01-01
US12003703B2 (en) 2024-06-04
TWI834722B (zh) 2024-03-11
KR102937491B1 (ko) 2026-03-10
US20240205389A1 (en) 2024-06-20
JP2022501906A (ja) 2022-01-06
CN112715030B (zh) 2024-04-23
TW202025751A (zh) 2020-07-01
US12464117B2 (en) 2025-11-04
IL281581A (en) 2021-05-31
TWI866421B (zh) 2024-12-11
US11968358B2 (en) 2024-04-23
US11470308B2 (en) 2022-10-11
JP7553659B2 (ja) 2024-09-18
JP7744485B2 (ja) 2025-09-25
US20230050213A1 (en) 2023-02-16
JP2024166257A (ja) 2024-11-28
KR102708989B1 (ko) 2024-09-23
KR20210071958A (ko) 2021-06-16
TW202516922A (zh) 2025-04-16
US20220038679A1 (en) 2022-02-03
CN112715030A (zh) 2021-04-27
WO2020061082A1 (en) 2020-03-26
CN118474345A (zh) 2024-08-09
JP2023118924A (ja) 2023-08-25
JP7311589B2 (ja) 2023-07-19
EP3854089A1 (en) 2021-07-28

Similar Documents

Publication Publication Date Title
US12003703B2 (en) Complexity reduction and bit-width control for bi-directional optical flow
US12395674B2 (en) Methods and apparatus for reducing the coding latency of decoder-side motion refinement
IL310462B2 (en) Symmetric motion vector difference coding
US12200222B2 (en) Affine motion model derivation method
WO2020257484A1 (en) Precision refinement for motion compensation with optical flow