CN113767627B - 基于二次变换的视频处理中的裁剪操作 - Google Patents

基于二次变换的视频处理中的裁剪操作 Download PDF

Info

Publication number
CN113767627B
CN113767627B CN202080031268.5A CN202080031268A CN113767627B CN 113767627 B CN113767627 B CN 113767627B CN 202080031268 A CN202080031268 A CN 202080031268A CN 113767627 B CN113767627 B CN 113767627B
Authority
CN
China
Prior art keywords
transform
block
video
current block
inverse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080031268.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN113767627A (zh
Inventor
张凯
张莉
刘鸿彬
许继征
王悦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
ByteDance Inc
Original Assignee
Beijing ByteDance Network Technology Co Ltd
ByteDance Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd, ByteDance Inc filed Critical Beijing ByteDance Network Technology Co Ltd
Publication of CN113767627A publication Critical patent/CN113767627A/zh
Application granted granted Critical
Publication of CN113767627B publication Critical patent/CN113767627B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN202080031268.5A 2019-04-23 2020-04-23 基于二次变换的视频处理中的裁剪操作 Active CN113767627B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2019083853 2019-04-23
CNPCT/CN2019/083853 2019-04-23
PCT/CN2020/086421 WO2020216296A1 (en) 2019-04-23 2020-04-23 Clipping operation in secondary transform based video processing

Publications (2)

Publication Number Publication Date
CN113767627A CN113767627A (zh) 2021-12-07
CN113767627B true CN113767627B (zh) 2022-11-25

Family

ID=72940845

Family Applications (4)

Application Number Title Priority Date Filing Date
CN202080031268.5A Active CN113767627B (zh) 2019-04-23 2020-04-23 基于二次变换的视频处理中的裁剪操作
CN202080031192.6A Active CN113785576B (zh) 2019-04-23 2020-04-23 编解码视频中的二次变换的使用
CN202080031341.9A Active CN113728636B (zh) 2019-04-23 2020-04-23 编解码视频中二次变换的选择性使用
CN202310488397.2A Pending CN116743994A (zh) 2019-04-23 2020-04-23 用于处理视频数据的方法和装置

Family Applications After (3)

Application Number Title Priority Date Filing Date
CN202080031192.6A Active CN113785576B (zh) 2019-04-23 2020-04-23 编解码视频中的二次变换的使用
CN202080031341.9A Active CN113728636B (zh) 2019-04-23 2020-04-23 编解码视频中二次变换的选择性使用
CN202310488397.2A Pending CN116743994A (zh) 2019-04-23 2020-04-23 用于处理视频数据的方法和装置

Country Status (6)

Country Link
US (3) US11647229B2 (enExample)
EP (1) EP3932061A4 (enExample)
JP (2) JP7256293B2 (enExample)
KR (1) KR102727219B1 (enExample)
CN (4) CN113767627B (enExample)
WO (3) WO2020216299A1 (enExample)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2580326A (en) 2018-12-28 2020-07-22 British Broadcasting Corp Video encoding and video decoding
CN113767627B (zh) * 2019-04-23 2022-11-25 北京字节跳动网络技术有限公司 基于二次变换的视频处理中的裁剪操作
CN119277088A (zh) * 2019-06-10 2025-01-07 株式会社 Xris 用于对图像信号进行编码/解码方法及其装置
EP3962082A4 (en) 2019-06-12 2022-10-05 Sony Group Corporation IMAGE PROCESSING DEVICE AND METHOD
GB2585030A (en) * 2019-06-25 2020-12-30 British Broadcasting Corp Method of signalling in a video codec
CN112135148B (zh) * 2019-06-25 2022-05-10 华为技术有限公司 非可分离变换方法以及设备
EP3991416A4 (en) * 2019-08-30 2022-09-07 Alibaba Group Holding Limited MATRIX WEIGHTED INTRA PREDICTION OF VIDEO SIGNALS
EP4032306A1 (en) * 2019-09-20 2022-07-27 Nokia Technologies Oy An apparatus, a method and a computer program for video coding and decoding
GB2591806B (en) 2020-02-07 2023-07-19 British Broadcasting Corp Chroma intra prediction in video coding and decoding
JP7536484B2 (ja) * 2020-03-18 2024-08-20 キヤノン株式会社 画像符号化装置、画像符号化方法及びプログラム、画像復号装置、画像復号方法及びプログラム
CN115606182B (zh) 2020-03-25 2026-02-06 抖音视界有限公司 使用增强二次变换的编解码视频处理
KR20230133891A (ko) * 2021-02-04 2023-09-19 베이징 다지아 인터넷 인포메이션 테크놀로지 컴퍼니 리미티드 비디오 코딩을 위한 잔차 및 계수 코딩
US12114014B2 (en) * 2021-10-01 2024-10-08 Tencent America LLC Secondary transforms for compound inter-intra prediction modes
WO2024208638A1 (en) * 2023-04-06 2024-10-10 Interdigital Ce Patent Holdings, Sas Non-separable transforms for low delay applications

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108141594A (zh) * 2015-10-13 2018-06-08 三星电子株式会社 用于对图像进行编码或解码的方法和设备
CN108141596A (zh) * 2015-09-29 2018-06-08 高通股份有限公司 用于视频译码的非可分离二次变换
CN109076230A (zh) * 2016-05-03 2018-12-21 高通股份有限公司 二值化二次变换指数
CN109076242A (zh) * 2016-05-13 2018-12-21 索尼公司 图像处理设备和方法
CN109644269A (zh) * 2016-08-24 2019-04-16 索尼公司 图像处理设备、图像处理方法和程序

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2721787B1 (fr) * 1994-06-22 1996-07-26 Thomson Consumer Electronics Procédé de quantification des coefficients.
US6389072B1 (en) 1998-12-23 2002-05-14 U.S. Philips Corp. Motion analysis based buffer regulation scheme
JP2002094989A (ja) 2000-09-14 2002-03-29 Pioneer Electronic Corp ビデオ信号符号化装置及びビデオ信号符号化方法
US7280597B2 (en) 2003-06-24 2007-10-09 Mitsubishi Electric Research Laboratories, Inc. System and method for determining coding modes, DCT types and quantizers for video coding
US20130003856A1 (en) * 2011-07-01 2013-01-03 Samsung Electronics Co. Ltd. Mode-dependent transforms for residual coding with low latency
WO2013063784A1 (en) * 2011-11-03 2013-05-10 Thomson Licensing Video encoding and decoding based on image refinement
CN108632611A (zh) * 2012-06-29 2018-10-09 韩国电子通信研究院 视频解码方法、视频编码方法和计算机可读介质
AU2013202653A1 (en) 2013-04-05 2014-10-23 Canon Kabushiki Kaisha Method, apparatus and system for generating intra-predicted samples
CN105516730B (zh) * 2014-09-24 2018-04-24 晨星半导体股份有限公司 视讯编码装置及视讯解码装置以及其编码与解码方法
KR102600756B1 (ko) * 2015-03-06 2023-11-10 한국과학기술원 저 복잡도 변환에 기반한 영상 부호화 및 복호화 방법 및 이를 이용하는 장치
ITUB20155295A1 (it) * 2015-10-16 2017-04-16 Torino Politecnico Apparatuses and methods for encoding and decoding images
WO2017173593A1 (en) 2016-04-06 2017-10-12 Mediatek Singapore Pte. Ltd. Separate coding secondary transform syntax elements for different color components
EP3453181B1 (en) * 2016-05-04 2025-10-29 Sharp Kabushiki Kaisha Methods and apparatuses for coding transform data
WO2017195667A1 (ja) * 2016-05-13 2017-11-16 ソニー株式会社 画像処理装置および方法
EP4568242A1 (en) 2016-05-13 2025-06-11 Sony Group Corporation Image processing apparatus and method
US10887626B2 (en) * 2016-05-13 2021-01-05 Sharp Kabushiki Kaisha Image decoding device and image encoding device
JP6921870B2 (ja) 2016-05-24 2021-08-18 エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートＥｌｅｃｔｒｏｎｉｃｓ Ａｎｄ Ｔｅｌｅｃｏｍｍｕｎｉｃａｔｉｏｎｓ Ｒｅｓｅａｒｃｈ Ｉｎｓｔｉｔｕｔｅ 画像復号方法、画像符号化方法及び記録媒体
KR102321394B1 (ko) 2016-08-01 2021-11-03 한국전자통신연구원 영상 부호화/복호화 방법
US11095893B2 (en) * 2016-10-12 2021-08-17 Qualcomm Incorporated Primary transform and secondary transform in video coding
KR102416804B1 (ko) * 2016-10-14 2022-07-05 세종대학교산학협력단 영상 부호화 방법/장치, 영상 복호화 방법/장치 및 비트스트림을 저장한 기록 매체
JP6870096B2 (ja) * 2017-01-03 2021-05-12 エルジー エレクトロニクス インコーポレイティド 二次変換を用いたビデオ信号のエンコーディング／デコーディング方法及び装置
EP3349451A1 (en) 2017-01-11 2018-07-18 Thomson Licensing Method and apparatus for selecting a coding mode used for encoding/decoding a residual block
CN110419218B (zh) 2017-03-16 2021-02-26 联发科技股份有限公司 编码或解码视频数据的方法和装置
RU2722394C1 (ru) 2017-03-21 2020-05-29 ЭлДжи ЭЛЕКТРОНИКС ИНК. Способ преобразования в системе кодирования изображений и устройство для его осуществления
US10855997B2 (en) * 2017-04-14 2020-12-01 Mediatek Inc. Secondary transform kernel size selection
US10805641B2 (en) * 2017-06-15 2020-10-13 Qualcomm Incorporated Intra filtering applied together with transform processing in video coding
US11134272B2 (en) * 2017-06-29 2021-09-28 Qualcomm Incorporated Memory reduction for non-separable transforms
CN115174911B (zh) * 2017-07-24 2025-06-20 艾锐势有限责任公司 帧内模式jvet编译方法
EP4395317A3 (en) * 2017-07-28 2024-08-14 Panasonic Intellectual Property Corporation of America Encoding device and encoding method
CN115460403A (zh) 2017-07-31 2022-12-09 韩国电子通信研究院 对图像编码和解码的方法及存储比特流的计算机可读介质
CN108322745B (zh) * 2018-02-28 2019-12-03 中南大学 一种基于不可分二次变换模式的帧内快速选择方法
KR102555966B1 (ko) * 2018-07-12 2023-07-17 엘지전자 주식회사 비디오 신호를 처리하기 위한 방법 및 장치
KR102396112B1 (ko) 2018-09-02 2022-05-10 엘지전자 주식회사 비디오 신호의 부호화/복호화 방법 및 이를 위한 장치
CN112740684A (zh) 2018-09-19 2021-04-30 韩国电子通信研究院 用于对图像进行编码/解码的方法和装置以及用于存储比特流的记录介质
US11172211B2 (en) * 2019-04-04 2021-11-09 Tencent America LLC Method and apparatus for video coding
EP3949423A4 (en) 2019-04-16 2023-04-12 HFI Innovation Inc. METHODS AND APPARATUS FOR ENCODING VIDEO DATA USING SECONDARY TRANSFORMATION
US11943476B2 (en) 2019-04-16 2024-03-26 Hfi Innovation Inc. Methods and apparatuses for coding video data with adaptive secondary transform signaling
CN113767627B (zh) 2019-04-23 2022-11-25 北京字节跳动网络技术有限公司 基于二次变换的视频处理中的裁剪操作
US12316874B2 (en) 2019-08-06 2025-05-27 Interdigital Ce Patent Holdings, Sas Secondary transform for video encoding and decoding
CN110636313B (zh) 2019-09-18 2022-07-15 浙江大华技术股份有限公司 变换、二次变换矩阵训练方法、编码器及相关装置
WO2021194052A1 (ko) 2020-03-27 2021-09-30 주식회사 아틴스 영상의 복호화 방법 및 장치
KR102313731B1 (ko) 2020-03-27 2021-10-18 주식회사 아틴스 영상의 복호화 방법 및 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108141596A (zh) * 2015-09-29 2018-06-08 高通股份有限公司 用于视频译码的非可分离二次变换
CN108141594A (zh) * 2015-10-13 2018-06-08 三星电子株式会社 用于对图像进行编码或解码的方法和设备
CN109076230A (zh) * 2016-05-03 2018-12-21 高通股份有限公司 二值化二次变换指数
CN109076242A (zh) * 2016-05-13 2018-12-21 索尼公司 图像处理设备和方法
CN109644269A (zh) * 2016-08-24 2019-04-16 索尼公司 图像处理设备、图像处理方法和程序

Also Published As

Publication number Publication date
CN113767627A (zh) 2021-12-07
EP3932061A1 (en) 2022-01-05
JP7256293B2 (ja) 2023-04-11
JP2023089032A (ja) 2023-06-27
WO2020216299A1 (en) 2020-10-29
CN113728636B (zh) 2022-11-04
CN116743994A (zh) 2023-09-12
CN113785576A (zh) 2021-12-10
WO2020216303A1 (en) 2020-10-29
US20230262263A1 (en) 2023-08-17
CN113728636A (zh) 2021-11-30
US12389037B2 (en) 2025-08-12
US20220182675A1 (en) 2022-06-09
US11546636B2 (en) 2023-01-03
WO2020216296A1 (en) 2020-10-29
JP7509944B2 (ja) 2024-07-02
US11647229B2 (en) 2023-05-09
JP2022529055A (ja) 2022-06-16
CN113785576B (zh) 2023-05-16
US20220109876A1 (en) 2022-04-07
KR20210154151A (ko) 2021-12-20
KR102727219B1 (ko) 2024-11-08
EP3932061A4 (en) 2022-06-01

Similar Documents

Publication Publication Date Title
CN113767627B (zh) 基于二次变换的视频处理中的裁剪操作
WO2020244662A1 (en) Simplified transform coding tools
US12096013B2 (en) Signaling for transform skip mode
US12081758B2 (en) Block dimension settings of transform skip mode
US11991358B2 (en) Indication of multiple transform matrices in coded video
US11546595B2 (en) Sub-block based use of transform skip mode
WO2021180020A1 (en) Implicit multiple transform set signaling in video coding
CN115066899B (zh) 编解码视频的可分二次变换处理
WO2020228716A1 (en) Usage of transquant bypass mode for multiple color components
CN115606182A (zh) 使用增强二次变换的编解码视频处理
CN113994696B (zh) 编解码视频中的块尺寸相关的二次变换的使用
CN114026865B (zh) 用于色度分量的编解码工具
WO2021190594A1 (en) Implicit determination of transform skip mode

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant